May 21 17:30:07.558572 ip-10-0-140-106 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
May 21 17:30:07.558585 ip-10-0-140-106 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
May 21 17:30:07.558594 ip-10-0-140-106 systemd[1]: kubelet.service: Failed with result 'resources'.
May 21 17:30:07.558957 ip-10-0-140-106 systemd[1]: Failed to start Kubernetes Kubelet.
May 21 17:30:17.674985 ip-10-0-140-106 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
May 21 17:30:17.675005 ip-10-0-140-106 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 1b9d45e0136947a9962c97049d75d5cb --
May 21 17:32:49.100293 ip-10-0-140-106 systemd[1]: Starting Kubernetes Kubelet...
May 21 17:32:49.548984 ip-10-0-140-106 kubenswrapper[2563]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 21 17:32:49.548984 ip-10-0-140-106 kubenswrapper[2563]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
May 21 17:32:49.548984 ip-10-0-140-106 kubenswrapper[2563]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 21 17:32:49.548984 ip-10-0-140-106 kubenswrapper[2563]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
May 21 17:32:49.548984 ip-10-0-140-106 kubenswrapper[2563]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 21 17:32:49.551947 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.551864    2563 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
May 21 17:32:49.558063 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.558040    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 21 17:32:49.558063 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.558064    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 21 17:32:49.558126 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.558068    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 21 17:32:49.558126 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.558072    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 21 17:32:49.558126 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.558075    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 21 17:32:49.558126 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.558078    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 21 17:32:49.558126 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.558080    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 21 17:32:49.558126 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.558083    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 21 17:32:49.558126 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.558086    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 21 17:32:49.558126 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.558089    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 21 17:32:49.558126 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.558091    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 21 17:32:49.558126 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.558094    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 21 17:32:49.558126 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.558097    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 21 17:32:49.558126 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.558100    2563 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 21 17:32:49.558126 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.558102    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 21 17:32:49.558126 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.558105    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 21 17:32:49.558126 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.558107    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 21 17:32:49.558126 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.558110    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 21 17:32:49.558126 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.558113    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 21 17:32:49.558126 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.558116    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 21 17:32:49.558126 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.558122    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 21 17:32:49.558570 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.558125    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 21 17:32:49.558570 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.558128    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 21 17:32:49.558570 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.558131    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 21 17:32:49.558570 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.558134    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 21 17:32:49.558570 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.558137    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 21 17:32:49.558570 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.558140    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 21 17:32:49.558570 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.558142    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 21 17:32:49.558570 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.558145    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 21 17:32:49.558570 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.558147    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 21 17:32:49.558570 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.558151    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 21 17:32:49.558570 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.558155    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 21 17:32:49.558570 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.558159    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
May 21 17:32:49.558570 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.558161    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 21 17:32:49.558570 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.558164    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 21 17:32:49.558570 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.558167    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 21 17:32:49.558570 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.558170    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 21 17:32:49.558570 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.558173    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 21 17:32:49.558570 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.558175    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 21 17:32:49.558570 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.558178    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 21 17:32:49.559034 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.558181    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 21 17:32:49.559034 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.558185    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 21 17:32:49.559034 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.558189    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 21 17:32:49.559034 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.558192    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 21 17:32:49.559034 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.558194    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 21 17:32:49.559034 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.558197    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 21 17:32:49.559034 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.558199    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 21 17:32:49.559034 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.558202    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 21 17:32:49.559034 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.558204    2563 feature_gate.go:328] unrecognized feature gate: Example
May 21 17:32:49.559034 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.558207    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 21 17:32:49.559034 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.558210    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 21 17:32:49.559034 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.558213    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 21 17:32:49.559034 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.558215    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 21 17:32:49.559034 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.558218    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 21 17:32:49.559034 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.558221    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 21 17:32:49.559034 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.558223    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 21 17:32:49.559034 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.558226    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 21 17:32:49.559034 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.558228    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 21 17:32:49.559034 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.558231    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 21 17:32:49.559034 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.558234    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 21 17:32:49.559550 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.558236    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 21 17:32:49.559550 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.558239    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 21 17:32:49.559550 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.558241    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 21 17:32:49.559550 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.558244    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 21 17:32:49.559550 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.558247    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 21 17:32:49.559550 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.558250    2563 feature_gate.go:328] unrecognized feature gate: Example2
May 21 17:32:49.559550 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.558253    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 21 17:32:49.559550 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.558256    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 21 17:32:49.559550 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.558258    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 21 17:32:49.559550 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.558261    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 21 17:32:49.559550 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.558264    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 21 17:32:49.559550 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.558267    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 21 17:32:49.559550 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.558269    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 21 17:32:49.559550 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.558272    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 21 17:32:49.559550 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.558275    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 21 17:32:49.559550 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.558278    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 21 17:32:49.559550 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.558280    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 21 17:32:49.559550 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.558283    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 21 17:32:49.559550 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.558285    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 21 17:32:49.559550 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.558288    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 21 17:32:49.560032 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.558290    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 21 17:32:49.560032 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.558293    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 21 17:32:49.560032 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.558295    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 21 17:32:49.560032 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.558298    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 21 17:32:49.560032 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.558300    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
May 21 17:32:49.560032 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.558303    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 21 17:32:49.560032 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.558674    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 21 17:32:49.560032 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.558679    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 21 17:32:49.560032 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.558682    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 21 17:32:49.560032 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.558685    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 21 17:32:49.560032 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.558688    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 21 17:32:49.560032 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.558690    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 21 17:32:49.560032 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.558693    2563 feature_gate.go:328] unrecognized feature gate: Example
May 21 17:32:49.560032 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.558695    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 21 17:32:49.560032 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.558698    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 21 17:32:49.560032 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.558701    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 21 17:32:49.560032 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.558703    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 21 17:32:49.560032 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.558706    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 21 17:32:49.560032 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.558709    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 21 17:32:49.560032 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.558711    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 21 17:32:49.560519 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.558714    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 21 17:32:49.560519 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.558717    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 21 17:32:49.560519 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.558719    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
May 21 17:32:49.560519 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.558722    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 21 17:32:49.560519 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.558724    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 21 17:32:49.560519 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.558727    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 21 17:32:49.560519 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.558730    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 21 17:32:49.560519 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.558732    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 21 17:32:49.560519 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.558735    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 21 17:32:49.560519 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.558738    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 21 17:32:49.560519 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.558740    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 21 17:32:49.560519 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.558743    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 21 17:32:49.560519 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.558745    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 21 17:32:49.560519 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.558748    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 21 17:32:49.560519 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.558750    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 21 17:32:49.560519 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.558753    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 21 17:32:49.560519 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.558755    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 21 17:32:49.560519 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.558759    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 21 17:32:49.560519 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.558762    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 21 17:32:49.560519 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.558764    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 21 17:32:49.561042 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.558767    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 21 17:32:49.561042 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.558771    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 21 17:32:49.561042 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.558775    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 21 17:32:49.561042 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.558777    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 21 17:32:49.561042 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.558780    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 21 17:32:49.561042 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.558782    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 21 17:32:49.561042 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.558785    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 21 17:32:49.561042 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.558787    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 21 17:32:49.561042 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.558790    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 21 17:32:49.561042 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.558792    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 21 17:32:49.561042 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.558794    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 21 17:32:49.561042 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.558797    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 21 17:32:49.561042 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.558800    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 21 17:32:49.561042 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.558803    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 21 17:32:49.561042 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.558805    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 21 17:32:49.561042 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.558807    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 21 17:32:49.561042 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.558810    2563 feature_gate.go:328] unrecognized feature gate: Example2
May 21 17:32:49.561042 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.558813    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 21 17:32:49.561042 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.558815    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 21 17:32:49.561042 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.558818    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
May 21 17:32:49.561537 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.558820    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 21 17:32:49.561537 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.558823    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 21 17:32:49.561537 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.558825    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 21 17:32:49.561537 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.558829    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 21 17:32:49.561537 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.558833    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 21 17:32:49.561537 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.558836    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 21 17:32:49.561537 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.558839    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 21 17:32:49.561537 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.558842    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 21 17:32:49.561537 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.558845    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 21 17:32:49.561537 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.558848    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 21 17:32:49.561537 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.558851    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 21 17:32:49.561537 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.558854    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 21 17:32:49.561537 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.558857    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 21 17:32:49.561537 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.558859    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 21 17:32:49.561537 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.558862    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 21 17:32:49.561537 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.558864    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 21 17:32:49.561537 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.558867    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 21 17:32:49.561537 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.558870    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 21 17:32:49.561537 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.558872    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 21 17:32:49.561992 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.558875    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 21 17:32:49.561992 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.558877    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 21 17:32:49.561992 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.558880    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 21 17:32:49.561992 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.558882    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 21 17:32:49.561992 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.558885    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 21 17:32:49.561992 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.558888    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 21 17:32:49.561992 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.558891    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 21 17:32:49.561992 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.558893    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 21 17:32:49.561992 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.558896    2563 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 21 17:32:49.561992 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.558898    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 21 17:32:49.561992 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.558901    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 21 17:32:49.561992 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.558904    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 21 17:32:49.561992 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.558906    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 21 17:32:49.561992 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.558980    2563 flags.go:64] FLAG: --address="0.0.0.0"
May 21 17:32:49.561992 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.558987    2563 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
May 21 17:32:49.561992 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.558994    2563 flags.go:64] FLAG: --anonymous-auth="true"
May 21 17:32:49.561992 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.558999    2563 flags.go:64] FLAG: --application-metrics-count-limit="100"
May 21 17:32:49.561992 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.559003    2563 flags.go:64] FLAG: --authentication-token-webhook="false"
May 21 17:32:49.561992 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.559006    2563 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
May 21 17:32:49.561992 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.559010    2563 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
May 21 17:32:49.561992 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.559014    2563 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
May 21 17:32:49.562515 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.559018    2563 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
May 21 17:32:49.562515 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.559021    2563 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
May 21 17:32:49.562515 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.559025    2563 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
May 21 17:32:49.562515 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.559028    2563 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
May 21 17:32:49.562515 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.559031    2563 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
May 21 17:32:49.562515 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.559034    2563 flags.go:64] FLAG: --cgroup-root=""
May 21 17:32:49.562515 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.559038    2563 flags.go:64] FLAG: --cgroups-per-qos="true"
May 21 17:32:49.562515 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.559041    2563 flags.go:64] FLAG: --client-ca-file=""
May 21 17:32:49.562515 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.559044    2563 flags.go:64] FLAG: --cloud-config=""
May 21 17:32:49.562515 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.559047    2563 flags.go:64] FLAG: --cloud-provider="external"
May 21 17:32:49.562515 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.559050    2563 flags.go:64] FLAG: --cluster-dns="[]"
May 21 17:32:49.562515 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.559069    2563 flags.go:64] FLAG: --cluster-domain=""
May 21 17:32:49.562515 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.559072    2563 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
May 21 17:32:49.562515 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.559075    2563 flags.go:64] FLAG: --config-dir=""
May 21 17:32:49.562515 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.559078    2563 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
May 21 17:32:49.562515 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.559081    2563 flags.go:64] FLAG: --container-log-max-files="5"
May 21 17:32:49.562515 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.559085    2563 flags.go:64] FLAG: --container-log-max-size="10Mi"
May 21 17:32:49.562515 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.559090    2563 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
May 21 17:32:49.562515 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.559093    2563 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
May 21 17:32:49.562515 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.559096    2563 flags.go:64] FLAG: --containerd-namespace="k8s.io"
May 21 17:32:49.562515 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.559099    2563 flags.go:64] FLAG: --contention-profiling="false"
May 21 17:32:49.562515 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.559102    2563 flags.go:64] FLAG: --cpu-cfs-quota="true"
May 21 17:32:49.562515 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.559105    2563 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
May 21 17:32:49.562515 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.559108    2563 flags.go:64] FLAG: --cpu-manager-policy="none"
May 21 17:32:49.562515 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.559111    2563 flags.go:64] FLAG: --cpu-manager-policy-options=""
May 21 17:32:49.563126 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.559115    2563 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
May 21 17:32:49.563126 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.559119    2563 flags.go:64] FLAG: --enable-controller-attach-detach="true"
May 21 17:32:49.563126 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.559122    2563 flags.go:64] FLAG: --enable-debugging-handlers="true"
May 21 17:32:49.563126 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.559124    2563 flags.go:64] FLAG: --enable-load-reader="false"
May 21 17:32:49.563126 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.559127    2563 flags.go:64] FLAG: --enable-server="true"
May 21 17:32:49.563126 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.559130    2563 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
May 21 17:32:49.563126 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.559135    2563 flags.go:64] FLAG: --event-burst="100"
May 21 17:32:49.563126 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.559138    2563 flags.go:64] FLAG: --event-qps="50"
May 21 17:32:49.563126 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.559141    2563 flags.go:64] FLAG: --event-storage-age-limit="default=0"
May 21 17:32:49.563126 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.559144    2563 flags.go:64] FLAG: --event-storage-event-limit="default=0"
May 21 17:32:49.563126 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.559147    2563 flags.go:64] FLAG: --eviction-hard=""
May 21 17:32:49.563126 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.559151    2563 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
May 21 17:32:49.563126 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.559153    2563 flags.go:64] FLAG: --eviction-minimum-reclaim=""
May 21 17:32:49.563126 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.559156    2563 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
May 21 17:32:49.563126 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.559159    2563 flags.go:64] FLAG: --eviction-soft=""
May 21 17:32:49.563126 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.559162    2563 flags.go:64] FLAG: --eviction-soft-grace-period=""
May 21 17:32:49.563126 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.559165    2563 flags.go:64] FLAG: --exit-on-lock-contention="false"
May 21 17:32:49.563126 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.559168    2563 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
May 21 17:32:49.563126 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.559171    2563 flags.go:64] FLAG: --experimental-mounter-path=""
May 21 17:32:49.563126 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.559174    2563 flags.go:64] FLAG: --fail-cgroupv1="false"
May 21 17:32:49.563126 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.559176    2563 flags.go:64] FLAG: --fail-swap-on="true"
May 21 17:32:49.563126 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.559179    2563 flags.go:64] FLAG: --feature-gates=""
May 21 17:32:49.563126 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.559183    2563 flags.go:64] FLAG: --file-check-frequency="20s"
May 21 17:32:49.563126 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.559186    2563 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
May 21 17:32:49.563126 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.559189    2563 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
May 21 17:32:49.563731 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.559199    2563 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
May 21 17:32:49.563731 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.559203    2563 flags.go:64] FLAG: --healthz-port="10248"
May 21 17:32:49.563731 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.559205    2563 flags.go:64] FLAG: --help="false"
May 21 17:32:49.563731 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.559208    2563 flags.go:64] FLAG: --hostname-override="ip-10-0-140-106.ec2.internal"
May 21 17:32:49.563731 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.559211    2563 flags.go:64] FLAG: --housekeeping-interval="10s"
May 21 17:32:49.563731 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.559214    2563 flags.go:64] FLAG: --http-check-frequency="20s"
May 21 17:32:49.563731 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.559217    2563 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
May 21 17:32:49.563731 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.559221    2563 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
May 21 17:32:49.563731 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.559224    2563 flags.go:64] FLAG: --image-gc-high-threshold="85"
May 21 17:32:49.563731 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.559227    2563 flags.go:64] FLAG: --image-gc-low-threshold="80"
May 21 17:32:49.563731 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.559230    2563 flags.go:64] FLAG: --image-service-endpoint=""
May 21 17:32:49.563731 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.559233    2563 flags.go:64] FLAG: --kernel-memcg-notification="false"
May 21 17:32:49.563731 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.559236    2563 flags.go:64] FLAG: --kube-api-burst="100"
May 21 17:32:49.563731 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.559239    2563 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
May 21 17:32:49.563731 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.559242    2563 flags.go:64] FLAG: --kube-api-qps="50"
May 21 17:32:49.563731 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.559245    2563 flags.go:64] FLAG: --kube-reserved=""
May 21 17:32:49.563731 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.559247    2563 flags.go:64] FLAG: --kube-reserved-cgroup=""
May 21 17:32:49.563731 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.559250    2563 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
May 21 17:32:49.563731 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.559260    2563 flags.go:64] FLAG: --kubelet-cgroups=""
May 21 17:32:49.563731 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.559264    2563 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
May 21 17:32:49.563731 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.559267    2563 flags.go:64] FLAG: --lock-file=""
May 21 17:32:49.563731 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.559270    2563 flags.go:64] FLAG: --log-cadvisor-usage="false"
May 21 17:32:49.563731 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.559273    2563 flags.go:64] FLAG: --log-flush-frequency="5s"
May 21 17:32:49.563731 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.559277    2563 flags.go:64] FLAG: --log-json-info-buffer-size="0"
May 21 17:32:49.564324 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.559286    2563 flags.go:64] FLAG: --log-json-split-stream="false"
May 21 17:32:49.564324 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.559289    2563 flags.go:64] FLAG: --log-text-info-buffer-size="0"
May 21 17:32:49.564324 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.559292    2563 flags.go:64] FLAG: --log-text-split-stream="false"
May 21 17:32:49.564324 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.559295    2563 flags.go:64] FLAG: --logging-format="text"
May 21 17:32:49.564324 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.559298    2563 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
May 21 17:32:49.564324 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.559301    2563 flags.go:64] FLAG: --make-iptables-util-chains="true"
May 21 17:32:49.564324 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.559304    2563 flags.go:64] FLAG: --manifest-url=""
May 21 17:32:49.564324 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.559307    2563 flags.go:64] FLAG: --manifest-url-header=""
May 21 17:32:49.564324 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.559312    2563 flags.go:64] FLAG: --max-housekeeping-interval="15s"
May 21 17:32:49.564324 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.559316    2563 flags.go:64] FLAG: --max-open-files="1000000"
May 21 17:32:49.564324 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.559320    2563 flags.go:64] FLAG: --max-pods="110"
May 21 17:32:49.564324 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.559323    2563 flags.go:64] FLAG: --maximum-dead-containers="-1"
May 21 17:32:49.564324 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.559326    2563 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
May 21 17:32:49.564324 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.559329    2563 flags.go:64] FLAG: --memory-manager-policy="None"
May 21 17:32:49.564324 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.559331    2563 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
May 21 17:32:49.564324 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.559334    2563 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
May 21 17:32:49.564324 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.559337    2563 flags.go:64] FLAG: --node-ip="0.0.0.0"
May 21 17:32:49.564324 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.559340    2563 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
May 21 17:32:49.564324 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.559347    2563 flags.go:64] FLAG: --node-status-max-images="50"
May 21 17:32:49.564324 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.559350    2563 flags.go:64] FLAG: --node-status-update-frequency="10s"
May 21 17:32:49.564324 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.559353    2563 flags.go:64] FLAG: --oom-score-adj="-999"
May 21 17:32:49.564324 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.559356    2563 flags.go:64] FLAG: --pod-cidr=""
May 21 17:32:49.564324 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.559359    2563 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc"
May 21 17:32:49.564871 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.559364    2563 flags.go:64] FLAG: --pod-manifest-path=""
May 21 17:32:49.564871 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.559367    2563 flags.go:64] FLAG: --pod-max-pids="-1"
May 21 17:32:49.564871 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.559370    2563 flags.go:64] FLAG: --pods-per-core="0"
May 21 17:32:49.564871 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.559373    2563 flags.go:64] FLAG: --port="10250"
May 21 17:32:49.564871 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.559376    2563 flags.go:64] FLAG: --protect-kernel-defaults="false"
May 21 17:32:49.564871 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.559379    2563 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0e1dfa3148292ee2a"
May 21 17:32:49.564871 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.559382    2563 flags.go:64] FLAG: --qos-reserved=""
May 21 17:32:49.564871 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.559385    2563 flags.go:64] FLAG: --read-only-port="10255"
May 21 17:32:49.564871 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.559388    2563 flags.go:64] FLAG: --register-node="true"
May 21 17:32:49.564871 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.559392    2563 flags.go:64] FLAG: --register-schedulable="true"
May 21 17:32:49.564871 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.559394    2563 flags.go:64] FLAG: --register-with-taints=""
May 21 17:32:49.564871 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.559398    2563 flags.go:64] FLAG: --registry-burst="10"
May 21 17:32:49.564871 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.559401    2563 flags.go:64] FLAG: --registry-qps="5"
May 21 17:32:49.564871 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.559407    2563 flags.go:64] FLAG: --reserved-cpus=""
May 21 17:32:49.564871 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.559410    2563 flags.go:64] FLAG: --reserved-memory=""
May 21 17:32:49.564871 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.559414    2563 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
May 21 17:32:49.564871 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.559416    2563 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
May 21 17:32:49.564871 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.559420    2563 flags.go:64] FLAG: --rotate-certificates="false"
May 21 17:32:49.564871 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.559422    2563 flags.go:64] FLAG: --rotate-server-certificates="false"
May 21 17:32:49.564871 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.559426    2563 flags.go:64] FLAG: --runonce="false"
May 21 17:32:49.564871 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.559429    2563 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
May 21 17:32:49.564871 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.559432    2563 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
May 21 17:32:49.564871 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.559435    2563 flags.go:64] FLAG: --seccomp-default="false"
May 21 17:32:49.564871 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.559438    2563 flags.go:64] FLAG: --serialize-image-pulls="true"
May 21 17:32:49.564871 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.559441    2563 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
May 21 17:32:49.564871 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.559444    2563 flags.go:64] FLAG: --storage-driver-db="cadvisor"
May 21 17:32:49.565556 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.559447    2563 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
May 21 17:32:49.565556 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.559450    2563 flags.go:64] FLAG: --storage-driver-password="root"
May 21 17:32:49.565556 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.559452    2563 flags.go:64] FLAG: --storage-driver-secure="false"
May 21 17:32:49.565556 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.559455    2563 flags.go:64] FLAG: --storage-driver-table="stats"
May 21 17:32:49.565556 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.559458    2563 flags.go:64] FLAG: --storage-driver-user="root"
May 21 17:32:49.565556 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.559461    2563 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
May 21 17:32:49.565556 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.559464    2563 flags.go:64] FLAG: --sync-frequency="1m0s"
May 21 17:32:49.565556 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.559467    2563 flags.go:64] FLAG: --system-cgroups=""
May 21 17:32:49.565556 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.559470    2563 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
May 21 17:32:49.565556 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.559475    2563 flags.go:64] FLAG: --system-reserved-cgroup=""
May 21 17:32:49.565556 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.559478    2563 flags.go:64] FLAG: --tls-cert-file=""
May 21 17:32:49.565556 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.559481    2563 flags.go:64] FLAG: --tls-cipher-suites="[]"
May 21 17:32:49.565556 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.559484    2563 flags.go:64] FLAG: --tls-min-version=""
May 21 17:32:49.565556 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.559487    2563 flags.go:64] FLAG: --tls-private-key-file=""
May 21 17:32:49.565556 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.559490    2563 flags.go:64] FLAG: --topology-manager-policy="none"
May 21 17:32:49.565556 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.559493    2563 flags.go:64] FLAG: --topology-manager-policy-options=""
May 21 17:32:49.565556 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.559496    2563 flags.go:64] FLAG: --topology-manager-scope="container"
May 21 17:32:49.565556 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.559499    2563 flags.go:64] FLAG: --v="2"
May 21 17:32:49.565556 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.559503    2563 flags.go:64] FLAG: --version="false"
May 21 17:32:49.565556 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.559508    2563 flags.go:64] FLAG: --vmodule=""
May 21 17:32:49.565556 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.559516    2563 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
May 21 17:32:49.565556 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.559519    2563 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
May 21 17:32:49.565556 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.559608    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 21 17:32:49.565556 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.559611    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 21 17:32:49.566188 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.559615    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 21 17:32:49.566188 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.559617    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 21 17:32:49.566188 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.559621    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 21 17:32:49.566188 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.559624    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 21 17:32:49.566188 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.559627    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 21 17:32:49.566188 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.559629    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 21 17:32:49.566188 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.559632    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 21 17:32:49.566188 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.559635    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 21 17:32:49.566188 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.559637    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 21 17:32:49.566188 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.559640    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 21 17:32:49.566188 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.559642    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 21 17:32:49.566188 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.559645    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 21 17:32:49.566188 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.559647    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 21 17:32:49.566188 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.559651    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 21 17:32:49.566188 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.559655    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 21 17:32:49.566188 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.559658    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 21 17:32:49.566188 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.559661    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 21 17:32:49.566188 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.559664    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 21 17:32:49.566188 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.559667    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 21 17:32:49.566660 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.559670    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 21 17:32:49.566660 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.559673    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 21 17:32:49.566660 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.559675    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 21 17:32:49.566660 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.559678    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 21 17:32:49.566660 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.559681    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 21 17:32:49.566660 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.559683    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 21 17:32:49.566660 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.559687    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 21 17:32:49.566660 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.559690    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 21 17:32:49.566660 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.559695    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 21 17:32:49.566660 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.559697    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 21 17:32:49.566660 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.559700    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 21 17:32:49.566660 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.559703    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
May 21 17:32:49.566660 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.559705    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 21 17:32:49.566660 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.559708    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 21 17:32:49.566660 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.559710    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 21 17:32:49.566660 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.559713    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 21 17:32:49.566660 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.559716    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 21 17:32:49.566660 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.559719    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 21 17:32:49.566660 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.559721    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 21 17:32:49.567138 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.559724    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 21 17:32:49.567138 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.559726    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 21 17:32:49.567138 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.559729    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 21 17:32:49.567138 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.559732    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 21 17:32:49.567138 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.559734    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 21 17:32:49.567138 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.559736    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 21 17:32:49.567138 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.559739    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 21 17:32:49.567138 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.559742    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 21 17:32:49.567138 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.559744    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 21 17:32:49.567138 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.559747    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 21 17:32:49.567138 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.559749    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 21 17:32:49.567138 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.559752    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 21 17:32:49.567138 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.559754    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
May 21 17:32:49.567138 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.559757    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 21 17:32:49.567138 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.559760    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 21 17:32:49.567138 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.559762    2563 feature_gate.go:328] unrecognized feature gate: Example2
May 21 17:32:49.567138 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.559765    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 21 17:32:49.567138 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.559767    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 21 17:32:49.567138 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.559770    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 21 17:32:49.567138 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.559772    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 21 17:32:49.567794 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.559775    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 21 17:32:49.567794 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.559778    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 21 17:32:49.567794 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.559781    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 21 17:32:49.567794 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.559784    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 21 17:32:49.567794 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.559786    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 21 17:32:49.567794 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.559789    2563 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 21 17:32:49.567794 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.559792    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 21 17:32:49.567794 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.559794    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 21 17:32:49.567794 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.559797    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 21 17:32:49.567794 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.559799    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 21 17:32:49.567794 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.559802    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 21 17:32:49.567794 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.559804    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 21 17:32:49.567794 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.559807    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 21 17:32:49.567794 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.559810    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 21 17:32:49.567794 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.559812    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 21 17:32:49.567794 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.559815    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 21 17:32:49.567794 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.559817    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 21 17:32:49.567794 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.559820    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 21 17:32:49.567794 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.559822    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 21 17:32:49.567794 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.559825    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 21 17:32:49.568532 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.559827    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 21 17:32:49.568532 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.559830    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 21 17:32:49.568532 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.559833    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 21 17:32:49.568532 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.559835    2563 feature_gate.go:328] unrecognized feature gate: Example
May 21 17:32:49.568532 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.559837    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 21 17:32:49.568532 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.559841    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 21 17:32:49.568532 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.560657    2563 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 21 17:32:49.568532 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.567475    2563 server.go:530] "Kubelet version" kubeletVersion="v1.33.11"
May 21 17:32:49.568532 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.567661    2563 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
May 21 17:32:49.568532 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.567860    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 21 17:32:49.568532 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.567870    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 21 17:32:49.568532 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.567875    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 21 17:32:49.568532 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.567880    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 21 17:32:49.568532 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.567886    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 21 17:32:49.568532 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.567890    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 21 17:32:49.568532 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.567901    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 21 17:32:49.568937 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.567905    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 21 17:32:49.568937 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.567910    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 21 17:32:49.568937 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.567914    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 21 17:32:49.568937 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.567919    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 21 17:32:49.568937 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.567936    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 21 17:32:49.568937 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.567940    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 21 17:32:49.568937 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.567945    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 21 17:32:49.568937 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.567949    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 21 17:32:49.568937 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.567953    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 21 17:32:49.568937 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.567957    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 21 17:32:49.568937 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.567962    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 21 17:32:49.568937 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.567966    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 21 17:32:49.568937 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.567976    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 21 17:32:49.568937 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.567980    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 21 17:32:49.568937 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.567984    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 21 17:32:49.568937 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.567988    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 21 17:32:49.568937 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.567993    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 21 17:32:49.568937 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.567997    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 21 17:32:49.568937 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.568011    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 21 17:32:49.568937 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.568016    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 21 17:32:49.569441 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.568020    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 21 17:32:49.569441 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.568024    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 21 17:32:49.569441 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.568028    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 21 17:32:49.569441 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.568032    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 21 17:32:49.569441 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.568042    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 21 17:32:49.569441 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.568047    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 21 17:32:49.569441 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.568051    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 21 17:32:49.569441 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.568074    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 21 17:32:49.569441 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.568079    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 21 17:32:49.569441 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.568085    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 21 17:32:49.569441 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.568090    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 21 17:32:49.569441 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.568095    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 21 17:32:49.569441 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.568100    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 21 17:32:49.569441 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.568104    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 21 17:32:49.569441 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.568108    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
May 21 17:32:49.569441 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.568112    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 21 17:32:49.569441 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.568117    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 21 17:32:49.569441 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.568126    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 21 17:32:49.569441 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.568131    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 21 17:32:49.569938 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.568135    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 21 17:32:49.569938 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.568152    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 21 17:32:49.569938 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.568156    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 21 17:32:49.569938 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.568160    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 21 17:32:49.569938 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.568165    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 21 17:32:49.569938 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.568171    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 21 17:32:49.569938 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.568178    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 21 17:32:49.569938 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.568183    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 21 17:32:49.569938 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.568188    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 21 17:32:49.569938 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.568192    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 21 17:32:49.569938 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.568202    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 21 17:32:49.569938 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.568206    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 21 17:32:49.569938 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.568211    2563 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 21 17:32:49.569938 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.568227    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 21 17:32:49.569938 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.568232    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 21 17:32:49.569938 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.568237    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 21 17:32:49.569938 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.568241    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 21 17:32:49.569938 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.568246    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 21 17:32:49.569938 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.568251    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 21 17:32:49.569938 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.568257    2563 feature_gate.go:328] unrecognized feature gate: Example
May 21 17:32:49.570456 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.568262    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 21 17:32:49.570456 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.568266    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 21 17:32:49.570456 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.568275    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 21 17:32:49.570456 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.568279    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 21 17:32:49.570456 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.568284    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 21 17:32:49.570456 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.568288    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 21 17:32:49.570456 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.568303    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 21 17:32:49.570456 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.568308    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 21 17:32:49.570456 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.568312    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 21 17:32:49.570456 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.568317    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 21 17:32:49.570456 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.568321    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 21 17:32:49.570456 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.568325    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 21 17:32:49.570456 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.568329    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 21 17:32:49.570456 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.568334    2563 feature_gate.go:328] unrecognized feature gate: Example2
May 21 17:32:49.570456 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.568338    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 21 17:32:49.570456 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.568347    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 21 17:32:49.570456 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.568352    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 21 17:32:49.570456 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.568355    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 21 17:32:49.570456 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.568360    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
May 21 17:32:49.570924 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.568364    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 21 17:32:49.570924 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.568386    2563 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 21 17:32:49.570924 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.568655    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 21 17:32:49.570924 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.568667    2563 feature_gate.go:328] unrecognized feature gate: Example2
May 21 17:32:49.570924 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.568670    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 21 17:32:49.570924 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.568677    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 21 17:32:49.570924 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.568684    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
May 21 17:32:49.570924 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.568689    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 21 17:32:49.570924 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.568692    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 21 17:32:49.570924 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.568695    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 21 17:32:49.570924 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.568698    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 21 17:32:49.570924 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.568701    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 21 17:32:49.570924 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.568706    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 21 17:32:49.570924 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.568710    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 21 17:32:49.570924 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.568712    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 21 17:32:49.570924 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.568717    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 21 17:32:49.571350 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.568719    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 21 17:32:49.571350 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.568724    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 21 17:32:49.571350 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.568728    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 21 17:32:49.571350 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.568731    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 21 17:32:49.571350 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.568734    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 21 17:32:49.571350 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.568736    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 21 17:32:49.571350 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.568739    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 21 17:32:49.571350 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.568742    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 21 17:32:49.571350 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.568745    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 21 17:32:49.571350 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.568747    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 21 17:32:49.571350 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.568750    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 21 17:32:49.571350 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.568755    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 21 17:32:49.571350 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.568759    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 21 17:32:49.571350 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.568762    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 21 17:32:49.571350 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.568766    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 21 17:32:49.571350 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.568770    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 21 17:32:49.571350 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.568773    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
May 21 17:32:49.571350 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.568776    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 21 17:32:49.571350 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.568779    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 21 17:32:49.571350 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.568783    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 21 17:32:49.571837 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.568785    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 21 17:32:49.571837 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.568788    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 21 17:32:49.571837 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.568791    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 21 17:32:49.571837 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.568793    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 21 17:32:49.571837 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.568796    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 21 17:32:49.571837 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.568799    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 21 17:32:49.571837 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.568802    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 21 17:32:49.571837 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.568804    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 21 17:32:49.571837 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.568807    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 21 17:32:49.571837 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.568811    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 21 17:32:49.571837 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.568813    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 21 17:32:49.571837 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.568816    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 21 17:32:49.571837 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.568818    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 21 17:32:49.571837 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.568821    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 21 17:32:49.571837 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.568823    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 21 17:32:49.571837 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.568827    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 21 17:32:49.571837 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.568831    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 21 17:32:49.571837 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.568834    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 21 17:32:49.571837 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.568839    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 21 17:32:49.572308 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.568843    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 21 17:32:49.572308 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.568847    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 21 17:32:49.572308 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.568850    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 21 17:32:49.572308 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.568853    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 21 17:32:49.572308 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.568856    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 21 17:32:49.572308 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.568858    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 21 17:32:49.572308 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.568861    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 21 17:32:49.572308 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.568863    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 21 17:32:49.572308 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.568866    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 21 17:32:49.572308 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.568868    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 21 17:32:49.572308 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.568871    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 21 17:32:49.572308 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.568873    2563 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 21 17:32:49.572308 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.568876    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 21 17:32:49.572308 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.568879    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 21 17:32:49.572308 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.568882    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 21 17:32:49.572308 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.568885    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 21 17:32:49.572308 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.568887    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 21 17:32:49.572308 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.568890    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 21 17:32:49.572308 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.568893    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 21 17:32:49.572308 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.568895    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 21 17:32:49.572787 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.568898    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 21 17:32:49.572787 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.568900    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 21 17:32:49.572787 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.568903    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 21 17:32:49.572787 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.568906    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 21 17:32:49.572787 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.568908    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 21 17:32:49.572787 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.568911    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 21 17:32:49.572787 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.568916    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 21 17:32:49.572787 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.568920    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 21 17:32:49.572787 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.568924    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 21 17:32:49.572787 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.568927    2563 feature_gate.go:328] unrecognized feature gate: Example
May 21 17:32:49.572787 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.568929    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 21 17:32:49.572787 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.568932    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 21 17:32:49.572787 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:49.568934    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 21 17:32:49.572787 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.568939    2563 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 21 17:32:49.572787 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.569712    2563 server.go:962] "Client rotation is on, will bootstrap in background"
May 21 17:32:49.573647 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.573633    2563 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
May 21 17:32:49.574612 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.574601    2563 server.go:1019] "Starting client certificate rotation"
May 21 17:32:49.574708 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.574694    2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 21 17:32:49.574739 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.574727    2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 21 17:32:49.604702 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.604685    2563 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 21 17:32:49.607380 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.607363    2563 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 21 17:32:49.620321 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.620304    2563 log.go:25] "Validated CRI v1 runtime API"
May 21 17:32:49.625386 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.625372    2563 log.go:25] "Validated CRI v1 image API"
May 21 17:32:49.626607 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.626581    2563 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
May 21 17:32:49.630639 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.630620    2563 fs.go:135] Filesystem UUIDs: map[4d3723cf-e544-453a-979f-a906fb59eb3d:/dev/nvme0n1p3 590cfb72-c8b6-4515-b40d-80edcf3a3ffc:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2]
May 21 17:32:49.630715 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.630638    2563 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
May 21 17:32:49.631989 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.631965    2563 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 21 17:32:49.636996 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.636882    2563 manager.go:217] Machine: {Timestamp:2026-05-21 17:32:49.636412254 +0000 UTC m=+0.413784750 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3095057 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec287e7d1bf052e35152c1a9035c206f SystemUUID:ec287e7d-1bf0-52e3-5152-c1a9035c206f BootID:1b9d45e0-1369-47a9-962c-97049d75d5cb Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:d3:ad:d6:91:9f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:d3:ad:d6:91:9f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ea:15:89:ed:8d:d0 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
May 21 17:32:49.638175 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.638163    2563 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
May 21 17:32:49.638255 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.638243    2563 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
May 21 17:32:49.639950 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.639926    2563 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
May 21 17:32:49.640100 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.639954    2563 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-140-106.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
May 21 17:32:49.640150 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.640109    2563 topology_manager.go:138] "Creating topology manager with none policy"
May 21 17:32:49.640150 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.640118    2563 container_manager_linux.go:306] "Creating device plugin manager"
May 21 17:32:49.640150 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.640125    2563 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
May 21 17:32:49.640806 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.640796    2563 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
May 21 17:32:49.643206 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.643196    2563 state_mem.go:36] "Initialized new in-memory state store"
May 21 17:32:49.643316 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.643307    2563 server.go:1267] "Using root directory" path="/var/lib/kubelet"
May 21 17:32:49.645825 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.645816    2563 kubelet.go:491] "Attempting to sync node with API server"
May 21 17:32:49.645861 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.645829    2563 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests"
May 21 17:32:49.645861 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.645841    2563 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
May 21 17:32:49.645861 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.645850    2563 kubelet.go:397] "Adding apiserver pod source"
May 21 17:32:49.645861 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.645858    2563 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
May 21 17:32:49.646995 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.646983    2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 21 17:32:49.647049 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.647002    2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 21 17:32:49.648263 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.648242    2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-d22w7"
May 21 17:32:49.649972 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.649952    2563 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1"
May 21 17:32:49.651712 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.651699    2563 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
May 21 17:32:49.652606 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.652592    2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
May 21 17:32:49.652656 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.652613    2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
May 21 17:32:49.652656 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.652620    2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
May 21 17:32:49.652656 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.652626    2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
May 21 17:32:49.652656 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.652634    2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
May 21 17:32:49.652656 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.652640    2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret"
May 21 17:32:49.652656 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.652646    2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
May 21 17:32:49.652656 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.652653    2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
May 21 17:32:49.652837 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.652664    2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc"
May 21 17:32:49.652837 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.652672    2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
May 21 17:32:49.652837 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.652689    2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected"
May 21 17:32:49.652957 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.652947    2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
May 21 17:32:49.653739 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.653729    2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi"
May 21 17:32:49.653775 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.653741    2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image"
May 21 17:32:49.655049 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.655033    2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-d22w7"
May 21 17:32:49.657013 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.657001    2563 watchdog_linux.go:99] "Systemd watchdog is not enabled"
May 21 17:32:49.657087 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.657036    2563 server.go:1295] "Started kubelet"
May 21 17:32:49.657163 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.657137    2563 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
May 21 17:32:49.657163 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.657130    2563 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
May 21 17:32:49.657255 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.657187    2563 server_v1.go:47] "podresources" method="list" useActivePods=true
May 21 17:32:49.657947 ip-10-0-140-106 systemd[1]: Started Kubernetes Kubelet.
May 21 17:32:49.659325 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.659309    2563 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
May 21 17:32:49.660969 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.660953    2563 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
May 21 17:32:49.661119 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.661105    2563 server.go:317] "Adding debug handlers to kubelet server"
May 21 17:32:49.663348 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.663333    2563 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
May 21 17:32:49.664969 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.664945    2563 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-140-106.ec2.internal" not found
May 21 17:32:49.665956 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.665938    2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
May 21 17:32:49.666441 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.666424    2563 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
May 21 17:32:49.666620 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.666588    2563 volume_manager.go:295] "The desired_state_of_world populator starts"
May 21 17:32:49.666801 ip-10-0-140-106 kubenswrapper[2563]: E0521 17:32:49.666780    2563 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
May 21 17:32:49.666863 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.666846    2563 volume_manager.go:297] "Starting Kubelet Volume Manager"
May 21 17:32:49.667069 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.667033    2563 reconstruct.go:97] "Volume reconstruction finished"
May 21 17:32:49.667069 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.667050    2563 reconciler.go:26] "Reconciler: start to sync state"
May 21 17:32:49.667231 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.667206    2563 desired_state_of_world_populator.go:150] "Desired state populator starts to run"
May 21 17:32:49.667643 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.667616    2563 factory.go:55] Registering systemd factory
May 21 17:32:49.667717 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.667704    2563 factory.go:223] Registration of the systemd container factory successfully
May 21 17:32:49.668012 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.667998    2563 factory.go:153] Registering CRI-O factory
May 21 17:32:49.668012 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.668015    2563 factory.go:223] Registration of the crio container factory successfully
May 21 17:32:49.668179 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.668096    2563 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
May 21 17:32:49.668179 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.668114    2563 factory.go:103] Registering Raw factory
May 21 17:32:49.668179 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.668135    2563 manager.go:1196] Started watching for new ooms in manager
May 21 17:32:49.669131 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.668554    2563 manager.go:319] Starting recovery of all containers
May 21 17:32:49.669930 ip-10-0-140-106 kubenswrapper[2563]: E0521 17:32:49.669890    2563 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-106.ec2.internal\" not found"
May 21 17:32:49.672544 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.672459    2563 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
May 21 17:32:49.673340 ip-10-0-140-106 kubenswrapper[2563]: E0521 17:32:49.673321    2563 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-140-106.ec2.internal\" not found" node="ip-10-0-140-106.ec2.internal"
May 21 17:32:49.679283 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.679124    2563 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-140-106.ec2.internal" not found
May 21 17:32:49.681733 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.681719    2563 manager.go:324] Recovery completed
May 21 17:32:49.683203 ip-10-0-140-106 kubenswrapper[2563]: E0521 17:32:49.683179    2563 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
May 21 17:32:49.686231 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.686218    2563 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 21 17:32:49.689285 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.689269    2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-106.ec2.internal" event="NodeHasSufficientMemory"
May 21 17:32:49.689357 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.689297    2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-106.ec2.internal" event="NodeHasNoDiskPressure"
May 21 17:32:49.689357 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.689313    2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-106.ec2.internal" event="NodeHasSufficientPID"
May 21 17:32:49.689815 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.689801    2563 cpu_manager.go:222] "Starting CPU manager" policy="none"
May 21 17:32:49.689815 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.689812    2563 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
May 21 17:32:49.689912 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.689827    2563 state_mem.go:36] "Initialized new in-memory state store"
May 21 17:32:49.692248 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.692237    2563 policy_none.go:49] "None policy: Start"
May 21 17:32:49.692295 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.692254    2563 memory_manager.go:186] "Starting memorymanager" policy="None"
May 21 17:32:49.692295 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.692264    2563 state_mem.go:35] "Initializing new in-memory state store"
May 21 17:32:49.738334 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.738318    2563 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-140-106.ec2.internal" not found
May 21 17:32:49.741982 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.741970    2563 manager.go:341] "Starting Device Plugin manager"
May 21 17:32:49.742041 ip-10-0-140-106 kubenswrapper[2563]: E0521 17:32:49.741998    2563 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
May 21 17:32:49.742041 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.742007    2563 server.go:85] "Starting device plugin registration server"
May 21 17:32:49.742325 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.742312    2563 eviction_manager.go:189] "Eviction manager: starting control loop"
May 21 17:32:49.742393 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.742327    2563 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
May 21 17:32:49.742444 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.742420    2563 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
May 21 17:32:49.742517 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.742505    2563 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
May 21 17:32:49.742517 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.742518    2563 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
May 21 17:32:49.743209 ip-10-0-140-106 kubenswrapper[2563]: E0521 17:32:49.743179    2563 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
May 21 17:32:49.743287 ip-10-0-140-106 kubenswrapper[2563]: E0521 17:32:49.743224    2563 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-140-106.ec2.internal\" not found"
May 21 17:32:49.797768 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.797734    2563 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4"
May 21 17:32:49.798901 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.798881    2563 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6"
May 21 17:32:49.798901 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.798900    2563 status_manager.go:230] "Starting to sync pod status with apiserver"
May 21 17:32:49.799078 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.798916    2563 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
May 21 17:32:49.799078 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.798926    2563 kubelet.go:2451] "Starting kubelet main sync loop"
May 21 17:32:49.799078 ip-10-0-140-106 kubenswrapper[2563]: E0521 17:32:49.798967    2563 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
May 21 17:32:49.801027 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.801009    2563 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 21 17:32:49.842808 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.842789    2563 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 21 17:32:49.843540 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.843517    2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-106.ec2.internal" event="NodeHasSufficientMemory"
May 21 17:32:49.843595 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.843546    2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-106.ec2.internal" event="NodeHasNoDiskPressure"
May 21 17:32:49.843595 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.843556    2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-106.ec2.internal" event="NodeHasSufficientPID"
May 21 17:32:49.843595 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.843578    2563 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-140-106.ec2.internal"
May 21 17:32:49.851293 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.851272    2563 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-140-106.ec2.internal"
May 21 17:32:49.851339 ip-10-0-140-106 kubenswrapper[2563]: E0521 17:32:49.851298    2563 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-140-106.ec2.internal\": node \"ip-10-0-140-106.ec2.internal\" not found"
May 21 17:32:49.899879 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.899857    2563 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-106.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-140-106.ec2.internal"]
May 21 17:32:49.902269 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.902253    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-106.ec2.internal"
May 21 17:32:49.902356 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.902283    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-106.ec2.internal"
May 21 17:32:49.926655 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.926634    2563 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-106.ec2.internal"
May 21 17:32:49.930956 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.930943    2563 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-106.ec2.internal"
May 21 17:32:49.936235 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.936221    2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 21 17:32:49.942513 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:49.942498    2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 21 17:32:50.068368 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.068306    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ee738e3c8bad4e84961a8137a36a0108-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-106.ec2.internal\" (UID: \"ee738e3c8bad4e84961a8137a36a0108\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-106.ec2.internal"
May 21 17:32:50.068368 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.068333    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ee738e3c8bad4e84961a8137a36a0108-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-106.ec2.internal\" (UID: \"ee738e3c8bad4e84961a8137a36a0108\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-106.ec2.internal"
May 21 17:32:50.068368 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.068351    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0842e044b1618ebb8b3bbc536a394d83-config\") pod \"kube-apiserver-proxy-ip-10-0-140-106.ec2.internal\" (UID: \"0842e044b1618ebb8b3bbc536a394d83\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-106.ec2.internal"
May 21 17:32:50.169271 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.169240    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ee738e3c8bad4e84961a8137a36a0108-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-106.ec2.internal\" (UID: \"ee738e3c8bad4e84961a8137a36a0108\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-106.ec2.internal"
May 21 17:32:50.169410 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.169284    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ee738e3c8bad4e84961a8137a36a0108-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-106.ec2.internal\" (UID: \"ee738e3c8bad4e84961a8137a36a0108\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-106.ec2.internal"
May 21 17:32:50.169410 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.169302    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0842e044b1618ebb8b3bbc536a394d83-config\") pod \"kube-apiserver-proxy-ip-10-0-140-106.ec2.internal\" (UID: \"0842e044b1618ebb8b3bbc536a394d83\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-106.ec2.internal"
May 21 17:32:50.169410 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.169364    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ee738e3c8bad4e84961a8137a36a0108-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-106.ec2.internal\" (UID: \"ee738e3c8bad4e84961a8137a36a0108\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-106.ec2.internal"
May 21 17:32:50.169535 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.169411    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ee738e3c8bad4e84961a8137a36a0108-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-106.ec2.internal\" (UID: \"ee738e3c8bad4e84961a8137a36a0108\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-106.ec2.internal"
May 21 17:32:50.169535 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.169444    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0842e044b1618ebb8b3bbc536a394d83-config\") pod \"kube-apiserver-proxy-ip-10-0-140-106.ec2.internal\" (UID: \"0842e044b1618ebb8b3bbc536a394d83\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-106.ec2.internal"
May 21 17:32:50.240121 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.240104    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-106.ec2.internal"
May 21 17:32:50.245679 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.245658    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-106.ec2.internal"
May 21 17:32:50.574049 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.574017    2563 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
May 21 17:32:50.574620 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.574181    2563 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 21 17:32:50.574620 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.574215    2563 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 21 17:32:50.574620 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.574224    2563 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 21 17:32:50.646024 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.646002    2563 apiserver.go:52] "Watching apiserver"
May 21 17:32:50.655485 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.655463    2563 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
May 21 17:32:50.655806 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.655786    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-mjdmf","openshift-image-registry/node-ca-wxdwr","openshift-multus/multus-additional-cni-plugins-lwm7w","openshift-multus/multus-qbjhb","openshift-multus/network-metrics-daemon-5m8k5","openshift-network-diagnostics/network-check-target-7d87n","openshift-network-operator/iptables-alerter-kzq5f","openshift-ovn-kubernetes/ovnkube-node-l26qr","kube-system/kube-apiserver-proxy-ip-10-0-140-106.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jkl6g","openshift-cluster-node-tuning-operator/tuned-tztkr","openshift-dns/node-resolver-9tfbv","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-106.ec2.internal"]
May 21 17:32:50.657085 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.657043    2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-20 17:27:49 +0000 UTC" deadline="2027-11-16 13:21:40.787508592 +0000 UTC"
May 21 17:32:50.657085 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.657083    2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13051h48m50.130427785s"
May 21 17:32:50.658303 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.658285    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-mjdmf"
May 21 17:32:50.658361 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.658292    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wxdwr"
May 21 17:32:50.659492 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.659476    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-lwm7w"
May 21 17:32:50.660648 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.660631    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
May 21 17:32:50.660737 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.660680    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
May 21 17:32:50.660936 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.660916    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
May 21 17:32:50.660936 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.660929    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-7p5mb\""
May 21 17:32:50.661210 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.661193    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
May 21 17:32:50.661300 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.661283    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
May 21 17:32:50.661344 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.661287    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-ltkqm\""
May 21 17:32:50.661885 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.661867    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-qbjhb"
May 21 17:32:50.661973 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.661956    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
May 21 17:32:50.662027 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.661988    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
May 21 17:32:50.662228 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.662215    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
May 21 17:32:50.662316 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.662247    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
May 21 17:32:50.662316 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.662270    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-dhg8x\""
May 21 17:32:50.662417 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.662343    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
May 21 17:32:50.662909 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.662894    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5m8k5"
May 21 17:32:50.662972 ip-10-0-140-106 kubenswrapper[2563]: E0521 17:32:50.662949    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5m8k5" podUID="44544f15-6623-4cbc-876d-2336ac096e94"
May 21 17:32:50.663027 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.663014    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7d87n"
May 21 17:32:50.663147 ip-10-0-140-106 kubenswrapper[2563]: E0521 17:32:50.663105    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7d87n" podUID="0ac45335-a985-45d8-be5b-85b5d4bcd78a"
May 21 17:32:50.664003 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.663982    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-tjtbf\""
May 21 17:32:50.664179 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.664160    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
May 21 17:32:50.665674 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.664455    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-kzq5f"
May 21 17:32:50.666281 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.666263    2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
May 21 17:32:50.666930 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.666494    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-l26qr"
May 21 17:32:50.666930 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.666526    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
May 21 17:32:50.666930 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.666659    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-gzd5v\""
May 21 17:32:50.667132 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.667117    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
May 21 17:32:50.667180 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.667144    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
May 21 17:32:50.668378 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.668360    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jkl6g"
May 21 17:32:50.668790 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.668767    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
May 21 17:32:50.668880 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.668846    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
May 21 17:32:50.669132 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.669110    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-t9dz4\""
May 21 17:32:50.669227 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.669145    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
May 21 17:32:50.671772 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.670230    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
May 21 17:32:50.671772 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.670454    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
May 21 17:32:50.671772 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.670664    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
May 21 17:32:50.671772 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.670669    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
May 21 17:32:50.671772 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.670913    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
May 21 17:32:50.671772 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.671120    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-6vhxn\""
May 21 17:32:50.671772 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.671135    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
May 21 17:32:50.672152 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.672104    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-tztkr"
May 21 17:32:50.673032 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.673008    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6a4c3e7d-e19e-4f8a-bdb5-e1b89087e80a-sys-fs\") pod \"aws-ebs-csi-driver-node-jkl6g\" (UID: \"6a4c3e7d-e19e-4f8a-bdb5-e1b89087e80a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jkl6g"
May 21 17:32:50.673154 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.673099    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/bbbebc0e-c07f-479d-add3-16a2e09e96f8-os-release\") pod \"multus-additional-cni-plugins-lwm7w\" (UID: \"bbbebc0e-c07f-479d-add3-16a2e09e96f8\") " pod="openshift-multus/multus-additional-cni-plugins-lwm7w"
May 21 17:32:50.673154 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.673136    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e2773ea7-39f5-44bf-ac23-72d4ae6cce44-cni-binary-copy\") pod \"multus-qbjhb\" (UID: \"e2773ea7-39f5-44bf-ac23-72d4ae6cce44\") " pod="openshift-multus/multus-qbjhb"
May 21 17:32:50.673154 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.673153    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e2773ea7-39f5-44bf-ac23-72d4ae6cce44-host-run-k8s-cni-cncf-io\") pod \"multus-qbjhb\" (UID: \"e2773ea7-39f5-44bf-ac23-72d4ae6cce44\") " pod="openshift-multus/multus-qbjhb"
May 21 17:32:50.673284 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.673169    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2vdfr\" (UniqueName: \"kubernetes.io/projected/e2773ea7-39f5-44bf-ac23-72d4ae6cce44-kube-api-access-2vdfr\") pod \"multus-qbjhb\" (UID: \"e2773ea7-39f5-44bf-ac23-72d4ae6cce44\") " pod="openshift-multus/multus-qbjhb"
May 21 17:32:50.673284 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.673188    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q2h8x\" (UniqueName: \"kubernetes.io/projected/f81b0bfa-3067-444d-9daf-734b247ab575-kube-api-access-q2h8x\") pod \"node-ca-wxdwr\" (UID: \"f81b0bfa-3067-444d-9daf-734b247ab575\") " pod="openshift-image-registry/node-ca-wxdwr"
May 21 17:32:50.673284 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.673210    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h2sct\" (UniqueName: \"kubernetes.io/projected/0ac45335-a985-45d8-be5b-85b5d4bcd78a-kube-api-access-h2sct\") pod \"network-check-target-7d87n\" (UID: \"0ac45335-a985-45d8-be5b-85b5d4bcd78a\") " pod="openshift-network-diagnostics/network-check-target-7d87n"
May 21 17:32:50.673284 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.673241    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hxf7p\" (UniqueName: \"kubernetes.io/projected/bbbebc0e-c07f-479d-add3-16a2e09e96f8-kube-api-access-hxf7p\") pod \"multus-additional-cni-plugins-lwm7w\" (UID: \"bbbebc0e-c07f-479d-add3-16a2e09e96f8\") " pod="openshift-multus/multus-additional-cni-plugins-lwm7w"
May 21 17:32:50.673284 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.673261    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/68bcb748-24b1-47d9-89a0-443f1ac90b79-host-slash\") pod \"iptables-alerter-kzq5f\" (UID: \"68bcb748-24b1-47d9-89a0-443f1ac90b79\") " pod="openshift-network-operator/iptables-alerter-kzq5f"
May 21 17:32:50.673284 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.673282    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e2773ea7-39f5-44bf-ac23-72d4ae6cce44-hostroot\") pod \"multus-qbjhb\" (UID: \"e2773ea7-39f5-44bf-ac23-72d4ae6cce44\") " pod="openshift-multus/multus-qbjhb"
May 21 17:32:50.673491 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.673309    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e2773ea7-39f5-44bf-ac23-72d4ae6cce44-multus-conf-dir\") pod \"multus-qbjhb\" (UID: \"e2773ea7-39f5-44bf-ac23-72d4ae6cce44\") " pod="openshift-multus/multus-qbjhb"
May 21 17:32:50.673491 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.673340    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7czmb\" (UniqueName: \"kubernetes.io/projected/39aff25f-af46-4546-bc78-4d19a0c1747a-kube-api-access-7czmb\") pod \"ovnkube-node-l26qr\" (UID: \"39aff25f-af46-4546-bc78-4d19a0c1747a\") " pod="openshift-ovn-kubernetes/ovnkube-node-l26qr"
May 21 17:32:50.673491 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.673357    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e2773ea7-39f5-44bf-ac23-72d4ae6cce44-host-run-multus-certs\") pod \"multus-qbjhb\" (UID: \"e2773ea7-39f5-44bf-ac23-72d4ae6cce44\") " pod="openshift-multus/multus-qbjhb"
May 21 17:32:50.673491 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.673372    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/39aff25f-af46-4546-bc78-4d19a0c1747a-var-lib-openvswitch\") pod \"ovnkube-node-l26qr\" (UID: \"39aff25f-af46-4546-bc78-4d19a0c1747a\") " pod="openshift-ovn-kubernetes/ovnkube-node-l26qr"
May 21 17:32:50.673491 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.673386    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/39aff25f-af46-4546-bc78-4d19a0c1747a-run-openvswitch\") pod \"ovnkube-node-l26qr\" (UID: \"39aff25f-af46-4546-bc78-4d19a0c1747a\") " pod="openshift-ovn-kubernetes/ovnkube-node-l26qr"
May 21 17:32:50.673491 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.673410    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/39aff25f-af46-4546-bc78-4d19a0c1747a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-l26qr\" (UID: \"39aff25f-af46-4546-bc78-4d19a0c1747a\") " pod="openshift-ovn-kubernetes/ovnkube-node-l26qr"
May 21 17:32:50.673491 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.673436    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/39aff25f-af46-4546-bc78-4d19a0c1747a-ovn-node-metrics-cert\") pod \"ovnkube-node-l26qr\" (UID: \"39aff25f-af46-4546-bc78-4d19a0c1747a\") " pod="openshift-ovn-kubernetes/ovnkube-node-l26qr"
May 21 17:32:50.673491 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.673458    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f81b0bfa-3067-444d-9daf-734b247ab575-host\") pod \"node-ca-wxdwr\" (UID: \"f81b0bfa-3067-444d-9daf-734b247ab575\") " pod="openshift-image-registry/node-ca-wxdwr"
May 21 17:32:50.673491 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.673474    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e2773ea7-39f5-44bf-ac23-72d4ae6cce44-host-var-lib-cni-bin\") pod \"multus-qbjhb\" (UID: \"e2773ea7-39f5-44bf-ac23-72d4ae6cce44\") " pod="openshift-multus/multus-qbjhb"
May 21 17:32:50.673733 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.673497    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e2773ea7-39f5-44bf-ac23-72d4ae6cce44-host-var-lib-cni-multus\") pod \"multus-qbjhb\" (UID: \"e2773ea7-39f5-44bf-ac23-72d4ae6cce44\") " pod="openshift-multus/multus-qbjhb"
May 21 17:32:50.673733 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.673535    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e2773ea7-39f5-44bf-ac23-72d4ae6cce44-multus-daemon-config\") pod \"multus-qbjhb\" (UID: \"e2773ea7-39f5-44bf-ac23-72d4ae6cce44\") " pod="openshift-multus/multus-qbjhb"
May 21 17:32:50.673733 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.673580    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e2773ea7-39f5-44bf-ac23-72d4ae6cce44-os-release\") pod \"multus-qbjhb\" (UID: \"e2773ea7-39f5-44bf-ac23-72d4ae6cce44\") " pod="openshift-multus/multus-qbjhb"
May 21 17:32:50.673733 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.673608    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/cda57dfb-738d-462c-98d6-f8f03db1d69d-agent-certs\") pod \"konnectivity-agent-mjdmf\" (UID: \"cda57dfb-738d-462c-98d6-f8f03db1d69d\") " pod="kube-system/konnectivity-agent-mjdmf"
May 21 17:32:50.673733 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.673631    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e2773ea7-39f5-44bf-ac23-72d4ae6cce44-system-cni-dir\") pod \"multus-qbjhb\" (UID: \"e2773ea7-39f5-44bf-ac23-72d4ae6cce44\") " pod="openshift-multus/multus-qbjhb"
May 21 17:32:50.673733 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.673666    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/39aff25f-af46-4546-bc78-4d19a0c1747a-host-slash\") pod \"ovnkube-node-l26qr\" (UID: \"39aff25f-af46-4546-bc78-4d19a0c1747a\") " pod="openshift-ovn-kubernetes/ovnkube-node-l26qr"
May 21 17:32:50.673733 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.673701    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e2773ea7-39f5-44bf-ac23-72d4ae6cce44-cnibin\") pod \"multus-qbjhb\" (UID: \"e2773ea7-39f5-44bf-ac23-72d4ae6cce44\") " pod="openshift-multus/multus-qbjhb"
May 21 17:32:50.674038 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.673725    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6a4c3e7d-e19e-4f8a-bdb5-e1b89087e80a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jkl6g\" (UID: \"6a4c3e7d-e19e-4f8a-bdb5-e1b89087e80a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jkl6g"
May 21 17:32:50.674038 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.673759    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6a4c3e7d-e19e-4f8a-bdb5-e1b89087e80a-socket-dir\") pod \"aws-ebs-csi-driver-node-jkl6g\" (UID: \"6a4c3e7d-e19e-4f8a-bdb5-e1b89087e80a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jkl6g"
May 21 17:32:50.674038 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.673781    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bbbebc0e-c07f-479d-add3-16a2e09e96f8-cni-binary-copy\") pod \"multus-additional-cni-plugins-lwm7w\" (UID: \"bbbebc0e-c07f-479d-add3-16a2e09e96f8\") " pod="openshift-multus/multus-additional-cni-plugins-lwm7w"
May 21 17:32:50.674038 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.673796    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e2773ea7-39f5-44bf-ac23-72d4ae6cce44-multus-socket-dir-parent\") pod \"multus-qbjhb\" (UID: \"e2773ea7-39f5-44bf-ac23-72d4ae6cce44\") " pod="openshift-multus/multus-qbjhb"
May 21 17:32:50.674038 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.673819    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/39aff25f-af46-4546-bc78-4d19a0c1747a-log-socket\") pod \"ovnkube-node-l26qr\" (UID: \"39aff25f-af46-4546-bc78-4d19a0c1747a\") " pod="openshift-ovn-kubernetes/ovnkube-node-l26qr"
May 21 17:32:50.674038 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.673863    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/39aff25f-af46-4546-bc78-4d19a0c1747a-host-run-ovn-kubernetes\") pod \"ovnkube-node-l26qr\" (UID: \"39aff25f-af46-4546-bc78-4d19a0c1747a\") " pod="openshift-ovn-kubernetes/ovnkube-node-l26qr"
May 21 17:32:50.674038 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.673897    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/39aff25f-af46-4546-bc78-4d19a0c1747a-host-cni-netd\") pod \"ovnkube-node-l26qr\" (UID: \"39aff25f-af46-4546-bc78-4d19a0c1747a\") " pod="openshift-ovn-kubernetes/ovnkube-node-l26qr"
May 21 17:32:50.674038 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.673921    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/39aff25f-af46-4546-bc78-4d19a0c1747a-env-overrides\") pod \"ovnkube-node-l26qr\" (UID: \"39aff25f-af46-4546-bc78-4d19a0c1747a\") " pod="openshift-ovn-kubernetes/ovnkube-node-l26qr"
May 21 17:32:50.674038 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.673945    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/39aff25f-af46-4546-bc78-4d19a0c1747a-ovnkube-script-lib\") pod \"ovnkube-node-l26qr\" (UID: \"39aff25f-af46-4546-bc78-4d19a0c1747a\") " pod="openshift-ovn-kubernetes/ovnkube-node-l26qr"
May 21 17:32:50.674038 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.673972    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/bbbebc0e-c07f-479d-add3-16a2e09e96f8-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-lwm7w\" (UID: \"bbbebc0e-c07f-479d-add3-16a2e09e96f8\") " pod="openshift-multus/multus-additional-cni-plugins-lwm7w"
May 21 17:32:50.674038 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.674000    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e2773ea7-39f5-44bf-ac23-72d4ae6cce44-host-var-lib-kubelet\") pod \"multus-qbjhb\" (UID: \"e2773ea7-39f5-44bf-ac23-72d4ae6cce44\") " pod="openshift-multus/multus-qbjhb"
May 21 17:32:50.674038 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.674037    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-9tfbv"
May 21 17:32:50.674552 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.674038    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/68bcb748-24b1-47d9-89a0-443f1ac90b79-iptables-alerter-script\") pod \"iptables-alerter-kzq5f\" (UID: \"68bcb748-24b1-47d9-89a0-443f1ac90b79\") " pod="openshift-network-operator/iptables-alerter-kzq5f"
May 21 17:32:50.674552 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.674134    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/39aff25f-af46-4546-bc78-4d19a0c1747a-ovnkube-config\") pod \"ovnkube-node-l26qr\" (UID: \"39aff25f-af46-4546-bc78-4d19a0c1747a\") " pod="openshift-ovn-kubernetes/ovnkube-node-l26qr"
May 21 17:32:50.674552 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.674174    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6a4c3e7d-e19e-4f8a-bdb5-e1b89087e80a-device-dir\") pod \"aws-ebs-csi-driver-node-jkl6g\" (UID: \"6a4c3e7d-e19e-4f8a-bdb5-e1b89087e80a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jkl6g"
May 21 17:32:50.674552 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.674201    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hm2vt\" (UniqueName: \"kubernetes.io/projected/6a4c3e7d-e19e-4f8a-bdb5-e1b89087e80a-kube-api-access-hm2vt\") pod \"aws-ebs-csi-driver-node-jkl6g\" (UID: \"6a4c3e7d-e19e-4f8a-bdb5-e1b89087e80a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jkl6g"
May 21 17:32:50.674552 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.674280    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
May 21 17:32:50.674552 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.674292    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/bbbebc0e-c07f-479d-add3-16a2e09e96f8-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-lwm7w\" (UID: \"bbbebc0e-c07f-479d-add3-16a2e09e96f8\") " pod="openshift-multus/multus-additional-cni-plugins-lwm7w"
May 21 17:32:50.674552 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.674319    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/39aff25f-af46-4546-bc78-4d19a0c1747a-etc-openvswitch\") pod \"ovnkube-node-l26qr\" (UID: \"39aff25f-af46-4546-bc78-4d19a0c1747a\") " pod="openshift-ovn-kubernetes/ovnkube-node-l26qr"
May 21 17:32:50.674552 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.674377    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/39aff25f-af46-4546-bc78-4d19a0c1747a-node-log\") pod \"ovnkube-node-l26qr\" (UID: \"39aff25f-af46-4546-bc78-4d19a0c1747a\") " pod="openshift-ovn-kubernetes/ovnkube-node-l26qr"
May 21 17:32:50.674552 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.674424    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e2773ea7-39f5-44bf-ac23-72d4ae6cce44-multus-cni-dir\") pod \"multus-qbjhb\" (UID: \"e2773ea7-39f5-44bf-ac23-72d4ae6cce44\") " pod="openshift-multus/multus-qbjhb"
May 21 17:32:50.674552 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.674447    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e2773ea7-39f5-44bf-ac23-72d4ae6cce44-host-run-netns\") pod \"multus-qbjhb\" (UID: \"e2773ea7-39f5-44bf-ac23-72d4ae6cce44\") " pod="openshift-multus/multus-qbjhb"
May 21 17:32:50.674552 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.674464    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e2773ea7-39f5-44bf-ac23-72d4ae6cce44-etc-kubernetes\") pod \"multus-qbjhb\" (UID: \"e2773ea7-39f5-44bf-ac23-72d4ae6cce44\") " pod="openshift-multus/multus-qbjhb"
May 21 17:32:50.674552 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.674509    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/39aff25f-af46-4546-bc78-4d19a0c1747a-systemd-units\") pod \"ovnkube-node-l26qr\" (UID: \"39aff25f-af46-4546-bc78-4d19a0c1747a\") " pod="openshift-ovn-kubernetes/ovnkube-node-l26qr"
May 21 17:32:50.674552 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.674547    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/39aff25f-af46-4546-bc78-4d19a0c1747a-run-ovn\") pod \"ovnkube-node-l26qr\" (UID: \"39aff25f-af46-4546-bc78-4d19a0c1747a\") " pod="openshift-ovn-kubernetes/ovnkube-node-l26qr"
May 21 17:32:50.675125 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.674576    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/39aff25f-af46-4546-bc78-4d19a0c1747a-host-run-netns\") pod \"ovnkube-node-l26qr\" (UID: \"39aff25f-af46-4546-bc78-4d19a0c1747a\") " pod="openshift-ovn-kubernetes/ovnkube-node-l26qr"
May 21 17:32:50.675125 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.674622    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/cda57dfb-738d-462c-98d6-f8f03db1d69d-konnectivity-ca\") pod \"konnectivity-agent-mjdmf\" (UID: \"cda57dfb-738d-462c-98d6-f8f03db1d69d\") " pod="kube-system/konnectivity-agent-mjdmf"
May 21 17:32:50.675125 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.674647    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6a4c3e7d-e19e-4f8a-bdb5-e1b89087e80a-registration-dir\") pod \"aws-ebs-csi-driver-node-jkl6g\" (UID: \"6a4c3e7d-e19e-4f8a-bdb5-e1b89087e80a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jkl6g"
May 21 17:32:50.675125 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.674673    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bbbebc0e-c07f-479d-add3-16a2e09e96f8-system-cni-dir\") pod \"multus-additional-cni-plugins-lwm7w\" (UID: \"bbbebc0e-c07f-479d-add3-16a2e09e96f8\") " pod="openshift-multus/multus-additional-cni-plugins-lwm7w"
May 21 17:32:50.675125 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.674709    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zlpbc\" (UniqueName: \"kubernetes.io/projected/44544f15-6623-4cbc-876d-2336ac096e94-kube-api-access-zlpbc\") pod \"network-metrics-daemon-5m8k5\" (UID: \"44544f15-6623-4cbc-876d-2336ac096e94\") " pod="openshift-multus/network-metrics-daemon-5m8k5"
May 21 17:32:50.675125 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.674716    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-6bbcz\""
May 21 17:32:50.675125 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.674728    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
May 21 17:32:50.675125 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.674782    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q88zv\" (UniqueName: \"kubernetes.io/projected/68bcb748-24b1-47d9-89a0-443f1ac90b79-kube-api-access-q88zv\") pod \"iptables-alerter-kzq5f\" (UID: \"68bcb748-24b1-47d9-89a0-443f1ac90b79\") " pod="openshift-network-operator/iptables-alerter-kzq5f"
May 21 17:32:50.675125 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.674820    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/39aff25f-af46-4546-bc78-4d19a0c1747a-host-cni-bin\") pod \"ovnkube-node-l26qr\" (UID: \"39aff25f-af46-4546-bc78-4d19a0c1747a\") " pod="openshift-ovn-kubernetes/ovnkube-node-l26qr"
May 21 17:32:50.675125 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.674871    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6a4c3e7d-e19e-4f8a-bdb5-e1b89087e80a-etc-selinux\") pod \"aws-ebs-csi-driver-node-jkl6g\" (UID: \"6a4c3e7d-e19e-4f8a-bdb5-e1b89087e80a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jkl6g"
May 21 17:32:50.675125 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.674898    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bbbebc0e-c07f-479d-add3-16a2e09e96f8-tuning-conf-dir\") pod \"multus-additional-cni-plugins-lwm7w\" (UID: \"bbbebc0e-c07f-479d-add3-16a2e09e96f8\") " pod="openshift-multus/multus-additional-cni-plugins-lwm7w"
May 21 17:32:50.675125 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.674923    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/44544f15-6623-4cbc-876d-2336ac096e94-metrics-certs\") pod \"network-metrics-daemon-5m8k5\" (UID: \"44544f15-6623-4cbc-876d-2336ac096e94\") " pod="openshift-multus/network-metrics-daemon-5m8k5"
May 21 17:32:50.675125 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.674960    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f81b0bfa-3067-444d-9daf-734b247ab575-serviceca\") pod \"node-ca-wxdwr\" (UID: \"f81b0bfa-3067-444d-9daf-734b247ab575\") " pod="openshift-image-registry/node-ca-wxdwr"
May 21 17:32:50.675125 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.674984    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/39aff25f-af46-4546-bc78-4d19a0c1747a-host-kubelet\") pod \"ovnkube-node-l26qr\" (UID: \"39aff25f-af46-4546-bc78-4d19a0c1747a\") " pod="openshift-ovn-kubernetes/ovnkube-node-l26qr"
May 21 17:32:50.675125 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.675014    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bbbebc0e-c07f-479d-add3-16a2e09e96f8-cnibin\") pod \"multus-additional-cni-plugins-lwm7w\" (UID: \"bbbebc0e-c07f-479d-add3-16a2e09e96f8\") " pod="openshift-multus/multus-additional-cni-plugins-lwm7w"
May 21 17:32:50.675125 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.675051    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/39aff25f-af46-4546-bc78-4d19a0c1747a-run-systemd\") pod \"ovnkube-node-l26qr\" (UID: \"39aff25f-af46-4546-bc78-4d19a0c1747a\") " pod="openshift-ovn-kubernetes/ovnkube-node-l26qr"
May 21 17:32:50.676327 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.676296    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-8lbvd\""
May 21 17:32:50.676421 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.676355    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
May 21 17:32:50.676421 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.676379    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
May 21 17:32:50.679195 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.679177    2563 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 21 17:32:50.700549 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.700530    2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-w5hgg"
May 21 17:32:50.709119 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.709101    2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-w5hgg"
May 21 17:32:50.714467 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:50.714436    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0842e044b1618ebb8b3bbc536a394d83.slice/crio-44adbb660238d79ba5350e1d16088c0d6ad016d37000bd4d9e2d3adad25589d6 WatchSource:0}: Error finding container 44adbb660238d79ba5350e1d16088c0d6ad016d37000bd4d9e2d3adad25589d6: Status 404 returned error can't find the container with id 44adbb660238d79ba5350e1d16088c0d6ad016d37000bd4d9e2d3adad25589d6
May 21 17:32:50.714614 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:50.714601    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee738e3c8bad4e84961a8137a36a0108.slice/crio-0a54ff25f670ae63d9c087e473811ab976d69b8457e4dc1cf852dcdaf9a00969 WatchSource:0}: Error finding container 0a54ff25f670ae63d9c087e473811ab976d69b8457e4dc1cf852dcdaf9a00969: Status 404 returned error can't find the container with id 0a54ff25f670ae63d9c087e473811ab976d69b8457e4dc1cf852dcdaf9a00969
May 21 17:32:50.718210 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.718193    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 21 17:32:50.768517 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.768498    2563 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world"
May 21 17:32:50.775780 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.775755    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-q2h8x\" (UniqueName: \"kubernetes.io/projected/f81b0bfa-3067-444d-9daf-734b247ab575-kube-api-access-q2h8x\") pod \"node-ca-wxdwr\" (UID: \"f81b0bfa-3067-444d-9daf-734b247ab575\") " pod="openshift-image-registry/node-ca-wxdwr"
May 21 17:32:50.775835 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.775784    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-h2sct\" (UniqueName: \"kubernetes.io/projected/0ac45335-a985-45d8-be5b-85b5d4bcd78a-kube-api-access-h2sct\") pod \"network-check-target-7d87n\" (UID: \"0ac45335-a985-45d8-be5b-85b5d4bcd78a\") " pod="openshift-network-diagnostics/network-check-target-7d87n"
May 21 17:32:50.775835 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.775800    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hxf7p\" (UniqueName: \"kubernetes.io/projected/bbbebc0e-c07f-479d-add3-16a2e09e96f8-kube-api-access-hxf7p\") pod \"multus-additional-cni-plugins-lwm7w\" (UID: \"bbbebc0e-c07f-479d-add3-16a2e09e96f8\") " pod="openshift-multus/multus-additional-cni-plugins-lwm7w"
May 21 17:32:50.775835 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.775815    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/68bcb748-24b1-47d9-89a0-443f1ac90b79-host-slash\") pod \"iptables-alerter-kzq5f\" (UID: \"68bcb748-24b1-47d9-89a0-443f1ac90b79\") " pod="openshift-network-operator/iptables-alerter-kzq5f"
May 21 17:32:50.775975 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.775833    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/81f0d607-ba97-4306-82e3-1d42c03c400f-run\") pod \"tuned-tztkr\" (UID: \"81f0d607-ba97-4306-82e3-1d42c03c400f\") " pod="openshift-cluster-node-tuning-operator/tuned-tztkr"
May 21 17:32:50.775975 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.775855    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e2773ea7-39f5-44bf-ac23-72d4ae6cce44-hostroot\") pod \"multus-qbjhb\" (UID: \"e2773ea7-39f5-44bf-ac23-72d4ae6cce44\") " pod="openshift-multus/multus-qbjhb"
May 21 17:32:50.775975 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.775875    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e2773ea7-39f5-44bf-ac23-72d4ae6cce44-multus-conf-dir\") pod \"multus-qbjhb\" (UID: \"e2773ea7-39f5-44bf-ac23-72d4ae6cce44\") " pod="openshift-multus/multus-qbjhb"
May 21 17:32:50.775975 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.775901    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7czmb\" (UniqueName: \"kubernetes.io/projected/39aff25f-af46-4546-bc78-4d19a0c1747a-kube-api-access-7czmb\") pod \"ovnkube-node-l26qr\" (UID: \"39aff25f-af46-4546-bc78-4d19a0c1747a\") " pod="openshift-ovn-kubernetes/ovnkube-node-l26qr"
May 21 17:32:50.775975 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.775905    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/68bcb748-24b1-47d9-89a0-443f1ac90b79-host-slash\") pod \"iptables-alerter-kzq5f\" (UID: \"68bcb748-24b1-47d9-89a0-443f1ac90b79\") " pod="openshift-network-operator/iptables-alerter-kzq5f"
May 21 17:32:50.775975 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.775928    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/81f0d607-ba97-4306-82e3-1d42c03c400f-var-lib-kubelet\") pod \"tuned-tztkr\" (UID: \"81f0d607-ba97-4306-82e3-1d42c03c400f\") " pod="openshift-cluster-node-tuning-operator/tuned-tztkr"
May 21 17:32:50.775975 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.775927    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e2773ea7-39f5-44bf-ac23-72d4ae6cce44-multus-conf-dir\") pod \"multus-qbjhb\" (UID: \"e2773ea7-39f5-44bf-ac23-72d4ae6cce44\") " pod="openshift-multus/multus-qbjhb"
May 21 17:32:50.775975 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.775928    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e2773ea7-39f5-44bf-ac23-72d4ae6cce44-hostroot\") pod \"multus-qbjhb\" (UID: \"e2773ea7-39f5-44bf-ac23-72d4ae6cce44\") " pod="openshift-multus/multus-qbjhb"
May 21 17:32:50.775975 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.775953    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e2773ea7-39f5-44bf-ac23-72d4ae6cce44-host-run-multus-certs\") pod \"multus-qbjhb\" (UID: \"e2773ea7-39f5-44bf-ac23-72d4ae6cce44\") " pod="openshift-multus/multus-qbjhb"
May 21 17:32:50.775975 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.775969    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/39aff25f-af46-4546-bc78-4d19a0c1747a-var-lib-openvswitch\") pod \"ovnkube-node-l26qr\" (UID: \"39aff25f-af46-4546-bc78-4d19a0c1747a\") " pod="openshift-ovn-kubernetes/ovnkube-node-l26qr"
May 21 17:32:50.776393 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.775987    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/39aff25f-af46-4546-bc78-4d19a0c1747a-run-openvswitch\") pod \"ovnkube-node-l26qr\" (UID: \"39aff25f-af46-4546-bc78-4d19a0c1747a\") " pod="openshift-ovn-kubernetes/ovnkube-node-l26qr"
May 21 17:32:50.776393 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.776007    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e2773ea7-39f5-44bf-ac23-72d4ae6cce44-host-run-multus-certs\") pod \"multus-qbjhb\" (UID: \"e2773ea7-39f5-44bf-ac23-72d4ae6cce44\") " pod="openshift-multus/multus-qbjhb"
May 21 17:32:50.776393 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.776010    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/39aff25f-af46-4546-bc78-4d19a0c1747a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-l26qr\" (UID: \"39aff25f-af46-4546-bc78-4d19a0c1747a\") " pod="openshift-ovn-kubernetes/ovnkube-node-l26qr"
May 21 17:32:50.776393 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.776040    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/39aff25f-af46-4546-bc78-4d19a0c1747a-var-lib-openvswitch\") pod \"ovnkube-node-l26qr\" (UID: \"39aff25f-af46-4546-bc78-4d19a0c1747a\") " pod="openshift-ovn-kubernetes/ovnkube-node-l26qr"
May 21 17:32:50.776393 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.776048    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/39aff25f-af46-4546-bc78-4d19a0c1747a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-l26qr\" (UID: \"39aff25f-af46-4546-bc78-4d19a0c1747a\") " pod="openshift-ovn-kubernetes/ovnkube-node-l26qr"
May 21 17:32:50.776393 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.776051    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/39aff25f-af46-4546-bc78-4d19a0c1747a-ovn-node-metrics-cert\") pod \"ovnkube-node-l26qr\" (UID: \"39aff25f-af46-4546-bc78-4d19a0c1747a\") " pod="openshift-ovn-kubernetes/ovnkube-node-l26qr"
May 21 17:32:50.776393 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.776042    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/39aff25f-af46-4546-bc78-4d19a0c1747a-run-openvswitch\") pod \"ovnkube-node-l26qr\" (UID: \"39aff25f-af46-4546-bc78-4d19a0c1747a\") " pod="openshift-ovn-kubernetes/ovnkube-node-l26qr"
May 21 17:32:50.776393 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.776102    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/81f0d607-ba97-4306-82e3-1d42c03c400f-etc-kubernetes\") pod \"tuned-tztkr\" (UID: \"81f0d607-ba97-4306-82e3-1d42c03c400f\") " pod="openshift-cluster-node-tuning-operator/tuned-tztkr"
May 21 17:32:50.776393 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.776127    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/81f0d607-ba97-4306-82e3-1d42c03c400f-etc-sysctl-d\") pod \"tuned-tztkr\" (UID: \"81f0d607-ba97-4306-82e3-1d42c03c400f\") " pod="openshift-cluster-node-tuning-operator/tuned-tztkr"
May 21 17:32:50.776393 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.776150    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/81f0d607-ba97-4306-82e3-1d42c03c400f-sys\") pod \"tuned-tztkr\" (UID: \"81f0d607-ba97-4306-82e3-1d42c03c400f\") " pod="openshift-cluster-node-tuning-operator/tuned-tztkr"
May 21 17:32:50.776393 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.776174    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f81b0bfa-3067-444d-9daf-734b247ab575-host\") pod \"node-ca-wxdwr\" (UID: \"f81b0bfa-3067-444d-9daf-734b247ab575\") " pod="openshift-image-registry/node-ca-wxdwr"
May 21 17:32:50.776393 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.776190    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e2773ea7-39f5-44bf-ac23-72d4ae6cce44-host-var-lib-cni-bin\") pod \"multus-qbjhb\" (UID: \"e2773ea7-39f5-44bf-ac23-72d4ae6cce44\") " pod="openshift-multus/multus-qbjhb"
May 21 17:32:50.776393 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.776205    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e2773ea7-39f5-44bf-ac23-72d4ae6cce44-host-var-lib-cni-multus\") pod \"multus-qbjhb\" (UID: \"e2773ea7-39f5-44bf-ac23-72d4ae6cce44\") " pod="openshift-multus/multus-qbjhb"
May 21 17:32:50.776393 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.776238    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e2773ea7-39f5-44bf-ac23-72d4ae6cce44-host-var-lib-cni-bin\") pod \"multus-qbjhb\" (UID: \"e2773ea7-39f5-44bf-ac23-72d4ae6cce44\") " pod="openshift-multus/multus-qbjhb"
May 21 17:32:50.776393 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.776237    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f81b0bfa-3067-444d-9daf-734b247ab575-host\") pod \"node-ca-wxdwr\" (UID: \"f81b0bfa-3067-444d-9daf-734b247ab575\") " pod="openshift-image-registry/node-ca-wxdwr"
May 21 17:32:50.776393 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.776226    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e2773ea7-39f5-44bf-ac23-72d4ae6cce44-multus-daemon-config\") pod \"multus-qbjhb\" (UID: \"e2773ea7-39f5-44bf-ac23-72d4ae6cce44\") " pod="openshift-multus/multus-qbjhb"
May 21 17:32:50.776393 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.776261    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e2773ea7-39f5-44bf-ac23-72d4ae6cce44-host-var-lib-cni-multus\") pod \"multus-qbjhb\" (UID: \"e2773ea7-39f5-44bf-ac23-72d4ae6cce44\") " pod="openshift-multus/multus-qbjhb"
May 21 17:32:50.777111 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.776296    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e2773ea7-39f5-44bf-ac23-72d4ae6cce44-os-release\") pod \"multus-qbjhb\" (UID: \"e2773ea7-39f5-44bf-ac23-72d4ae6cce44\") " pod="openshift-multus/multus-qbjhb"
May 21 17:32:50.777111 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.776325    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/cda57dfb-738d-462c-98d6-f8f03db1d69d-agent-certs\") pod \"konnectivity-agent-mjdmf\" (UID: \"cda57dfb-738d-462c-98d6-f8f03db1d69d\") " pod="kube-system/konnectivity-agent-mjdmf"
May 21 17:32:50.777111 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.776353    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e2773ea7-39f5-44bf-ac23-72d4ae6cce44-os-release\") pod \"multus-qbjhb\" (UID: \"e2773ea7-39f5-44bf-ac23-72d4ae6cce44\") " pod="openshift-multus/multus-qbjhb"
May 21 17:32:50.777111 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.776337    2563 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
May 21 17:32:50.777111 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.776363    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e2773ea7-39f5-44bf-ac23-72d4ae6cce44-system-cni-dir\") pod \"multus-qbjhb\" (UID: \"e2773ea7-39f5-44bf-ac23-72d4ae6cce44\") " pod="openshift-multus/multus-qbjhb"
May 21 17:32:50.777111 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.776394    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/39aff25f-af46-4546-bc78-4d19a0c1747a-host-slash\") pod \"ovnkube-node-l26qr\" (UID: \"39aff25f-af46-4546-bc78-4d19a0c1747a\") " pod="openshift-ovn-kubernetes/ovnkube-node-l26qr"
May 21 17:32:50.777111 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.776412    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e2773ea7-39f5-44bf-ac23-72d4ae6cce44-system-cni-dir\") pod \"multus-qbjhb\" (UID: \"e2773ea7-39f5-44bf-ac23-72d4ae6cce44\") " pod="openshift-multus/multus-qbjhb"
May 21 17:32:50.777111 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.776420    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p5fk4\" (UniqueName: \"kubernetes.io/projected/c47ca98f-38f9-4d7d-bae8-b6e89f01fba1-kube-api-access-p5fk4\") pod \"node-resolver-9tfbv\" (UID: \"c47ca98f-38f9-4d7d-bae8-b6e89f01fba1\") " pod="openshift-dns/node-resolver-9tfbv"
May 21 17:32:50.777111 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.776457    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e2773ea7-39f5-44bf-ac23-72d4ae6cce44-cnibin\") pod \"multus-qbjhb\" (UID: \"e2773ea7-39f5-44bf-ac23-72d4ae6cce44\") " pod="openshift-multus/multus-qbjhb"
May 21 17:32:50.777111 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.776471    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/39aff25f-af46-4546-bc78-4d19a0c1747a-host-slash\") pod \"ovnkube-node-l26qr\" (UID: \"39aff25f-af46-4546-bc78-4d19a0c1747a\") " pod="openshift-ovn-kubernetes/ovnkube-node-l26qr"
May 21 17:32:50.777111 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.776485    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6a4c3e7d-e19e-4f8a-bdb5-e1b89087e80a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jkl6g\" (UID: \"6a4c3e7d-e19e-4f8a-bdb5-e1b89087e80a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jkl6g"
May 21 17:32:50.777111 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.776510    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6a4c3e7d-e19e-4f8a-bdb5-e1b89087e80a-socket-dir\") pod \"aws-ebs-csi-driver-node-jkl6g\" (UID: \"6a4c3e7d-e19e-4f8a-bdb5-e1b89087e80a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jkl6g"
May 21 17:32:50.777111 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.776519    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e2773ea7-39f5-44bf-ac23-72d4ae6cce44-cnibin\") pod \"multus-qbjhb\" (UID: \"e2773ea7-39f5-44bf-ac23-72d4ae6cce44\") " pod="openshift-multus/multus-qbjhb"
May 21 17:32:50.777111 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.776535    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bbbebc0e-c07f-479d-add3-16a2e09e96f8-cni-binary-copy\") pod \"multus-additional-cni-plugins-lwm7w\" (UID: \"bbbebc0e-c07f-479d-add3-16a2e09e96f8\") " pod="openshift-multus/multus-additional-cni-plugins-lwm7w"
May 21 17:32:50.777111 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.776561    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e2773ea7-39f5-44bf-ac23-72d4ae6cce44-multus-socket-dir-parent\") pod \"multus-qbjhb\" (UID: \"e2773ea7-39f5-44bf-ac23-72d4ae6cce44\") " pod="openshift-multus/multus-qbjhb"
May 21 17:32:50.777111 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.776573    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6a4c3e7d-e19e-4f8a-bdb5-e1b89087e80a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jkl6g\" (UID: \"6a4c3e7d-e19e-4f8a-bdb5-e1b89087e80a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jkl6g"
May 21 17:32:50.777111 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.776585    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/39aff25f-af46-4546-bc78-4d19a0c1747a-log-socket\") pod \"ovnkube-node-l26qr\" (UID: \"39aff25f-af46-4546-bc78-4d19a0c1747a\") " pod="openshift-ovn-kubernetes/ovnkube-node-l26qr"
May 21 17:32:50.777111 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.776602    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6a4c3e7d-e19e-4f8a-bdb5-e1b89087e80a-socket-dir\") pod \"aws-ebs-csi-driver-node-jkl6g\" (UID: \"6a4c3e7d-e19e-4f8a-bdb5-e1b89087e80a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jkl6g"
May 21 17:32:50.778039 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.776621    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/39aff25f-af46-4546-bc78-4d19a0c1747a-log-socket\") pod \"ovnkube-node-l26qr\" (UID: \"39aff25f-af46-4546-bc78-4d19a0c1747a\") " pod="openshift-ovn-kubernetes/ovnkube-node-l26qr"
May 21 17:32:50.778039 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.776623    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/39aff25f-af46-4546-bc78-4d19a0c1747a-host-run-ovn-kubernetes\") pod \"ovnkube-node-l26qr\" (UID: \"39aff25f-af46-4546-bc78-4d19a0c1747a\") " pod="openshift-ovn-kubernetes/ovnkube-node-l26qr"
May 21 17:32:50.778039 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.776652    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e2773ea7-39f5-44bf-ac23-72d4ae6cce44-multus-socket-dir-parent\") pod \"multus-qbjhb\" (UID: \"e2773ea7-39f5-44bf-ac23-72d4ae6cce44\") " pod="openshift-multus/multus-qbjhb"
May 21 17:32:50.778039 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.776669    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/39aff25f-af46-4546-bc78-4d19a0c1747a-host-run-ovn-kubernetes\") pod \"ovnkube-node-l26qr\" (UID: \"39aff25f-af46-4546-bc78-4d19a0c1747a\") " pod="openshift-ovn-kubernetes/ovnkube-node-l26qr"
May 21 17:32:50.778039 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.776739    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e2773ea7-39f5-44bf-ac23-72d4ae6cce44-multus-daemon-config\") pod \"multus-qbjhb\" (UID: \"e2773ea7-39f5-44bf-ac23-72d4ae6cce44\") " pod="openshift-multus/multus-qbjhb"
May 21 17:32:50.778039 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.776742    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/39aff25f-af46-4546-bc78-4d19a0c1747a-host-cni-netd\") pod \"ovnkube-node-l26qr\" (UID: \"39aff25f-af46-4546-bc78-4d19a0c1747a\") " pod="openshift-ovn-kubernetes/ovnkube-node-l26qr"
May 21 17:32:50.778039 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.776779    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/39aff25f-af46-4546-bc78-4d19a0c1747a-host-cni-netd\") pod \"ovnkube-node-l26qr\" (UID: \"39aff25f-af46-4546-bc78-4d19a0c1747a\") " pod="openshift-ovn-kubernetes/ovnkube-node-l26qr"
May 21 17:32:50.778039 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.776771    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/39aff25f-af46-4546-bc78-4d19a0c1747a-env-overrides\") pod \"ovnkube-node-l26qr\" (UID: \"39aff25f-af46-4546-bc78-4d19a0c1747a\") " pod="openshift-ovn-kubernetes/ovnkube-node-l26qr"
May 21 17:32:50.778039 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.776825    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/39aff25f-af46-4546-bc78-4d19a0c1747a-ovnkube-script-lib\") pod \"ovnkube-node-l26qr\" (UID: \"39aff25f-af46-4546-bc78-4d19a0c1747a\") " pod="openshift-ovn-kubernetes/ovnkube-node-l26qr"
May 21 17:32:50.778039 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.776863    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/81f0d607-ba97-4306-82e3-1d42c03c400f-etc-tuned\") pod \"tuned-tztkr\" (UID: \"81f0d607-ba97-4306-82e3-1d42c03c400f\") " pod="openshift-cluster-node-tuning-operator/tuned-tztkr"
May 21 17:32:50.778039 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.776906    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/81f0d607-ba97-4306-82e3-1d42c03c400f-tmp\") pod \"tuned-tztkr\" (UID: \"81f0d607-ba97-4306-82e3-1d42c03c400f\") " pod="openshift-cluster-node-tuning-operator/tuned-tztkr"
May 21 17:32:50.778039 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.776930    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q24gb\" (UniqueName: \"kubernetes.io/projected/81f0d607-ba97-4306-82e3-1d42c03c400f-kube-api-access-q24gb\") pod \"tuned-tztkr\" (UID: \"81f0d607-ba97-4306-82e3-1d42c03c400f\") " pod="openshift-cluster-node-tuning-operator/tuned-tztkr"
May 21 17:32:50.778039 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.776961    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/bbbebc0e-c07f-479d-add3-16a2e09e96f8-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-lwm7w\" (UID: \"bbbebc0e-c07f-479d-add3-16a2e09e96f8\") " pod="openshift-multus/multus-additional-cni-plugins-lwm7w"
May 21 17:32:50.778039 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.776990    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e2773ea7-39f5-44bf-ac23-72d4ae6cce44-host-var-lib-kubelet\") pod \"multus-qbjhb\" (UID: \"e2773ea7-39f5-44bf-ac23-72d4ae6cce44\") " pod="openshift-multus/multus-qbjhb"
May 21 17:32:50.778039 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.777126    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e2773ea7-39f5-44bf-ac23-72d4ae6cce44-host-var-lib-kubelet\") pod \"multus-qbjhb\" (UID: \"e2773ea7-39f5-44bf-ac23-72d4ae6cce44\") " pod="openshift-multus/multus-qbjhb"
May 21 17:32:50.778039 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.777143    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bbbebc0e-c07f-479d-add3-16a2e09e96f8-cni-binary-copy\") pod \"multus-additional-cni-plugins-lwm7w\" (UID: \"bbbebc0e-c07f-479d-add3-16a2e09e96f8\") " pod="openshift-multus/multus-additional-cni-plugins-lwm7w"
May 21 17:32:50.778039 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.777170    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/68bcb748-24b1-47d9-89a0-443f1ac90b79-iptables-alerter-script\") pod \"iptables-alerter-kzq5f\" (UID: \"68bcb748-24b1-47d9-89a0-443f1ac90b79\") " pod="openshift-network-operator/iptables-alerter-kzq5f"
May 21 17:32:50.778809 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.777197    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/39aff25f-af46-4546-bc78-4d19a0c1747a-ovnkube-config\") pod \"ovnkube-node-l26qr\" (UID: \"39aff25f-af46-4546-bc78-4d19a0c1747a\") " pod="openshift-ovn-kubernetes/ovnkube-node-l26qr"
May 21 17:32:50.778809 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.777250    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/81f0d607-ba97-4306-82e3-1d42c03c400f-etc-sysconfig\") pod \"tuned-tztkr\" (UID: \"81f0d607-ba97-4306-82e3-1d42c03c400f\") " pod="openshift-cluster-node-tuning-operator/tuned-tztkr"
May 21 17:32:50.778809 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.777264    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/39aff25f-af46-4546-bc78-4d19a0c1747a-env-overrides\") pod \"ovnkube-node-l26qr\" (UID: \"39aff25f-af46-4546-bc78-4d19a0c1747a\") " pod="openshift-ovn-kubernetes/ovnkube-node-l26qr"
May 21 17:32:50.778809 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.777293    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/81f0d607-ba97-4306-82e3-1d42c03c400f-etc-sysctl-conf\") pod \"tuned-tztkr\" (UID: \"81f0d607-ba97-4306-82e3-1d42c03c400f\") " pod="openshift-cluster-node-tuning-operator/tuned-tztkr"
May 21 17:32:50.778809 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.777317    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/81f0d607-ba97-4306-82e3-1d42c03c400f-etc-systemd\") pod \"tuned-tztkr\" (UID: \"81f0d607-ba97-4306-82e3-1d42c03c400f\") " pod="openshift-cluster-node-tuning-operator/tuned-tztkr"
May 21 17:32:50.778809 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.777345    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6a4c3e7d-e19e-4f8a-bdb5-e1b89087e80a-device-dir\") pod \"aws-ebs-csi-driver-node-jkl6g\" (UID: \"6a4c3e7d-e19e-4f8a-bdb5-e1b89087e80a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jkl6g"
May 21 17:32:50.778809 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.777369    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hm2vt\" (UniqueName: \"kubernetes.io/projected/6a4c3e7d-e19e-4f8a-bdb5-e1b89087e80a-kube-api-access-hm2vt\") pod \"aws-ebs-csi-driver-node-jkl6g\" (UID: \"6a4c3e7d-e19e-4f8a-bdb5-e1b89087e80a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jkl6g"
May 21 17:32:50.778809 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.777410    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/bbbebc0e-c07f-479d-add3-16a2e09e96f8-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-lwm7w\" (UID: \"bbbebc0e-c07f-479d-add3-16a2e09e96f8\") " pod="openshift-multus/multus-additional-cni-plugins-lwm7w"
May 21 17:32:50.778809 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.777434    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/bbbebc0e-c07f-479d-add3-16a2e09e96f8-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-lwm7w\" (UID: \"bbbebc0e-c07f-479d-add3-16a2e09e96f8\") " pod="openshift-multus/multus-additional-cni-plugins-lwm7w"
May 21 17:32:50.778809 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.777439    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/39aff25f-af46-4546-bc78-4d19a0c1747a-etc-openvswitch\") pod \"ovnkube-node-l26qr\" (UID: \"39aff25f-af46-4546-bc78-4d19a0c1747a\") " pod="openshift-ovn-kubernetes/ovnkube-node-l26qr"
May 21 17:32:50.778809 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.777469    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/39aff25f-af46-4546-bc78-4d19a0c1747a-ovnkube-script-lib\") pod \"ovnkube-node-l26qr\" (UID: \"39aff25f-af46-4546-bc78-4d19a0c1747a\") " pod="openshift-ovn-kubernetes/ovnkube-node-l26qr"
May 21 17:32:50.778809 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.777493    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/39aff25f-af46-4546-bc78-4d19a0c1747a-etc-openvswitch\") pod \"ovnkube-node-l26qr\" (UID: \"39aff25f-af46-4546-bc78-4d19a0c1747a\") " pod="openshift-ovn-kubernetes/ovnkube-node-l26qr"
May 21 17:32:50.778809 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.777485    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/39aff25f-af46-4546-bc78-4d19a0c1747a-node-log\") pod \"ovnkube-node-l26qr\" (UID: \"39aff25f-af46-4546-bc78-4d19a0c1747a\") " pod="openshift-ovn-kubernetes/ovnkube-node-l26qr"
May 21 17:32:50.778809 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.777532    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/81f0d607-ba97-4306-82e3-1d42c03c400f-host\") pod \"tuned-tztkr\" (UID: \"81f0d607-ba97-4306-82e3-1d42c03c400f\") " pod="openshift-cluster-node-tuning-operator/tuned-tztkr"
May 21 17:32:50.778809 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.777559    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e2773ea7-39f5-44bf-ac23-72d4ae6cce44-multus-cni-dir\") pod \"multus-qbjhb\" (UID: \"e2773ea7-39f5-44bf-ac23-72d4ae6cce44\") " pod="openshift-multus/multus-qbjhb"
May 21 17:32:50.778809 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.777586    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e2773ea7-39f5-44bf-ac23-72d4ae6cce44-host-run-netns\") pod \"multus-qbjhb\" (UID: \"e2773ea7-39f5-44bf-ac23-72d4ae6cce44\") " pod="openshift-multus/multus-qbjhb"
May 21 17:32:50.778809 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.777594    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/39aff25f-af46-4546-bc78-4d19a0c1747a-node-log\") pod \"ovnkube-node-l26qr\" (UID: \"39aff25f-af46-4546-bc78-4d19a0c1747a\") " pod="openshift-ovn-kubernetes/ovnkube-node-l26qr"
May 21 17:32:50.779535 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.777623    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c47ca98f-38f9-4d7d-bae8-b6e89f01fba1-hosts-file\") pod \"node-resolver-9tfbv\" (UID: \"c47ca98f-38f9-4d7d-bae8-b6e89f01fba1\") " pod="openshift-dns/node-resolver-9tfbv"
May 21 17:32:50.779535 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.777649    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e2773ea7-39f5-44bf-ac23-72d4ae6cce44-etc-kubernetes\") pod \"multus-qbjhb\" (UID: \"e2773ea7-39f5-44bf-ac23-72d4ae6cce44\") " pod="openshift-multus/multus-qbjhb"
May 21 17:32:50.779535 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.777659    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e2773ea7-39f5-44bf-ac23-72d4ae6cce44-multus-cni-dir\") pod \"multus-qbjhb\" (UID: \"e2773ea7-39f5-44bf-ac23-72d4ae6cce44\") " pod="openshift-multus/multus-qbjhb"
May 21 17:32:50.779535 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.777673    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/39aff25f-af46-4546-bc78-4d19a0c1747a-systemd-units\") pod \"ovnkube-node-l26qr\" (UID: \"39aff25f-af46-4546-bc78-4d19a0c1747a\") " pod="openshift-ovn-kubernetes/ovnkube-node-l26qr"
May 21 17:32:50.779535 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.777684    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/68bcb748-24b1-47d9-89a0-443f1ac90b79-iptables-alerter-script\") pod \"iptables-alerter-kzq5f\" (UID: \"68bcb748-24b1-47d9-89a0-443f1ac90b79\") " pod="openshift-network-operator/iptables-alerter-kzq5f"
May 21 17:32:50.779535 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.777696    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/39aff25f-af46-4546-bc78-4d19a0c1747a-run-ovn\") pod \"ovnkube-node-l26qr\" (UID: \"39aff25f-af46-4546-bc78-4d19a0c1747a\") " pod="openshift-ovn-kubernetes/ovnkube-node-l26qr"
May 21 17:32:50.779535 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.777712    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e2773ea7-39f5-44bf-ac23-72d4ae6cce44-host-run-netns\") pod \"multus-qbjhb\" (UID: \"e2773ea7-39f5-44bf-ac23-72d4ae6cce44\") " pod="openshift-multus/multus-qbjhb"
May 21 17:32:50.779535 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.777731    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/81f0d607-ba97-4306-82e3-1d42c03c400f-lib-modules\") pod \"tuned-tztkr\" (UID: \"81f0d607-ba97-4306-82e3-1d42c03c400f\") " pod="openshift-cluster-node-tuning-operator/tuned-tztkr"
May 21 17:32:50.779535 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.777734    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/39aff25f-af46-4546-bc78-4d19a0c1747a-run-ovn\") pod \"ovnkube-node-l26qr\" (UID: \"39aff25f-af46-4546-bc78-4d19a0c1747a\") " pod="openshift-ovn-kubernetes/ovnkube-node-l26qr"
May 21 17:32:50.779535 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.777758    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/39aff25f-af46-4546-bc78-4d19a0c1747a-host-run-netns\") pod \"ovnkube-node-l26qr\" (UID: \"39aff25f-af46-4546-bc78-4d19a0c1747a\") " pod="openshift-ovn-kubernetes/ovnkube-node-l26qr"
May 21 17:32:50.779535 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.777783    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e2773ea7-39f5-44bf-ac23-72d4ae6cce44-etc-kubernetes\") pod \"multus-qbjhb\" (UID: \"e2773ea7-39f5-44bf-ac23-72d4ae6cce44\") " pod="openshift-multus/multus-qbjhb"
May 21 17:32:50.779535 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.777785    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/cda57dfb-738d-462c-98d6-f8f03db1d69d-konnectivity-ca\") pod \"konnectivity-agent-mjdmf\" (UID: \"cda57dfb-738d-462c-98d6-f8f03db1d69d\") " pod="kube-system/konnectivity-agent-mjdmf"
May 21 17:32:50.779535 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.777816    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6a4c3e7d-e19e-4f8a-bdb5-e1b89087e80a-registration-dir\") pod \"aws-ebs-csi-driver-node-jkl6g\" (UID: \"6a4c3e7d-e19e-4f8a-bdb5-e1b89087e80a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jkl6g"
May 21 17:32:50.779535 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.777844    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bbbebc0e-c07f-479d-add3-16a2e09e96f8-system-cni-dir\") pod \"multus-additional-cni-plugins-lwm7w\" (UID: \"bbbebc0e-c07f-479d-add3-16a2e09e96f8\") " pod="openshift-multus/multus-additional-cni-plugins-lwm7w"
May 21 17:32:50.779535 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.777871    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zlpbc\" (UniqueName: \"kubernetes.io/projected/44544f15-6623-4cbc-876d-2336ac096e94-kube-api-access-zlpbc\") pod \"network-metrics-daemon-5m8k5\" (UID: \"44544f15-6623-4cbc-876d-2336ac096e94\") " pod="openshift-multus/network-metrics-daemon-5m8k5"
May 21 17:32:50.779535 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.777896    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-q88zv\" (UniqueName: \"kubernetes.io/projected/68bcb748-24b1-47d9-89a0-443f1ac90b79-kube-api-access-q88zv\") pod \"iptables-alerter-kzq5f\" (UID: \"68bcb748-24b1-47d9-89a0-443f1ac90b79\") " pod="openshift-network-operator/iptables-alerter-kzq5f"
May 21 17:32:50.779535 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.777935    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/39aff25f-af46-4546-bc78-4d19a0c1747a-host-cni-bin\") pod \"ovnkube-node-l26qr\" (UID: \"39aff25f-af46-4546-bc78-4d19a0c1747a\") " pod="openshift-ovn-kubernetes/ovnkube-node-l26qr"
May 21 17:32:50.780048 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.777966    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6a4c3e7d-e19e-4f8a-bdb5-e1b89087e80a-etc-selinux\") pod \"aws-ebs-csi-driver-node-jkl6g\" (UID: \"6a4c3e7d-e19e-4f8a-bdb5-e1b89087e80a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jkl6g"
May 21 17:32:50.780048 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.777978    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/39aff25f-af46-4546-bc78-4d19a0c1747a-ovnkube-config\") pod \"ovnkube-node-l26qr\" (UID: \"39aff25f-af46-4546-bc78-4d19a0c1747a\") " pod="openshift-ovn-kubernetes/ovnkube-node-l26qr"
May 21 17:32:50.780048 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.777996    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bbbebc0e-c07f-479d-add3-16a2e09e96f8-tuning-conf-dir\") pod \"multus-additional-cni-plugins-lwm7w\" (UID: \"bbbebc0e-c07f-479d-add3-16a2e09e96f8\") " pod="openshift-multus/multus-additional-cni-plugins-lwm7w"
May 21 17:32:50.780048 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.778034    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/44544f15-6623-4cbc-876d-2336ac096e94-metrics-certs\") pod \"network-metrics-daemon-5m8k5\" (UID: \"44544f15-6623-4cbc-876d-2336ac096e94\") " pod="openshift-multus/network-metrics-daemon-5m8k5"
May 21 17:32:50.780048 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.778082    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c47ca98f-38f9-4d7d-bae8-b6e89f01fba1-tmp-dir\") pod \"node-resolver-9tfbv\" (UID: \"c47ca98f-38f9-4d7d-bae8-b6e89f01fba1\") " pod="openshift-dns/node-resolver-9tfbv"
May 21 17:32:50.780048 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.778110    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f81b0bfa-3067-444d-9daf-734b247ab575-serviceca\") pod \"node-ca-wxdwr\" (UID: \"f81b0bfa-3067-444d-9daf-734b247ab575\") " pod="openshift-image-registry/node-ca-wxdwr"
May 21 17:32:50.780048 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.778133    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/39aff25f-af46-4546-bc78-4d19a0c1747a-systemd-units\") pod \"ovnkube-node-l26qr\" (UID: \"39aff25f-af46-4546-bc78-4d19a0c1747a\") " pod="openshift-ovn-kubernetes/ovnkube-node-l26qr"
May 21 17:32:50.780048 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.778139    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bbbebc0e-c07f-479d-add3-16a2e09e96f8-tuning-conf-dir\") pod \"multus-additional-cni-plugins-lwm7w\" (UID: \"bbbebc0e-c07f-479d-add3-16a2e09e96f8\") " pod="openshift-multus/multus-additional-cni-plugins-lwm7w"
May 21 17:32:50.780048 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.778137    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/39aff25f-af46-4546-bc78-4d19a0c1747a-host-cni-bin\") pod \"ovnkube-node-l26qr\" (UID: \"39aff25f-af46-4546-bc78-4d19a0c1747a\") " pod="openshift-ovn-kubernetes/ovnkube-node-l26qr"
May 21 17:32:50.780048 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.778178    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/39aff25f-af46-4546-bc78-4d19a0c1747a-host-kubelet\") pod \"ovnkube-node-l26qr\" (UID: \"39aff25f-af46-4546-bc78-4d19a0c1747a\") " pod="openshift-ovn-kubernetes/ovnkube-node-l26qr"
May 21 17:32:50.780048 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.778136    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/39aff25f-af46-4546-bc78-4d19a0c1747a-host-kubelet\") pod \"ovnkube-node-l26qr\" (UID: \"39aff25f-af46-4546-bc78-4d19a0c1747a\") " pod="openshift-ovn-kubernetes/ovnkube-node-l26qr"
May 21 17:32:50.780048 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.778253    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6a4c3e7d-e19e-4f8a-bdb5-e1b89087e80a-etc-selinux\") pod \"aws-ebs-csi-driver-node-jkl6g\" (UID: \"6a4c3e7d-e19e-4f8a-bdb5-e1b89087e80a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jkl6g"
May 21 17:32:50.780048 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.778288    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/cda57dfb-738d-462c-98d6-f8f03db1d69d-konnectivity-ca\") pod \"konnectivity-agent-mjdmf\" (UID: \"cda57dfb-738d-462c-98d6-f8f03db1d69d\") " pod="kube-system/konnectivity-agent-mjdmf"
May 21 17:32:50.780048 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.778303    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bbbebc0e-c07f-479d-add3-16a2e09e96f8-cnibin\") pod \"multus-additional-cni-plugins-lwm7w\" (UID: \"bbbebc0e-c07f-479d-add3-16a2e09e96f8\") " pod="openshift-multus/multus-additional-cni-plugins-lwm7w"
May 21 17:32:50.780048 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.778332    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/39aff25f-af46-4546-bc78-4d19a0c1747a-run-systemd\") pod \"ovnkube-node-l26qr\" (UID: \"39aff25f-af46-4546-bc78-4d19a0c1747a\") " pod="openshift-ovn-kubernetes/ovnkube-node-l26qr"
May 21 17:32:50.780048 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.778365    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6a4c3e7d-e19e-4f8a-bdb5-e1b89087e80a-sys-fs\") pod \"aws-ebs-csi-driver-node-jkl6g\" (UID: \"6a4c3e7d-e19e-4f8a-bdb5-e1b89087e80a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jkl6g"
May 21 17:32:50.780048 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.778393    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/bbbebc0e-c07f-479d-add3-16a2e09e96f8-os-release\") pod \"multus-additional-cni-plugins-lwm7w\" (UID: \"bbbebc0e-c07f-479d-add3-16a2e09e96f8\") " pod="openshift-multus/multus-additional-cni-plugins-lwm7w"
May 21 17:32:50.780574 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.778396    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/39aff25f-af46-4546-bc78-4d19a0c1747a-run-systemd\") pod \"ovnkube-node-l26qr\" (UID: \"39aff25f-af46-4546-bc78-4d19a0c1747a\") " pod="openshift-ovn-kubernetes/ovnkube-node-l26qr"
May 21 17:32:50.780574 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.778418    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e2773ea7-39f5-44bf-ac23-72d4ae6cce44-cni-binary-copy\") pod \"multus-qbjhb\" (UID: \"e2773ea7-39f5-44bf-ac23-72d4ae6cce44\") " pod="openshift-multus/multus-qbjhb"
May 21 17:32:50.780574 ip-10-0-140-106 kubenswrapper[2563]: E0521 17:32:50.778480    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 17:32:50.780574 ip-10-0-140-106 kubenswrapper[2563]: E0521 17:32:50.778543    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44544f15-6623-4cbc-876d-2336ac096e94-metrics-certs podName:44544f15-6623-4cbc-876d-2336ac096e94 nodeName:}" failed. No retries permitted until 2026-05-21 17:32:51.278512761 +0000 UTC m=+2.055885264 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/44544f15-6623-4cbc-876d-2336ac096e94-metrics-certs") pod "network-metrics-daemon-5m8k5" (UID: "44544f15-6623-4cbc-876d-2336ac096e94") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 17:32:50.780574 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.778652    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f81b0bfa-3067-444d-9daf-734b247ab575-serviceca\") pod \"node-ca-wxdwr\" (UID: \"f81b0bfa-3067-444d-9daf-734b247ab575\") " pod="openshift-image-registry/node-ca-wxdwr"
May 21 17:32:50.780574 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.778653    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/bbbebc0e-c07f-479d-add3-16a2e09e96f8-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-lwm7w\" (UID: \"bbbebc0e-c07f-479d-add3-16a2e09e96f8\") " pod="openshift-multus/multus-additional-cni-plugins-lwm7w"
May 21 17:32:50.780574 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.778682    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bbbebc0e-c07f-479d-add3-16a2e09e96f8-system-cni-dir\") pod \"multus-additional-cni-plugins-lwm7w\" (UID: \"bbbebc0e-c07f-479d-add3-16a2e09e96f8\") " pod="openshift-multus/multus-additional-cni-plugins-lwm7w"
May 21 17:32:50.780574 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.778698    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6a4c3e7d-e19e-4f8a-bdb5-e1b89087e80a-device-dir\") pod \"aws-ebs-csi-driver-node-jkl6g\" (UID: \"6a4c3e7d-e19e-4f8a-bdb5-e1b89087e80a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jkl6g"
May 21 17:32:50.780574 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.778728    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/bbbebc0e-c07f-479d-add3-16a2e09e96f8-os-release\") pod \"multus-additional-cni-plugins-lwm7w\" (UID: \"bbbebc0e-c07f-479d-add3-16a2e09e96f8\") " pod="openshift-multus/multus-additional-cni-plugins-lwm7w"
May 21 17:32:50.780574 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.778732    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/39aff25f-af46-4546-bc78-4d19a0c1747a-host-run-netns\") pod \"ovnkube-node-l26qr\" (UID: \"39aff25f-af46-4546-bc78-4d19a0c1747a\") " pod="openshift-ovn-kubernetes/ovnkube-node-l26qr"
May 21 17:32:50.780574 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.778739    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6a4c3e7d-e19e-4f8a-bdb5-e1b89087e80a-sys-fs\") pod \"aws-ebs-csi-driver-node-jkl6g\" (UID: \"6a4c3e7d-e19e-4f8a-bdb5-e1b89087e80a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jkl6g"
May 21 17:32:50.780574 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.778777    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bbbebc0e-c07f-479d-add3-16a2e09e96f8-cnibin\") pod \"multus-additional-cni-plugins-lwm7w\" (UID: \"bbbebc0e-c07f-479d-add3-16a2e09e96f8\") " pod="openshift-multus/multus-additional-cni-plugins-lwm7w"
May 21 17:32:50.780574 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.778772    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e2773ea7-39f5-44bf-ac23-72d4ae6cce44-host-run-k8s-cni-cncf-io\") pod \"multus-qbjhb\" (UID: \"e2773ea7-39f5-44bf-ac23-72d4ae6cce44\") " pod="openshift-multus/multus-qbjhb"
May 21 17:32:50.780574 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.778807    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e2773ea7-39f5-44bf-ac23-72d4ae6cce44-cni-binary-copy\") pod \"multus-qbjhb\" (UID: \"e2773ea7-39f5-44bf-ac23-72d4ae6cce44\") " pod="openshift-multus/multus-qbjhb"
May 21 17:32:50.780574 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.778815    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2vdfr\" (UniqueName: \"kubernetes.io/projected/e2773ea7-39f5-44bf-ac23-72d4ae6cce44-kube-api-access-2vdfr\") pod \"multus-qbjhb\" (UID: \"e2773ea7-39f5-44bf-ac23-72d4ae6cce44\") " pod="openshift-multus/multus-qbjhb"
May 21 17:32:50.780574 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.778843    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e2773ea7-39f5-44bf-ac23-72d4ae6cce44-host-run-k8s-cni-cncf-io\") pod \"multus-qbjhb\" (UID: \"e2773ea7-39f5-44bf-ac23-72d4ae6cce44\") " pod="openshift-multus/multus-qbjhb"
May 21 17:32:50.780574 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.778845    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/81f0d607-ba97-4306-82e3-1d42c03c400f-etc-modprobe-d\") pod \"tuned-tztkr\" (UID: \"81f0d607-ba97-4306-82e3-1d42c03c400f\") " pod="openshift-cluster-node-tuning-operator/tuned-tztkr"
May 21 17:32:50.781028 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.778865    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6a4c3e7d-e19e-4f8a-bdb5-e1b89087e80a-registration-dir\") pod \"aws-ebs-csi-driver-node-jkl6g\" (UID: \"6a4c3e7d-e19e-4f8a-bdb5-e1b89087e80a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jkl6g"
May 21 17:32:50.781028 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.779594    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/39aff25f-af46-4546-bc78-4d19a0c1747a-ovn-node-metrics-cert\") pod \"ovnkube-node-l26qr\" (UID: \"39aff25f-af46-4546-bc78-4d19a0c1747a\") " pod="openshift-ovn-kubernetes/ovnkube-node-l26qr"
May 21 17:32:50.781028 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.779711    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/cda57dfb-738d-462c-98d6-f8f03db1d69d-agent-certs\") pod \"konnectivity-agent-mjdmf\" (UID: \"cda57dfb-738d-462c-98d6-f8f03db1d69d\") " pod="kube-system/konnectivity-agent-mjdmf"
May 21 17:32:50.782912 ip-10-0-140-106 kubenswrapper[2563]: E0521 17:32:50.782879    2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 21 17:32:50.782912 ip-10-0-140-106 kubenswrapper[2563]: E0521 17:32:50.782902    2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 21 17:32:50.782912 ip-10-0-140-106 kubenswrapper[2563]: E0521 17:32:50.782914    2563 projected.go:194] Error preparing data for projected volume kube-api-access-h2sct for pod openshift-network-diagnostics/network-check-target-7d87n: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 17:32:50.783422 ip-10-0-140-106 kubenswrapper[2563]: E0521 17:32:50.782970    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0ac45335-a985-45d8-be5b-85b5d4bcd78a-kube-api-access-h2sct podName:0ac45335-a985-45d8-be5b-85b5d4bcd78a nodeName:}" failed. No retries permitted until 2026-05-21 17:32:51.282954721 +0000 UTC m=+2.060327206 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-h2sct" (UniqueName: "kubernetes.io/projected/0ac45335-a985-45d8-be5b-85b5d4bcd78a-kube-api-access-h2sct") pod "network-check-target-7d87n" (UID: "0ac45335-a985-45d8-be5b-85b5d4bcd78a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 17:32:50.784583 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.784538    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hxf7p\" (UniqueName: \"kubernetes.io/projected/bbbebc0e-c07f-479d-add3-16a2e09e96f8-kube-api-access-hxf7p\") pod \"multus-additional-cni-plugins-lwm7w\" (UID: \"bbbebc0e-c07f-479d-add3-16a2e09e96f8\") " pod="openshift-multus/multus-additional-cni-plugins-lwm7w"
May 21 17:32:50.784826 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.784785    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7czmb\" (UniqueName: \"kubernetes.io/projected/39aff25f-af46-4546-bc78-4d19a0c1747a-kube-api-access-7czmb\") pod \"ovnkube-node-l26qr\" (UID: \"39aff25f-af46-4546-bc78-4d19a0c1747a\") " pod="openshift-ovn-kubernetes/ovnkube-node-l26qr"
May 21 17:32:50.784965 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.784944    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q2h8x\" (UniqueName: \"kubernetes.io/projected/f81b0bfa-3067-444d-9daf-734b247ab575-kube-api-access-q2h8x\") pod \"node-ca-wxdwr\" (UID: \"f81b0bfa-3067-444d-9daf-734b247ab575\") " pod="openshift-image-registry/node-ca-wxdwr"
May 21 17:32:50.785240 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.785222    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q88zv\" (UniqueName: \"kubernetes.io/projected/68bcb748-24b1-47d9-89a0-443f1ac90b79-kube-api-access-q88zv\") pod \"iptables-alerter-kzq5f\" (UID: \"68bcb748-24b1-47d9-89a0-443f1ac90b79\") " pod="openshift-network-operator/iptables-alerter-kzq5f"
May 21 17:32:50.786593 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.786572    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zlpbc\" (UniqueName: \"kubernetes.io/projected/44544f15-6623-4cbc-876d-2336ac096e94-kube-api-access-zlpbc\") pod \"network-metrics-daemon-5m8k5\" (UID: \"44544f15-6623-4cbc-876d-2336ac096e94\") " pod="openshift-multus/network-metrics-daemon-5m8k5"
May 21 17:32:50.786671 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.786655    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2vdfr\" (UniqueName: \"kubernetes.io/projected/e2773ea7-39f5-44bf-ac23-72d4ae6cce44-kube-api-access-2vdfr\") pod \"multus-qbjhb\" (UID: \"e2773ea7-39f5-44bf-ac23-72d4ae6cce44\") " pod="openshift-multus/multus-qbjhb"
May 21 17:32:50.787010 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.786996    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hm2vt\" (UniqueName: \"kubernetes.io/projected/6a4c3e7d-e19e-4f8a-bdb5-e1b89087e80a-kube-api-access-hm2vt\") pod \"aws-ebs-csi-driver-node-jkl6g\" (UID: \"6a4c3e7d-e19e-4f8a-bdb5-e1b89087e80a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jkl6g"
May 21 17:32:50.801402 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.801367    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-106.ec2.internal" event={"ID":"0842e044b1618ebb8b3bbc536a394d83","Type":"ContainerStarted","Data":"44adbb660238d79ba5350e1d16088c0d6ad016d37000bd4d9e2d3adad25589d6"}
May 21 17:32:50.802322 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.802305    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-106.ec2.internal" event={"ID":"ee738e3c8bad4e84961a8137a36a0108","Type":"ContainerStarted","Data":"0a54ff25f670ae63d9c087e473811ab976d69b8457e4dc1cf852dcdaf9a00969"}
May 21 17:32:50.879881 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.879850    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/81f0d607-ba97-4306-82e3-1d42c03c400f-etc-sysconfig\") pod \"tuned-tztkr\" (UID: \"81f0d607-ba97-4306-82e3-1d42c03c400f\") " pod="openshift-cluster-node-tuning-operator/tuned-tztkr"
May 21 17:32:50.879881 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.879875    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/81f0d607-ba97-4306-82e3-1d42c03c400f-etc-sysctl-conf\") pod \"tuned-tztkr\" (UID: \"81f0d607-ba97-4306-82e3-1d42c03c400f\") " pod="openshift-cluster-node-tuning-operator/tuned-tztkr"
May 21 17:32:50.880039 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.879898    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/81f0d607-ba97-4306-82e3-1d42c03c400f-etc-systemd\") pod \"tuned-tztkr\" (UID: \"81f0d607-ba97-4306-82e3-1d42c03c400f\") " pod="openshift-cluster-node-tuning-operator/tuned-tztkr"
May 21 17:32:50.880039 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.879919    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/81f0d607-ba97-4306-82e3-1d42c03c400f-host\") pod \"tuned-tztkr\" (UID: \"81f0d607-ba97-4306-82e3-1d42c03c400f\") " pod="openshift-cluster-node-tuning-operator/tuned-tztkr"
May 21 17:32:50.880039 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.879925    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/81f0d607-ba97-4306-82e3-1d42c03c400f-etc-sysconfig\") pod \"tuned-tztkr\" (UID: \"81f0d607-ba97-4306-82e3-1d42c03c400f\") " pod="openshift-cluster-node-tuning-operator/tuned-tztkr"
May 21 17:32:50.880039 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.879936    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c47ca98f-38f9-4d7d-bae8-b6e89f01fba1-hosts-file\") pod \"node-resolver-9tfbv\" (UID: \"c47ca98f-38f9-4d7d-bae8-b6e89f01fba1\") " pod="openshift-dns/node-resolver-9tfbv"
May 21 17:32:50.880039 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.879983    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/81f0d607-ba97-4306-82e3-1d42c03c400f-host\") pod \"tuned-tztkr\" (UID: \"81f0d607-ba97-4306-82e3-1d42c03c400f\") " pod="openshift-cluster-node-tuning-operator/tuned-tztkr"
May 21 17:32:50.880039 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.879994    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c47ca98f-38f9-4d7d-bae8-b6e89f01fba1-hosts-file\") pod \"node-resolver-9tfbv\" (UID: \"c47ca98f-38f9-4d7d-bae8-b6e89f01fba1\") " pod="openshift-dns/node-resolver-9tfbv"
May 21 17:32:50.880039 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.880011    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/81f0d607-ba97-4306-82e3-1d42c03c400f-lib-modules\") pod \"tuned-tztkr\" (UID: \"81f0d607-ba97-4306-82e3-1d42c03c400f\") " pod="openshift-cluster-node-tuning-operator/tuned-tztkr"
May 21 17:32:50.880039 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.880005    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/81f0d607-ba97-4306-82e3-1d42c03c400f-etc-systemd\") pod \"tuned-tztkr\" (UID: \"81f0d607-ba97-4306-82e3-1d42c03c400f\") " pod="openshift-cluster-node-tuning-operator/tuned-tztkr"
May 21 17:32:50.880039 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.880014    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/81f0d607-ba97-4306-82e3-1d42c03c400f-etc-sysctl-conf\") pod \"tuned-tztkr\" (UID: \"81f0d607-ba97-4306-82e3-1d42c03c400f\") " pod="openshift-cluster-node-tuning-operator/tuned-tztkr"
May 21 17:32:50.880418 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.880073    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c47ca98f-38f9-4d7d-bae8-b6e89f01fba1-tmp-dir\") pod \"node-resolver-9tfbv\" (UID: \"c47ca98f-38f9-4d7d-bae8-b6e89f01fba1\") " pod="openshift-dns/node-resolver-9tfbv"
May 21 17:32:50.880418 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.880108    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/81f0d607-ba97-4306-82e3-1d42c03c400f-etc-modprobe-d\") pod \"tuned-tztkr\" (UID: \"81f0d607-ba97-4306-82e3-1d42c03c400f\") " pod="openshift-cluster-node-tuning-operator/tuned-tztkr"
May 21 17:32:50.880418 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.880143    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/81f0d607-ba97-4306-82e3-1d42c03c400f-lib-modules\") pod \"tuned-tztkr\" (UID: \"81f0d607-ba97-4306-82e3-1d42c03c400f\") " pod="openshift-cluster-node-tuning-operator/tuned-tztkr"
May 21 17:32:50.880418 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.880170    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/81f0d607-ba97-4306-82e3-1d42c03c400f-run\") pod \"tuned-tztkr\" (UID: \"81f0d607-ba97-4306-82e3-1d42c03c400f\") " pod="openshift-cluster-node-tuning-operator/tuned-tztkr"
May 21 17:32:50.880418 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.880192    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/81f0d607-ba97-4306-82e3-1d42c03c400f-var-lib-kubelet\") pod \"tuned-tztkr\" (UID: \"81f0d607-ba97-4306-82e3-1d42c03c400f\") " pod="openshift-cluster-node-tuning-operator/tuned-tztkr"
May 21 17:32:50.880418 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.880210    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/81f0d607-ba97-4306-82e3-1d42c03c400f-etc-modprobe-d\") pod \"tuned-tztkr\" (UID: \"81f0d607-ba97-4306-82e3-1d42c03c400f\") " pod="openshift-cluster-node-tuning-operator/tuned-tztkr"
May 21 17:32:50.880418 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.880213    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/81f0d607-ba97-4306-82e3-1d42c03c400f-etc-kubernetes\") pod \"tuned-tztkr\" (UID: \"81f0d607-ba97-4306-82e3-1d42c03c400f\") " pod="openshift-cluster-node-tuning-operator/tuned-tztkr"
May 21 17:32:50.880418 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.880243    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/81f0d607-ba97-4306-82e3-1d42c03c400f-etc-sysctl-d\") pod \"tuned-tztkr\" (UID: \"81f0d607-ba97-4306-82e3-1d42c03c400f\") " pod="openshift-cluster-node-tuning-operator/tuned-tztkr"
May 21 17:32:50.880418 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.880242    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/81f0d607-ba97-4306-82e3-1d42c03c400f-run\") pod \"tuned-tztkr\" (UID: \"81f0d607-ba97-4306-82e3-1d42c03c400f\") " pod="openshift-cluster-node-tuning-operator/tuned-tztkr"
May 21 17:32:50.880418 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.880249    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/81f0d607-ba97-4306-82e3-1d42c03c400f-var-lib-kubelet\") pod \"tuned-tztkr\" (UID: \"81f0d607-ba97-4306-82e3-1d42c03c400f\") " pod="openshift-cluster-node-tuning-operator/tuned-tztkr"
May 21 17:32:50.880418 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.880252    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/81f0d607-ba97-4306-82e3-1d42c03c400f-etc-kubernetes\") pod \"tuned-tztkr\" (UID: \"81f0d607-ba97-4306-82e3-1d42c03c400f\") " pod="openshift-cluster-node-tuning-operator/tuned-tztkr"
May 21 17:32:50.880418 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.880279    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/81f0d607-ba97-4306-82e3-1d42c03c400f-sys\") pod \"tuned-tztkr\" (UID: \"81f0d607-ba97-4306-82e3-1d42c03c400f\") " pod="openshift-cluster-node-tuning-operator/tuned-tztkr"
May 21 17:32:50.880418 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.880316    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p5fk4\" (UniqueName: \"kubernetes.io/projected/c47ca98f-38f9-4d7d-bae8-b6e89f01fba1-kube-api-access-p5fk4\") pod \"node-resolver-9tfbv\" (UID: \"c47ca98f-38f9-4d7d-bae8-b6e89f01fba1\") " pod="openshift-dns/node-resolver-9tfbv"
May 21 17:32:50.880418 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.880321    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/81f0d607-ba97-4306-82e3-1d42c03c400f-sys\") pod \"tuned-tztkr\" (UID: \"81f0d607-ba97-4306-82e3-1d42c03c400f\") " pod="openshift-cluster-node-tuning-operator/tuned-tztkr"
May 21 17:32:50.880418 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.880326    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/81f0d607-ba97-4306-82e3-1d42c03c400f-etc-sysctl-d\") pod \"tuned-tztkr\" (UID: \"81f0d607-ba97-4306-82e3-1d42c03c400f\") " pod="openshift-cluster-node-tuning-operator/tuned-tztkr"
May 21 17:32:50.880418 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.880356    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/81f0d607-ba97-4306-82e3-1d42c03c400f-etc-tuned\") pod \"tuned-tztkr\" (UID: \"81f0d607-ba97-4306-82e3-1d42c03c400f\") " pod="openshift-cluster-node-tuning-operator/tuned-tztkr"
May 21 17:32:50.880418 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.880375    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/81f0d607-ba97-4306-82e3-1d42c03c400f-tmp\") pod \"tuned-tztkr\" (UID: \"81f0d607-ba97-4306-82e3-1d42c03c400f\") " pod="openshift-cluster-node-tuning-operator/tuned-tztkr"
May 21 17:32:50.880418 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.880383    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c47ca98f-38f9-4d7d-bae8-b6e89f01fba1-tmp-dir\") pod \"node-resolver-9tfbv\" (UID: \"c47ca98f-38f9-4d7d-bae8-b6e89f01fba1\") " pod="openshift-dns/node-resolver-9tfbv"
May 21 17:32:50.880999 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.880444    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-q24gb\" (UniqueName: \"kubernetes.io/projected/81f0d607-ba97-4306-82e3-1d42c03c400f-kube-api-access-q24gb\") pod \"tuned-tztkr\" (UID: \"81f0d607-ba97-4306-82e3-1d42c03c400f\") " pod="openshift-cluster-node-tuning-operator/tuned-tztkr"
May 21 17:32:50.882185 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.882171    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/81f0d607-ba97-4306-82e3-1d42c03c400f-tmp\") pod \"tuned-tztkr\" (UID: \"81f0d607-ba97-4306-82e3-1d42c03c400f\") " pod="openshift-cluster-node-tuning-operator/tuned-tztkr"
May 21 17:32:50.882233 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.882217    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/81f0d607-ba97-4306-82e3-1d42c03c400f-etc-tuned\") pod \"tuned-tztkr\" (UID: \"81f0d607-ba97-4306-82e3-1d42c03c400f\") " pod="openshift-cluster-node-tuning-operator/tuned-tztkr"
May 21 17:32:50.887799 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.887782    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p5fk4\" (UniqueName: \"kubernetes.io/projected/c47ca98f-38f9-4d7d-bae8-b6e89f01fba1-kube-api-access-p5fk4\") pod \"node-resolver-9tfbv\" (UID: \"c47ca98f-38f9-4d7d-bae8-b6e89f01fba1\") " pod="openshift-dns/node-resolver-9tfbv"
May 21 17:32:50.887851 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.887779    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q24gb\" (UniqueName: \"kubernetes.io/projected/81f0d607-ba97-4306-82e3-1d42c03c400f-kube-api-access-q24gb\") pod \"tuned-tztkr\" (UID: \"81f0d607-ba97-4306-82e3-1d42c03c400f\") " pod="openshift-cluster-node-tuning-operator/tuned-tztkr"
May 21 17:32:50.990713 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:50.990679    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-mjdmf"
May 21 17:32:50.997827 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:50.997798    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcda57dfb_738d_462c_98d6_f8f03db1d69d.slice/crio-a45f049c26ba3082ddaaa9e7b5b5883cb765c860ad39ba71e50bccdab6825db2 WatchSource:0}: Error finding container a45f049c26ba3082ddaaa9e7b5b5883cb765c860ad39ba71e50bccdab6825db2: Status 404 returned error can't find the container with id a45f049c26ba3082ddaaa9e7b5b5883cb765c860ad39ba71e50bccdab6825db2
May 21 17:32:51.020304 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:51.020283    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wxdwr"
May 21 17:32:51.026678 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:51.026659    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-lwm7w"
May 21 17:32:51.026885 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:51.026860    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf81b0bfa_3067_444d_9daf_734b247ab575.slice/crio-2cdcbcaa687c6c1f9aa6eb49b1e77c37da741a112708acbad21356ea0ebb845a WatchSource:0}: Error finding container 2cdcbcaa687c6c1f9aa6eb49b1e77c37da741a112708acbad21356ea0ebb845a: Status 404 returned error can't find the container with id 2cdcbcaa687c6c1f9aa6eb49b1e77c37da741a112708acbad21356ea0ebb845a
May 21 17:32:51.031142 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:51.031121    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-qbjhb"
May 21 17:32:51.033853 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:51.033826    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbbbebc0e_c07f_479d_add3_16a2e09e96f8.slice/crio-3481d1c8704c61a212e44dfa562053503d4c4433bfc5adef847b0afa3b4b37b4 WatchSource:0}: Error finding container 3481d1c8704c61a212e44dfa562053503d4c4433bfc5adef847b0afa3b4b37b4: Status 404 returned error can't find the container with id 3481d1c8704c61a212e44dfa562053503d4c4433bfc5adef847b0afa3b4b37b4
May 21 17:32:51.037475 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:51.037365    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-kzq5f"
May 21 17:32:51.041429 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:51.041402    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2773ea7_39f5_44bf_ac23_72d4ae6cce44.slice/crio-4bc6d7e8b6f78a28e764b448fccd048d7b59277d6b921b0deaaac80d665195b5 WatchSource:0}: Error finding container 4bc6d7e8b6f78a28e764b448fccd048d7b59277d6b921b0deaaac80d665195b5: Status 404 returned error can't find the container with id 4bc6d7e8b6f78a28e764b448fccd048d7b59277d6b921b0deaaac80d665195b5
May 21 17:32:51.044941 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:51.044896    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-l26qr"
May 21 17:32:51.047235 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:51.047213    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68bcb748_24b1_47d9_89a0_443f1ac90b79.slice/crio-e51891dc9374c00928f2a2705f19ce0a6341d8e765019ae2c487ef54b97e1c95 WatchSource:0}: Error finding container e51891dc9374c00928f2a2705f19ce0a6341d8e765019ae2c487ef54b97e1c95: Status 404 returned error can't find the container with id e51891dc9374c00928f2a2705f19ce0a6341d8e765019ae2c487ef54b97e1c95
May 21 17:32:51.050384 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:51.050365    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jkl6g"
May 21 17:32:51.052021 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:51.052001    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39aff25f_af46_4546_bc78_4d19a0c1747a.slice/crio-2872af237ebc9fd8c639ce5fc8ac9c8ff1975f6f2752979a222e537c9b995961 WatchSource:0}: Error finding container 2872af237ebc9fd8c639ce5fc8ac9c8ff1975f6f2752979a222e537c9b995961: Status 404 returned error can't find the container with id 2872af237ebc9fd8c639ce5fc8ac9c8ff1975f6f2752979a222e537c9b995961
May 21 17:32:51.054787 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:51.054764    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-tztkr"
May 21 17:32:51.059630 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:51.059610    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a4c3e7d_e19e_4f8a_bdb5_e1b89087e80a.slice/crio-79b8262ab998bdcbc404d5916c02de6a531856ab6ba2380734561c94c8e5a889 WatchSource:0}: Error finding container 79b8262ab998bdcbc404d5916c02de6a531856ab6ba2380734561c94c8e5a889: Status 404 returned error can't find the container with id 79b8262ab998bdcbc404d5916c02de6a531856ab6ba2380734561c94c8e5a889
May 21 17:32:51.061102 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:51.061083    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-9tfbv"
May 21 17:32:51.062480 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:51.062442    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81f0d607_ba97_4306_82e3_1d42c03c400f.slice/crio-34ef7521fa321fe5b75a9035dbd40109bb0e4c3e4a8a01017ba533982df0360c WatchSource:0}: Error finding container 34ef7521fa321fe5b75a9035dbd40109bb0e4c3e4a8a01017ba533982df0360c: Status 404 returned error can't find the container with id 34ef7521fa321fe5b75a9035dbd40109bb0e4c3e4a8a01017ba533982df0360c
May 21 17:32:51.067582 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:32:51.067561    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc47ca98f_38f9_4d7d_bae8_b6e89f01fba1.slice/crio-5e2e19961e5ed3a2ea74c0f1b068f18ffe802d149d7dd617b810db16875c1b75 WatchSource:0}: Error finding container 5e2e19961e5ed3a2ea74c0f1b068f18ffe802d149d7dd617b810db16875c1b75: Status 404 returned error can't find the container with id 5e2e19961e5ed3a2ea74c0f1b068f18ffe802d149d7dd617b810db16875c1b75
May 21 17:32:51.283296 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:51.283214    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-h2sct\" (UniqueName: \"kubernetes.io/projected/0ac45335-a985-45d8-be5b-85b5d4bcd78a-kube-api-access-h2sct\") pod \"network-check-target-7d87n\" (UID: \"0ac45335-a985-45d8-be5b-85b5d4bcd78a\") " pod="openshift-network-diagnostics/network-check-target-7d87n"
May 21 17:32:51.283445 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:51.283305    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/44544f15-6623-4cbc-876d-2336ac096e94-metrics-certs\") pod \"network-metrics-daemon-5m8k5\" (UID: \"44544f15-6623-4cbc-876d-2336ac096e94\") " pod="openshift-multus/network-metrics-daemon-5m8k5"
May 21 17:32:51.283445 ip-10-0-140-106 kubenswrapper[2563]: E0521 17:32:51.283422    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 17:32:51.283559 ip-10-0-140-106 kubenswrapper[2563]: E0521 17:32:51.283479    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44544f15-6623-4cbc-876d-2336ac096e94-metrics-certs podName:44544f15-6623-4cbc-876d-2336ac096e94 nodeName:}" failed. No retries permitted until 2026-05-21 17:32:52.283461336 +0000 UTC m=+3.060833825 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/44544f15-6623-4cbc-876d-2336ac096e94-metrics-certs") pod "network-metrics-daemon-5m8k5" (UID: "44544f15-6623-4cbc-876d-2336ac096e94") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 17:32:51.283621 ip-10-0-140-106 kubenswrapper[2563]: E0521 17:32:51.283561    2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 21 17:32:51.283621 ip-10-0-140-106 kubenswrapper[2563]: E0521 17:32:51.283574    2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 21 17:32:51.283621 ip-10-0-140-106 kubenswrapper[2563]: E0521 17:32:51.283587    2563 projected.go:194] Error preparing data for projected volume kube-api-access-h2sct for pod openshift-network-diagnostics/network-check-target-7d87n: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 17:32:51.283621 ip-10-0-140-106 kubenswrapper[2563]: E0521 17:32:51.283622    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0ac45335-a985-45d8-be5b-85b5d4bcd78a-kube-api-access-h2sct podName:0ac45335-a985-45d8-be5b-85b5d4bcd78a nodeName:}" failed. No retries permitted until 2026-05-21 17:32:52.283609695 +0000 UTC m=+3.060982185 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-h2sct" (UniqueName: "kubernetes.io/projected/0ac45335-a985-45d8-be5b-85b5d4bcd78a-kube-api-access-h2sct") pod "network-check-target-7d87n" (UID: "0ac45335-a985-45d8-be5b-85b5d4bcd78a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 17:32:51.514922 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:51.514892    2563 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
May 21 17:32:51.710449 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:51.710413    2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-20 17:27:50 +0000 UTC" deadline="2027-11-19 05:19:44.134911454 +0000 UTC"
May 21 17:32:51.710449 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:51.710446    2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13115h46m52.424468736s"
May 21 17:32:51.817900 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:51.817864    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-qbjhb" event={"ID":"e2773ea7-39f5-44bf-ac23-72d4ae6cce44","Type":"ContainerStarted","Data":"4bc6d7e8b6f78a28e764b448fccd048d7b59277d6b921b0deaaac80d665195b5"}
May 21 17:32:51.831513 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:51.831440    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jkl6g" event={"ID":"6a4c3e7d-e19e-4f8a-bdb5-e1b89087e80a","Type":"ContainerStarted","Data":"79b8262ab998bdcbc404d5916c02de6a531856ab6ba2380734561c94c8e5a889"}
May 21 17:32:51.839171 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:51.839140    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-kzq5f" event={"ID":"68bcb748-24b1-47d9-89a0-443f1ac90b79","Type":"ContainerStarted","Data":"e51891dc9374c00928f2a2705f19ce0a6341d8e765019ae2c487ef54b97e1c95"}
May 21 17:32:51.858377 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:51.858350    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lwm7w" event={"ID":"bbbebc0e-c07f-479d-add3-16a2e09e96f8","Type":"ContainerStarted","Data":"3481d1c8704c61a212e44dfa562053503d4c4433bfc5adef847b0afa3b4b37b4"}
May 21 17:32:51.873916 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:51.873887    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wxdwr" event={"ID":"f81b0bfa-3067-444d-9daf-734b247ab575","Type":"ContainerStarted","Data":"2cdcbcaa687c6c1f9aa6eb49b1e77c37da741a112708acbad21356ea0ebb845a"}
May 21 17:32:51.880098 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:51.879992    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-mjdmf" event={"ID":"cda57dfb-738d-462c-98d6-f8f03db1d69d","Type":"ContainerStarted","Data":"a45f049c26ba3082ddaaa9e7b5b5883cb765c860ad39ba71e50bccdab6825db2"}
May 21 17:32:51.889735 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:51.889702    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-9tfbv" event={"ID":"c47ca98f-38f9-4d7d-bae8-b6e89f01fba1","Type":"ContainerStarted","Data":"5e2e19961e5ed3a2ea74c0f1b068f18ffe802d149d7dd617b810db16875c1b75"}
May 21 17:32:51.908069 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:51.908031    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-tztkr" event={"ID":"81f0d607-ba97-4306-82e3-1d42c03c400f","Type":"ContainerStarted","Data":"34ef7521fa321fe5b75a9035dbd40109bb0e4c3e4a8a01017ba533982df0360c"}
May 21 17:32:51.910681 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:51.910658    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l26qr" event={"ID":"39aff25f-af46-4546-bc78-4d19a0c1747a","Type":"ContainerStarted","Data":"2872af237ebc9fd8c639ce5fc8ac9c8ff1975f6f2752979a222e537c9b995961"}
May 21 17:32:52.056892 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:52.056818    2563 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
May 21 17:32:52.148523 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:52.148316    2563 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 21 17:32:52.291041 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:52.291005    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-h2sct\" (UniqueName: \"kubernetes.io/projected/0ac45335-a985-45d8-be5b-85b5d4bcd78a-kube-api-access-h2sct\") pod \"network-check-target-7d87n\" (UID: \"0ac45335-a985-45d8-be5b-85b5d4bcd78a\") " pod="openshift-network-diagnostics/network-check-target-7d87n"
May 21 17:32:52.291237 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:52.291102    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/44544f15-6623-4cbc-876d-2336ac096e94-metrics-certs\") pod \"network-metrics-daemon-5m8k5\" (UID: \"44544f15-6623-4cbc-876d-2336ac096e94\") " pod="openshift-multus/network-metrics-daemon-5m8k5"
May 21 17:32:52.291237 ip-10-0-140-106 kubenswrapper[2563]: E0521 17:32:52.291228    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 17:32:52.291341 ip-10-0-140-106 kubenswrapper[2563]: E0521 17:32:52.291286    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44544f15-6623-4cbc-876d-2336ac096e94-metrics-certs podName:44544f15-6623-4cbc-876d-2336ac096e94 nodeName:}" failed. No retries permitted until 2026-05-21 17:32:54.291268509 +0000 UTC m=+5.068640995 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/44544f15-6623-4cbc-876d-2336ac096e94-metrics-certs") pod "network-metrics-daemon-5m8k5" (UID: "44544f15-6623-4cbc-876d-2336ac096e94") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 17:32:52.291707 ip-10-0-140-106 kubenswrapper[2563]: E0521 17:32:52.291684    2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 21 17:32:52.291802 ip-10-0-140-106 kubenswrapper[2563]: E0521 17:32:52.291711    2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 21 17:32:52.291802 ip-10-0-140-106 kubenswrapper[2563]: E0521 17:32:52.291725    2563 projected.go:194] Error preparing data for projected volume kube-api-access-h2sct for pod openshift-network-diagnostics/network-check-target-7d87n: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 17:32:52.291802 ip-10-0-140-106 kubenswrapper[2563]: E0521 17:32:52.291771    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0ac45335-a985-45d8-be5b-85b5d4bcd78a-kube-api-access-h2sct podName:0ac45335-a985-45d8-be5b-85b5d4bcd78a nodeName:}" failed. No retries permitted until 2026-05-21 17:32:54.291754352 +0000 UTC m=+5.069126840 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-h2sct" (UniqueName: "kubernetes.io/projected/0ac45335-a985-45d8-be5b-85b5d4bcd78a-kube-api-access-h2sct") pod "network-check-target-7d87n" (UID: "0ac45335-a985-45d8-be5b-85b5d4bcd78a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 17:32:52.711357 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:52.711315    2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-20 17:27:50 +0000 UTC" deadline="2028-02-07 17:30:35.239696456 +0000 UTC"
May 21 17:32:52.711357 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:52.711356    2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15047h57m42.528345543s"
May 21 17:32:52.799421 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:52.799393    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7d87n"
May 21 17:32:52.799598 ip-10-0-140-106 kubenswrapper[2563]: E0521 17:32:52.799514    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7d87n" podUID="0ac45335-a985-45d8-be5b-85b5d4bcd78a"
May 21 17:32:52.799978 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:52.799957    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5m8k5"
May 21 17:32:52.800116 ip-10-0-140-106 kubenswrapper[2563]: E0521 17:32:52.800080    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5m8k5" podUID="44544f15-6623-4cbc-876d-2336ac096e94"
May 21 17:32:54.308948 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:54.308909    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/44544f15-6623-4cbc-876d-2336ac096e94-metrics-certs\") pod \"network-metrics-daemon-5m8k5\" (UID: \"44544f15-6623-4cbc-876d-2336ac096e94\") " pod="openshift-multus/network-metrics-daemon-5m8k5"
May 21 17:32:54.309398 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:54.308961    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-h2sct\" (UniqueName: \"kubernetes.io/projected/0ac45335-a985-45d8-be5b-85b5d4bcd78a-kube-api-access-h2sct\") pod \"network-check-target-7d87n\" (UID: \"0ac45335-a985-45d8-be5b-85b5d4bcd78a\") " pod="openshift-network-diagnostics/network-check-target-7d87n"
May 21 17:32:54.309398 ip-10-0-140-106 kubenswrapper[2563]: E0521 17:32:54.309100    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 17:32:54.309398 ip-10-0-140-106 kubenswrapper[2563]: E0521 17:32:54.309122    2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 21 17:32:54.309398 ip-10-0-140-106 kubenswrapper[2563]: E0521 17:32:54.309139    2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 21 17:32:54.309398 ip-10-0-140-106 kubenswrapper[2563]: E0521 17:32:54.309152    2563 projected.go:194] Error preparing data for projected volume kube-api-access-h2sct for pod openshift-network-diagnostics/network-check-target-7d87n: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 17:32:54.309398 ip-10-0-140-106 kubenswrapper[2563]: E0521 17:32:54.309171    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44544f15-6623-4cbc-876d-2336ac096e94-metrics-certs podName:44544f15-6623-4cbc-876d-2336ac096e94 nodeName:}" failed. No retries permitted until 2026-05-21 17:32:58.309150678 +0000 UTC m=+9.086523166 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/44544f15-6623-4cbc-876d-2336ac096e94-metrics-certs") pod "network-metrics-daemon-5m8k5" (UID: "44544f15-6623-4cbc-876d-2336ac096e94") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 17:32:54.309398 ip-10-0-140-106 kubenswrapper[2563]: E0521 17:32:54.309202    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0ac45335-a985-45d8-be5b-85b5d4bcd78a-kube-api-access-h2sct podName:0ac45335-a985-45d8-be5b-85b5d4bcd78a nodeName:}" failed. No retries permitted until 2026-05-21 17:32:58.309185833 +0000 UTC m=+9.086558333 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-h2sct" (UniqueName: "kubernetes.io/projected/0ac45335-a985-45d8-be5b-85b5d4bcd78a-kube-api-access-h2sct") pod "network-check-target-7d87n" (UID: "0ac45335-a985-45d8-be5b-85b5d4bcd78a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 17:32:54.799901 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:54.799869    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7d87n"
May 21 17:32:54.800101 ip-10-0-140-106 kubenswrapper[2563]: E0521 17:32:54.800011    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7d87n" podUID="0ac45335-a985-45d8-be5b-85b5d4bcd78a"
May 21 17:32:54.800101 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:54.799869    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5m8k5"
May 21 17:32:54.800232 ip-10-0-140-106 kubenswrapper[2563]: E0521 17:32:54.800188    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5m8k5" podUID="44544f15-6623-4cbc-876d-2336ac096e94"
May 21 17:32:56.799954 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:56.799915    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7d87n"
May 21 17:32:56.800418 ip-10-0-140-106 kubenswrapper[2563]: E0521 17:32:56.800048    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7d87n" podUID="0ac45335-a985-45d8-be5b-85b5d4bcd78a"
May 21 17:32:56.800495 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:56.799916    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5m8k5"
May 21 17:32:56.800598 ip-10-0-140-106 kubenswrapper[2563]: E0521 17:32:56.800576    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5m8k5" podUID="44544f15-6623-4cbc-876d-2336ac096e94"
May 21 17:32:58.339926 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:58.339845    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/44544f15-6623-4cbc-876d-2336ac096e94-metrics-certs\") pod \"network-metrics-daemon-5m8k5\" (UID: \"44544f15-6623-4cbc-876d-2336ac096e94\") " pod="openshift-multus/network-metrics-daemon-5m8k5"
May 21 17:32:58.339926 ip-10-0-140-106 kubenswrapper[2563]: E0521 17:32:58.339879    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 17:32:58.340472 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:58.339933    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-h2sct\" (UniqueName: \"kubernetes.io/projected/0ac45335-a985-45d8-be5b-85b5d4bcd78a-kube-api-access-h2sct\") pod \"network-check-target-7d87n\" (UID: \"0ac45335-a985-45d8-be5b-85b5d4bcd78a\") " pod="openshift-network-diagnostics/network-check-target-7d87n"
May 21 17:32:58.340472 ip-10-0-140-106 kubenswrapper[2563]: E0521 17:32:58.339951    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44544f15-6623-4cbc-876d-2336ac096e94-metrics-certs podName:44544f15-6623-4cbc-876d-2336ac096e94 nodeName:}" failed. No retries permitted until 2026-05-21 17:33:06.33993393 +0000 UTC m=+17.117306417 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/44544f15-6623-4cbc-876d-2336ac096e94-metrics-certs") pod "network-metrics-daemon-5m8k5" (UID: "44544f15-6623-4cbc-876d-2336ac096e94") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 17:32:58.340472 ip-10-0-140-106 kubenswrapper[2563]: E0521 17:32:58.340038    2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 21 17:32:58.340472 ip-10-0-140-106 kubenswrapper[2563]: E0521 17:32:58.340072    2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 21 17:32:58.340472 ip-10-0-140-106 kubenswrapper[2563]: E0521 17:32:58.340086    2563 projected.go:194] Error preparing data for projected volume kube-api-access-h2sct for pod openshift-network-diagnostics/network-check-target-7d87n: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 17:32:58.340472 ip-10-0-140-106 kubenswrapper[2563]: E0521 17:32:58.340134    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0ac45335-a985-45d8-be5b-85b5d4bcd78a-kube-api-access-h2sct podName:0ac45335-a985-45d8-be5b-85b5d4bcd78a nodeName:}" failed. No retries permitted until 2026-05-21 17:33:06.340119485 +0000 UTC m=+17.117491972 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-h2sct" (UniqueName: "kubernetes.io/projected/0ac45335-a985-45d8-be5b-85b5d4bcd78a-kube-api-access-h2sct") pod "network-check-target-7d87n" (UID: "0ac45335-a985-45d8-be5b-85b5d4bcd78a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 17:32:58.799913 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:58.799680    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7d87n"
May 21 17:32:58.799913 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:32:58.799716    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5m8k5"
May 21 17:32:58.799913 ip-10-0-140-106 kubenswrapper[2563]: E0521 17:32:58.799806    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7d87n" podUID="0ac45335-a985-45d8-be5b-85b5d4bcd78a"
May 21 17:32:58.799913 ip-10-0-140-106 kubenswrapper[2563]: E0521 17:32:58.799887    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5m8k5" podUID="44544f15-6623-4cbc-876d-2336ac096e94"
May 21 17:33:00.799294 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:33:00.799260    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5m8k5"
May 21 17:33:00.799791 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:33:00.799260    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7d87n"
May 21 17:33:00.799791 ip-10-0-140-106 kubenswrapper[2563]: E0521 17:33:00.799400    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5m8k5" podUID="44544f15-6623-4cbc-876d-2336ac096e94"
May 21 17:33:00.799791 ip-10-0-140-106 kubenswrapper[2563]: E0521 17:33:00.799476    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7d87n" podUID="0ac45335-a985-45d8-be5b-85b5d4bcd78a"
May 21 17:33:02.799964 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:33:02.799723    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5m8k5"
May 21 17:33:02.800391 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:33:02.799723    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7d87n"
May 21 17:33:02.800391 ip-10-0-140-106 kubenswrapper[2563]: E0521 17:33:02.800095    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5m8k5" podUID="44544f15-6623-4cbc-876d-2336ac096e94"
May 21 17:33:02.800391 ip-10-0-140-106 kubenswrapper[2563]: E0521 17:33:02.800149    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7d87n" podUID="0ac45335-a985-45d8-be5b-85b5d4bcd78a"
May 21 17:33:04.799307 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:33:04.799269    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7d87n"
May 21 17:33:04.799762 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:33:04.799280    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5m8k5"
May 21 17:33:04.799762 ip-10-0-140-106 kubenswrapper[2563]: E0521 17:33:04.799386    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7d87n" podUID="0ac45335-a985-45d8-be5b-85b5d4bcd78a"
May 21 17:33:04.799762 ip-10-0-140-106 kubenswrapper[2563]: E0521 17:33:04.799445    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5m8k5" podUID="44544f15-6623-4cbc-876d-2336ac096e94"
May 21 17:33:06.400834 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:33:06.400794    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-h2sct\" (UniqueName: \"kubernetes.io/projected/0ac45335-a985-45d8-be5b-85b5d4bcd78a-kube-api-access-h2sct\") pod \"network-check-target-7d87n\" (UID: \"0ac45335-a985-45d8-be5b-85b5d4bcd78a\") " pod="openshift-network-diagnostics/network-check-target-7d87n"
May 21 17:33:06.401313 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:33:06.400887    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/44544f15-6623-4cbc-876d-2336ac096e94-metrics-certs\") pod \"network-metrics-daemon-5m8k5\" (UID: \"44544f15-6623-4cbc-876d-2336ac096e94\") " pod="openshift-multus/network-metrics-daemon-5m8k5"
May 21 17:33:06.401313 ip-10-0-140-106 kubenswrapper[2563]: E0521 17:33:06.400977    2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 21 17:33:06.401313 ip-10-0-140-106 kubenswrapper[2563]: E0521 17:33:06.400996    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 17:33:06.401313 ip-10-0-140-106 kubenswrapper[2563]: E0521 17:33:06.401002    2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 21 17:33:06.401313 ip-10-0-140-106 kubenswrapper[2563]: E0521 17:33:06.401017    2563 projected.go:194] Error preparing data for projected volume kube-api-access-h2sct for pod openshift-network-diagnostics/network-check-target-7d87n: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 17:33:06.401313 ip-10-0-140-106 kubenswrapper[2563]: E0521 17:33:06.401071    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44544f15-6623-4cbc-876d-2336ac096e94-metrics-certs podName:44544f15-6623-4cbc-876d-2336ac096e94 nodeName:}" failed. No retries permitted until 2026-05-21 17:33:22.401035622 +0000 UTC m=+33.178408104 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/44544f15-6623-4cbc-876d-2336ac096e94-metrics-certs") pod "network-metrics-daemon-5m8k5" (UID: "44544f15-6623-4cbc-876d-2336ac096e94") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 17:33:06.401313 ip-10-0-140-106 kubenswrapper[2563]: E0521 17:33:06.401090    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0ac45335-a985-45d8-be5b-85b5d4bcd78a-kube-api-access-h2sct podName:0ac45335-a985-45d8-be5b-85b5d4bcd78a nodeName:}" failed. No retries permitted until 2026-05-21 17:33:22.401080691 +0000 UTC m=+33.178453175 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-h2sct" (UniqueName: "kubernetes.io/projected/0ac45335-a985-45d8-be5b-85b5d4bcd78a-kube-api-access-h2sct") pod "network-check-target-7d87n" (UID: "0ac45335-a985-45d8-be5b-85b5d4bcd78a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 17:33:06.799441 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:33:06.799325    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5m8k5"
May 21 17:33:06.799441 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:33:06.799325    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7d87n"
May 21 17:33:06.799657 ip-10-0-140-106 kubenswrapper[2563]: E0521 17:33:06.799494    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5m8k5" podUID="44544f15-6623-4cbc-876d-2336ac096e94"
May 21 17:33:06.799657 ip-10-0-140-106 kubenswrapper[2563]: E0521 17:33:06.799537    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7d87n" podUID="0ac45335-a985-45d8-be5b-85b5d4bcd78a"
May 21 17:33:08.800052 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:33:08.800015    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7d87n"
May 21 17:33:08.800474 ip-10-0-140-106 kubenswrapper[2563]: E0521 17:33:08.800135    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7d87n" podUID="0ac45335-a985-45d8-be5b-85b5d4bcd78a"
May 21 17:33:08.800474 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:33:08.800196    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5m8k5"
May 21 17:33:08.800474 ip-10-0-140-106 kubenswrapper[2563]: E0521 17:33:08.800317    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5m8k5" podUID="44544f15-6623-4cbc-876d-2336ac096e94"
May 21 17:33:09.948446 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:33:09.948400    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-qbjhb" event={"ID":"e2773ea7-39f5-44bf-ac23-72d4ae6cce44","Type":"ContainerStarted","Data":"cab120dc1f88d9a5f1fc2c5bdc802a8733741466106cec2c1412deb13cb2dfab"}
May 21 17:33:09.956513 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:33:09.956481    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-106.ec2.internal" event={"ID":"0842e044b1618ebb8b3bbc536a394d83","Type":"ContainerStarted","Data":"830f100136c6f4f503690f0493bd3707fcbaa8176bde7c07c4f15a24f7315cd8"}
May 21 17:33:09.964813 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:33:09.964772    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-qbjhb" podStartSLOduration=2.218924783 podStartE2EDuration="20.964760053s" podCreationTimestamp="2026-05-21 17:32:49 +0000 UTC" firstStartedPulling="2026-05-21 17:32:51.04343965 +0000 UTC m=+1.820812136" lastFinishedPulling="2026-05-21 17:33:09.789274909 +0000 UTC m=+20.566647406" observedRunningTime="2026-05-21 17:33:09.964334947 +0000 UTC m=+20.741707455" watchObservedRunningTime="2026-05-21 17:33:09.964760053 +0000 UTC m=+20.742132557"
May 21 17:33:09.977593 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:33:09.977506    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-106.ec2.internal" podStartSLOduration=20.977488566 podStartE2EDuration="20.977488566s" podCreationTimestamp="2026-05-21 17:32:49 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 17:33:09.977033722 +0000 UTC m=+20.754406226" watchObservedRunningTime="2026-05-21 17:33:09.977488566 +0000 UTC m=+20.754861082"
May 21 17:33:09.993293 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:33:09.993252    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-tztkr" podStartSLOduration=2.268955144 podStartE2EDuration="20.993239021s" podCreationTimestamp="2026-05-21 17:32:49 +0000 UTC" firstStartedPulling="2026-05-21 17:32:51.064510263 +0000 UTC m=+1.841882762" lastFinishedPulling="2026-05-21 17:33:09.788794142 +0000 UTC m=+20.566166639" observedRunningTime="2026-05-21 17:33:09.992654378 +0000 UTC m=+20.770026884" watchObservedRunningTime="2026-05-21 17:33:09.993239021 +0000 UTC m=+20.770611525"
May 21 17:33:10.800204 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:33:10.799874    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7d87n"
May 21 17:33:10.800325 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:33:10.799934    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5m8k5"
May 21 17:33:10.800381 ip-10-0-140-106 kubenswrapper[2563]: E0521 17:33:10.800320    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5m8k5" podUID="44544f15-6623-4cbc-876d-2336ac096e94"
May 21 17:33:10.800381 ip-10-0-140-106 kubenswrapper[2563]: E0521 17:33:10.800223    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7d87n" podUID="0ac45335-a985-45d8-be5b-85b5d4bcd78a"
May 21 17:33:10.961983 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:33:10.961951    2563 generic.go:358] "Generic (PLEG): container finished" podID="ee738e3c8bad4e84961a8137a36a0108" containerID="ce47b0df13acd0fffe61ae13a002750225d04b8ac7f1f24009e2b1887e322260" exitCode=0
May 21 17:33:10.962715 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:33:10.962037    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-106.ec2.internal" event={"ID":"ee738e3c8bad4e84961a8137a36a0108","Type":"ContainerDied","Data":"ce47b0df13acd0fffe61ae13a002750225d04b8ac7f1f24009e2b1887e322260"}
May 21 17:33:10.963634 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:33:10.963600    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jkl6g" event={"ID":"6a4c3e7d-e19e-4f8a-bdb5-e1b89087e80a","Type":"ContainerStarted","Data":"cceefacf1e1fa4800958ab03a4fe6c836d0bbbd4cad6e765579cd184029950f9"}
May 21 17:33:10.965154 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:33:10.965124    2563 generic.go:358] "Generic (PLEG): container finished" podID="bbbebc0e-c07f-479d-add3-16a2e09e96f8" containerID="4bf752aa58887aac7dba721099a4feda36076d0334c8de6d37bed633aaa86953" exitCode=0
May 21 17:33:10.965272 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:33:10.965185    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lwm7w" event={"ID":"bbbebc0e-c07f-479d-add3-16a2e09e96f8","Type":"ContainerDied","Data":"4bf752aa58887aac7dba721099a4feda36076d0334c8de6d37bed633aaa86953"}
May 21 17:33:10.967775 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:33:10.967743    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wxdwr" event={"ID":"f81b0bfa-3067-444d-9daf-734b247ab575","Type":"ContainerStarted","Data":"238519039a78d46092dc5f838b8ea9402001dc09147bd5dccc3998bfb6e4000c"}
May 21 17:33:10.970634 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:33:10.970608    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-mjdmf" event={"ID":"cda57dfb-738d-462c-98d6-f8f03db1d69d","Type":"ContainerStarted","Data":"688b4617c49b2330c641270b20ccd539b81fda1de33b580aa7448ea67c6b94bd"}
May 21 17:33:10.971985 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:33:10.971961    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-9tfbv" event={"ID":"c47ca98f-38f9-4d7d-bae8-b6e89f01fba1","Type":"ContainerStarted","Data":"492e2806b91e98d7af4a11aaf4cb8b305140db4500b33518528502eef83dc973"}
May 21 17:33:10.973399 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:33:10.973379    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-tztkr" event={"ID":"81f0d607-ba97-4306-82e3-1d42c03c400f","Type":"ContainerStarted","Data":"59ef5c0393bcd7a576396baf0c55b4c1e6eac6162d06874d32e3f9270682d378"}
May 21 17:33:10.976478 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:33:10.976221    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l26qr" event={"ID":"39aff25f-af46-4546-bc78-4d19a0c1747a","Type":"ContainerStarted","Data":"507494143eea18cb3be9b61a3c5801263bf8f182f1230d7c0cac2edc76b909fe"}
May 21 17:33:10.976478 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:33:10.976250    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l26qr" event={"ID":"39aff25f-af46-4546-bc78-4d19a0c1747a","Type":"ContainerStarted","Data":"f8142a5efbfdf825b715720d6e988370a4c919324796d9900772bcccf4eeec29"}
May 21 17:33:10.976478 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:33:10.976264    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l26qr" event={"ID":"39aff25f-af46-4546-bc78-4d19a0c1747a","Type":"ContainerStarted","Data":"5fea8680bfa89549d36fa04d7c0dab15bbfcabe313846586dd59e779cf8efd8a"}
May 21 17:33:10.976478 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:33:10.976275    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l26qr" event={"ID":"39aff25f-af46-4546-bc78-4d19a0c1747a","Type":"ContainerStarted","Data":"d3a9d321ab1cfe6822c701a8eb4bb1868ca7d3e4eb9d0af9d6ca7bee8a5247f9"}
May 21 17:33:10.976478 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:33:10.976287    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l26qr" event={"ID":"39aff25f-af46-4546-bc78-4d19a0c1747a","Type":"ContainerStarted","Data":"a2c825a9c6fc46f2aa76150121b329a867e8ca191a0f8d52b633ea3d82188971"}
May 21 17:33:10.976478 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:33:10.976295    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l26qr" event={"ID":"39aff25f-af46-4546-bc78-4d19a0c1747a","Type":"ContainerStarted","Data":"8fe985c92ae72fd653c2d5468519877635b1ebf4a1c8ceea95525e2f8c918c83"}
May 21 17:33:10.988323 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:33:10.988284    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-9tfbv" podStartSLOduration=3.268349705 podStartE2EDuration="21.988270045s" podCreationTimestamp="2026-05-21 17:32:49 +0000 UTC" firstStartedPulling="2026-05-21 17:32:51.069356854 +0000 UTC m=+1.846729335" lastFinishedPulling="2026-05-21 17:33:09.789277182 +0000 UTC m=+20.566649675" observedRunningTime="2026-05-21 17:33:10.987850262 +0000 UTC m=+21.765222766" watchObservedRunningTime="2026-05-21 17:33:10.988270045 +0000 UTC m=+21.765642552"
May 21 17:33:11.017960 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:33:11.017907    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-mjdmf" podStartSLOduration=3.260363288 podStartE2EDuration="22.017893725s" podCreationTimestamp="2026-05-21 17:32:49 +0000 UTC" firstStartedPulling="2026-05-21 17:32:50.999793164 +0000 UTC m=+1.777165647" lastFinishedPulling="2026-05-21 17:33:09.757323587 +0000 UTC m=+20.534696084" observedRunningTime="2026-05-21 17:33:10.99987265 +0000 UTC m=+21.777245154" watchObservedRunningTime="2026-05-21 17:33:11.017893725 +0000 UTC m=+21.795266230"
May 21 17:33:11.030322 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:33:11.030277    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-wxdwr" podStartSLOduration=8.017294185 podStartE2EDuration="22.030262468s" podCreationTimestamp="2026-05-21 17:32:49 +0000 UTC" firstStartedPulling="2026-05-21 17:32:51.029647791 +0000 UTC m=+1.807020278" lastFinishedPulling="2026-05-21 17:33:05.042616079 +0000 UTC m=+15.819988561" observedRunningTime="2026-05-21 17:33:11.030083936 +0000 UTC m=+21.807456440" watchObservedRunningTime="2026-05-21 17:33:11.030262468 +0000 UTC m=+21.807634977"
May 21 17:33:11.297546 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:33:11.297521    2563 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
May 21 17:33:11.755394 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:33:11.755269    2563 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-21T17:33:11.297542007Z","UUID":"80a75a61-5888-41e9-b05d-9eb5953b7531","Handler":null,"Name":"","Endpoint":""}
May 21 17:33:11.758809 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:33:11.758778    2563 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
May 21 17:33:11.758809 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:33:11.758808    2563 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
May 21 17:33:11.980407 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:33:11.980347    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-106.ec2.internal" event={"ID":"ee738e3c8bad4e84961a8137a36a0108","Type":"ContainerStarted","Data":"b5d38c9a14ed511036afd71e0f6116ecfbc0e3a9aca3ead962d72810903fdcea"}
May 21 17:33:11.983100 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:33:11.983038    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jkl6g" event={"ID":"6a4c3e7d-e19e-4f8a-bdb5-e1b89087e80a","Type":"ContainerStarted","Data":"88b06754eb17f821eb48d148e72fb50baae37af9d11560421427dc05e163ebb7"}
May 21 17:33:11.985194 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:33:11.985096    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-kzq5f" event={"ID":"68bcb748-24b1-47d9-89a0-443f1ac90b79","Type":"ContainerStarted","Data":"666016de4a9f72a71c6bc86150424a99b0642c1b73f920aafc6f52c972c61d97"}
May 21 17:33:11.994175 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:33:11.994130    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-106.ec2.internal" podStartSLOduration=22.994113959 podStartE2EDuration="22.994113959s" podCreationTimestamp="2026-05-21 17:32:49 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 17:33:11.993695739 +0000 UTC m=+22.771068451" watchObservedRunningTime="2026-05-21 17:33:11.994113959 +0000 UTC m=+22.771486463"
May 21 17:33:12.011471 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:33:12.011384    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-kzq5f" podStartSLOduration=4.302796814 podStartE2EDuration="23.011369392s" podCreationTimestamp="2026-05-21 17:32:49 +0000 UTC" firstStartedPulling="2026-05-21 17:32:51.048887998 +0000 UTC m=+1.826260479" lastFinishedPulling="2026-05-21 17:33:09.757460563 +0000 UTC m=+20.534833057" observedRunningTime="2026-05-21 17:33:12.010554602 +0000 UTC m=+22.787927106" watchObservedRunningTime="2026-05-21 17:33:12.011369392 +0000 UTC m=+22.788741897"
May 21 17:33:12.800087 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:33:12.800045    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7d87n"
May 21 17:33:12.800226 ip-10-0-140-106 kubenswrapper[2563]: E0521 17:33:12.800172    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7d87n" podUID="0ac45335-a985-45d8-be5b-85b5d4bcd78a"
May 21 17:33:12.800226 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:33:12.800216    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5m8k5"
May 21 17:33:12.800344 ip-10-0-140-106 kubenswrapper[2563]: E0521 17:33:12.800325    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5m8k5" podUID="44544f15-6623-4cbc-876d-2336ac096e94"
May 21 17:33:12.990552 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:33:12.990466    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l26qr" event={"ID":"39aff25f-af46-4546-bc78-4d19a0c1747a","Type":"ContainerStarted","Data":"74d95399444a39ebf69f40943b184876c4610734d1bff6c35d6fc6a79225a00d"}
May 21 17:33:12.993133 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:33:12.993098    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jkl6g" event={"ID":"6a4c3e7d-e19e-4f8a-bdb5-e1b89087e80a","Type":"ContainerStarted","Data":"5741225ee31439883ad1cb34ad49e4a1dfa5ffeaa462a22384e2089b3b791b91"}
May 21 17:33:13.009170 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:33:13.009124    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jkl6g" podStartSLOduration=2.626849886 podStartE2EDuration="24.009111903s" podCreationTimestamp="2026-05-21 17:32:49 +0000 UTC" firstStartedPulling="2026-05-21 17:32:51.06173727 +0000 UTC m=+1.839109752" lastFinishedPulling="2026-05-21 17:33:12.443999272 +0000 UTC m=+23.221371769" observedRunningTime="2026-05-21 17:33:13.008692899 +0000 UTC m=+23.786065404" watchObservedRunningTime="2026-05-21 17:33:13.009111903 +0000 UTC m=+23.786484407"
May 21 17:33:14.799383 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:33:14.799356    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5m8k5"
May 21 17:33:14.799815 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:33:14.799357    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7d87n"
May 21 17:33:14.799815 ip-10-0-140-106 kubenswrapper[2563]: E0521 17:33:14.799485    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5m8k5" podUID="44544f15-6623-4cbc-876d-2336ac096e94"
May 21 17:33:14.799815 ip-10-0-140-106 kubenswrapper[2563]: E0521 17:33:14.799537    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7d87n" podUID="0ac45335-a985-45d8-be5b-85b5d4bcd78a"
May 21 17:33:15.770041 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:33:15.769797    2563 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-mjdmf"
May 21 17:33:15.770673 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:33:15.770651    2563 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-mjdmf"
May 21 17:33:16.001179 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:33:16.001139    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l26qr" event={"ID":"39aff25f-af46-4546-bc78-4d19a0c1747a","Type":"ContainerStarted","Data":"07494065005fa0613d21cad7202d194744560703394c7f3ec1f4be24f9c5ef82"}
May 21 17:33:16.001881 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:33:16.001414    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-l26qr"
May 21 17:33:16.001881 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:33:16.001445    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-l26qr"
May 21 17:33:16.001881 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:33:16.001459    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-l26qr"
May 21 17:33:16.002825 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:33:16.002792    2563 generic.go:358] "Generic (PLEG): container finished" podID="bbbebc0e-c07f-479d-add3-16a2e09e96f8" containerID="7442929e3e7dde6be3b91c24a0c8eebcbc7759e6212ced80570f17ec246a834e" exitCode=0
May 21 17:33:16.002941 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:33:16.002847    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lwm7w" event={"ID":"bbbebc0e-c07f-479d-add3-16a2e09e96f8","Type":"ContainerDied","Data":"7442929e3e7dde6be3b91c24a0c8eebcbc7759e6212ced80570f17ec246a834e"}
May 21 17:33:16.016762 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:33:16.016742    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-l26qr"
May 21 17:33:16.016945 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:33:16.016930    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-l26qr"
May 21 17:33:16.031869 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:33:16.031835    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-l26qr" podStartSLOduration=8.202692683 podStartE2EDuration="27.031823305s" podCreationTimestamp="2026-05-21 17:32:49 +0000 UTC" firstStartedPulling="2026-05-21 17:32:51.054120928 +0000 UTC m=+1.831493424" lastFinishedPulling="2026-05-21 17:33:09.883251561 +0000 UTC m=+20.660624046" observedRunningTime="2026-05-21 17:33:16.03155924 +0000 UTC m=+26.808931746" watchObservedRunningTime="2026-05-21 17:33:16.031823305 +0000 UTC m=+26.809195809"
May 21 17:33:16.183898 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:33:16.183817    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-mjdmf"
May 21 17:33:16.184405 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:33:16.184380    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-mjdmf"
May 21 17:33:16.799366 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:33:16.799339    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5m8k5"
May 21 17:33:16.799521 ip-10-0-140-106 kubenswrapper[2563]: E0521 17:33:16.799502    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5m8k5" podUID="44544f15-6623-4cbc-876d-2336ac096e94"
May 21 17:33:16.799583 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:33:16.799566    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7d87n"
May 21 17:33:16.799674 ip-10-0-140-106 kubenswrapper[2563]: E0521 17:33:16.799659    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7d87n" podUID="0ac45335-a985-45d8-be5b-85b5d4bcd78a"
May 21 17:33:17.602168 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:33:17.601989    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-7d87n"]
May 21 17:33:17.602673 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:33:17.602284    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7d87n"
May 21 17:33:17.602673 ip-10-0-140-106 kubenswrapper[2563]: E0521 17:33:17.602391    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7d87n" podUID="0ac45335-a985-45d8-be5b-85b5d4bcd78a"
May 21 17:33:17.602673 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:33:17.602567    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-5m8k5"]
May 21 17:33:17.602805 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:33:17.602682    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5m8k5"
May 21 17:33:17.602848 ip-10-0-140-106 kubenswrapper[2563]: E0521 17:33:17.602818    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5m8k5" podUID="44544f15-6623-4cbc-876d-2336ac096e94"
May 21 17:33:18.007841 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:33:18.007804    2563 generic.go:358] "Generic (PLEG): container finished" podID="bbbebc0e-c07f-479d-add3-16a2e09e96f8" containerID="b9a263d6b81410e2648ceaed873e8c199208afa76fb0421682116c48f08d5a0c" exitCode=0
May 21 17:33:18.007990 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:33:18.007897    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lwm7w" event={"ID":"bbbebc0e-c07f-479d-add3-16a2e09e96f8","Type":"ContainerDied","Data":"b9a263d6b81410e2648ceaed873e8c199208afa76fb0421682116c48f08d5a0c"}
May 21 17:33:19.800616 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:33:19.800589    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5m8k5"
May 21 17:33:19.800962 ip-10-0-140-106 kubenswrapper[2563]: E0521 17:33:19.800685    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5m8k5" podUID="44544f15-6623-4cbc-876d-2336ac096e94"
May 21 17:33:19.800962 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:33:19.800759    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7d87n"
May 21 17:33:19.800962 ip-10-0-140-106 kubenswrapper[2563]: E0521 17:33:19.800836    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7d87n" podUID="0ac45335-a985-45d8-be5b-85b5d4bcd78a"
May 21 17:33:20.016471 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:33:20.016403    2563 generic.go:358] "Generic (PLEG): container finished" podID="bbbebc0e-c07f-479d-add3-16a2e09e96f8" containerID="c85869c10c0767a5a3912b41497e447c5b807d5c3f694f08077ad372f97fb7fb" exitCode=0
May 21 17:33:20.016471 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:33:20.016452    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lwm7w" event={"ID":"bbbebc0e-c07f-479d-add3-16a2e09e96f8","Type":"ContainerDied","Data":"c85869c10c0767a5a3912b41497e447c5b807d5c3f694f08077ad372f97fb7fb"}
May 21 17:33:21.802338 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:33:21.802311    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7d87n"
May 21 17:33:21.802733 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:33:21.802318    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5m8k5"
May 21 17:33:21.802733 ip-10-0-140-106 kubenswrapper[2563]: E0521 17:33:21.802411    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7d87n" podUID="0ac45335-a985-45d8-be5b-85b5d4bcd78a"
May 21 17:33:21.802733 ip-10-0-140-106 kubenswrapper[2563]: E0521 17:33:21.802521    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5m8k5" podUID="44544f15-6623-4cbc-876d-2336ac096e94"
May 21 17:33:22.432915 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:33:22.432886    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/44544f15-6623-4cbc-876d-2336ac096e94-metrics-certs\") pod \"network-metrics-daemon-5m8k5\" (UID: \"44544f15-6623-4cbc-876d-2336ac096e94\") " pod="openshift-multus/network-metrics-daemon-5m8k5"
May 21 17:33:22.433193 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:33:22.432936    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-h2sct\" (UniqueName: \"kubernetes.io/projected/0ac45335-a985-45d8-be5b-85b5d4bcd78a-kube-api-access-h2sct\") pod \"network-check-target-7d87n\" (UID: \"0ac45335-a985-45d8-be5b-85b5d4bcd78a\") " pod="openshift-network-diagnostics/network-check-target-7d87n"
May 21 17:33:22.433193 ip-10-0-140-106 kubenswrapper[2563]: E0521 17:33:22.433031    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 17:33:22.433193 ip-10-0-140-106 kubenswrapper[2563]: E0521 17:33:22.433083    2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 21 17:33:22.433193 ip-10-0-140-106 kubenswrapper[2563]: E0521 17:33:22.433101    2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 21 17:33:22.433193 ip-10-0-140-106 kubenswrapper[2563]: E0521 17:33:22.433111    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44544f15-6623-4cbc-876d-2336ac096e94-metrics-certs podName:44544f15-6623-4cbc-876d-2336ac096e94 nodeName:}" failed. No retries permitted until 2026-05-21 17:33:54.433092881 +0000 UTC m=+65.210465383 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/44544f15-6623-4cbc-876d-2336ac096e94-metrics-certs") pod "network-metrics-daemon-5m8k5" (UID: "44544f15-6623-4cbc-876d-2336ac096e94") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 17:33:22.433193 ip-10-0-140-106 kubenswrapper[2563]: E0521 17:33:22.433114    2563 projected.go:194] Error preparing data for projected volume kube-api-access-h2sct for pod openshift-network-diagnostics/network-check-target-7d87n: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 17:33:22.433193 ip-10-0-140-106 kubenswrapper[2563]: E0521 17:33:22.433162    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0ac45335-a985-45d8-be5b-85b5d4bcd78a-kube-api-access-h2sct podName:0ac45335-a985-45d8-be5b-85b5d4bcd78a nodeName:}" failed. No retries permitted until 2026-05-21 17:33:54.433146245 +0000 UTC m=+65.210518728 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-h2sct" (UniqueName: "kubernetes.io/projected/0ac45335-a985-45d8-be5b-85b5d4bcd78a-kube-api-access-h2sct") pod "network-check-target-7d87n" (UID: "0ac45335-a985-45d8-be5b-85b5d4bcd78a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 17:33:22.532224 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:33:22.532200    2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-106.ec2.internal" event="NodeReady"
May 21 17:33:22.532342 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:33:22.532331    2563 kubelet_node_status.go:550] "Fast updating node status as it just became ready"
May 21 17:33:22.571986 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:33:22.571925    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-d75hh"]
May 21 17:33:22.593763 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:33:22.593736    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-xvxtt"]
May 21 17:33:22.593912 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:33:22.593893    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-d75hh"
May 21 17:33:22.596386 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:33:22.596363    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
May 21 17:33:22.596531 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:33:22.596513    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
May 21 17:33:22.596596 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:33:22.596530    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
May 21 17:33:22.596596 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:33:22.596536    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-7rz88\""
May 21 17:33:22.615587 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:33:22.615565    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-d75hh"]
May 21 17:33:22.615587 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:33:22.615591    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-xvxtt"]
May 21 17:33:22.615738 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:33:22.615701    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xvxtt"
May 21 17:33:22.617979 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:33:22.617959    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
May 21 17:33:22.618100 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:33:22.617986    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
May 21 17:33:22.618100 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:33:22.618018    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-nhpf9\""
May 21 17:33:22.734593 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:33:22.734569    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dbxnv\" (UniqueName: \"kubernetes.io/projected/d8721e69-80fd-48ad-ac87-8f44d8aa94c9-kube-api-access-dbxnv\") pod \"ingress-canary-d75hh\" (UID: \"d8721e69-80fd-48ad-ac87-8f44d8aa94c9\") " pod="openshift-ingress-canary/ingress-canary-d75hh"
May 21 17:33:22.734728 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:33:22.734602    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hn8pk\" (UniqueName: \"kubernetes.io/projected/958fb2fd-9a72-40c2-b659-e99b240176d1-kube-api-access-hn8pk\") pod \"dns-default-xvxtt\" (UID: \"958fb2fd-9a72-40c2-b659-e99b240176d1\") " pod="openshift-dns/dns-default-xvxtt"
May 21 17:33:22.734728 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:33:22.734622    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/958fb2fd-9a72-40c2-b659-e99b240176d1-config-volume\") pod \"dns-default-xvxtt\" (UID: \"958fb2fd-9a72-40c2-b659-e99b240176d1\") " pod="openshift-dns/dns-default-xvxtt"
May 21 17:33:22.734728 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:33:22.734714    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d8721e69-80fd-48ad-ac87-8f44d8aa94c9-cert\") pod \"ingress-canary-d75hh\" (UID: \"d8721e69-80fd-48ad-ac87-8f44d8aa94c9\") " pod="openshift-ingress-canary/ingress-canary-d75hh"
May 21 17:33:22.734870 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:33:22.734745    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/958fb2fd-9a72-40c2-b659-e99b240176d1-metrics-tls\") pod \"dns-default-xvxtt\" (UID: \"958fb2fd-9a72-40c2-b659-e99b240176d1\") " pod="openshift-dns/dns-default-xvxtt"
May 21 17:33:22.734870 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:33:22.734760    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/958fb2fd-9a72-40c2-b659-e99b240176d1-tmp-dir\") pod \"dns-default-xvxtt\" (UID: \"958fb2fd-9a72-40c2-b659-e99b240176d1\") " pod="openshift-dns/dns-default-xvxtt"
May 21 17:33:22.835150 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:33:22.835074    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dbxnv\" (UniqueName: \"kubernetes.io/projected/d8721e69-80fd-48ad-ac87-8f44d8aa94c9-kube-api-access-dbxnv\") pod \"ingress-canary-d75hh\" (UID: \"d8721e69-80fd-48ad-ac87-8f44d8aa94c9\") " pod="openshift-ingress-canary/ingress-canary-d75hh"
May 21 17:33:22.835150 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:33:22.835125    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hn8pk\" (UniqueName: \"kubernetes.io/projected/958fb2fd-9a72-40c2-b659-e99b240176d1-kube-api-access-hn8pk\") pod \"dns-default-xvxtt\" (UID: \"958fb2fd-9a72-40c2-b659-e99b240176d1\") " pod="openshift-dns/dns-default-xvxtt"
May 21 17:33:22.835150 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:33:22.835151    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/958fb2fd-9a72-40c2-b659-e99b240176d1-config-volume\") pod \"dns-default-xvxtt\" (UID: \"958fb2fd-9a72-40c2-b659-e99b240176d1\") " pod="openshift-dns/dns-default-xvxtt"
May 21 17:33:22.835582 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:33:22.835183    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d8721e69-80fd-48ad-ac87-8f44d8aa94c9-cert\") pod \"ingress-canary-d75hh\" (UID: \"d8721e69-80fd-48ad-ac87-8f44d8aa94c9\") " pod="openshift-ingress-canary/ingress-canary-d75hh"
May 21 17:33:22.835582 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:33:22.835202    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/958fb2fd-9a72-40c2-b659-e99b240176d1-metrics-tls\") pod \"dns-default-xvxtt\" (UID: \"958fb2fd-9a72-40c2-b659-e99b240176d1\") " pod="openshift-dns/dns-default-xvxtt"
May 21 17:33:22.835582 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:33:22.835224    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/958fb2fd-9a72-40c2-b659-e99b240176d1-tmp-dir\") pod \"dns-default-xvxtt\" (UID: \"958fb2fd-9a72-40c2-b659-e99b240176d1\") " pod="openshift-dns/dns-default-xvxtt"
May 21 17:33:22.835582 ip-10-0-140-106 kubenswrapper[2563]: E0521 17:33:22.835309    2563 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 21 17:33:22.835582 ip-10-0-140-106 kubenswrapper[2563]: E0521 17:33:22.835363    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8721e69-80fd-48ad-ac87-8f44d8aa94c9-cert podName:d8721e69-80fd-48ad-ac87-8f44d8aa94c9 nodeName:}" failed. No retries permitted until 2026-05-21 17:33:23.335348626 +0000 UTC m=+34.112721112 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/d8721e69-80fd-48ad-ac87-8f44d8aa94c9-cert") pod "ingress-canary-d75hh" (UID: "d8721e69-80fd-48ad-ac87-8f44d8aa94c9") : secret "canary-serving-cert" not found
May 21 17:33:22.835582 ip-10-0-140-106 kubenswrapper[2563]: E0521 17:33:22.835310    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 21 17:33:22.835582 ip-10-0-140-106 kubenswrapper[2563]: E0521 17:33:22.835467    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/958fb2fd-9a72-40c2-b659-e99b240176d1-metrics-tls podName:958fb2fd-9a72-40c2-b659-e99b240176d1 nodeName:}" failed. No retries permitted until 2026-05-21 17:33:23.335449483 +0000 UTC m=+34.112821979 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/958fb2fd-9a72-40c2-b659-e99b240176d1-metrics-tls") pod "dns-default-xvxtt" (UID: "958fb2fd-9a72-40c2-b659-e99b240176d1") : secret "dns-default-metrics-tls" not found
May 21 17:33:22.835582 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:33:22.835555    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/958fb2fd-9a72-40c2-b659-e99b240176d1-tmp-dir\") pod \"dns-default-xvxtt\" (UID: \"958fb2fd-9a72-40c2-b659-e99b240176d1\") " pod="openshift-dns/dns-default-xvxtt"
May 21 17:33:22.835822 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:33:22.835694    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/958fb2fd-9a72-40c2-b659-e99b240176d1-config-volume\") pod \"dns-default-xvxtt\" (UID: \"958fb2fd-9a72-40c2-b659-e99b240176d1\") " pod="openshift-dns/dns-default-xvxtt"
May 21 17:33:22.845030 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:33:22.844901    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hn8pk\" (UniqueName: \"kubernetes.io/projected/958fb2fd-9a72-40c2-b659-e99b240176d1-kube-api-access-hn8pk\") pod \"dns-default-xvxtt\" (UID: \"958fb2fd-9a72-40c2-b659-e99b240176d1\") " pod="openshift-dns/dns-default-xvxtt"
May 21 17:33:22.845139 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:33:22.844907    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dbxnv\" (UniqueName: \"kubernetes.io/projected/d8721e69-80fd-48ad-ac87-8f44d8aa94c9-kube-api-access-dbxnv\") pod \"ingress-canary-d75hh\" (UID: \"d8721e69-80fd-48ad-ac87-8f44d8aa94c9\") " pod="openshift-ingress-canary/ingress-canary-d75hh"
May 21 17:33:23.339697 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:33:23.339663    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d8721e69-80fd-48ad-ac87-8f44d8aa94c9-cert\") pod \"ingress-canary-d75hh\" (UID: \"d8721e69-80fd-48ad-ac87-8f44d8aa94c9\") " pod="openshift-ingress-canary/ingress-canary-d75hh"
May 21 17:33:23.339697 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:33:23.339702    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/958fb2fd-9a72-40c2-b659-e99b240176d1-metrics-tls\") pod \"dns-default-xvxtt\" (UID: \"958fb2fd-9a72-40c2-b659-e99b240176d1\") " pod="openshift-dns/dns-default-xvxtt"
May 21 17:33:23.339937 ip-10-0-140-106 kubenswrapper[2563]: E0521 17:33:23.339820    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 21 17:33:23.339937 ip-10-0-140-106 kubenswrapper[2563]: E0521 17:33:23.339823    2563 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 21 17:33:23.339937 ip-10-0-140-106 kubenswrapper[2563]: E0521 17:33:23.339898    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/958fb2fd-9a72-40c2-b659-e99b240176d1-metrics-tls podName:958fb2fd-9a72-40c2-b659-e99b240176d1 nodeName:}" failed. No retries permitted until 2026-05-21 17:33:24.339877992 +0000 UTC m=+35.117250493 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/958fb2fd-9a72-40c2-b659-e99b240176d1-metrics-tls") pod "dns-default-xvxtt" (UID: "958fb2fd-9a72-40c2-b659-e99b240176d1") : secret "dns-default-metrics-tls" not found
May 21 17:33:23.339937 ip-10-0-140-106 kubenswrapper[2563]: E0521 17:33:23.339918    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8721e69-80fd-48ad-ac87-8f44d8aa94c9-cert podName:d8721e69-80fd-48ad-ac87-8f44d8aa94c9 nodeName:}" failed. No retries permitted until 2026-05-21 17:33:24.339908713 +0000 UTC m=+35.117281197 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/d8721e69-80fd-48ad-ac87-8f44d8aa94c9-cert") pod "ingress-canary-d75hh" (UID: "d8721e69-80fd-48ad-ac87-8f44d8aa94c9") : secret "canary-serving-cert" not found
May 21 17:33:23.799667 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:33:23.799585    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7d87n"
May 21 17:33:23.799823 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:33:23.799796    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5m8k5"
May 21 17:33:23.803290 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:33:23.803260    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 21 17:33:23.803426 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:33:23.803306    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 21 17:33:23.803426 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:33:23.803331    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-jx287\""
May 21 17:33:23.803426 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:33:23.803381    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 21 17:33:23.803595 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:33:23.803536    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-2czh7\""
May 21 17:33:24.345838 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:33:24.345806    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d8721e69-80fd-48ad-ac87-8f44d8aa94c9-cert\") pod \"ingress-canary-d75hh\" (UID: \"d8721e69-80fd-48ad-ac87-8f44d8aa94c9\") " pod="openshift-ingress-canary/ingress-canary-d75hh"
May 21 17:33:24.345838 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:33:24.345840    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/958fb2fd-9a72-40c2-b659-e99b240176d1-metrics-tls\") pod \"dns-default-xvxtt\" (UID: \"958fb2fd-9a72-40c2-b659-e99b240176d1\") " pod="openshift-dns/dns-default-xvxtt"
May 21 17:33:24.346237 ip-10-0-140-106 kubenswrapper[2563]: E0521 17:33:24.345955    2563 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 21 17:33:24.346237 ip-10-0-140-106 kubenswrapper[2563]: E0521 17:33:24.346015    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8721e69-80fd-48ad-ac87-8f44d8aa94c9-cert podName:d8721e69-80fd-48ad-ac87-8f44d8aa94c9 nodeName:}" failed. No retries permitted until 2026-05-21 17:33:26.346001008 +0000 UTC m=+37.123373496 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/d8721e69-80fd-48ad-ac87-8f44d8aa94c9-cert") pod "ingress-canary-d75hh" (UID: "d8721e69-80fd-48ad-ac87-8f44d8aa94c9") : secret "canary-serving-cert" not found
May 21 17:33:24.346237 ip-10-0-140-106 kubenswrapper[2563]: E0521 17:33:24.345955    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 21 17:33:24.346237 ip-10-0-140-106 kubenswrapper[2563]: E0521 17:33:24.346104    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/958fb2fd-9a72-40c2-b659-e99b240176d1-metrics-tls podName:958fb2fd-9a72-40c2-b659-e99b240176d1 nodeName:}" failed. No retries permitted until 2026-05-21 17:33:26.34609141 +0000 UTC m=+37.123463891 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/958fb2fd-9a72-40c2-b659-e99b240176d1-metrics-tls") pod "dns-default-xvxtt" (UID: "958fb2fd-9a72-40c2-b659-e99b240176d1") : secret "dns-default-metrics-tls" not found
May 21 17:33:26.357647 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:33:26.357616    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d8721e69-80fd-48ad-ac87-8f44d8aa94c9-cert\") pod \"ingress-canary-d75hh\" (UID: \"d8721e69-80fd-48ad-ac87-8f44d8aa94c9\") " pod="openshift-ingress-canary/ingress-canary-d75hh"
May 21 17:33:26.357647 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:33:26.357650    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/958fb2fd-9a72-40c2-b659-e99b240176d1-metrics-tls\") pod \"dns-default-xvxtt\" (UID: \"958fb2fd-9a72-40c2-b659-e99b240176d1\") " pod="openshift-dns/dns-default-xvxtt"
May 21 17:33:26.358204 ip-10-0-140-106 kubenswrapper[2563]: E0521 17:33:26.357772    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 21 17:33:26.358204 ip-10-0-140-106 kubenswrapper[2563]: E0521 17:33:26.357828    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/958fb2fd-9a72-40c2-b659-e99b240176d1-metrics-tls podName:958fb2fd-9a72-40c2-b659-e99b240176d1 nodeName:}" failed. No retries permitted until 2026-05-21 17:33:30.3578145 +0000 UTC m=+41.135186981 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/958fb2fd-9a72-40c2-b659-e99b240176d1-metrics-tls") pod "dns-default-xvxtt" (UID: "958fb2fd-9a72-40c2-b659-e99b240176d1") : secret "dns-default-metrics-tls" not found
May 21 17:33:26.358204 ip-10-0-140-106 kubenswrapper[2563]: E0521 17:33:26.357773    2563 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 21 17:33:26.358204 ip-10-0-140-106 kubenswrapper[2563]: E0521 17:33:26.357912    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8721e69-80fd-48ad-ac87-8f44d8aa94c9-cert podName:d8721e69-80fd-48ad-ac87-8f44d8aa94c9 nodeName:}" failed. No retries permitted until 2026-05-21 17:33:30.357898261 +0000 UTC m=+41.135270743 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/d8721e69-80fd-48ad-ac87-8f44d8aa94c9-cert") pod "ingress-canary-d75hh" (UID: "d8721e69-80fd-48ad-ac87-8f44d8aa94c9") : secret "canary-serving-cert" not found
May 21 17:33:27.033636 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:33:27.033596    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lwm7w" event={"ID":"bbbebc0e-c07f-479d-add3-16a2e09e96f8","Type":"ContainerStarted","Data":"d5950f8c92e7f9a09feea6afa34cdfbb4af72b8827784071fd5d44f5fd3a7a12"}
May 21 17:33:28.037446 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:33:28.037400    2563 generic.go:358] "Generic (PLEG): container finished" podID="bbbebc0e-c07f-479d-add3-16a2e09e96f8" containerID="d5950f8c92e7f9a09feea6afa34cdfbb4af72b8827784071fd5d44f5fd3a7a12" exitCode=0
May 21 17:33:28.037943 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:33:28.037454    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lwm7w" event={"ID":"bbbebc0e-c07f-479d-add3-16a2e09e96f8","Type":"ContainerDied","Data":"d5950f8c92e7f9a09feea6afa34cdfbb4af72b8827784071fd5d44f5fd3a7a12"}
May 21 17:33:29.041372 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:33:29.041337    2563 generic.go:358] "Generic (PLEG): container finished" podID="bbbebc0e-c07f-479d-add3-16a2e09e96f8" containerID="5f2364d2052ff6466a1d9f5a8c1d300b8e14fcb6360b761777de91ce9ed34890" exitCode=0
May 21 17:33:29.041731 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:33:29.041398    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lwm7w" event={"ID":"bbbebc0e-c07f-479d-add3-16a2e09e96f8","Type":"ContainerDied","Data":"5f2364d2052ff6466a1d9f5a8c1d300b8e14fcb6360b761777de91ce9ed34890"}
May 21 17:33:30.047753 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:33:30.047372    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lwm7w" event={"ID":"bbbebc0e-c07f-479d-add3-16a2e09e96f8","Type":"ContainerStarted","Data":"cb025d611985bc9e9ab958d46a32049c3d71cd25d5af9a2f46d487974b481d8e"}
May 21 17:33:30.068655 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:33:30.068603    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-lwm7w" podStartSLOduration=5.311264578 podStartE2EDuration="41.068591802s" podCreationTimestamp="2026-05-21 17:32:49 +0000 UTC" firstStartedPulling="2026-05-21 17:32:51.036804443 +0000 UTC m=+1.814176929" lastFinishedPulling="2026-05-21 17:33:26.794131664 +0000 UTC m=+37.571504153" observedRunningTime="2026-05-21 17:33:30.067077519 +0000 UTC m=+40.844450015" watchObservedRunningTime="2026-05-21 17:33:30.068591802 +0000 UTC m=+40.845964305"
May 21 17:33:30.386446 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:33:30.386418    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d8721e69-80fd-48ad-ac87-8f44d8aa94c9-cert\") pod \"ingress-canary-d75hh\" (UID: \"d8721e69-80fd-48ad-ac87-8f44d8aa94c9\") " pod="openshift-ingress-canary/ingress-canary-d75hh"
May 21 17:33:30.386613 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:33:30.386450    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/958fb2fd-9a72-40c2-b659-e99b240176d1-metrics-tls\") pod \"dns-default-xvxtt\" (UID: \"958fb2fd-9a72-40c2-b659-e99b240176d1\") " pod="openshift-dns/dns-default-xvxtt"
May 21 17:33:30.386613 ip-10-0-140-106 kubenswrapper[2563]: E0521 17:33:30.386538    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 21 17:33:30.386613 ip-10-0-140-106 kubenswrapper[2563]: E0521 17:33:30.386540    2563 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 21 17:33:30.386613 ip-10-0-140-106 kubenswrapper[2563]: E0521 17:33:30.386607    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/958fb2fd-9a72-40c2-b659-e99b240176d1-metrics-tls podName:958fb2fd-9a72-40c2-b659-e99b240176d1 nodeName:}" failed. No retries permitted until 2026-05-21 17:33:38.38659236 +0000 UTC m=+49.163964855 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/958fb2fd-9a72-40c2-b659-e99b240176d1-metrics-tls") pod "dns-default-xvxtt" (UID: "958fb2fd-9a72-40c2-b659-e99b240176d1") : secret "dns-default-metrics-tls" not found
May 21 17:33:30.386751 ip-10-0-140-106 kubenswrapper[2563]: E0521 17:33:30.386684    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8721e69-80fd-48ad-ac87-8f44d8aa94c9-cert podName:d8721e69-80fd-48ad-ac87-8f44d8aa94c9 nodeName:}" failed. No retries permitted until 2026-05-21 17:33:38.386669461 +0000 UTC m=+49.164041943 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/d8721e69-80fd-48ad-ac87-8f44d8aa94c9-cert") pod "ingress-canary-d75hh" (UID: "d8721e69-80fd-48ad-ac87-8f44d8aa94c9") : secret "canary-serving-cert" not found
May 21 17:33:38.442765 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:33:38.442727    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d8721e69-80fd-48ad-ac87-8f44d8aa94c9-cert\") pod \"ingress-canary-d75hh\" (UID: \"d8721e69-80fd-48ad-ac87-8f44d8aa94c9\") " pod="openshift-ingress-canary/ingress-canary-d75hh"
May 21 17:33:38.442765 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:33:38.442763    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/958fb2fd-9a72-40c2-b659-e99b240176d1-metrics-tls\") pod \"dns-default-xvxtt\" (UID: \"958fb2fd-9a72-40c2-b659-e99b240176d1\") " pod="openshift-dns/dns-default-xvxtt"
May 21 17:33:38.443322 ip-10-0-140-106 kubenswrapper[2563]: E0521 17:33:38.442858    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 21 17:33:38.443322 ip-10-0-140-106 kubenswrapper[2563]: E0521 17:33:38.442859    2563 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 21 17:33:38.443322 ip-10-0-140-106 kubenswrapper[2563]: E0521 17:33:38.442914    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/958fb2fd-9a72-40c2-b659-e99b240176d1-metrics-tls podName:958fb2fd-9a72-40c2-b659-e99b240176d1 nodeName:}" failed. No retries permitted until 2026-05-21 17:33:54.442901884 +0000 UTC m=+65.220274369 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/958fb2fd-9a72-40c2-b659-e99b240176d1-metrics-tls") pod "dns-default-xvxtt" (UID: "958fb2fd-9a72-40c2-b659-e99b240176d1") : secret "dns-default-metrics-tls" not found
May 21 17:33:38.443322 ip-10-0-140-106 kubenswrapper[2563]: E0521 17:33:38.442929    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8721e69-80fd-48ad-ac87-8f44d8aa94c9-cert podName:d8721e69-80fd-48ad-ac87-8f44d8aa94c9 nodeName:}" failed. No retries permitted until 2026-05-21 17:33:54.44292199 +0000 UTC m=+65.220294472 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/d8721e69-80fd-48ad-ac87-8f44d8aa94c9-cert") pod "ingress-canary-d75hh" (UID: "d8721e69-80fd-48ad-ac87-8f44d8aa94c9") : secret "canary-serving-cert" not found
May 21 17:33:48.026329 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:33:48.026297    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-l26qr"
May 21 17:33:54.442922 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:33:54.442890    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/44544f15-6623-4cbc-876d-2336ac096e94-metrics-certs\") pod \"network-metrics-daemon-5m8k5\" (UID: \"44544f15-6623-4cbc-876d-2336ac096e94\") " pod="openshift-multus/network-metrics-daemon-5m8k5"
May 21 17:33:54.443409 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:33:54.442930    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-h2sct\" (UniqueName: \"kubernetes.io/projected/0ac45335-a985-45d8-be5b-85b5d4bcd78a-kube-api-access-h2sct\") pod \"network-check-target-7d87n\" (UID: \"0ac45335-a985-45d8-be5b-85b5d4bcd78a\") " pod="openshift-network-diagnostics/network-check-target-7d87n"
May 21 17:33:54.443409 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:33:54.442955    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d8721e69-80fd-48ad-ac87-8f44d8aa94c9-cert\") pod \"ingress-canary-d75hh\" (UID: \"d8721e69-80fd-48ad-ac87-8f44d8aa94c9\") " pod="openshift-ingress-canary/ingress-canary-d75hh"
May 21 17:33:54.443409 ip-10-0-140-106 kubenswrapper[2563]: E0521 17:33:54.443049    2563 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 21 17:33:54.443409 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:33:54.443107    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/958fb2fd-9a72-40c2-b659-e99b240176d1-metrics-tls\") pod \"dns-default-xvxtt\" (UID: \"958fb2fd-9a72-40c2-b659-e99b240176d1\") " pod="openshift-dns/dns-default-xvxtt"
May 21 17:33:54.443409 ip-10-0-140-106 kubenswrapper[2563]: E0521 17:33:54.443128    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8721e69-80fd-48ad-ac87-8f44d8aa94c9-cert podName:d8721e69-80fd-48ad-ac87-8f44d8aa94c9 nodeName:}" failed. No retries permitted until 2026-05-21 17:34:26.44311312 +0000 UTC m=+97.220485603 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/d8721e69-80fd-48ad-ac87-8f44d8aa94c9-cert") pod "ingress-canary-d75hh" (UID: "d8721e69-80fd-48ad-ac87-8f44d8aa94c9") : secret "canary-serving-cert" not found
May 21 17:33:54.443409 ip-10-0-140-106 kubenswrapper[2563]: E0521 17:33:54.443192    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 21 17:33:54.443409 ip-10-0-140-106 kubenswrapper[2563]: E0521 17:33:54.443270    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/958fb2fd-9a72-40c2-b659-e99b240176d1-metrics-tls podName:958fb2fd-9a72-40c2-b659-e99b240176d1 nodeName:}" failed. No retries permitted until 2026-05-21 17:34:26.443256783 +0000 UTC m=+97.220629264 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/958fb2fd-9a72-40c2-b659-e99b240176d1-metrics-tls") pod "dns-default-xvxtt" (UID: "958fb2fd-9a72-40c2-b659-e99b240176d1") : secret "dns-default-metrics-tls" not found
May 21 17:33:54.445785 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:33:54.445766    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 21 17:33:54.445829 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:33:54.445813    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 21 17:33:54.453582 ip-10-0-140-106 kubenswrapper[2563]: E0521 17:33:54.453560    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
May 21 17:33:54.453630 ip-10-0-140-106 kubenswrapper[2563]: E0521 17:33:54.453619    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44544f15-6623-4cbc-876d-2336ac096e94-metrics-certs podName:44544f15-6623-4cbc-876d-2336ac096e94 nodeName:}" failed. No retries permitted until 2026-05-21 17:34:58.453607057 +0000 UTC m=+129.230979538 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/44544f15-6623-4cbc-876d-2336ac096e94-metrics-certs") pod "network-metrics-daemon-5m8k5" (UID: "44544f15-6623-4cbc-876d-2336ac096e94") : secret "metrics-daemon-secret" not found
May 21 17:33:54.455408 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:33:54.455391    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 21 17:33:54.466303 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:33:54.466261    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h2sct\" (UniqueName: \"kubernetes.io/projected/0ac45335-a985-45d8-be5b-85b5d4bcd78a-kube-api-access-h2sct\") pod \"network-check-target-7d87n\" (UID: \"0ac45335-a985-45d8-be5b-85b5d4bcd78a\") " pod="openshift-network-diagnostics/network-check-target-7d87n"
May 21 17:33:54.713940 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:33:54.713879    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-2czh7\""
May 21 17:33:54.721907 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:33:54.721889    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7d87n"
May 21 17:33:54.847225 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:33:54.847189    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-7d87n"]
May 21 17:33:54.852728 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:33:54.852168    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ac45335_a985_45d8_be5b_85b5d4bcd78a.slice/crio-0a861857d7cc71fa48099ce374bfff02a81779bd9ad3c96ba9459ead5486933a WatchSource:0}: Error finding container 0a861857d7cc71fa48099ce374bfff02a81779bd9ad3c96ba9459ead5486933a: Status 404 returned error can't find the container with id 0a861857d7cc71fa48099ce374bfff02a81779bd9ad3c96ba9459ead5486933a
May 21 17:33:55.094340 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:33:55.094309    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-7d87n" event={"ID":"0ac45335-a985-45d8-be5b-85b5d4bcd78a","Type":"ContainerStarted","Data":"0a861857d7cc71fa48099ce374bfff02a81779bd9ad3c96ba9459ead5486933a"}
May 21 17:33:58.101874 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:33:58.101832    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-7d87n" event={"ID":"0ac45335-a985-45d8-be5b-85b5d4bcd78a","Type":"ContainerStarted","Data":"c3eeeebf048208c52a3f96f91f656553573b9ec67519d79c620653bf15fd4195"}
May 21 17:33:58.102249 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:33:58.101962    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-7d87n"
May 21 17:33:58.121506 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:33:58.121463    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-7d87n" podStartSLOduration=66.325065365 podStartE2EDuration="1m9.121448826s" podCreationTimestamp="2026-05-21 17:32:49 +0000 UTC" firstStartedPulling="2026-05-21 17:33:54.854122748 +0000 UTC m=+65.631495234" lastFinishedPulling="2026-05-21 17:33:57.650506199 +0000 UTC m=+68.427878695" observedRunningTime="2026-05-21 17:33:58.120608353 +0000 UTC m=+68.897980857" watchObservedRunningTime="2026-05-21 17:33:58.121448826 +0000 UTC m=+68.898821366"
May 21 17:34:26.444969 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:34:26.444933    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d8721e69-80fd-48ad-ac87-8f44d8aa94c9-cert\") pod \"ingress-canary-d75hh\" (UID: \"d8721e69-80fd-48ad-ac87-8f44d8aa94c9\") " pod="openshift-ingress-canary/ingress-canary-d75hh"
May 21 17:34:26.444969 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:34:26.444968    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/958fb2fd-9a72-40c2-b659-e99b240176d1-metrics-tls\") pod \"dns-default-xvxtt\" (UID: \"958fb2fd-9a72-40c2-b659-e99b240176d1\") " pod="openshift-dns/dns-default-xvxtt"
May 21 17:34:26.445533 ip-10-0-140-106 kubenswrapper[2563]: E0521 17:34:26.445073    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 21 17:34:26.445533 ip-10-0-140-106 kubenswrapper[2563]: E0521 17:34:26.445108    2563 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 21 17:34:26.445533 ip-10-0-140-106 kubenswrapper[2563]: E0521 17:34:26.445133    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/958fb2fd-9a72-40c2-b659-e99b240176d1-metrics-tls podName:958fb2fd-9a72-40c2-b659-e99b240176d1 nodeName:}" failed. No retries permitted until 2026-05-21 17:35:30.445119538 +0000 UTC m=+161.222492021 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/958fb2fd-9a72-40c2-b659-e99b240176d1-metrics-tls") pod "dns-default-xvxtt" (UID: "958fb2fd-9a72-40c2-b659-e99b240176d1") : secret "dns-default-metrics-tls" not found
May 21 17:34:26.445533 ip-10-0-140-106 kubenswrapper[2563]: E0521 17:34:26.445182    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8721e69-80fd-48ad-ac87-8f44d8aa94c9-cert podName:d8721e69-80fd-48ad-ac87-8f44d8aa94c9 nodeName:}" failed. No retries permitted until 2026-05-21 17:35:30.445162978 +0000 UTC m=+161.222535477 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/d8721e69-80fd-48ad-ac87-8f44d8aa94c9-cert") pod "ingress-canary-d75hh" (UID: "d8721e69-80fd-48ad-ac87-8f44d8aa94c9") : secret "canary-serving-cert" not found
May 21 17:34:29.105524 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:34:29.105495    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-7d87n"
May 21 17:34:48.369311 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:34:48.369273    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-9zh59"]
May 21 17:34:48.371810 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:34:48.371790    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-5cf9c7f8d-ggtn8"]
May 21 17:34:48.371974 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:34:48.371954    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-78bdfb888c-9zh59"
May 21 17:34:48.373590 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:34:48.373574    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5cf9c7f8d-ggtn8"
May 21 17:34:48.374455 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:34:48.374428    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
May 21 17:34:48.374563 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:34:48.374465    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
May 21 17:34:48.374563 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:34:48.374475    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
May 21 17:34:48.374563 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:34:48.374484    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
May 21 17:34:48.374563 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:34:48.374552    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-79pnj\""
May 21 17:34:48.375796 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:34:48.375778    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
May 21 17:34:48.375857 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:34:48.375822    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
May 21 17:34:48.376254 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:34:48.376238    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
May 21 17:34:48.376396 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:34:48.376383    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
May 21 17:34:48.376450 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:34:48.376388    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-mrknt\""
May 21 17:34:48.376536 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:34:48.376443    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
May 21 17:34:48.376800 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:34:48.376781    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
May 21 17:34:48.380034 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:34:48.380002    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-9zh59"]
May 21 17:34:48.380720 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:34:48.380688    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
May 21 17:34:48.383209 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:34:48.383191    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5cf9c7f8d-ggtn8"]
May 21 17:34:48.482946 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:34:48.482917    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/079fa2fb-e0ca-4997-935e-d3aeba409ed2-serving-cert\") pod \"insights-operator-78bdfb888c-9zh59\" (UID: \"079fa2fb-e0ca-4997-935e-d3aeba409ed2\") " pod="openshift-insights/insights-operator-78bdfb888c-9zh59"
May 21 17:34:48.483095 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:34:48.482965    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/079fa2fb-e0ca-4997-935e-d3aeba409ed2-tmp\") pod \"insights-operator-78bdfb888c-9zh59\" (UID: \"079fa2fb-e0ca-4997-935e-d3aeba409ed2\") " pod="openshift-insights/insights-operator-78bdfb888c-9zh59"
May 21 17:34:48.483095 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:34:48.482986    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/e3134993-804a-42f3-9f38-67aec00d2b8d-stats-auth\") pod \"router-default-5cf9c7f8d-ggtn8\" (UID: \"e3134993-804a-42f3-9f38-67aec00d2b8d\") " pod="openshift-ingress/router-default-5cf9c7f8d-ggtn8"
May 21 17:34:48.483095 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:34:48.483045    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/079fa2fb-e0ca-4997-935e-d3aeba409ed2-snapshots\") pod \"insights-operator-78bdfb888c-9zh59\" (UID: \"079fa2fb-e0ca-4997-935e-d3aeba409ed2\") " pod="openshift-insights/insights-operator-78bdfb888c-9zh59"
May 21 17:34:48.483244 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:34:48.483127    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3134993-804a-42f3-9f38-67aec00d2b8d-service-ca-bundle\") pod \"router-default-5cf9c7f8d-ggtn8\" (UID: \"e3134993-804a-42f3-9f38-67aec00d2b8d\") " pod="openshift-ingress/router-default-5cf9c7f8d-ggtn8"
May 21 17:34:48.483244 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:34:48.483154    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3134993-804a-42f3-9f38-67aec00d2b8d-metrics-certs\") pod \"router-default-5cf9c7f8d-ggtn8\" (UID: \"e3134993-804a-42f3-9f38-67aec00d2b8d\") " pod="openshift-ingress/router-default-5cf9c7f8d-ggtn8"
May 21 17:34:48.483244 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:34:48.483178    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/079fa2fb-e0ca-4997-935e-d3aeba409ed2-service-ca-bundle\") pod \"insights-operator-78bdfb888c-9zh59\" (UID: \"079fa2fb-e0ca-4997-935e-d3aeba409ed2\") " pod="openshift-insights/insights-operator-78bdfb888c-9zh59"
May 21 17:34:48.483244 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:34:48.483192    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lkvvj\" (UniqueName: \"kubernetes.io/projected/079fa2fb-e0ca-4997-935e-d3aeba409ed2-kube-api-access-lkvvj\") pod \"insights-operator-78bdfb888c-9zh59\" (UID: \"079fa2fb-e0ca-4997-935e-d3aeba409ed2\") " pod="openshift-insights/insights-operator-78bdfb888c-9zh59"
May 21 17:34:48.483244 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:34:48.483227    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/e3134993-804a-42f3-9f38-67aec00d2b8d-default-certificate\") pod \"router-default-5cf9c7f8d-ggtn8\" (UID: \"e3134993-804a-42f3-9f38-67aec00d2b8d\") " pod="openshift-ingress/router-default-5cf9c7f8d-ggtn8"
May 21 17:34:48.483412 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:34:48.483251    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rqhqp\" (UniqueName: \"kubernetes.io/projected/e3134993-804a-42f3-9f38-67aec00d2b8d-kube-api-access-rqhqp\") pod \"router-default-5cf9c7f8d-ggtn8\" (UID: \"e3134993-804a-42f3-9f38-67aec00d2b8d\") " pod="openshift-ingress/router-default-5cf9c7f8d-ggtn8"
May 21 17:34:48.483412 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:34:48.483268    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/079fa2fb-e0ca-4997-935e-d3aeba409ed2-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-9zh59\" (UID: \"079fa2fb-e0ca-4997-935e-d3aeba409ed2\") " pod="openshift-insights/insights-operator-78bdfb888c-9zh59"
May 21 17:34:48.584223 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:34:48.584195    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3134993-804a-42f3-9f38-67aec00d2b8d-service-ca-bundle\") pod \"router-default-5cf9c7f8d-ggtn8\" (UID: \"e3134993-804a-42f3-9f38-67aec00d2b8d\") " pod="openshift-ingress/router-default-5cf9c7f8d-ggtn8"
May 21 17:34:48.584352 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:34:48.584230    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3134993-804a-42f3-9f38-67aec00d2b8d-metrics-certs\") pod \"router-default-5cf9c7f8d-ggtn8\" (UID: \"e3134993-804a-42f3-9f38-67aec00d2b8d\") " pod="openshift-ingress/router-default-5cf9c7f8d-ggtn8"
May 21 17:34:48.584352 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:34:48.584255    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/079fa2fb-e0ca-4997-935e-d3aeba409ed2-service-ca-bundle\") pod \"insights-operator-78bdfb888c-9zh59\" (UID: \"079fa2fb-e0ca-4997-935e-d3aeba409ed2\") " pod="openshift-insights/insights-operator-78bdfb888c-9zh59"
May 21 17:34:48.584352 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:34:48.584278    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lkvvj\" (UniqueName: \"kubernetes.io/projected/079fa2fb-e0ca-4997-935e-d3aeba409ed2-kube-api-access-lkvvj\") pod \"insights-operator-78bdfb888c-9zh59\" (UID: \"079fa2fb-e0ca-4997-935e-d3aeba409ed2\") " pod="openshift-insights/insights-operator-78bdfb888c-9zh59"
May 21 17:34:48.584352 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:34:48.584320    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/e3134993-804a-42f3-9f38-67aec00d2b8d-default-certificate\") pod \"router-default-5cf9c7f8d-ggtn8\" (UID: \"e3134993-804a-42f3-9f38-67aec00d2b8d\") " pod="openshift-ingress/router-default-5cf9c7f8d-ggtn8"
May 21 17:34:48.584352 ip-10-0-140-106 kubenswrapper[2563]: E0521 17:34:48.584341    2563 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
May 21 17:34:48.584586 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:34:48.584345    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rqhqp\" (UniqueName: \"kubernetes.io/projected/e3134993-804a-42f3-9f38-67aec00d2b8d-kube-api-access-rqhqp\") pod \"router-default-5cf9c7f8d-ggtn8\" (UID: \"e3134993-804a-42f3-9f38-67aec00d2b8d\") " pod="openshift-ingress/router-default-5cf9c7f8d-ggtn8"
May 21 17:34:48.584586 ip-10-0-140-106 kubenswrapper[2563]: E0521 17:34:48.584404    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e3134993-804a-42f3-9f38-67aec00d2b8d-service-ca-bundle podName:e3134993-804a-42f3-9f38-67aec00d2b8d nodeName:}" failed. No retries permitted until 2026-05-21 17:34:49.084364355 +0000 UTC m=+119.861736860 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/e3134993-804a-42f3-9f38-67aec00d2b8d-service-ca-bundle") pod "router-default-5cf9c7f8d-ggtn8" (UID: "e3134993-804a-42f3-9f38-67aec00d2b8d") : configmap references non-existent config key: service-ca.crt
May 21 17:34:48.584586 ip-10-0-140-106 kubenswrapper[2563]: E0521 17:34:48.584434    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3134993-804a-42f3-9f38-67aec00d2b8d-metrics-certs podName:e3134993-804a-42f3-9f38-67aec00d2b8d nodeName:}" failed. No retries permitted until 2026-05-21 17:34:49.084425579 +0000 UTC m=+119.861798061 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e3134993-804a-42f3-9f38-67aec00d2b8d-metrics-certs") pod "router-default-5cf9c7f8d-ggtn8" (UID: "e3134993-804a-42f3-9f38-67aec00d2b8d") : secret "router-metrics-certs-default" not found
May 21 17:34:48.584586 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:34:48.584456    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/079fa2fb-e0ca-4997-935e-d3aeba409ed2-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-9zh59\" (UID: \"079fa2fb-e0ca-4997-935e-d3aeba409ed2\") " pod="openshift-insights/insights-operator-78bdfb888c-9zh59"
May 21 17:34:48.584586 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:34:48.584485    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/079fa2fb-e0ca-4997-935e-d3aeba409ed2-serving-cert\") pod \"insights-operator-78bdfb888c-9zh59\" (UID: \"079fa2fb-e0ca-4997-935e-d3aeba409ed2\") " pod="openshift-insights/insights-operator-78bdfb888c-9zh59"
May 21 17:34:48.584586 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:34:48.584509    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/079fa2fb-e0ca-4997-935e-d3aeba409ed2-tmp\") pod \"insights-operator-78bdfb888c-9zh59\" (UID: \"079fa2fb-e0ca-4997-935e-d3aeba409ed2\") " pod="openshift-insights/insights-operator-78bdfb888c-9zh59"
May 21 17:34:48.584586 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:34:48.584530    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/e3134993-804a-42f3-9f38-67aec00d2b8d-stats-auth\") pod \"router-default-5cf9c7f8d-ggtn8\" (UID: \"e3134993-804a-42f3-9f38-67aec00d2b8d\") " pod="openshift-ingress/router-default-5cf9c7f8d-ggtn8"
May 21 17:34:48.584586 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:34:48.584566    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/079fa2fb-e0ca-4997-935e-d3aeba409ed2-snapshots\") pod \"insights-operator-78bdfb888c-9zh59\" (UID: \"079fa2fb-e0ca-4997-935e-d3aeba409ed2\") " pod="openshift-insights/insights-operator-78bdfb888c-9zh59"
May 21 17:34:48.584979 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:34:48.584900    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/079fa2fb-e0ca-4997-935e-d3aeba409ed2-service-ca-bundle\") pod \"insights-operator-78bdfb888c-9zh59\" (UID: \"079fa2fb-e0ca-4997-935e-d3aeba409ed2\") " pod="openshift-insights/insights-operator-78bdfb888c-9zh59"
May 21 17:34:48.585085 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:34:48.585044    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/079fa2fb-e0ca-4997-935e-d3aeba409ed2-tmp\") pod \"insights-operator-78bdfb888c-9zh59\" (UID: \"079fa2fb-e0ca-4997-935e-d3aeba409ed2\") " pod="openshift-insights/insights-operator-78bdfb888c-9zh59"
May 21 17:34:48.585156 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:34:48.585131    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/079fa2fb-e0ca-4997-935e-d3aeba409ed2-snapshots\") pod \"insights-operator-78bdfb888c-9zh59\" (UID: \"079fa2fb-e0ca-4997-935e-d3aeba409ed2\") " pod="openshift-insights/insights-operator-78bdfb888c-9zh59"
May 21 17:34:48.585615 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:34:48.585590    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/079fa2fb-e0ca-4997-935e-d3aeba409ed2-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-9zh59\" (UID: \"079fa2fb-e0ca-4997-935e-d3aeba409ed2\") " pod="openshift-insights/insights-operator-78bdfb888c-9zh59"
May 21 17:34:48.586861 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:34:48.586835    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/e3134993-804a-42f3-9f38-67aec00d2b8d-stats-auth\") pod \"router-default-5cf9c7f8d-ggtn8\" (UID: \"e3134993-804a-42f3-9f38-67aec00d2b8d\") " pod="openshift-ingress/router-default-5cf9c7f8d-ggtn8"
May 21 17:34:48.586861 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:34:48.586845    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/079fa2fb-e0ca-4997-935e-d3aeba409ed2-serving-cert\") pod \"insights-operator-78bdfb888c-9zh59\" (UID: \"079fa2fb-e0ca-4997-935e-d3aeba409ed2\") " pod="openshift-insights/insights-operator-78bdfb888c-9zh59"
May 21 17:34:48.586861 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:34:48.586859    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/e3134993-804a-42f3-9f38-67aec00d2b8d-default-certificate\") pod \"router-default-5cf9c7f8d-ggtn8\" (UID: \"e3134993-804a-42f3-9f38-67aec00d2b8d\") " pod="openshift-ingress/router-default-5cf9c7f8d-ggtn8"
May 21 17:34:48.593185 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:34:48.593165    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rqhqp\" (UniqueName: \"kubernetes.io/projected/e3134993-804a-42f3-9f38-67aec00d2b8d-kube-api-access-rqhqp\") pod \"router-default-5cf9c7f8d-ggtn8\" (UID: \"e3134993-804a-42f3-9f38-67aec00d2b8d\") " pod="openshift-ingress/router-default-5cf9c7f8d-ggtn8"
May 21 17:34:48.593277 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:34:48.593174    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lkvvj\" (UniqueName: \"kubernetes.io/projected/079fa2fb-e0ca-4997-935e-d3aeba409ed2-kube-api-access-lkvvj\") pod \"insights-operator-78bdfb888c-9zh59\" (UID: \"079fa2fb-e0ca-4997-935e-d3aeba409ed2\") " pod="openshift-insights/insights-operator-78bdfb888c-9zh59"
May 21 17:34:48.684469 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:34:48.684419    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-78bdfb888c-9zh59"
May 21 17:34:48.801098 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:34:48.801052    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-9zh59"]
May 21 17:34:48.801421 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:34:48.801400    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod079fa2fb_e0ca_4997_935e_d3aeba409ed2.slice/crio-b3134c14b4bfde2d8fb71259546407609e3aef6ea0faccedc0414cd4c291c5eb WatchSource:0}: Error finding container b3134c14b4bfde2d8fb71259546407609e3aef6ea0faccedc0414cd4c291c5eb: Status 404 returned error can't find the container with id b3134c14b4bfde2d8fb71259546407609e3aef6ea0faccedc0414cd4c291c5eb
May 21 17:34:49.088996 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:34:49.088966    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3134993-804a-42f3-9f38-67aec00d2b8d-service-ca-bundle\") pod \"router-default-5cf9c7f8d-ggtn8\" (UID: \"e3134993-804a-42f3-9f38-67aec00d2b8d\") " pod="openshift-ingress/router-default-5cf9c7f8d-ggtn8"
May 21 17:34:49.089148 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:34:49.089003    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3134993-804a-42f3-9f38-67aec00d2b8d-metrics-certs\") pod \"router-default-5cf9c7f8d-ggtn8\" (UID: \"e3134993-804a-42f3-9f38-67aec00d2b8d\") " pod="openshift-ingress/router-default-5cf9c7f8d-ggtn8"
May 21 17:34:49.089148 ip-10-0-140-106 kubenswrapper[2563]: E0521 17:34:49.089116    2563 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
May 21 17:34:49.089227 ip-10-0-140-106 kubenswrapper[2563]: E0521 17:34:49.089167    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e3134993-804a-42f3-9f38-67aec00d2b8d-service-ca-bundle podName:e3134993-804a-42f3-9f38-67aec00d2b8d nodeName:}" failed. No retries permitted until 2026-05-21 17:34:50.089150086 +0000 UTC m=+120.866522572 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/e3134993-804a-42f3-9f38-67aec00d2b8d-service-ca-bundle") pod "router-default-5cf9c7f8d-ggtn8" (UID: "e3134993-804a-42f3-9f38-67aec00d2b8d") : configmap references non-existent config key: service-ca.crt
May 21 17:34:49.089227 ip-10-0-140-106 kubenswrapper[2563]: E0521 17:34:49.089189    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3134993-804a-42f3-9f38-67aec00d2b8d-metrics-certs podName:e3134993-804a-42f3-9f38-67aec00d2b8d nodeName:}" failed. No retries permitted until 2026-05-21 17:34:50.089183247 +0000 UTC m=+120.866555730 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e3134993-804a-42f3-9f38-67aec00d2b8d-metrics-certs") pod "router-default-5cf9c7f8d-ggtn8" (UID: "e3134993-804a-42f3-9f38-67aec00d2b8d") : secret "router-metrics-certs-default" not found
May 21 17:34:49.192714 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:34:49.192685    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-9zh59" event={"ID":"079fa2fb-e0ca-4997-935e-d3aeba409ed2","Type":"ContainerStarted","Data":"b3134c14b4bfde2d8fb71259546407609e3aef6ea0faccedc0414cd4c291c5eb"}
May 21 17:34:50.097557 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:34:50.097518    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3134993-804a-42f3-9f38-67aec00d2b8d-service-ca-bundle\") pod \"router-default-5cf9c7f8d-ggtn8\" (UID: \"e3134993-804a-42f3-9f38-67aec00d2b8d\") " pod="openshift-ingress/router-default-5cf9c7f8d-ggtn8"
May 21 17:34:50.098006 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:34:50.097562    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3134993-804a-42f3-9f38-67aec00d2b8d-metrics-certs\") pod \"router-default-5cf9c7f8d-ggtn8\" (UID: \"e3134993-804a-42f3-9f38-67aec00d2b8d\") " pod="openshift-ingress/router-default-5cf9c7f8d-ggtn8"
May 21 17:34:50.098006 ip-10-0-140-106 kubenswrapper[2563]: E0521 17:34:50.097675    2563 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
May 21 17:34:50.098006 ip-10-0-140-106 kubenswrapper[2563]: E0521 17:34:50.097695    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e3134993-804a-42f3-9f38-67aec00d2b8d-service-ca-bundle podName:e3134993-804a-42f3-9f38-67aec00d2b8d nodeName:}" failed. No retries permitted until 2026-05-21 17:34:52.097674233 +0000 UTC m=+122.875046734 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/e3134993-804a-42f3-9f38-67aec00d2b8d-service-ca-bundle") pod "router-default-5cf9c7f8d-ggtn8" (UID: "e3134993-804a-42f3-9f38-67aec00d2b8d") : configmap references non-existent config key: service-ca.crt
May 21 17:34:50.098006 ip-10-0-140-106 kubenswrapper[2563]: E0521 17:34:50.097728    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3134993-804a-42f3-9f38-67aec00d2b8d-metrics-certs podName:e3134993-804a-42f3-9f38-67aec00d2b8d nodeName:}" failed. No retries permitted until 2026-05-21 17:34:52.097717267 +0000 UTC m=+122.875089758 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e3134993-804a-42f3-9f38-67aec00d2b8d-metrics-certs") pod "router-default-5cf9c7f8d-ggtn8" (UID: "e3134993-804a-42f3-9f38-67aec00d2b8d") : secret "router-metrics-certs-default" not found
May 21 17:34:51.198345 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:34:51.198317    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-9zh59" event={"ID":"079fa2fb-e0ca-4997-935e-d3aeba409ed2","Type":"ContainerStarted","Data":"df47b014e9e8fc6ef888ed2b63fb52c90a8bbdcb37d8649efd79ead4d56e2b22"}
May 21 17:34:51.213469 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:34:51.213425    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-operator-78bdfb888c-9zh59" podStartSLOduration=1.360740191 podStartE2EDuration="3.213411569s" podCreationTimestamp="2026-05-21 17:34:48 +0000 UTC" firstStartedPulling="2026-05-21 17:34:48.803343022 +0000 UTC m=+119.580715504" lastFinishedPulling="2026-05-21 17:34:50.656014383 +0000 UTC m=+121.433386882" observedRunningTime="2026-05-21 17:34:51.212886764 +0000 UTC m=+121.990259270" watchObservedRunningTime="2026-05-21 17:34:51.213411569 +0000 UTC m=+121.990784072"
May 21 17:34:52.112117 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:34:52.112080    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3134993-804a-42f3-9f38-67aec00d2b8d-service-ca-bundle\") pod \"router-default-5cf9c7f8d-ggtn8\" (UID: \"e3134993-804a-42f3-9f38-67aec00d2b8d\") " pod="openshift-ingress/router-default-5cf9c7f8d-ggtn8"
May 21 17:34:52.112117 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:34:52.112116    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3134993-804a-42f3-9f38-67aec00d2b8d-metrics-certs\") pod \"router-default-5cf9c7f8d-ggtn8\" (UID: \"e3134993-804a-42f3-9f38-67aec00d2b8d\") " pod="openshift-ingress/router-default-5cf9c7f8d-ggtn8"
May 21 17:34:52.112387 ip-10-0-140-106 kubenswrapper[2563]: E0521 17:34:52.112278    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e3134993-804a-42f3-9f38-67aec00d2b8d-service-ca-bundle podName:e3134993-804a-42f3-9f38-67aec00d2b8d nodeName:}" failed. No retries permitted until 2026-05-21 17:34:56.112254213 +0000 UTC m=+126.889626701 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/e3134993-804a-42f3-9f38-67aec00d2b8d-service-ca-bundle") pod "router-default-5cf9c7f8d-ggtn8" (UID: "e3134993-804a-42f3-9f38-67aec00d2b8d") : configmap references non-existent config key: service-ca.crt
May 21 17:34:52.112387 ip-10-0-140-106 kubenswrapper[2563]: E0521 17:34:52.112298    2563 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
May 21 17:34:52.112387 ip-10-0-140-106 kubenswrapper[2563]: E0521 17:34:52.112353    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3134993-804a-42f3-9f38-67aec00d2b8d-metrics-certs podName:e3134993-804a-42f3-9f38-67aec00d2b8d nodeName:}" failed. No retries permitted until 2026-05-21 17:34:56.1123381 +0000 UTC m=+126.889710581 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e3134993-804a-42f3-9f38-67aec00d2b8d-metrics-certs") pod "router-default-5cf9c7f8d-ggtn8" (UID: "e3134993-804a-42f3-9f38-67aec00d2b8d") : secret "router-metrics-certs-default" not found
May 21 17:34:53.514704 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:34:53.514679    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-9tfbv_c47ca98f-38f9-4d7d-bae8-b6e89f01fba1/dns-node-resolver/0.log"
May 21 17:34:54.513869 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:34:54.513841    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wxdwr_f81b0bfa-3067-444d-9daf-734b247ab575/node-ca/0.log"
May 21 17:34:56.140663 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:34:56.140633    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3134993-804a-42f3-9f38-67aec00d2b8d-service-ca-bundle\") pod \"router-default-5cf9c7f8d-ggtn8\" (UID: \"e3134993-804a-42f3-9f38-67aec00d2b8d\") " pod="openshift-ingress/router-default-5cf9c7f8d-ggtn8"
May 21 17:34:56.140663 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:34:56.140665    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3134993-804a-42f3-9f38-67aec00d2b8d-metrics-certs\") pod \"router-default-5cf9c7f8d-ggtn8\" (UID: \"e3134993-804a-42f3-9f38-67aec00d2b8d\") " pod="openshift-ingress/router-default-5cf9c7f8d-ggtn8"
May 21 17:34:56.141034 ip-10-0-140-106 kubenswrapper[2563]: E0521 17:34:56.140755    2563 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
May 21 17:34:56.141034 ip-10-0-140-106 kubenswrapper[2563]: E0521 17:34:56.140791    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e3134993-804a-42f3-9f38-67aec00d2b8d-service-ca-bundle podName:e3134993-804a-42f3-9f38-67aec00d2b8d nodeName:}" failed. No retries permitted until 2026-05-21 17:35:04.140773967 +0000 UTC m=+134.918146449 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/e3134993-804a-42f3-9f38-67aec00d2b8d-service-ca-bundle") pod "router-default-5cf9c7f8d-ggtn8" (UID: "e3134993-804a-42f3-9f38-67aec00d2b8d") : configmap references non-existent config key: service-ca.crt
May 21 17:34:56.141034 ip-10-0-140-106 kubenswrapper[2563]: E0521 17:34:56.140814    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3134993-804a-42f3-9f38-67aec00d2b8d-metrics-certs podName:e3134993-804a-42f3-9f38-67aec00d2b8d nodeName:}" failed. No retries permitted until 2026-05-21 17:35:04.140807154 +0000 UTC m=+134.918179635 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e3134993-804a-42f3-9f38-67aec00d2b8d-metrics-certs") pod "router-default-5cf9c7f8d-ggtn8" (UID: "e3134993-804a-42f3-9f38-67aec00d2b8d") : secret "router-metrics-certs-default" not found
May 21 17:34:58.294404 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:34:58.294373    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-mhmcm"]
May 21 17:34:58.297211 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:34:58.297190    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-mhmcm"
May 21 17:34:58.299612 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:34:58.299591    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
May 21 17:34:58.299612 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:34:58.299604    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-94rst\""
May 21 17:34:58.299839 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:34:58.299826    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
May 21 17:34:58.300569 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:34:58.300551    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
May 21 17:34:58.300633 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:34:58.300585    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
May 21 17:34:58.304286 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:34:58.304268    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-mhmcm"]
May 21 17:34:58.460577 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:34:58.460540    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b7309693-1d8c-4edb-884a-6771748790d7-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-mhmcm\" (UID: \"b7309693-1d8c-4edb-884a-6771748790d7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-mhmcm"
May 21 17:34:58.460753 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:34:58.460585    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/44544f15-6623-4cbc-876d-2336ac096e94-metrics-certs\") pod \"network-metrics-daemon-5m8k5\" (UID: \"44544f15-6623-4cbc-876d-2336ac096e94\") " pod="openshift-multus/network-metrics-daemon-5m8k5"
May 21 17:34:58.460753 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:34:58.460617    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6rbmn\" (UniqueName: \"kubernetes.io/projected/b7309693-1d8c-4edb-884a-6771748790d7-kube-api-access-6rbmn\") pod \"kube-storage-version-migrator-operator-565644f49-mhmcm\" (UID: \"b7309693-1d8c-4edb-884a-6771748790d7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-mhmcm"
May 21 17:34:58.460753 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:34:58.460664    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b7309693-1d8c-4edb-884a-6771748790d7-config\") pod \"kube-storage-version-migrator-operator-565644f49-mhmcm\" (UID: \"b7309693-1d8c-4edb-884a-6771748790d7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-mhmcm"
May 21 17:34:58.460753 ip-10-0-140-106 kubenswrapper[2563]: E0521 17:34:58.460704    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
May 21 17:34:58.460911 ip-10-0-140-106 kubenswrapper[2563]: E0521 17:34:58.460770    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44544f15-6623-4cbc-876d-2336ac096e94-metrics-certs podName:44544f15-6623-4cbc-876d-2336ac096e94 nodeName:}" failed. No retries permitted until 2026-05-21 17:37:00.460752565 +0000 UTC m=+251.238125047 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/44544f15-6623-4cbc-876d-2336ac096e94-metrics-certs") pod "network-metrics-daemon-5m8k5" (UID: "44544f15-6623-4cbc-876d-2336ac096e94") : secret "metrics-daemon-secret" not found
May 21 17:34:58.561827 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:34:58.561749    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b7309693-1d8c-4edb-884a-6771748790d7-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-mhmcm\" (UID: \"b7309693-1d8c-4edb-884a-6771748790d7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-mhmcm"
May 21 17:34:58.561827 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:34:58.561794    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6rbmn\" (UniqueName: \"kubernetes.io/projected/b7309693-1d8c-4edb-884a-6771748790d7-kube-api-access-6rbmn\") pod \"kube-storage-version-migrator-operator-565644f49-mhmcm\" (UID: \"b7309693-1d8c-4edb-884a-6771748790d7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-mhmcm"
May 21 17:34:58.562019 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:34:58.561922    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b7309693-1d8c-4edb-884a-6771748790d7-config\") pod \"kube-storage-version-migrator-operator-565644f49-mhmcm\" (UID: \"b7309693-1d8c-4edb-884a-6771748790d7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-mhmcm"
May 21 17:34:58.562418 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:34:58.562398    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b7309693-1d8c-4edb-884a-6771748790d7-config\") pod \"kube-storage-version-migrator-operator-565644f49-mhmcm\" (UID: \"b7309693-1d8c-4edb-884a-6771748790d7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-mhmcm"
May 21 17:34:58.563914 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:34:58.563897    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b7309693-1d8c-4edb-884a-6771748790d7-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-mhmcm\" (UID: \"b7309693-1d8c-4edb-884a-6771748790d7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-mhmcm"
May 21 17:34:58.569230 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:34:58.569208    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6rbmn\" (UniqueName: \"kubernetes.io/projected/b7309693-1d8c-4edb-884a-6771748790d7-kube-api-access-6rbmn\") pod \"kube-storage-version-migrator-operator-565644f49-mhmcm\" (UID: \"b7309693-1d8c-4edb-884a-6771748790d7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-mhmcm"
May 21 17:34:58.606451 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:34:58.606429    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-mhmcm"
May 21 17:34:58.724238 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:34:58.724206    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-mhmcm"]
May 21 17:34:58.728446 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:34:58.728420    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7309693_1d8c_4edb_884a_6771748790d7.slice/crio-674f8d468213cd66159fc16f6c3e90b3478da7f37ec38c98cb2608c880bbfab1 WatchSource:0}: Error finding container 674f8d468213cd66159fc16f6c3e90b3478da7f37ec38c98cb2608c880bbfab1: Status 404 returned error can't find the container with id 674f8d468213cd66159fc16f6c3e90b3478da7f37ec38c98cb2608c880bbfab1
May 21 17:34:59.213988 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:34:59.213954    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-mhmcm" event={"ID":"b7309693-1d8c-4edb-884a-6771748790d7","Type":"ContainerStarted","Data":"674f8d468213cd66159fc16f6c3e90b3478da7f37ec38c98cb2608c880bbfab1"}
May 21 17:35:02.221774 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:02.221737    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-mhmcm" event={"ID":"b7309693-1d8c-4edb-884a-6771748790d7","Type":"ContainerStarted","Data":"c3ba8e75eed47fc13ef4a00728a80016ad59266085678839b77b7b1faaa44bea"}
May 21 17:35:02.236393 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:02.236344    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-mhmcm" podStartSLOduration=1.799252759 podStartE2EDuration="4.236331162s" podCreationTimestamp="2026-05-21 17:34:58 +0000 UTC" firstStartedPulling="2026-05-21 17:34:58.730254211 +0000 UTC m=+129.507626693" lastFinishedPulling="2026-05-21 17:35:01.167332615 +0000 UTC m=+131.944705096" observedRunningTime="2026-05-21 17:35:02.235209854 +0000 UTC m=+133.012582349" watchObservedRunningTime="2026-05-21 17:35:02.236331162 +0000 UTC m=+133.013703665"
May 21 17:35:04.208169 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:04.208120    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3134993-804a-42f3-9f38-67aec00d2b8d-service-ca-bundle\") pod \"router-default-5cf9c7f8d-ggtn8\" (UID: \"e3134993-804a-42f3-9f38-67aec00d2b8d\") " pod="openshift-ingress/router-default-5cf9c7f8d-ggtn8"
May 21 17:35:04.208169 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:04.208177    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3134993-804a-42f3-9f38-67aec00d2b8d-metrics-certs\") pod \"router-default-5cf9c7f8d-ggtn8\" (UID: \"e3134993-804a-42f3-9f38-67aec00d2b8d\") " pod="openshift-ingress/router-default-5cf9c7f8d-ggtn8"
May 21 17:35:04.208635 ip-10-0-140-106 kubenswrapper[2563]: E0521 17:35:04.208294    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e3134993-804a-42f3-9f38-67aec00d2b8d-service-ca-bundle podName:e3134993-804a-42f3-9f38-67aec00d2b8d nodeName:}" failed. No retries permitted until 2026-05-21 17:35:20.208273403 +0000 UTC m=+150.985645900 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/e3134993-804a-42f3-9f38-67aec00d2b8d-service-ca-bundle") pod "router-default-5cf9c7f8d-ggtn8" (UID: "e3134993-804a-42f3-9f38-67aec00d2b8d") : configmap references non-existent config key: service-ca.crt
May 21 17:35:04.208635 ip-10-0-140-106 kubenswrapper[2563]: E0521 17:35:04.208322    2563 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
May 21 17:35:04.208635 ip-10-0-140-106 kubenswrapper[2563]: E0521 17:35:04.208366    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3134993-804a-42f3-9f38-67aec00d2b8d-metrics-certs podName:e3134993-804a-42f3-9f38-67aec00d2b8d nodeName:}" failed. No retries permitted until 2026-05-21 17:35:20.208356074 +0000 UTC m=+150.985728556 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e3134993-804a-42f3-9f38-67aec00d2b8d-metrics-certs") pod "router-default-5cf9c7f8d-ggtn8" (UID: "e3134993-804a-42f3-9f38-67aec00d2b8d") : secret "router-metrics-certs-default" not found
May 21 17:35:04.976120 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:04.976088    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-tw8qw"]
May 21 17:35:04.979003 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:04.978987    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-tw8qw"
May 21 17:35:04.981431 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:04.981411    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
May 21 17:35:04.981539 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:04.981464    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-cqc5t\""
May 21 17:35:04.981539 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:04.981484    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
May 21 17:35:04.985593 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:04.985576    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-tw8qw"]
May 21 17:35:05.113919 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:05.113892    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3f5d2a8f-d5b5-4fef-b3f5-c79f42570c4b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tw8qw\" (UID: \"3f5d2a8f-d5b5-4fef-b3f5-c79f42570c4b\") " pod="openshift-insights/insights-runtime-extractor-tw8qw"
May 21 17:35:05.114033 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:05.113937    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3f5d2a8f-d5b5-4fef-b3f5-c79f42570c4b-data-volume\") pod \"insights-runtime-extractor-tw8qw\" (UID: \"3f5d2a8f-d5b5-4fef-b3f5-c79f42570c4b\") " pod="openshift-insights/insights-runtime-extractor-tw8qw"
May 21 17:35:05.114033 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:05.113961    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7qs76\" (UniqueName: \"kubernetes.io/projected/3f5d2a8f-d5b5-4fef-b3f5-c79f42570c4b-kube-api-access-7qs76\") pod \"insights-runtime-extractor-tw8qw\" (UID: \"3f5d2a8f-d5b5-4fef-b3f5-c79f42570c4b\") " pod="openshift-insights/insights-runtime-extractor-tw8qw"
May 21 17:35:05.114134 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:05.114051    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3f5d2a8f-d5b5-4fef-b3f5-c79f42570c4b-crio-socket\") pod \"insights-runtime-extractor-tw8qw\" (UID: \"3f5d2a8f-d5b5-4fef-b3f5-c79f42570c4b\") " pod="openshift-insights/insights-runtime-extractor-tw8qw"
May 21 17:35:05.114134 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:05.114097    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3f5d2a8f-d5b5-4fef-b3f5-c79f42570c4b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tw8qw\" (UID: \"3f5d2a8f-d5b5-4fef-b3f5-c79f42570c4b\") " pod="openshift-insights/insights-runtime-extractor-tw8qw"
May 21 17:35:05.214733 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:05.214701    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3f5d2a8f-d5b5-4fef-b3f5-c79f42570c4b-data-volume\") pod \"insights-runtime-extractor-tw8qw\" (UID: \"3f5d2a8f-d5b5-4fef-b3f5-c79f42570c4b\") " pod="openshift-insights/insights-runtime-extractor-tw8qw"
May 21 17:35:05.215050 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:05.214742    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7qs76\" (UniqueName: \"kubernetes.io/projected/3f5d2a8f-d5b5-4fef-b3f5-c79f42570c4b-kube-api-access-7qs76\") pod \"insights-runtime-extractor-tw8qw\" (UID: \"3f5d2a8f-d5b5-4fef-b3f5-c79f42570c4b\") " pod="openshift-insights/insights-runtime-extractor-tw8qw"
May 21 17:35:05.215050 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:05.214906    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3f5d2a8f-d5b5-4fef-b3f5-c79f42570c4b-crio-socket\") pod \"insights-runtime-extractor-tw8qw\" (UID: \"3f5d2a8f-d5b5-4fef-b3f5-c79f42570c4b\") " pod="openshift-insights/insights-runtime-extractor-tw8qw"
May 21 17:35:05.215050 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:05.214937    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3f5d2a8f-d5b5-4fef-b3f5-c79f42570c4b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tw8qw\" (UID: \"3f5d2a8f-d5b5-4fef-b3f5-c79f42570c4b\") " pod="openshift-insights/insights-runtime-extractor-tw8qw"
May 21 17:35:05.215050 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:05.214994    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3f5d2a8f-d5b5-4fef-b3f5-c79f42570c4b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tw8qw\" (UID: \"3f5d2a8f-d5b5-4fef-b3f5-c79f42570c4b\") " pod="openshift-insights/insights-runtime-extractor-tw8qw"
May 21 17:35:05.215050 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:05.215010    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3f5d2a8f-d5b5-4fef-b3f5-c79f42570c4b-crio-socket\") pod \"insights-runtime-extractor-tw8qw\" (UID: \"3f5d2a8f-d5b5-4fef-b3f5-c79f42570c4b\") " pod="openshift-insights/insights-runtime-extractor-tw8qw"
May 21 17:35:05.215329 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:05.215084    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3f5d2a8f-d5b5-4fef-b3f5-c79f42570c4b-data-volume\") pod \"insights-runtime-extractor-tw8qw\" (UID: \"3f5d2a8f-d5b5-4fef-b3f5-c79f42570c4b\") " pod="openshift-insights/insights-runtime-extractor-tw8qw"
May 21 17:35:05.215329 ip-10-0-140-106 kubenswrapper[2563]: E0521 17:35:05.215152    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
May 21 17:35:05.215329 ip-10-0-140-106 kubenswrapper[2563]: E0521 17:35:05.215241    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f5d2a8f-d5b5-4fef-b3f5-c79f42570c4b-insights-runtime-extractor-tls podName:3f5d2a8f-d5b5-4fef-b3f5-c79f42570c4b nodeName:}" failed. No retries permitted until 2026-05-21 17:35:05.71521887 +0000 UTC m=+136.492591370 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3f5d2a8f-d5b5-4fef-b3f5-c79f42570c4b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-tw8qw" (UID: "3f5d2a8f-d5b5-4fef-b3f5-c79f42570c4b") : secret "insights-runtime-extractor-tls" not found
May 21 17:35:05.215515 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:05.215499    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3f5d2a8f-d5b5-4fef-b3f5-c79f42570c4b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tw8qw\" (UID: \"3f5d2a8f-d5b5-4fef-b3f5-c79f42570c4b\") " pod="openshift-insights/insights-runtime-extractor-tw8qw"
May 21 17:35:05.225777 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:05.225759    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7qs76\" (UniqueName: \"kubernetes.io/projected/3f5d2a8f-d5b5-4fef-b3f5-c79f42570c4b-kube-api-access-7qs76\") pod \"insights-runtime-extractor-tw8qw\" (UID: \"3f5d2a8f-d5b5-4fef-b3f5-c79f42570c4b\") " pod="openshift-insights/insights-runtime-extractor-tw8qw"
May 21 17:35:05.633622 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:05.633586    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-nn4jx"]
May 21 17:35:05.636370 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:05.636355    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-67d667c7d-nn4jx"
May 21 17:35:05.638758 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:05.638736    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-2828z\""
May 21 17:35:05.639072 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:05.639039    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
May 21 17:35:05.639784 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:05.639762    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
May 21 17:35:05.639784 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:05.639783    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
May 21 17:35:05.639933 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:05.639764    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
May 21 17:35:05.644869 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:05.644849    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-nn4jx"]
May 21 17:35:05.718496 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:05.718474    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/84db8987-ede7-44fb-8c47-c42de3e9fa62-signing-cabundle\") pod \"service-ca-67d667c7d-nn4jx\" (UID: \"84db8987-ede7-44fb-8c47-c42de3e9fa62\") " pod="openshift-service-ca/service-ca-67d667c7d-nn4jx"
May 21 17:35:05.718604 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:05.718548    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3f5d2a8f-d5b5-4fef-b3f5-c79f42570c4b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tw8qw\" (UID: \"3f5d2a8f-d5b5-4fef-b3f5-c79f42570c4b\") " pod="openshift-insights/insights-runtime-extractor-tw8qw"
May 21 17:35:05.718604 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:05.718575    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8mftg\" (UniqueName: \"kubernetes.io/projected/84db8987-ede7-44fb-8c47-c42de3e9fa62-kube-api-access-8mftg\") pod \"service-ca-67d667c7d-nn4jx\" (UID: \"84db8987-ede7-44fb-8c47-c42de3e9fa62\") " pod="openshift-service-ca/service-ca-67d667c7d-nn4jx"
May 21 17:35:05.718687 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:05.718606    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/84db8987-ede7-44fb-8c47-c42de3e9fa62-signing-key\") pod \"service-ca-67d667c7d-nn4jx\" (UID: \"84db8987-ede7-44fb-8c47-c42de3e9fa62\") " pod="openshift-service-ca/service-ca-67d667c7d-nn4jx"
May 21 17:35:05.718734 ip-10-0-140-106 kubenswrapper[2563]: E0521 17:35:05.718721    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
May 21 17:35:05.718789 ip-10-0-140-106 kubenswrapper[2563]: E0521 17:35:05.718780    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f5d2a8f-d5b5-4fef-b3f5-c79f42570c4b-insights-runtime-extractor-tls podName:3f5d2a8f-d5b5-4fef-b3f5-c79f42570c4b nodeName:}" failed. No retries permitted until 2026-05-21 17:35:06.718763688 +0000 UTC m=+137.496136172 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3f5d2a8f-d5b5-4fef-b3f5-c79f42570c4b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-tw8qw" (UID: "3f5d2a8f-d5b5-4fef-b3f5-c79f42570c4b") : secret "insights-runtime-extractor-tls" not found
May 21 17:35:05.819493 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:05.819468    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8mftg\" (UniqueName: \"kubernetes.io/projected/84db8987-ede7-44fb-8c47-c42de3e9fa62-kube-api-access-8mftg\") pod \"service-ca-67d667c7d-nn4jx\" (UID: \"84db8987-ede7-44fb-8c47-c42de3e9fa62\") " pod="openshift-service-ca/service-ca-67d667c7d-nn4jx"
May 21 17:35:05.819587 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:05.819507    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/84db8987-ede7-44fb-8c47-c42de3e9fa62-signing-key\") pod \"service-ca-67d667c7d-nn4jx\" (UID: \"84db8987-ede7-44fb-8c47-c42de3e9fa62\") " pod="openshift-service-ca/service-ca-67d667c7d-nn4jx"
May 21 17:35:05.819587 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:05.819531    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/84db8987-ede7-44fb-8c47-c42de3e9fa62-signing-cabundle\") pod \"service-ca-67d667c7d-nn4jx\" (UID: \"84db8987-ede7-44fb-8c47-c42de3e9fa62\") " pod="openshift-service-ca/service-ca-67d667c7d-nn4jx"
May 21 17:35:05.820162 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:05.820142    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/84db8987-ede7-44fb-8c47-c42de3e9fa62-signing-cabundle\") pod \"service-ca-67d667c7d-nn4jx\" (UID: \"84db8987-ede7-44fb-8c47-c42de3e9fa62\") " pod="openshift-service-ca/service-ca-67d667c7d-nn4jx"
May 21 17:35:05.821835 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:05.821810    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/84db8987-ede7-44fb-8c47-c42de3e9fa62-signing-key\") pod \"service-ca-67d667c7d-nn4jx\" (UID: \"84db8987-ede7-44fb-8c47-c42de3e9fa62\") " pod="openshift-service-ca/service-ca-67d667c7d-nn4jx"
May 21 17:35:05.829997 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:05.829979    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8mftg\" (UniqueName: \"kubernetes.io/projected/84db8987-ede7-44fb-8c47-c42de3e9fa62-kube-api-access-8mftg\") pod \"service-ca-67d667c7d-nn4jx\" (UID: \"84db8987-ede7-44fb-8c47-c42de3e9fa62\") " pod="openshift-service-ca/service-ca-67d667c7d-nn4jx"
May 21 17:35:05.945377 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:05.945319    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-67d667c7d-nn4jx"
May 21 17:35:06.061527 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:06.061496    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-nn4jx"]
May 21 17:35:06.064231 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:35:06.064200    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84db8987_ede7_44fb_8c47_c42de3e9fa62.slice/crio-011f632542f93e7c8b900cfad2dad774050458ae17bd44fafb95e3f77f382c38 WatchSource:0}: Error finding container 011f632542f93e7c8b900cfad2dad774050458ae17bd44fafb95e3f77f382c38: Status 404 returned error can't find the container with id 011f632542f93e7c8b900cfad2dad774050458ae17bd44fafb95e3f77f382c38
May 21 17:35:06.231957 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:06.231887    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-67d667c7d-nn4jx" event={"ID":"84db8987-ede7-44fb-8c47-c42de3e9fa62","Type":"ContainerStarted","Data":"011f632542f93e7c8b900cfad2dad774050458ae17bd44fafb95e3f77f382c38"}
May 21 17:35:06.727628 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:06.727588    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3f5d2a8f-d5b5-4fef-b3f5-c79f42570c4b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tw8qw\" (UID: \"3f5d2a8f-d5b5-4fef-b3f5-c79f42570c4b\") " pod="openshift-insights/insights-runtime-extractor-tw8qw"
May 21 17:35:06.727809 ip-10-0-140-106 kubenswrapper[2563]: E0521 17:35:06.727706    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
May 21 17:35:06.727809 ip-10-0-140-106 kubenswrapper[2563]: E0521 17:35:06.727769    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f5d2a8f-d5b5-4fef-b3f5-c79f42570c4b-insights-runtime-extractor-tls podName:3f5d2a8f-d5b5-4fef-b3f5-c79f42570c4b nodeName:}" failed. No retries permitted until 2026-05-21 17:35:08.727751353 +0000 UTC m=+139.505123840 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3f5d2a8f-d5b5-4fef-b3f5-c79f42570c4b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-tw8qw" (UID: "3f5d2a8f-d5b5-4fef-b3f5-c79f42570c4b") : secret "insights-runtime-extractor-tls" not found
May 21 17:35:08.236755 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:08.236672    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-67d667c7d-nn4jx" event={"ID":"84db8987-ede7-44fb-8c47-c42de3e9fa62","Type":"ContainerStarted","Data":"17abe1f47adcfcc37e8c6ce7c4797f627cf2af8bbee47c83b83533a251c6526b"}
May 21 17:35:08.251192 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:08.251141    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca/service-ca-67d667c7d-nn4jx" podStartSLOduration=1.404911285 podStartE2EDuration="3.25112894s" podCreationTimestamp="2026-05-21 17:35:05 +0000 UTC" firstStartedPulling="2026-05-21 17:35:06.065965925 +0000 UTC m=+136.843338407" lastFinishedPulling="2026-05-21 17:35:07.912183574 +0000 UTC m=+138.689556062" observedRunningTime="2026-05-21 17:35:08.250682758 +0000 UTC m=+139.028055266" watchObservedRunningTime="2026-05-21 17:35:08.25112894 +0000 UTC m=+139.028501444"
May 21 17:35:08.743960 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:08.743927    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3f5d2a8f-d5b5-4fef-b3f5-c79f42570c4b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tw8qw\" (UID: \"3f5d2a8f-d5b5-4fef-b3f5-c79f42570c4b\") " pod="openshift-insights/insights-runtime-extractor-tw8qw"
May 21 17:35:08.744137 ip-10-0-140-106 kubenswrapper[2563]: E0521 17:35:08.744032    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
May 21 17:35:08.744137 ip-10-0-140-106 kubenswrapper[2563]: E0521 17:35:08.744098    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f5d2a8f-d5b5-4fef-b3f5-c79f42570c4b-insights-runtime-extractor-tls podName:3f5d2a8f-d5b5-4fef-b3f5-c79f42570c4b nodeName:}" failed. No retries permitted until 2026-05-21 17:35:12.74408409 +0000 UTC m=+143.521456573 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3f5d2a8f-d5b5-4fef-b3f5-c79f42570c4b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-tw8qw" (UID: "3f5d2a8f-d5b5-4fef-b3f5-c79f42570c4b") : secret "insights-runtime-extractor-tls" not found
May 21 17:35:12.771446 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:12.771402    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3f5d2a8f-d5b5-4fef-b3f5-c79f42570c4b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tw8qw\" (UID: \"3f5d2a8f-d5b5-4fef-b3f5-c79f42570c4b\") " pod="openshift-insights/insights-runtime-extractor-tw8qw"
May 21 17:35:12.771829 ip-10-0-140-106 kubenswrapper[2563]: E0521 17:35:12.771529    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
May 21 17:35:12.771829 ip-10-0-140-106 kubenswrapper[2563]: E0521 17:35:12.771593    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f5d2a8f-d5b5-4fef-b3f5-c79f42570c4b-insights-runtime-extractor-tls podName:3f5d2a8f-d5b5-4fef-b3f5-c79f42570c4b nodeName:}" failed. No retries permitted until 2026-05-21 17:35:20.771576331 +0000 UTC m=+151.548948812 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3f5d2a8f-d5b5-4fef-b3f5-c79f42570c4b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-tw8qw" (UID: "3f5d2a8f-d5b5-4fef-b3f5-c79f42570c4b") : secret "insights-runtime-extractor-tls" not found
May 21 17:35:20.227901 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:20.227864    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3134993-804a-42f3-9f38-67aec00d2b8d-service-ca-bundle\") pod \"router-default-5cf9c7f8d-ggtn8\" (UID: \"e3134993-804a-42f3-9f38-67aec00d2b8d\") " pod="openshift-ingress/router-default-5cf9c7f8d-ggtn8"
May 21 17:35:20.227901 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:20.227902    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3134993-804a-42f3-9f38-67aec00d2b8d-metrics-certs\") pod \"router-default-5cf9c7f8d-ggtn8\" (UID: \"e3134993-804a-42f3-9f38-67aec00d2b8d\") " pod="openshift-ingress/router-default-5cf9c7f8d-ggtn8"
May 21 17:35:20.228507 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:20.228487    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3134993-804a-42f3-9f38-67aec00d2b8d-service-ca-bundle\") pod \"router-default-5cf9c7f8d-ggtn8\" (UID: \"e3134993-804a-42f3-9f38-67aec00d2b8d\") " pod="openshift-ingress/router-default-5cf9c7f8d-ggtn8"
May 21 17:35:20.230186 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:20.230164    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3134993-804a-42f3-9f38-67aec00d2b8d-metrics-certs\") pod \"router-default-5cf9c7f8d-ggtn8\" (UID: \"e3134993-804a-42f3-9f38-67aec00d2b8d\") " pod="openshift-ingress/router-default-5cf9c7f8d-ggtn8"
May 21 17:35:20.491544 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:20.491474    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-mrknt\""
May 21 17:35:20.499624 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:20.499606    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5cf9c7f8d-ggtn8"
May 21 17:35:20.620127 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:20.620099    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5cf9c7f8d-ggtn8"]
May 21 17:35:20.622943 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:35:20.622910    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3134993_804a_42f3_9f38_67aec00d2b8d.slice/crio-21d90a61aac6c85f0729187b4fab48a78c4cd4f09fb5238bbcc43837beedda6a WatchSource:0}: Error finding container 21d90a61aac6c85f0729187b4fab48a78c4cd4f09fb5238bbcc43837beedda6a: Status 404 returned error can't find the container with id 21d90a61aac6c85f0729187b4fab48a78c4cd4f09fb5238bbcc43837beedda6a
May 21 17:35:20.833563 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:20.833498    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3f5d2a8f-d5b5-4fef-b3f5-c79f42570c4b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tw8qw\" (UID: \"3f5d2a8f-d5b5-4fef-b3f5-c79f42570c4b\") " pod="openshift-insights/insights-runtime-extractor-tw8qw"
May 21 17:35:20.835829 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:20.835805    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3f5d2a8f-d5b5-4fef-b3f5-c79f42570c4b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tw8qw\" (UID: \"3f5d2a8f-d5b5-4fef-b3f5-c79f42570c4b\") " pod="openshift-insights/insights-runtime-extractor-tw8qw"
May 21 17:35:20.888614 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:20.888590    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-tw8qw"
May 21 17:35:21.004280 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:21.004253    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-tw8qw"]
May 21 17:35:21.007066 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:35:21.007029    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f5d2a8f_d5b5_4fef_b3f5_c79f42570c4b.slice/crio-968d9f8383b55d4a253a33acb3c80f786d781a6014a37c437394b8cf64f264e1 WatchSource:0}: Error finding container 968d9f8383b55d4a253a33acb3c80f786d781a6014a37c437394b8cf64f264e1: Status 404 returned error can't find the container with id 968d9f8383b55d4a253a33acb3c80f786d781a6014a37c437394b8cf64f264e1
May 21 17:35:21.265443 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:21.265410    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-tw8qw" event={"ID":"3f5d2a8f-d5b5-4fef-b3f5-c79f42570c4b","Type":"ContainerStarted","Data":"075448fd0fffd1bfd9db4040cfc1a2a3b21326a0bf2a745516ff14bafbd89c84"}
May 21 17:35:21.265864 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:21.265450    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-tw8qw" event={"ID":"3f5d2a8f-d5b5-4fef-b3f5-c79f42570c4b","Type":"ContainerStarted","Data":"968d9f8383b55d4a253a33acb3c80f786d781a6014a37c437394b8cf64f264e1"}
May 21 17:35:21.266635 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:21.266609    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5cf9c7f8d-ggtn8" event={"ID":"e3134993-804a-42f3-9f38-67aec00d2b8d","Type":"ContainerStarted","Data":"9eb82699cb181817f1e6fcf55b57c1b36e1028e38df9ba9ed0c2f517b9be5976"}
May 21 17:35:21.266698 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:21.266644    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5cf9c7f8d-ggtn8" event={"ID":"e3134993-804a-42f3-9f38-67aec00d2b8d","Type":"ContainerStarted","Data":"21d90a61aac6c85f0729187b4fab48a78c4cd4f09fb5238bbcc43837beedda6a"}
May 21 17:35:21.284166 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:21.284124    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/router-default-5cf9c7f8d-ggtn8" podStartSLOduration=33.284110508 podStartE2EDuration="33.284110508s" podCreationTimestamp="2026-05-21 17:34:48 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 17:35:21.283439503 +0000 UTC m=+152.060812029" watchObservedRunningTime="2026-05-21 17:35:21.284110508 +0000 UTC m=+152.061483011"
May 21 17:35:21.500301 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:21.500269    2563 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-5cf9c7f8d-ggtn8"
May 21 17:35:21.502594 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:21.502574    2563 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-5cf9c7f8d-ggtn8"
May 21 17:35:22.271529 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:22.271487    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-tw8qw" event={"ID":"3f5d2a8f-d5b5-4fef-b3f5-c79f42570c4b","Type":"ContainerStarted","Data":"ba17acd51293a650dc8514aa703391170d648d2b0e769f2d80e817cb6a521725"}
May 21 17:35:22.271987 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:22.271709    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-5cf9c7f8d-ggtn8"
May 21 17:35:22.273074 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:22.273040    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-5cf9c7f8d-ggtn8"
May 21 17:35:24.256345 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:24.256319    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-w2lvc"]
May 21 17:35:24.258113 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:24.258099    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-xgg2n"]
May 21 17:35:24.258249 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:24.258232    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-w2lvc"
May 21 17:35:24.259821 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:24.259803    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-57bd96b888-9t58z"]
May 21 17:35:24.259971 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:24.259915    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-xgg2n"
May 21 17:35:24.260556 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:24.260539    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-dnrcx\""
May 21 17:35:24.261653 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:24.261640    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-57bd96b888-9t58z"
May 21 17:35:24.262108 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:24.262091    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-gmlz4\""
May 21 17:35:24.262202 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:24.262130    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
May 21 17:35:24.263802 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:24.263782    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-qv9fm\""
May 21 17:35:24.263877 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:24.263803    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
May 21 17:35:24.263930 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:24.263880    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
May 21 17:35:24.270098 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:24.270077    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-xgg2n"]
May 21 17:35:24.271046 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:24.271020    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-w2lvc"]
May 21 17:35:24.271885 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:24.271863    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-57bd96b888-9t58z"]
May 21 17:35:24.275527 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:24.275508    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-99d98f68d-lq66h"]
May 21 17:35:24.278181 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:24.278133    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-tw8qw" event={"ID":"3f5d2a8f-d5b5-4fef-b3f5-c79f42570c4b","Type":"ContainerStarted","Data":"8f64e4a1863c34cd7df1d07d9cc85c8761df51ad70f17803fe991c15a99b5744"}
May 21 17:35:24.278487 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:24.278470    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-99d98f68d-lq66h"
May 21 17:35:24.281046 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:24.281024    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
May 21 17:35:24.281556 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:24.281538    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-rwzsm\""
May 21 17:35:24.282364 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:24.282344    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
May 21 17:35:24.282464 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:24.282401    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
May 21 17:35:24.286858 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:24.286837    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
May 21 17:35:24.288387 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:24.288317    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-99d98f68d-lq66h"]
May 21 17:35:24.320935 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:24.320896    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-tw8qw" podStartSLOduration=18.169181235 podStartE2EDuration="20.320859622s" podCreationTimestamp="2026-05-21 17:35:04 +0000 UTC" firstStartedPulling="2026-05-21 17:35:21.067456692 +0000 UTC m=+151.844829173" lastFinishedPulling="2026-05-21 17:35:23.219135076 +0000 UTC m=+153.996507560" observedRunningTime="2026-05-21 17:35:24.32012319 +0000 UTC m=+155.097495694" watchObservedRunningTime="2026-05-21 17:35:24.320859622 +0000 UTC m=+155.098232164"
May 21 17:35:24.361005 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:24.360982    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0fc0b33b-b75f-4e8c-9013-b4cb993741b8-installation-pull-secrets\") pod \"image-registry-99d98f68d-lq66h\" (UID: \"0fc0b33b-b75f-4e8c-9013-b4cb993741b8\") " pod="openshift-image-registry/image-registry-99d98f68d-lq66h"
May 21 17:35:24.361126 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:24.361015    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qd2qj\" (UniqueName: \"kubernetes.io/projected/2ac1cbe0-26ce-432e-930b-bddbf477662a-kube-api-access-qd2qj\") pod \"downloads-57bd96b888-9t58z\" (UID: \"2ac1cbe0-26ce-432e-930b-bddbf477662a\") " pod="openshift-console/downloads-57bd96b888-9t58z"
May 21 17:35:24.361126 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:24.361037    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0fc0b33b-b75f-4e8c-9013-b4cb993741b8-trusted-ca\") pod \"image-registry-99d98f68d-lq66h\" (UID: \"0fc0b33b-b75f-4e8c-9013-b4cb993741b8\") " pod="openshift-image-registry/image-registry-99d98f68d-lq66h"
May 21 17:35:24.361244 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:24.361185    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0fc0b33b-b75f-4e8c-9013-b4cb993741b8-ca-trust-extracted\") pod \"image-registry-99d98f68d-lq66h\" (UID: \"0fc0b33b-b75f-4e8c-9013-b4cb993741b8\") " pod="openshift-image-registry/image-registry-99d98f68d-lq66h"
May 21 17:35:24.361244 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:24.361230    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0fc0b33b-b75f-4e8c-9013-b4cb993741b8-bound-sa-token\") pod \"image-registry-99d98f68d-lq66h\" (UID: \"0fc0b33b-b75f-4e8c-9013-b4cb993741b8\") " pod="openshift-image-registry/image-registry-99d98f68d-lq66h"
May 21 17:35:24.361350 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:24.361256    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0fc0b33b-b75f-4e8c-9013-b4cb993741b8-registry-certificates\") pod \"image-registry-99d98f68d-lq66h\" (UID: \"0fc0b33b-b75f-4e8c-9013-b4cb993741b8\") " pod="openshift-image-registry/image-registry-99d98f68d-lq66h"
May 21 17:35:24.361350 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:24.361305    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0fc0b33b-b75f-4e8c-9013-b4cb993741b8-registry-tls\") pod \"image-registry-99d98f68d-lq66h\" (UID: \"0fc0b33b-b75f-4e8c-9013-b4cb993741b8\") " pod="openshift-image-registry/image-registry-99d98f68d-lq66h"
May 21 17:35:24.361447 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:24.361354    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z6frt\" (UniqueName: \"kubernetes.io/projected/45ff293c-20a7-4794-b76f-707d794d3de1-kube-api-access-z6frt\") pod \"network-check-source-7f44b6dd87-w2lvc\" (UID: \"45ff293c-20a7-4794-b76f-707d794d3de1\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-w2lvc"
May 21 17:35:24.361447 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:24.361432    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0fc0b33b-b75f-4e8c-9013-b4cb993741b8-image-registry-private-configuration\") pod \"image-registry-99d98f68d-lq66h\" (UID: \"0fc0b33b-b75f-4e8c-9013-b4cb993741b8\") " pod="openshift-image-registry/image-registry-99d98f68d-lq66h"
May 21 17:35:24.361548 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:24.361461    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/d31013c7-826d-4686-be6b-c03c1b81d08f-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-xgg2n\" (UID: \"d31013c7-826d-4686-be6b-c03c1b81d08f\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-xgg2n"
May 21 17:35:24.361658 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:24.361637    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qcwff\" (UniqueName: \"kubernetes.io/projected/0fc0b33b-b75f-4e8c-9013-b4cb993741b8-kube-api-access-qcwff\") pod \"image-registry-99d98f68d-lq66h\" (UID: \"0fc0b33b-b75f-4e8c-9013-b4cb993741b8\") " pod="openshift-image-registry/image-registry-99d98f68d-lq66h"
May 21 17:35:24.462635 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:24.462569    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qcwff\" (UniqueName: \"kubernetes.io/projected/0fc0b33b-b75f-4e8c-9013-b4cb993741b8-kube-api-access-qcwff\") pod \"image-registry-99d98f68d-lq66h\" (UID: \"0fc0b33b-b75f-4e8c-9013-b4cb993741b8\") " pod="openshift-image-registry/image-registry-99d98f68d-lq66h"
May 21 17:35:24.462635 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:24.462625    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0fc0b33b-b75f-4e8c-9013-b4cb993741b8-installation-pull-secrets\") pod \"image-registry-99d98f68d-lq66h\" (UID: \"0fc0b33b-b75f-4e8c-9013-b4cb993741b8\") " pod="openshift-image-registry/image-registry-99d98f68d-lq66h"
May 21 17:35:24.462786 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:24.462657    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qd2qj\" (UniqueName: \"kubernetes.io/projected/2ac1cbe0-26ce-432e-930b-bddbf477662a-kube-api-access-qd2qj\") pod \"downloads-57bd96b888-9t58z\" (UID: \"2ac1cbe0-26ce-432e-930b-bddbf477662a\") " pod="openshift-console/downloads-57bd96b888-9t58z"
May 21 17:35:24.462786 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:24.462683    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0fc0b33b-b75f-4e8c-9013-b4cb993741b8-trusted-ca\") pod \"image-registry-99d98f68d-lq66h\" (UID: \"0fc0b33b-b75f-4e8c-9013-b4cb993741b8\") " pod="openshift-image-registry/image-registry-99d98f68d-lq66h"
May 21 17:35:24.462786 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:24.462768    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0fc0b33b-b75f-4e8c-9013-b4cb993741b8-ca-trust-extracted\") pod \"image-registry-99d98f68d-lq66h\" (UID: \"0fc0b33b-b75f-4e8c-9013-b4cb993741b8\") " pod="openshift-image-registry/image-registry-99d98f68d-lq66h"
May 21 17:35:24.463003 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:24.462799    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0fc0b33b-b75f-4e8c-9013-b4cb993741b8-bound-sa-token\") pod \"image-registry-99d98f68d-lq66h\" (UID: \"0fc0b33b-b75f-4e8c-9013-b4cb993741b8\") " pod="openshift-image-registry/image-registry-99d98f68d-lq66h"
May 21 17:35:24.463003 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:24.462851    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0fc0b33b-b75f-4e8c-9013-b4cb993741b8-registry-certificates\") pod \"image-registry-99d98f68d-lq66h\" (UID: \"0fc0b33b-b75f-4e8c-9013-b4cb993741b8\") " pod="openshift-image-registry/image-registry-99d98f68d-lq66h"
May 21 17:35:24.463003 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:24.462947    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0fc0b33b-b75f-4e8c-9013-b4cb993741b8-registry-tls\") pod \"image-registry-99d98f68d-lq66h\" (UID: \"0fc0b33b-b75f-4e8c-9013-b4cb993741b8\") " pod="openshift-image-registry/image-registry-99d98f68d-lq66h"
May 21 17:35:24.463003 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:24.462983    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-z6frt\" (UniqueName: \"kubernetes.io/projected/45ff293c-20a7-4794-b76f-707d794d3de1-kube-api-access-z6frt\") pod \"network-check-source-7f44b6dd87-w2lvc\" (UID: \"45ff293c-20a7-4794-b76f-707d794d3de1\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-w2lvc"
May 21 17:35:24.463253 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:24.463029    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0fc0b33b-b75f-4e8c-9013-b4cb993741b8-image-registry-private-configuration\") pod \"image-registry-99d98f68d-lq66h\" (UID: \"0fc0b33b-b75f-4e8c-9013-b4cb993741b8\") " pod="openshift-image-registry/image-registry-99d98f68d-lq66h"
May 21 17:35:24.463253 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:24.463053    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/d31013c7-826d-4686-be6b-c03c1b81d08f-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-xgg2n\" (UID: \"d31013c7-826d-4686-be6b-c03c1b81d08f\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-xgg2n"
May 21 17:35:24.463409 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:24.463281    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0fc0b33b-b75f-4e8c-9013-b4cb993741b8-ca-trust-extracted\") pod \"image-registry-99d98f68d-lq66h\" (UID: \"0fc0b33b-b75f-4e8c-9013-b4cb993741b8\") " pod="openshift-image-registry/image-registry-99d98f68d-lq66h"
May 21 17:35:24.464041 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:24.464014    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0fc0b33b-b75f-4e8c-9013-b4cb993741b8-registry-certificates\") pod \"image-registry-99d98f68d-lq66h\" (UID: \"0fc0b33b-b75f-4e8c-9013-b4cb993741b8\") " pod="openshift-image-registry/image-registry-99d98f68d-lq66h"
May 21 17:35:24.464225 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:24.464208    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0fc0b33b-b75f-4e8c-9013-b4cb993741b8-trusted-ca\") pod \"image-registry-99d98f68d-lq66h\" (UID: \"0fc0b33b-b75f-4e8c-9013-b4cb993741b8\") " pod="openshift-image-registry/image-registry-99d98f68d-lq66h"
May 21 17:35:24.465624 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:24.465593    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0fc0b33b-b75f-4e8c-9013-b4cb993741b8-image-registry-private-configuration\") pod \"image-registry-99d98f68d-lq66h\" (UID: \"0fc0b33b-b75f-4e8c-9013-b4cb993741b8\") " pod="openshift-image-registry/image-registry-99d98f68d-lq66h"
May 21 17:35:24.465624 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:24.465615    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0fc0b33b-b75f-4e8c-9013-b4cb993741b8-registry-tls\") pod \"image-registry-99d98f68d-lq66h\" (UID: \"0fc0b33b-b75f-4e8c-9013-b4cb993741b8\") " pod="openshift-image-registry/image-registry-99d98f68d-lq66h"
May 21 17:35:24.465784 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:24.465707    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0fc0b33b-b75f-4e8c-9013-b4cb993741b8-installation-pull-secrets\") pod \"image-registry-99d98f68d-lq66h\" (UID: \"0fc0b33b-b75f-4e8c-9013-b4cb993741b8\") " pod="openshift-image-registry/image-registry-99d98f68d-lq66h"
May 21 17:35:24.465859 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:24.465837    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/d31013c7-826d-4686-be6b-c03c1b81d08f-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-xgg2n\" (UID: \"d31013c7-826d-4686-be6b-c03c1b81d08f\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-xgg2n"
May 21 17:35:24.474457 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:24.474431    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0fc0b33b-b75f-4e8c-9013-b4cb993741b8-bound-sa-token\") pod \"image-registry-99d98f68d-lq66h\" (UID: \"0fc0b33b-b75f-4e8c-9013-b4cb993741b8\") " pod="openshift-image-registry/image-registry-99d98f68d-lq66h"
May 21 17:35:24.474593 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:24.474570    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qcwff\" (UniqueName: \"kubernetes.io/projected/0fc0b33b-b75f-4e8c-9013-b4cb993741b8-kube-api-access-qcwff\") pod \"image-registry-99d98f68d-lq66h\" (UID: \"0fc0b33b-b75f-4e8c-9013-b4cb993741b8\") " pod="openshift-image-registry/image-registry-99d98f68d-lq66h"
May 21 17:35:24.474701 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:24.474679    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z6frt\" (UniqueName: \"kubernetes.io/projected/45ff293c-20a7-4794-b76f-707d794d3de1-kube-api-access-z6frt\") pod \"network-check-source-7f44b6dd87-w2lvc\" (UID: \"45ff293c-20a7-4794-b76f-707d794d3de1\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-w2lvc"
May 21 17:35:24.474849 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:24.474832    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qd2qj\" (UniqueName: \"kubernetes.io/projected/2ac1cbe0-26ce-432e-930b-bddbf477662a-kube-api-access-qd2qj\") pod \"downloads-57bd96b888-9t58z\" (UID: \"2ac1cbe0-26ce-432e-930b-bddbf477662a\") " pod="openshift-console/downloads-57bd96b888-9t58z"
May 21 17:35:24.568149 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:24.568131    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-w2lvc"
May 21 17:35:24.575820 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:24.575784    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-xgg2n"
May 21 17:35:24.582366 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:24.582346    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-57bd96b888-9t58z"
May 21 17:35:24.590933 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:24.590915    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-99d98f68d-lq66h"
May 21 17:35:24.723756 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:24.723732    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-w2lvc"]
May 21 17:35:24.795859 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:24.795835    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-99d98f68d-lq66h"]
May 21 17:35:24.798156 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:35:24.798135    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0fc0b33b_b75f_4e8c_9013_b4cb993741b8.slice/crio-ae4019272932332acf97395b7adf70d59dce4f8b29cb6d8049040a42137ee69c WatchSource:0}: Error finding container ae4019272932332acf97395b7adf70d59dce4f8b29cb6d8049040a42137ee69c: Status 404 returned error can't find the container with id ae4019272932332acf97395b7adf70d59dce4f8b29cb6d8049040a42137ee69c
May 21 17:35:24.942904 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:24.942874    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-xgg2n"]
May 21 17:35:24.945904 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:24.945877    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-57bd96b888-9t58z"]
May 21 17:35:24.946237 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:35:24.946208    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd31013c7_826d_4686_be6b_c03c1b81d08f.slice/crio-1f8015822f808b6ad89bfa7ddfcdc2a12d4305f7f56516ce90b81b15793deced WatchSource:0}: Error finding container 1f8015822f808b6ad89bfa7ddfcdc2a12d4305f7f56516ce90b81b15793deced: Status 404 returned error can't find the container with id 1f8015822f808b6ad89bfa7ddfcdc2a12d4305f7f56516ce90b81b15793deced
May 21 17:35:24.949384 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:35:24.949357    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ac1cbe0_26ce_432e_930b_bddbf477662a.slice/crio-74457122566dbf3ab082da0fa5c49b41713c979a1dfc95a2489bf5cf66e4edd3 WatchSource:0}: Error finding container 74457122566dbf3ab082da0fa5c49b41713c979a1dfc95a2489bf5cf66e4edd3: Status 404 returned error can't find the container with id 74457122566dbf3ab082da0fa5c49b41713c979a1dfc95a2489bf5cf66e4edd3
May 21 17:35:25.281161 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:25.281115    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-99d98f68d-lq66h" event={"ID":"0fc0b33b-b75f-4e8c-9013-b4cb993741b8","Type":"ContainerStarted","Data":"506c64f0d7c78e9c2cbfe6865071f827903605ada4f265b3ee1c27be11309fca"}
May 21 17:35:25.281161 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:25.281161    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-99d98f68d-lq66h" event={"ID":"0fc0b33b-b75f-4e8c-9013-b4cb993741b8","Type":"ContainerStarted","Data":"ae4019272932332acf97395b7adf70d59dce4f8b29cb6d8049040a42137ee69c"}
May 21 17:35:25.281643 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:25.281344    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-99d98f68d-lq66h"
May 21 17:35:25.282253 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:25.282231    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-xgg2n" event={"ID":"d31013c7-826d-4686-be6b-c03c1b81d08f","Type":"ContainerStarted","Data":"1f8015822f808b6ad89bfa7ddfcdc2a12d4305f7f56516ce90b81b15793deced"}
May 21 17:35:25.283162 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:25.283144    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-57bd96b888-9t58z" event={"ID":"2ac1cbe0-26ce-432e-930b-bddbf477662a","Type":"ContainerStarted","Data":"74457122566dbf3ab082da0fa5c49b41713c979a1dfc95a2489bf5cf66e4edd3"}
May 21 17:35:25.284558 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:25.284535    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-w2lvc" event={"ID":"45ff293c-20a7-4794-b76f-707d794d3de1","Type":"ContainerStarted","Data":"dc2d22c9eb12a2f4b967082203a21f117f20e441b8ccf46248aaaa40fb672502"}
May 21 17:35:25.284558 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:25.284561    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-w2lvc" event={"ID":"45ff293c-20a7-4794-b76f-707d794d3de1","Type":"ContainerStarted","Data":"686ca201b268295cad06877c0d200f000b251cc450ae98e85668ec8b52f4fc0c"}
May 21 17:35:25.298526 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:25.298487    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-99d98f68d-lq66h" podStartSLOduration=1.298474553 podStartE2EDuration="1.298474553s" podCreationTimestamp="2026-05-21 17:35:24 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 17:35:25.298276864 +0000 UTC m=+156.075649371" watchObservedRunningTime="2026-05-21 17:35:25.298474553 +0000 UTC m=+156.075847061"
May 21 17:35:25.312110 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:25.312049    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-w2lvc" podStartSLOduration=1.3120389590000001 podStartE2EDuration="1.312038959s" podCreationTimestamp="2026-05-21 17:35:24 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 17:35:25.310982723 +0000 UTC m=+156.088355228" watchObservedRunningTime="2026-05-21 17:35:25.312038959 +0000 UTC m=+156.089411462"
May 21 17:35:25.605391 ip-10-0-140-106 kubenswrapper[2563]: E0521 17:35:25.605346    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-d75hh" podUID="d8721e69-80fd-48ad-ac87-8f44d8aa94c9"
May 21 17:35:25.624702 ip-10-0-140-106 kubenswrapper[2563]: E0521 17:35:25.624657    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-xvxtt" podUID="958fb2fd-9a72-40c2-b659-e99b240176d1"
May 21 17:35:26.288078 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:26.288028    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-d75hh"
May 21 17:35:26.818205 ip-10-0-140-106 kubenswrapper[2563]: E0521 17:35:26.818150    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-5m8k5" podUID="44544f15-6623-4cbc-876d-2336ac096e94"
May 21 17:35:27.292990 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:27.292952    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-xgg2n" event={"ID":"d31013c7-826d-4686-be6b-c03c1b81d08f","Type":"ContainerStarted","Data":"f283d47efb18cce4fa8141cbc218a11adb3b705d17c63b4890e1f159b5bd4559"}
May 21 17:35:27.293448 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:27.293353    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-xgg2n"
May 21 17:35:27.298605 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:27.298582    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-xgg2n"
May 21 17:35:27.307334 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:27.307284    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-xgg2n" podStartSLOduration=1.941062088 podStartE2EDuration="3.307269569s" podCreationTimestamp="2026-05-21 17:35:24 +0000 UTC" firstStartedPulling="2026-05-21 17:35:24.948312994 +0000 UTC m=+155.725685492" lastFinishedPulling="2026-05-21 17:35:26.314520486 +0000 UTC m=+157.091892973" observedRunningTime="2026-05-21 17:35:27.307127569 +0000 UTC m=+158.084500072" watchObservedRunningTime="2026-05-21 17:35:27.307269569 +0000 UTC m=+158.084642073"
May 21 17:35:30.515027 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:30.514948    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d8721e69-80fd-48ad-ac87-8f44d8aa94c9-cert\") pod \"ingress-canary-d75hh\" (UID: \"d8721e69-80fd-48ad-ac87-8f44d8aa94c9\") " pod="openshift-ingress-canary/ingress-canary-d75hh"
May 21 17:35:30.515027 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:30.514994    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/958fb2fd-9a72-40c2-b659-e99b240176d1-metrics-tls\") pod \"dns-default-xvxtt\" (UID: \"958fb2fd-9a72-40c2-b659-e99b240176d1\") " pod="openshift-dns/dns-default-xvxtt"
May 21 17:35:30.517809 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:30.517776    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/958fb2fd-9a72-40c2-b659-e99b240176d1-metrics-tls\") pod \"dns-default-xvxtt\" (UID: \"958fb2fd-9a72-40c2-b659-e99b240176d1\") " pod="openshift-dns/dns-default-xvxtt"
May 21 17:35:30.517988 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:30.517967    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d8721e69-80fd-48ad-ac87-8f44d8aa94c9-cert\") pod \"ingress-canary-d75hh\" (UID: \"d8721e69-80fd-48ad-ac87-8f44d8aa94c9\") " pod="openshift-ingress-canary/ingress-canary-d75hh"
May 21 17:35:30.791447 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:30.791376    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-7rz88\""
May 21 17:35:30.799442 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:30.799415    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-d75hh"
May 21 17:35:30.953747 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:30.953707    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-d75hh"]
May 21 17:35:30.956911 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:35:30.956877    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8721e69_80fd_48ad_ac87_8f44d8aa94c9.slice/crio-312a8a32c932d369787bee5b0f10dd7a5d2817a901c31e551cc3e5843c3bf07b WatchSource:0}: Error finding container 312a8a32c932d369787bee5b0f10dd7a5d2817a901c31e551cc3e5843c3bf07b: Status 404 returned error can't find the container with id 312a8a32c932d369787bee5b0f10dd7a5d2817a901c31e551cc3e5843c3bf07b
May 21 17:35:31.311492 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:31.311444    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-d75hh" event={"ID":"d8721e69-80fd-48ad-ac87-8f44d8aa94c9","Type":"ContainerStarted","Data":"312a8a32c932d369787bee5b0f10dd7a5d2817a901c31e551cc3e5843c3bf07b"}
May 21 17:35:31.810625 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:31.809310    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-5n24h"]
May 21 17:35:31.812084 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:31.811911    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-5n24h"
May 21 17:35:31.816499 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:31.815616    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-lcllv\""
May 21 17:35:31.816499 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:31.815837    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
May 21 17:35:31.816499 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:31.816088    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
May 21 17:35:31.816499 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:31.816182    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
May 21 17:35:31.816499 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:31.816094    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
May 21 17:35:31.816499 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:31.816359    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
May 21 17:35:31.816499 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:31.816445    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
May 21 17:35:31.822107 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:31.822088    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-5n24h"]
May 21 17:35:31.833346 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:31.829861    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-w2cbs"]
May 21 17:35:31.833346 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:31.832551    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-w2cbs"
May 21 17:35:31.835706 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:31.835628    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-h42qc\""
May 21 17:35:31.836434 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:31.836413    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
May 21 17:35:31.836636 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:31.836620    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
May 21 17:35:31.836859 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:31.836841    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
May 21 17:35:31.927993 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:31.927957    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9090d3c1-ac89-44c4-891f-095f109a4d69-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-5n24h\" (UID: \"9090d3c1-ac89-44c4-891f-095f109a4d69\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-5n24h"
May 21 17:35:31.928233 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:31.928003    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6ff60ab8-04c5-44d0-81da-2c8ae25e723b-node-exporter-tls\") pod \"node-exporter-w2cbs\" (UID: \"6ff60ab8-04c5-44d0-81da-2c8ae25e723b\") " pod="openshift-monitoring/node-exporter-w2cbs"
May 21 17:35:31.928233 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:31.928030    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6ff60ab8-04c5-44d0-81da-2c8ae25e723b-root\") pod \"node-exporter-w2cbs\" (UID: \"6ff60ab8-04c5-44d0-81da-2c8ae25e723b\") " pod="openshift-monitoring/node-exporter-w2cbs"
May 21 17:35:31.928233 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:31.928055    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6ff60ab8-04c5-44d0-81da-2c8ae25e723b-node-exporter-textfile\") pod \"node-exporter-w2cbs\" (UID: \"6ff60ab8-04c5-44d0-81da-2c8ae25e723b\") " pod="openshift-monitoring/node-exporter-w2cbs"
May 21 17:35:31.928233 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:31.928105    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6ff60ab8-04c5-44d0-81da-2c8ae25e723b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-w2cbs\" (UID: \"6ff60ab8-04c5-44d0-81da-2c8ae25e723b\") " pod="openshift-monitoring/node-exporter-w2cbs"
May 21 17:35:31.928233 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:31.928142    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6ff60ab8-04c5-44d0-81da-2c8ae25e723b-metrics-client-ca\") pod \"node-exporter-w2cbs\" (UID: \"6ff60ab8-04c5-44d0-81da-2c8ae25e723b\") " pod="openshift-monitoring/node-exporter-w2cbs"
May 21 17:35:31.928233 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:31.928175    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/9090d3c1-ac89-44c4-891f-095f109a4d69-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-5n24h\" (UID: \"9090d3c1-ac89-44c4-891f-095f109a4d69\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-5n24h"
May 21 17:35:31.928233 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:31.928204    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9090d3c1-ac89-44c4-891f-095f109a4d69-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-5n24h\" (UID: \"9090d3c1-ac89-44c4-891f-095f109a4d69\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-5n24h"
May 21 17:35:31.928643 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:31.928241    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9090d3c1-ac89-44c4-891f-095f109a4d69-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-5n24h\" (UID: \"9090d3c1-ac89-44c4-891f-095f109a4d69\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-5n24h"
May 21 17:35:31.928643 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:31.928280    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6ff60ab8-04c5-44d0-81da-2c8ae25e723b-node-exporter-accelerators-collector-config\") pod \"node-exporter-w2cbs\" (UID: \"6ff60ab8-04c5-44d0-81da-2c8ae25e723b\") " pod="openshift-monitoring/node-exporter-w2cbs"
May 21 17:35:31.928643 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:31.928310    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6ff60ab8-04c5-44d0-81da-2c8ae25e723b-sys\") pod \"node-exporter-w2cbs\" (UID: \"6ff60ab8-04c5-44d0-81da-2c8ae25e723b\") " pod="openshift-monitoring/node-exporter-w2cbs"
May 21 17:35:31.928643 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:31.928364    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dmtvs\" (UniqueName: \"kubernetes.io/projected/6ff60ab8-04c5-44d0-81da-2c8ae25e723b-kube-api-access-dmtvs\") pod \"node-exporter-w2cbs\" (UID: \"6ff60ab8-04c5-44d0-81da-2c8ae25e723b\") " pod="openshift-monitoring/node-exporter-w2cbs"
May 21 17:35:31.928643 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:31.928395    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6ff60ab8-04c5-44d0-81da-2c8ae25e723b-node-exporter-wtmp\") pod \"node-exporter-w2cbs\" (UID: \"6ff60ab8-04c5-44d0-81da-2c8ae25e723b\") " pod="openshift-monitoring/node-exporter-w2cbs"
May 21 17:35:31.928643 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:31.928443    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/9090d3c1-ac89-44c4-891f-095f109a4d69-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-5n24h\" (UID: \"9090d3c1-ac89-44c4-891f-095f109a4d69\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-5n24h"
May 21 17:35:31.928643 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:31.928476    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fvczj\" (UniqueName: \"kubernetes.io/projected/9090d3c1-ac89-44c4-891f-095f109a4d69-kube-api-access-fvczj\") pod \"kube-state-metrics-54fd6bc5c4-5n24h\" (UID: \"9090d3c1-ac89-44c4-891f-095f109a4d69\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-5n24h"
May 21 17:35:32.029607 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:32.029569    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6ff60ab8-04c5-44d0-81da-2c8ae25e723b-sys\") pod \"node-exporter-w2cbs\" (UID: \"6ff60ab8-04c5-44d0-81da-2c8ae25e723b\") " pod="openshift-monitoring/node-exporter-w2cbs"
May 21 17:35:32.029776 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:32.029641    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dmtvs\" (UniqueName: \"kubernetes.io/projected/6ff60ab8-04c5-44d0-81da-2c8ae25e723b-kube-api-access-dmtvs\") pod \"node-exporter-w2cbs\" (UID: \"6ff60ab8-04c5-44d0-81da-2c8ae25e723b\") " pod="openshift-monitoring/node-exporter-w2cbs"
May 21 17:35:32.029776 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:32.029675    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6ff60ab8-04c5-44d0-81da-2c8ae25e723b-node-exporter-wtmp\") pod \"node-exporter-w2cbs\" (UID: \"6ff60ab8-04c5-44d0-81da-2c8ae25e723b\") " pod="openshift-monitoring/node-exporter-w2cbs"
May 21 17:35:32.029776 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:32.029680    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6ff60ab8-04c5-44d0-81da-2c8ae25e723b-sys\") pod \"node-exporter-w2cbs\" (UID: \"6ff60ab8-04c5-44d0-81da-2c8ae25e723b\") " pod="openshift-monitoring/node-exporter-w2cbs"
May 21 17:35:32.029776 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:32.029700    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/9090d3c1-ac89-44c4-891f-095f109a4d69-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-5n24h\" (UID: \"9090d3c1-ac89-44c4-891f-095f109a4d69\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-5n24h"
May 21 17:35:32.029776 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:32.029730    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fvczj\" (UniqueName: \"kubernetes.io/projected/9090d3c1-ac89-44c4-891f-095f109a4d69-kube-api-access-fvczj\") pod \"kube-state-metrics-54fd6bc5c4-5n24h\" (UID: \"9090d3c1-ac89-44c4-891f-095f109a4d69\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-5n24h"
May 21 17:35:32.029776 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:32.029768    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9090d3c1-ac89-44c4-891f-095f109a4d69-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-5n24h\" (UID: \"9090d3c1-ac89-44c4-891f-095f109a4d69\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-5n24h"
May 21 17:35:32.030088 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:32.029794    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6ff60ab8-04c5-44d0-81da-2c8ae25e723b-node-exporter-tls\") pod \"node-exporter-w2cbs\" (UID: \"6ff60ab8-04c5-44d0-81da-2c8ae25e723b\") " pod="openshift-monitoring/node-exporter-w2cbs"
May 21 17:35:32.030088 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:32.029815    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6ff60ab8-04c5-44d0-81da-2c8ae25e723b-root\") pod \"node-exporter-w2cbs\" (UID: \"6ff60ab8-04c5-44d0-81da-2c8ae25e723b\") " pod="openshift-monitoring/node-exporter-w2cbs"
May 21 17:35:32.030088 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:32.029839    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6ff60ab8-04c5-44d0-81da-2c8ae25e723b-node-exporter-textfile\") pod \"node-exporter-w2cbs\" (UID: \"6ff60ab8-04c5-44d0-81da-2c8ae25e723b\") " pod="openshift-monitoring/node-exporter-w2cbs"
May 21 17:35:32.030088 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:32.029882    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6ff60ab8-04c5-44d0-81da-2c8ae25e723b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-w2cbs\" (UID: \"6ff60ab8-04c5-44d0-81da-2c8ae25e723b\") " pod="openshift-monitoring/node-exporter-w2cbs"
May 21 17:35:32.030088 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:32.029918    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6ff60ab8-04c5-44d0-81da-2c8ae25e723b-metrics-client-ca\") pod \"node-exporter-w2cbs\" (UID: \"6ff60ab8-04c5-44d0-81da-2c8ae25e723b\") " pod="openshift-monitoring/node-exporter-w2cbs"
May 21 17:35:32.030088 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:32.029948    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/9090d3c1-ac89-44c4-891f-095f109a4d69-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-5n24h\" (UID: \"9090d3c1-ac89-44c4-891f-095f109a4d69\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-5n24h"
May 21 17:35:32.030088 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:32.029971    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9090d3c1-ac89-44c4-891f-095f109a4d69-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-5n24h\" (UID: \"9090d3c1-ac89-44c4-891f-095f109a4d69\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-5n24h"
May 21 17:35:32.030088 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:32.030009    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9090d3c1-ac89-44c4-891f-095f109a4d69-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-5n24h\" (UID: \"9090d3c1-ac89-44c4-891f-095f109a4d69\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-5n24h"
May 21 17:35:32.030088 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:32.030044    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6ff60ab8-04c5-44d0-81da-2c8ae25e723b-node-exporter-accelerators-collector-config\") pod \"node-exporter-w2cbs\" (UID: \"6ff60ab8-04c5-44d0-81da-2c8ae25e723b\") " pod="openshift-monitoring/node-exporter-w2cbs"
May 21 17:35:32.030525 ip-10-0-140-106 kubenswrapper[2563]: E0521 17:35:32.030096    2563 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
May 21 17:35:32.030525 ip-10-0-140-106 kubenswrapper[2563]: E0521 17:35:32.030157    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ff60ab8-04c5-44d0-81da-2c8ae25e723b-node-exporter-tls podName:6ff60ab8-04c5-44d0-81da-2c8ae25e723b nodeName:}" failed. No retries permitted until 2026-05-21 17:35:32.530137008 +0000 UTC m=+163.307509507 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/6ff60ab8-04c5-44d0-81da-2c8ae25e723b-node-exporter-tls") pod "node-exporter-w2cbs" (UID: "6ff60ab8-04c5-44d0-81da-2c8ae25e723b") : secret "node-exporter-tls" not found
May 21 17:35:32.030525 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:32.030274    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6ff60ab8-04c5-44d0-81da-2c8ae25e723b-node-exporter-wtmp\") pod \"node-exporter-w2cbs\" (UID: \"6ff60ab8-04c5-44d0-81da-2c8ae25e723b\") " pod="openshift-monitoring/node-exporter-w2cbs"
May 21 17:35:32.031142 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:32.030711    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6ff60ab8-04c5-44d0-81da-2c8ae25e723b-node-exporter-accelerators-collector-config\") pod \"node-exporter-w2cbs\" (UID: \"6ff60ab8-04c5-44d0-81da-2c8ae25e723b\") " pod="openshift-monitoring/node-exporter-w2cbs"
May 21 17:35:32.031142 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:32.030927    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/9090d3c1-ac89-44c4-891f-095f109a4d69-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-5n24h\" (UID: \"9090d3c1-ac89-44c4-891f-095f109a4d69\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-5n24h"
May 21 17:35:32.031142 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:32.031021    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6ff60ab8-04c5-44d0-81da-2c8ae25e723b-node-exporter-textfile\") pod \"node-exporter-w2cbs\" (UID: \"6ff60ab8-04c5-44d0-81da-2c8ae25e723b\") " pod="openshift-monitoring/node-exporter-w2cbs"
May 21 17:35:32.031408 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:32.031186    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6ff60ab8-04c5-44d0-81da-2c8ae25e723b-root\") pod \"node-exporter-w2cbs\" (UID: \"6ff60ab8-04c5-44d0-81da-2c8ae25e723b\") " pod="openshift-monitoring/node-exporter-w2cbs"
May 21 17:35:32.031408 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:32.031345    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/9090d3c1-ac89-44c4-891f-095f109a4d69-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-5n24h\" (UID: \"9090d3c1-ac89-44c4-891f-095f109a4d69\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-5n24h"
May 21 17:35:32.031521 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:32.031452    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6ff60ab8-04c5-44d0-81da-2c8ae25e723b-metrics-client-ca\") pod \"node-exporter-w2cbs\" (UID: \"6ff60ab8-04c5-44d0-81da-2c8ae25e723b\") " pod="openshift-monitoring/node-exporter-w2cbs"
May 21 17:35:32.031748 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:32.031703    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9090d3c1-ac89-44c4-891f-095f109a4d69-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-5n24h\" (UID: \"9090d3c1-ac89-44c4-891f-095f109a4d69\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-5n24h"
May 21 17:35:32.034266 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:32.034221    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9090d3c1-ac89-44c4-891f-095f109a4d69-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-5n24h\" (UID: \"9090d3c1-ac89-44c4-891f-095f109a4d69\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-5n24h"
May 21 17:35:32.034986 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:32.034945    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6ff60ab8-04c5-44d0-81da-2c8ae25e723b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-w2cbs\" (UID: \"6ff60ab8-04c5-44d0-81da-2c8ae25e723b\") " pod="openshift-monitoring/node-exporter-w2cbs"
May 21 17:35:32.035797 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:32.035753    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9090d3c1-ac89-44c4-891f-095f109a4d69-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-5n24h\" (UID: \"9090d3c1-ac89-44c4-891f-095f109a4d69\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-5n24h"
May 21 17:35:32.040482 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:32.040457    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fvczj\" (UniqueName: \"kubernetes.io/projected/9090d3c1-ac89-44c4-891f-095f109a4d69-kube-api-access-fvczj\") pod \"kube-state-metrics-54fd6bc5c4-5n24h\" (UID: \"9090d3c1-ac89-44c4-891f-095f109a4d69\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-5n24h"
May 21 17:35:32.045806 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:32.043235    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dmtvs\" (UniqueName: \"kubernetes.io/projected/6ff60ab8-04c5-44d0-81da-2c8ae25e723b-kube-api-access-dmtvs\") pod \"node-exporter-w2cbs\" (UID: \"6ff60ab8-04c5-44d0-81da-2c8ae25e723b\") " pod="openshift-monitoring/node-exporter-w2cbs"
May 21 17:35:32.125893 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:32.125857    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-5n24h"
May 21 17:35:32.449124 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:32.449036    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-7c6f96c7f6-rkb8t"]
May 21 17:35:32.452285 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:32.452262    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c6f96c7f6-rkb8t"
May 21 17:35:32.455022 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:32.454941    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
May 21 17:35:32.455155 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:32.455093    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
May 21 17:35:32.455155 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:32.454945    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-4gspn\""
May 21 17:35:32.455394 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:32.455378    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
May 21 17:35:32.455491 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:32.455394    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
May 21 17:35:32.455686 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:32.455669    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
May 21 17:35:32.460636 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:32.460596    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7c6f96c7f6-rkb8t"]
May 21 17:35:32.534414 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:32.534388    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/43e7053a-c6f7-4b5b-91eb-4c1afc630a4d-console-config\") pod \"console-7c6f96c7f6-rkb8t\" (UID: \"43e7053a-c6f7-4b5b-91eb-4c1afc630a4d\") " pod="openshift-console/console-7c6f96c7f6-rkb8t"
May 21 17:35:32.534570 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:32.534429    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/43e7053a-c6f7-4b5b-91eb-4c1afc630a4d-console-serving-cert\") pod \"console-7c6f96c7f6-rkb8t\" (UID: \"43e7053a-c6f7-4b5b-91eb-4c1afc630a4d\") " pod="openshift-console/console-7c6f96c7f6-rkb8t"
May 21 17:35:32.534570 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:32.534461    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rq56t\" (UniqueName: \"kubernetes.io/projected/43e7053a-c6f7-4b5b-91eb-4c1afc630a4d-kube-api-access-rq56t\") pod \"console-7c6f96c7f6-rkb8t\" (UID: \"43e7053a-c6f7-4b5b-91eb-4c1afc630a4d\") " pod="openshift-console/console-7c6f96c7f6-rkb8t"
May 21 17:35:32.534570 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:32.534499    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/43e7053a-c6f7-4b5b-91eb-4c1afc630a4d-service-ca\") pod \"console-7c6f96c7f6-rkb8t\" (UID: \"43e7053a-c6f7-4b5b-91eb-4c1afc630a4d\") " pod="openshift-console/console-7c6f96c7f6-rkb8t"
May 21 17:35:32.534730 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:32.534589    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/43e7053a-c6f7-4b5b-91eb-4c1afc630a4d-console-oauth-config\") pod \"console-7c6f96c7f6-rkb8t\" (UID: \"43e7053a-c6f7-4b5b-91eb-4c1afc630a4d\") " pod="openshift-console/console-7c6f96c7f6-rkb8t"
May 21 17:35:32.534730 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:32.534640    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6ff60ab8-04c5-44d0-81da-2c8ae25e723b-node-exporter-tls\") pod \"node-exporter-w2cbs\" (UID: \"6ff60ab8-04c5-44d0-81da-2c8ae25e723b\") " pod="openshift-monitoring/node-exporter-w2cbs"
May 21 17:35:32.534730 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:32.534669    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/43e7053a-c6f7-4b5b-91eb-4c1afc630a4d-oauth-serving-cert\") pod \"console-7c6f96c7f6-rkb8t\" (UID: \"43e7053a-c6f7-4b5b-91eb-4c1afc630a4d\") " pod="openshift-console/console-7c6f96c7f6-rkb8t"
May 21 17:35:32.534880 ip-10-0-140-106 kubenswrapper[2563]: E0521 17:35:32.534803    2563 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
May 21 17:35:32.534927 ip-10-0-140-106 kubenswrapper[2563]: E0521 17:35:32.534889    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ff60ab8-04c5-44d0-81da-2c8ae25e723b-node-exporter-tls podName:6ff60ab8-04c5-44d0-81da-2c8ae25e723b nodeName:}" failed. No retries permitted until 2026-05-21 17:35:33.53486772 +0000 UTC m=+164.312240205 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/6ff60ab8-04c5-44d0-81da-2c8ae25e723b-node-exporter-tls") pod "node-exporter-w2cbs" (UID: "6ff60ab8-04c5-44d0-81da-2c8ae25e723b") : secret "node-exporter-tls" not found
May 21 17:35:32.635135 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:32.635102    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/43e7053a-c6f7-4b5b-91eb-4c1afc630a4d-console-oauth-config\") pod \"console-7c6f96c7f6-rkb8t\" (UID: \"43e7053a-c6f7-4b5b-91eb-4c1afc630a4d\") " pod="openshift-console/console-7c6f96c7f6-rkb8t"
May 21 17:35:32.635329 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:32.635169    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/43e7053a-c6f7-4b5b-91eb-4c1afc630a4d-oauth-serving-cert\") pod \"console-7c6f96c7f6-rkb8t\" (UID: \"43e7053a-c6f7-4b5b-91eb-4c1afc630a4d\") " pod="openshift-console/console-7c6f96c7f6-rkb8t"
May 21 17:35:32.635329 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:32.635205    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/43e7053a-c6f7-4b5b-91eb-4c1afc630a4d-console-config\") pod \"console-7c6f96c7f6-rkb8t\" (UID: \"43e7053a-c6f7-4b5b-91eb-4c1afc630a4d\") " pod="openshift-console/console-7c6f96c7f6-rkb8t"
May 21 17:35:32.635329 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:32.635240    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/43e7053a-c6f7-4b5b-91eb-4c1afc630a4d-console-serving-cert\") pod \"console-7c6f96c7f6-rkb8t\" (UID: \"43e7053a-c6f7-4b5b-91eb-4c1afc630a4d\") " pod="openshift-console/console-7c6f96c7f6-rkb8t"
May 21 17:35:32.635329 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:32.635321    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rq56t\" (UniqueName: \"kubernetes.io/projected/43e7053a-c6f7-4b5b-91eb-4c1afc630a4d-kube-api-access-rq56t\") pod \"console-7c6f96c7f6-rkb8t\" (UID: \"43e7053a-c6f7-4b5b-91eb-4c1afc630a4d\") " pod="openshift-console/console-7c6f96c7f6-rkb8t"
May 21 17:35:32.635553 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:32.635407    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/43e7053a-c6f7-4b5b-91eb-4c1afc630a4d-service-ca\") pod \"console-7c6f96c7f6-rkb8t\" (UID: \"43e7053a-c6f7-4b5b-91eb-4c1afc630a4d\") " pod="openshift-console/console-7c6f96c7f6-rkb8t"
May 21 17:35:32.636088 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:32.636043    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/43e7053a-c6f7-4b5b-91eb-4c1afc630a4d-console-config\") pod \"console-7c6f96c7f6-rkb8t\" (UID: \"43e7053a-c6f7-4b5b-91eb-4c1afc630a4d\") " pod="openshift-console/console-7c6f96c7f6-rkb8t"
May 21 17:35:32.636517 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:32.636463    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/43e7053a-c6f7-4b5b-91eb-4c1afc630a4d-service-ca\") pod \"console-7c6f96c7f6-rkb8t\" (UID: \"43e7053a-c6f7-4b5b-91eb-4c1afc630a4d\") " pod="openshift-console/console-7c6f96c7f6-rkb8t"
May 21 17:35:32.636904 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:32.636885    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/43e7053a-c6f7-4b5b-91eb-4c1afc630a4d-oauth-serving-cert\") pod \"console-7c6f96c7f6-rkb8t\" (UID: \"43e7053a-c6f7-4b5b-91eb-4c1afc630a4d\") " pod="openshift-console/console-7c6f96c7f6-rkb8t"
May 21 17:35:32.638463 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:32.638421    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/43e7053a-c6f7-4b5b-91eb-4c1afc630a4d-console-serving-cert\") pod \"console-7c6f96c7f6-rkb8t\" (UID: \"43e7053a-c6f7-4b5b-91eb-4c1afc630a4d\") " pod="openshift-console/console-7c6f96c7f6-rkb8t"
May 21 17:35:32.638947 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:32.638908    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/43e7053a-c6f7-4b5b-91eb-4c1afc630a4d-console-oauth-config\") pod \"console-7c6f96c7f6-rkb8t\" (UID: \"43e7053a-c6f7-4b5b-91eb-4c1afc630a4d\") " pod="openshift-console/console-7c6f96c7f6-rkb8t"
May 21 17:35:32.642825 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:32.642801    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rq56t\" (UniqueName: \"kubernetes.io/projected/43e7053a-c6f7-4b5b-91eb-4c1afc630a4d-kube-api-access-rq56t\") pod \"console-7c6f96c7f6-rkb8t\" (UID: \"43e7053a-c6f7-4b5b-91eb-4c1afc630a4d\") " pod="openshift-console/console-7c6f96c7f6-rkb8t"
May 21 17:35:32.766639 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:32.766416    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c6f96c7f6-rkb8t"
May 21 17:35:32.808792 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:32.808479    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-5n24h"]
May 21 17:35:32.875742 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:32.875692    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 21 17:35:32.879422 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:32.879400    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 21 17:35:32.881964 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:32.881926    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
May 21 17:35:32.882489 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:32.882400    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-2ghpd\""
May 21 17:35:32.882489 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:32.882440    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
May 21 17:35:32.882745 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:32.882635    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
May 21 17:35:32.884934 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:32.882867    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
May 21 17:35:32.884934 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:32.882909    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
May 21 17:35:32.884934 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:32.883003    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
May 21 17:35:32.884934 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:32.883082    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
May 21 17:35:32.884934 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:32.883490    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
May 21 17:35:32.886801 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:32.883490    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
May 21 17:35:32.895077 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:32.895014    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 21 17:35:32.928486 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:32.928439    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7c6f96c7f6-rkb8t"]
May 21 17:35:32.931808 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:35:32.931756    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43e7053a_c6f7_4b5b_91eb_4c1afc630a4d.slice/crio-174ee5d5c45b15b3e3aa34bced767f1550fcc487cfca047c0609d7e068cb3add WatchSource:0}: Error finding container 174ee5d5c45b15b3e3aa34bced767f1550fcc487cfca047c0609d7e068cb3add: Status 404 returned error can't find the container with id 174ee5d5c45b15b3e3aa34bced767f1550fcc487cfca047c0609d7e068cb3add
May 21 17:35:32.938827 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:32.938800    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/27e504bd-cf67-4a9a-a95b-280b565166ad-config-volume\") pod \"alertmanager-main-0\" (UID: \"27e504bd-cf67-4a9a-a95b-280b565166ad\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 17:35:32.938938 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:32.938843    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/27e504bd-cf67-4a9a-a95b-280b565166ad-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"27e504bd-cf67-4a9a-a95b-280b565166ad\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 17:35:32.938938 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:32.938869    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/27e504bd-cf67-4a9a-a95b-280b565166ad-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"27e504bd-cf67-4a9a-a95b-280b565166ad\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 17:35:32.938938 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:32.938893    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/27e504bd-cf67-4a9a-a95b-280b565166ad-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"27e504bd-cf67-4a9a-a95b-280b565166ad\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 17:35:32.939116 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:32.938940    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/27e504bd-cf67-4a9a-a95b-280b565166ad-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"27e504bd-cf67-4a9a-a95b-280b565166ad\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 17:35:32.939116 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:32.938966    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/27e504bd-cf67-4a9a-a95b-280b565166ad-tls-assets\") pod \"alertmanager-main-0\" (UID: \"27e504bd-cf67-4a9a-a95b-280b565166ad\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 17:35:32.939116 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:32.938990    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/27e504bd-cf67-4a9a-a95b-280b565166ad-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"27e504bd-cf67-4a9a-a95b-280b565166ad\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 17:35:32.939116 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:32.939016    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/27e504bd-cf67-4a9a-a95b-280b565166ad-config-out\") pod \"alertmanager-main-0\" (UID: \"27e504bd-cf67-4a9a-a95b-280b565166ad\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 17:35:32.939116 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:32.939043    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/27e504bd-cf67-4a9a-a95b-280b565166ad-web-config\") pod \"alertmanager-main-0\" (UID: \"27e504bd-cf67-4a9a-a95b-280b565166ad\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 17:35:32.939116 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:32.939101    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27e504bd-cf67-4a9a-a95b-280b565166ad-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"27e504bd-cf67-4a9a-a95b-280b565166ad\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 17:35:32.939417 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:32.939154    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/27e504bd-cf67-4a9a-a95b-280b565166ad-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"27e504bd-cf67-4a9a-a95b-280b565166ad\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 17:35:32.939417 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:32.939182    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lmdmz\" (UniqueName: \"kubernetes.io/projected/27e504bd-cf67-4a9a-a95b-280b565166ad-kube-api-access-lmdmz\") pod \"alertmanager-main-0\" (UID: \"27e504bd-cf67-4a9a-a95b-280b565166ad\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 17:35:32.939417 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:32.939236    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/27e504bd-cf67-4a9a-a95b-280b565166ad-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"27e504bd-cf67-4a9a-a95b-280b565166ad\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 17:35:33.039671 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:33.039605    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/27e504bd-cf67-4a9a-a95b-280b565166ad-config-volume\") pod \"alertmanager-main-0\" (UID: \"27e504bd-cf67-4a9a-a95b-280b565166ad\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 17:35:33.039671 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:33.039654    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/27e504bd-cf67-4a9a-a95b-280b565166ad-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"27e504bd-cf67-4a9a-a95b-280b565166ad\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 17:35:33.039849 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:33.039818    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/27e504bd-cf67-4a9a-a95b-280b565166ad-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"27e504bd-cf67-4a9a-a95b-280b565166ad\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 17:35:33.039902 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:33.039851    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/27e504bd-cf67-4a9a-a95b-280b565166ad-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"27e504bd-cf67-4a9a-a95b-280b565166ad\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 17:35:33.039952 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:33.039909    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/27e504bd-cf67-4a9a-a95b-280b565166ad-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"27e504bd-cf67-4a9a-a95b-280b565166ad\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 17:35:33.039952 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:33.039937    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/27e504bd-cf67-4a9a-a95b-280b565166ad-tls-assets\") pod \"alertmanager-main-0\" (UID: \"27e504bd-cf67-4a9a-a95b-280b565166ad\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 17:35:33.040052 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:33.039962    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/27e504bd-cf67-4a9a-a95b-280b565166ad-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"27e504bd-cf67-4a9a-a95b-280b565166ad\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 17:35:33.040052 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:33.039992    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/27e504bd-cf67-4a9a-a95b-280b565166ad-config-out\") pod \"alertmanager-main-0\" (UID: \"27e504bd-cf67-4a9a-a95b-280b565166ad\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 17:35:33.040052 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:33.040028    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/27e504bd-cf67-4a9a-a95b-280b565166ad-web-config\") pod \"alertmanager-main-0\" (UID: \"27e504bd-cf67-4a9a-a95b-280b565166ad\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 17:35:33.040208 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:33.040092    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27e504bd-cf67-4a9a-a95b-280b565166ad-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"27e504bd-cf67-4a9a-a95b-280b565166ad\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 17:35:33.040208 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:33.040156    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/27e504bd-cf67-4a9a-a95b-280b565166ad-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"27e504bd-cf67-4a9a-a95b-280b565166ad\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 17:35:33.040208 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:33.040185    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lmdmz\" (UniqueName: \"kubernetes.io/projected/27e504bd-cf67-4a9a-a95b-280b565166ad-kube-api-access-lmdmz\") pod \"alertmanager-main-0\" (UID: \"27e504bd-cf67-4a9a-a95b-280b565166ad\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 17:35:33.040387 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:33.040232    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/27e504bd-cf67-4a9a-a95b-280b565166ad-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"27e504bd-cf67-4a9a-a95b-280b565166ad\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 17:35:33.040387 ip-10-0-140-106 kubenswrapper[2563]: E0521 17:35:33.040372    2563 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found
May 21 17:35:33.040483 ip-10-0-140-106 kubenswrapper[2563]: E0521 17:35:33.040429    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27e504bd-cf67-4a9a-a95b-280b565166ad-secret-alertmanager-main-tls podName:27e504bd-cf67-4a9a-a95b-280b565166ad nodeName:}" failed. No retries permitted until 2026-05-21 17:35:33.540410933 +0000 UTC m=+164.317783430 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/27e504bd-cf67-4a9a-a95b-280b565166ad-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "27e504bd-cf67-4a9a-a95b-280b565166ad") : secret "alertmanager-main-tls" not found
May 21 17:35:33.040483 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:33.040427    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/27e504bd-cf67-4a9a-a95b-280b565166ad-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"27e504bd-cf67-4a9a-a95b-280b565166ad\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 17:35:33.040692 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:33.040668    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/27e504bd-cf67-4a9a-a95b-280b565166ad-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"27e504bd-cf67-4a9a-a95b-280b565166ad\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 17:35:33.041621 ip-10-0-140-106 kubenswrapper[2563]: E0521 17:35:33.041588    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/27e504bd-cf67-4a9a-a95b-280b565166ad-alertmanager-trusted-ca-bundle podName:27e504bd-cf67-4a9a-a95b-280b565166ad nodeName:}" failed. No retries permitted until 2026-05-21 17:35:33.541568186 +0000 UTC m=+164.318940689 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/27e504bd-cf67-4a9a-a95b-280b565166ad-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "27e504bd-cf67-4a9a-a95b-280b565166ad") : configmap references non-existent config key: ca-bundle.crt
May 21 17:35:33.042655 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:33.042612    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/27e504bd-cf67-4a9a-a95b-280b565166ad-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"27e504bd-cf67-4a9a-a95b-280b565166ad\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 17:35:33.042655 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:33.042620    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/27e504bd-cf67-4a9a-a95b-280b565166ad-config-volume\") pod \"alertmanager-main-0\" (UID: \"27e504bd-cf67-4a9a-a95b-280b565166ad\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 17:35:33.043501 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:33.043372    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/27e504bd-cf67-4a9a-a95b-280b565166ad-tls-assets\") pod \"alertmanager-main-0\" (UID: \"27e504bd-cf67-4a9a-a95b-280b565166ad\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 17:35:33.044122 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:33.044096    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/27e504bd-cf67-4a9a-a95b-280b565166ad-config-out\") pod \"alertmanager-main-0\" (UID: \"27e504bd-cf67-4a9a-a95b-280b565166ad\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 17:35:33.045029 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:33.045008    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/27e504bd-cf67-4a9a-a95b-280b565166ad-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"27e504bd-cf67-4a9a-a95b-280b565166ad\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 17:35:33.045981 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:33.045960    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/27e504bd-cf67-4a9a-a95b-280b565166ad-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"27e504bd-cf67-4a9a-a95b-280b565166ad\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 17:35:33.046533 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:33.046510    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/27e504bd-cf67-4a9a-a95b-280b565166ad-web-config\") pod \"alertmanager-main-0\" (UID: \"27e504bd-cf67-4a9a-a95b-280b565166ad\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 17:35:33.047577 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:33.047548    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/27e504bd-cf67-4a9a-a95b-280b565166ad-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"27e504bd-cf67-4a9a-a95b-280b565166ad\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 17:35:33.049899 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:33.049876    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lmdmz\" (UniqueName: \"kubernetes.io/projected/27e504bd-cf67-4a9a-a95b-280b565166ad-kube-api-access-lmdmz\") pod \"alertmanager-main-0\" (UID: \"27e504bd-cf67-4a9a-a95b-280b565166ad\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 17:35:33.318988 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:33.318906    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c6f96c7f6-rkb8t" event={"ID":"43e7053a-c6f7-4b5b-91eb-4c1afc630a4d","Type":"ContainerStarted","Data":"174ee5d5c45b15b3e3aa34bced767f1550fcc487cfca047c0609d7e068cb3add"}
May 21 17:35:33.320012 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:33.319967    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-5n24h" event={"ID":"9090d3c1-ac89-44c4-891f-095f109a4d69","Type":"ContainerStarted","Data":"f10eb06fbe41939c52fa726c045d1069de288d3fc429af90ba6abdd97f61288d"}
May 21 17:35:33.321317 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:33.321296    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-d75hh" event={"ID":"d8721e69-80fd-48ad-ac87-8f44d8aa94c9","Type":"ContainerStarted","Data":"23e67c14a7e48dad40b0d5a43ad32a363c5c04e5249a5e98ba9fbf5ab540e53f"}
May 21 17:35:33.336662 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:33.336611    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-d75hh" podStartSLOduration=129.609989319 podStartE2EDuration="2m11.336599123s" podCreationTimestamp="2026-05-21 17:33:22 +0000 UTC" firstStartedPulling="2026-05-21 17:35:30.95918659 +0000 UTC m=+161.736559076" lastFinishedPulling="2026-05-21 17:35:32.685796393 +0000 UTC m=+163.463168880" observedRunningTime="2026-05-21 17:35:33.33535853 +0000 UTC m=+164.112731035" watchObservedRunningTime="2026-05-21 17:35:33.336599123 +0000 UTC m=+164.113971661"
May 21 17:35:33.546413 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:33.545793    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27e504bd-cf67-4a9a-a95b-280b565166ad-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"27e504bd-cf67-4a9a-a95b-280b565166ad\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 17:35:33.546413 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:33.545868    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6ff60ab8-04c5-44d0-81da-2c8ae25e723b-node-exporter-tls\") pod \"node-exporter-w2cbs\" (UID: \"6ff60ab8-04c5-44d0-81da-2c8ae25e723b\") " pod="openshift-monitoring/node-exporter-w2cbs"
May 21 17:35:33.546413 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:33.545903    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/27e504bd-cf67-4a9a-a95b-280b565166ad-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"27e504bd-cf67-4a9a-a95b-280b565166ad\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 17:35:33.547135 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:33.547107    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27e504bd-cf67-4a9a-a95b-280b565166ad-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"27e504bd-cf67-4a9a-a95b-280b565166ad\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 17:35:33.549011 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:33.548966    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6ff60ab8-04c5-44d0-81da-2c8ae25e723b-node-exporter-tls\") pod \"node-exporter-w2cbs\" (UID: \"6ff60ab8-04c5-44d0-81da-2c8ae25e723b\") " pod="openshift-monitoring/node-exporter-w2cbs"
May 21 17:35:33.550197 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:33.550153    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/27e504bd-cf67-4a9a-a95b-280b565166ad-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"27e504bd-cf67-4a9a-a95b-280b565166ad\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 17:35:33.646106 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:33.646070    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-w2cbs"
May 21 17:35:33.657934 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:35:33.657902    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ff60ab8_04c5_44d0_81da_2c8ae25e723b.slice/crio-8481a6652f0f3a9a8618c79465b745522e7eef84820bdddac551231d2924d314 WatchSource:0}: Error finding container 8481a6652f0f3a9a8618c79465b745522e7eef84820bdddac551231d2924d314: Status 404 returned error can't find the container with id 8481a6652f0f3a9a8618c79465b745522e7eef84820bdddac551231d2924d314
May 21 17:35:33.794747 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:33.794325    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 21 17:35:33.960120 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:33.959866    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 21 17:35:33.962358 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:35:33.962327    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27e504bd_cf67_4a9a_a95b_280b565166ad.slice/crio-4bced5285f0f5798ba202f32c4a3666a4657ebf5a6e88593ce23131cacbc8ddb WatchSource:0}: Error finding container 4bced5285f0f5798ba202f32c4a3666a4657ebf5a6e88593ce23131cacbc8ddb: Status 404 returned error can't find the container with id 4bced5285f0f5798ba202f32c4a3666a4657ebf5a6e88593ce23131cacbc8ddb
May 21 17:35:34.326320 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:34.326231    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"27e504bd-cf67-4a9a-a95b-280b565166ad","Type":"ContainerStarted","Data":"4bced5285f0f5798ba202f32c4a3666a4657ebf5a6e88593ce23131cacbc8ddb"}
May 21 17:35:34.328216 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:34.328186    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-w2cbs" event={"ID":"6ff60ab8-04c5-44d0-81da-2c8ae25e723b","Type":"ContainerStarted","Data":"8481a6652f0f3a9a8618c79465b745522e7eef84820bdddac551231d2924d314"}
May 21 17:35:35.338086 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:35.337706    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-5n24h" event={"ID":"9090d3c1-ac89-44c4-891f-095f109a4d69","Type":"ContainerStarted","Data":"262f78608bdc57241375277a0fb4f75321976dee4206a6a126badd8f6a3ccc7f"}
May 21 17:35:35.338086 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:35.337753    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-5n24h" event={"ID":"9090d3c1-ac89-44c4-891f-095f109a4d69","Type":"ContainerStarted","Data":"107fd209c52b85a34d3f4aa618f0372e8823110acfa47ef39c6867268d058494"}
May 21 17:35:35.338086 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:35.337767    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-5n24h" event={"ID":"9090d3c1-ac89-44c4-891f-095f109a4d69","Type":"ContainerStarted","Data":"bce1b69464c5d0b72ce347ad95c849d23af33bc7f1181c1c29d5074cad8d85c6"}
May 21 17:35:35.356543 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:35.356172    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-5n24h" podStartSLOduration=2.776335487 podStartE2EDuration="4.35613259s" podCreationTimestamp="2026-05-21 17:35:31 +0000 UTC" firstStartedPulling="2026-05-21 17:35:32.815207276 +0000 UTC m=+163.592579759" lastFinishedPulling="2026-05-21 17:35:34.395004366 +0000 UTC m=+165.172376862" observedRunningTime="2026-05-21 17:35:35.354772804 +0000 UTC m=+166.132145310" watchObservedRunningTime="2026-05-21 17:35:35.35613259 +0000 UTC m=+166.133505094"
May 21 17:35:36.209816 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:36.209783    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-7dbd559cb4-pwfnq"]
May 21 17:35:36.212758 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:36.212732    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7dbd559cb4-pwfnq"
May 21 17:35:36.216259 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:36.216233    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
May 21 17:35:36.216393 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:36.216320    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
May 21 17:35:36.216446 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:36.216415    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-9n1tdgvfn17g1\""
May 21 17:35:36.216493 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:36.216415    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
May 21 17:35:36.216611 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:36.216592    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-9k7lr\""
May 21 17:35:36.216682 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:36.216657    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
May 21 17:35:36.223638 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:36.223596    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7dbd559cb4-pwfnq"]
May 21 17:35:36.274656 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:36.274579    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d44c6e19-a7a9-4a25-8253-7c83602a8b34-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7dbd559cb4-pwfnq\" (UID: \"d44c6e19-a7a9-4a25-8253-7c83602a8b34\") " pod="openshift-monitoring/metrics-server-7dbd559cb4-pwfnq"
May 21 17:35:36.274656 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:36.274627    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mrsnk\" (UniqueName: \"kubernetes.io/projected/d44c6e19-a7a9-4a25-8253-7c83602a8b34-kube-api-access-mrsnk\") pod \"metrics-server-7dbd559cb4-pwfnq\" (UID: \"d44c6e19-a7a9-4a25-8253-7c83602a8b34\") " pod="openshift-monitoring/metrics-server-7dbd559cb4-pwfnq"
May 21 17:35:36.274869 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:36.274684    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/d44c6e19-a7a9-4a25-8253-7c83602a8b34-secret-metrics-server-tls\") pod \"metrics-server-7dbd559cb4-pwfnq\" (UID: \"d44c6e19-a7a9-4a25-8253-7c83602a8b34\") " pod="openshift-monitoring/metrics-server-7dbd559cb4-pwfnq"
May 21 17:35:36.274869 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:36.274716    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/d44c6e19-a7a9-4a25-8253-7c83602a8b34-metrics-server-audit-profiles\") pod \"metrics-server-7dbd559cb4-pwfnq\" (UID: \"d44c6e19-a7a9-4a25-8253-7c83602a8b34\") " pod="openshift-monitoring/metrics-server-7dbd559cb4-pwfnq"
May 21 17:35:36.274869 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:36.274831    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/d44c6e19-a7a9-4a25-8253-7c83602a8b34-audit-log\") pod \"metrics-server-7dbd559cb4-pwfnq\" (UID: \"d44c6e19-a7a9-4a25-8253-7c83602a8b34\") " pod="openshift-monitoring/metrics-server-7dbd559cb4-pwfnq"
May 21 17:35:36.275001 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:36.274880    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/d44c6e19-a7a9-4a25-8253-7c83602a8b34-secret-metrics-server-client-certs\") pod \"metrics-server-7dbd559cb4-pwfnq\" (UID: \"d44c6e19-a7a9-4a25-8253-7c83602a8b34\") " pod="openshift-monitoring/metrics-server-7dbd559cb4-pwfnq"
May 21 17:35:36.275001 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:36.274911    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d44c6e19-a7a9-4a25-8253-7c83602a8b34-client-ca-bundle\") pod \"metrics-server-7dbd559cb4-pwfnq\" (UID: \"d44c6e19-a7a9-4a25-8253-7c83602a8b34\") " pod="openshift-monitoring/metrics-server-7dbd559cb4-pwfnq"
May 21 17:35:36.375399 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:36.375363    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d44c6e19-a7a9-4a25-8253-7c83602a8b34-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7dbd559cb4-pwfnq\" (UID: \"d44c6e19-a7a9-4a25-8253-7c83602a8b34\") " pod="openshift-monitoring/metrics-server-7dbd559cb4-pwfnq"
May 21 17:35:36.375854 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:36.375411    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mrsnk\" (UniqueName: \"kubernetes.io/projected/d44c6e19-a7a9-4a25-8253-7c83602a8b34-kube-api-access-mrsnk\") pod \"metrics-server-7dbd559cb4-pwfnq\" (UID: \"d44c6e19-a7a9-4a25-8253-7c83602a8b34\") " pod="openshift-monitoring/metrics-server-7dbd559cb4-pwfnq"
May 21 17:35:36.375854 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:36.375474    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/d44c6e19-a7a9-4a25-8253-7c83602a8b34-secret-metrics-server-tls\") pod \"metrics-server-7dbd559cb4-pwfnq\" (UID: \"d44c6e19-a7a9-4a25-8253-7c83602a8b34\") " pod="openshift-monitoring/metrics-server-7dbd559cb4-pwfnq"
May 21 17:35:36.375854 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:36.375512    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/d44c6e19-a7a9-4a25-8253-7c83602a8b34-metrics-server-audit-profiles\") pod \"metrics-server-7dbd559cb4-pwfnq\" (UID: \"d44c6e19-a7a9-4a25-8253-7c83602a8b34\") " pod="openshift-monitoring/metrics-server-7dbd559cb4-pwfnq"
May 21 17:35:36.375854 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:36.375597    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/d44c6e19-a7a9-4a25-8253-7c83602a8b34-audit-log\") pod \"metrics-server-7dbd559cb4-pwfnq\" (UID: \"d44c6e19-a7a9-4a25-8253-7c83602a8b34\") " pod="openshift-monitoring/metrics-server-7dbd559cb4-pwfnq"
May 21 17:35:36.375854 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:36.375625    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/d44c6e19-a7a9-4a25-8253-7c83602a8b34-secret-metrics-server-client-certs\") pod \"metrics-server-7dbd559cb4-pwfnq\" (UID: \"d44c6e19-a7a9-4a25-8253-7c83602a8b34\") " pod="openshift-monitoring/metrics-server-7dbd559cb4-pwfnq"
May 21 17:35:36.375854 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:36.375652    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d44c6e19-a7a9-4a25-8253-7c83602a8b34-client-ca-bundle\") pod \"metrics-server-7dbd559cb4-pwfnq\" (UID: \"d44c6e19-a7a9-4a25-8253-7c83602a8b34\") " pod="openshift-monitoring/metrics-server-7dbd559cb4-pwfnq"
May 21 17:35:36.376248 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:36.376219    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d44c6e19-a7a9-4a25-8253-7c83602a8b34-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7dbd559cb4-pwfnq\" (UID: \"d44c6e19-a7a9-4a25-8253-7c83602a8b34\") " pod="openshift-monitoring/metrics-server-7dbd559cb4-pwfnq"
May 21 17:35:36.376388 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:36.376344    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/d44c6e19-a7a9-4a25-8253-7c83602a8b34-audit-log\") pod \"metrics-server-7dbd559cb4-pwfnq\" (UID: \"d44c6e19-a7a9-4a25-8253-7c83602a8b34\") " pod="openshift-monitoring/metrics-server-7dbd559cb4-pwfnq"
May 21 17:35:36.376907 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:36.376854    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/d44c6e19-a7a9-4a25-8253-7c83602a8b34-metrics-server-audit-profiles\") pod \"metrics-server-7dbd559cb4-pwfnq\" (UID: \"d44c6e19-a7a9-4a25-8253-7c83602a8b34\") " pod="openshift-monitoring/metrics-server-7dbd559cb4-pwfnq"
May 21 17:35:36.378730 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:36.378706    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d44c6e19-a7a9-4a25-8253-7c83602a8b34-client-ca-bundle\") pod \"metrics-server-7dbd559cb4-pwfnq\" (UID: \"d44c6e19-a7a9-4a25-8253-7c83602a8b34\") " pod="openshift-monitoring/metrics-server-7dbd559cb4-pwfnq"
May 21 17:35:36.378821 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:36.378784    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/d44c6e19-a7a9-4a25-8253-7c83602a8b34-secret-metrics-server-tls\") pod \"metrics-server-7dbd559cb4-pwfnq\" (UID: \"d44c6e19-a7a9-4a25-8253-7c83602a8b34\") " pod="openshift-monitoring/metrics-server-7dbd559cb4-pwfnq"
May 21 17:35:36.379321 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:36.379299    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/d44c6e19-a7a9-4a25-8253-7c83602a8b34-secret-metrics-server-client-certs\") pod \"metrics-server-7dbd559cb4-pwfnq\" (UID: \"d44c6e19-a7a9-4a25-8253-7c83602a8b34\") " pod="openshift-monitoring/metrics-server-7dbd559cb4-pwfnq"
May 21 17:35:36.386487 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:36.386442    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mrsnk\" (UniqueName: \"kubernetes.io/projected/d44c6e19-a7a9-4a25-8253-7c83602a8b34-kube-api-access-mrsnk\") pod \"metrics-server-7dbd559cb4-pwfnq\" (UID: \"d44c6e19-a7a9-4a25-8253-7c83602a8b34\") " pod="openshift-monitoring/metrics-server-7dbd559cb4-pwfnq"
May 21 17:35:36.525297 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:36.525212    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7dbd559cb4-pwfnq"
May 21 17:35:36.800510 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:36.799941    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xvxtt"
May 21 17:35:36.802832 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:36.802626    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-nhpf9\""
May 21 17:35:36.811510 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:36.811110    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xvxtt"
May 21 17:35:36.925583 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:36.925427    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7dbd559cb4-pwfnq"]
May 21 17:35:36.985332 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:36.985302    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-xvxtt"]
May 21 17:35:36.988469 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:35:36.988431    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod958fb2fd_9a72_40c2_b659_e99b240176d1.slice/crio-575e5f5632a8037b47cac3eac392feb1fddcb833d681c92c45423c513a5fd9a1 WatchSource:0}: Error finding container 575e5f5632a8037b47cac3eac392feb1fddcb833d681c92c45423c513a5fd9a1: Status 404 returned error can't find the container with id 575e5f5632a8037b47cac3eac392feb1fddcb833d681c92c45423c513a5fd9a1
May 21 17:35:37.346067 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:37.346015    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c6f96c7f6-rkb8t" event={"ID":"43e7053a-c6f7-4b5b-91eb-4c1afc630a4d","Type":"ContainerStarted","Data":"3ba2e385a988993531e3f2427dec24ea9e56f5a981851c43e306dae7a11fb237"}
May 21 17:35:37.347218 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:37.347178    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xvxtt" event={"ID":"958fb2fd-9a72-40c2-b659-e99b240176d1","Type":"ContainerStarted","Data":"575e5f5632a8037b47cac3eac392feb1fddcb833d681c92c45423c513a5fd9a1"}
May 21 17:35:37.348685 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:37.348658    2563 generic.go:358] "Generic (PLEG): container finished" podID="27e504bd-cf67-4a9a-a95b-280b565166ad" containerID="6d96e55436c12e0ed7f086c90e2e1f09442149ce8cad4c944c5d32fcefcc1d3a" exitCode=0
May 21 17:35:37.348796 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:37.348730    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"27e504bd-cf67-4a9a-a95b-280b565166ad","Type":"ContainerDied","Data":"6d96e55436c12e0ed7f086c90e2e1f09442149ce8cad4c944c5d32fcefcc1d3a"}
May 21 17:35:37.350460 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:37.350388    2563 generic.go:358] "Generic (PLEG): container finished" podID="6ff60ab8-04c5-44d0-81da-2c8ae25e723b" containerID="3938c8cbb6312206e848959de077545563edf9b40d1b879bbd699832740c6df6" exitCode=0
May 21 17:35:37.350533 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:37.350475    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-w2cbs" event={"ID":"6ff60ab8-04c5-44d0-81da-2c8ae25e723b","Type":"ContainerDied","Data":"3938c8cbb6312206e848959de077545563edf9b40d1b879bbd699832740c6df6"}
May 21 17:35:37.351754 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:37.351731    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7dbd559cb4-pwfnq" event={"ID":"d44c6e19-a7a9-4a25-8253-7c83602a8b34","Type":"ContainerStarted","Data":"6d45dc031abcfddce11c48216c9226cbd79b7580a9b0386b7c8aaa180a10f6c8"}
May 21 17:35:37.360987 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:37.360943    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-7c6f96c7f6-rkb8t" podStartSLOduration=1.536417627 podStartE2EDuration="5.360928039s" podCreationTimestamp="2026-05-21 17:35:32 +0000 UTC" firstStartedPulling="2026-05-21 17:35:32.933890511 +0000 UTC m=+163.711263001" lastFinishedPulling="2026-05-21 17:35:36.758400917 +0000 UTC m=+167.535773413" observedRunningTime="2026-05-21 17:35:37.360442838 +0000 UTC m=+168.137815343" watchObservedRunningTime="2026-05-21 17:35:37.360928039 +0000 UTC m=+168.138300543"
May 21 17:35:38.799934 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:38.799894    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5m8k5"
May 21 17:35:40.045053 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:40.045015    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-58f4f797fc-flqs4"]
May 21 17:35:40.048603 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:40.048581    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-58f4f797fc-flqs4"
May 21 17:35:40.055902 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:40.055868    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
May 21 17:35:40.056023 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:40.056009    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-58f4f797fc-flqs4"]
May 21 17:35:40.111158 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:40.111131    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dac805af-f8a4-4a1f-8f53-ed7328c54c7a-trusted-ca-bundle\") pod \"console-58f4f797fc-flqs4\" (UID: \"dac805af-f8a4-4a1f-8f53-ed7328c54c7a\") " pod="openshift-console/console-58f4f797fc-flqs4"
May 21 17:35:40.111329 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:40.111173    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-82plw\" (UniqueName: \"kubernetes.io/projected/dac805af-f8a4-4a1f-8f53-ed7328c54c7a-kube-api-access-82plw\") pod \"console-58f4f797fc-flqs4\" (UID: \"dac805af-f8a4-4a1f-8f53-ed7328c54c7a\") " pod="openshift-console/console-58f4f797fc-flqs4"
May 21 17:35:40.111329 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:40.111212    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dac805af-f8a4-4a1f-8f53-ed7328c54c7a-console-oauth-config\") pod \"console-58f4f797fc-flqs4\" (UID: \"dac805af-f8a4-4a1f-8f53-ed7328c54c7a\") " pod="openshift-console/console-58f4f797fc-flqs4"
May 21 17:35:40.111413 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:40.111332    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dac805af-f8a4-4a1f-8f53-ed7328c54c7a-console-config\") pod \"console-58f4f797fc-flqs4\" (UID: \"dac805af-f8a4-4a1f-8f53-ed7328c54c7a\") " pod="openshift-console/console-58f4f797fc-flqs4"
May 21 17:35:40.111413 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:40.111374    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dac805af-f8a4-4a1f-8f53-ed7328c54c7a-oauth-serving-cert\") pod \"console-58f4f797fc-flqs4\" (UID: \"dac805af-f8a4-4a1f-8f53-ed7328c54c7a\") " pod="openshift-console/console-58f4f797fc-flqs4"
May 21 17:35:40.111413 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:40.111408    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dac805af-f8a4-4a1f-8f53-ed7328c54c7a-console-serving-cert\") pod \"console-58f4f797fc-flqs4\" (UID: \"dac805af-f8a4-4a1f-8f53-ed7328c54c7a\") " pod="openshift-console/console-58f4f797fc-flqs4"
May 21 17:35:40.111536 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:40.111449    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dac805af-f8a4-4a1f-8f53-ed7328c54c7a-service-ca\") pod \"console-58f4f797fc-flqs4\" (UID: \"dac805af-f8a4-4a1f-8f53-ed7328c54c7a\") " pod="openshift-console/console-58f4f797fc-flqs4"
May 21 17:35:40.212124 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:40.212090    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dac805af-f8a4-4a1f-8f53-ed7328c54c7a-console-serving-cert\") pod \"console-58f4f797fc-flqs4\" (UID: \"dac805af-f8a4-4a1f-8f53-ed7328c54c7a\") " pod="openshift-console/console-58f4f797fc-flqs4"
May 21 17:35:40.212288 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:40.212149    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dac805af-f8a4-4a1f-8f53-ed7328c54c7a-service-ca\") pod \"console-58f4f797fc-flqs4\" (UID: \"dac805af-f8a4-4a1f-8f53-ed7328c54c7a\") " pod="openshift-console/console-58f4f797fc-flqs4"
May 21 17:35:40.212288 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:40.212187    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dac805af-f8a4-4a1f-8f53-ed7328c54c7a-trusted-ca-bundle\") pod \"console-58f4f797fc-flqs4\" (UID: \"dac805af-f8a4-4a1f-8f53-ed7328c54c7a\") " pod="openshift-console/console-58f4f797fc-flqs4"
May 21 17:35:40.212288 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:40.212231    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-82plw\" (UniqueName: \"kubernetes.io/projected/dac805af-f8a4-4a1f-8f53-ed7328c54c7a-kube-api-access-82plw\") pod \"console-58f4f797fc-flqs4\" (UID: \"dac805af-f8a4-4a1f-8f53-ed7328c54c7a\") " pod="openshift-console/console-58f4f797fc-flqs4"
May 21 17:35:40.212288 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:40.212266    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dac805af-f8a4-4a1f-8f53-ed7328c54c7a-console-oauth-config\") pod \"console-58f4f797fc-flqs4\" (UID: \"dac805af-f8a4-4a1f-8f53-ed7328c54c7a\") " pod="openshift-console/console-58f4f797fc-flqs4"
May 21 17:35:40.212490 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:40.212346    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dac805af-f8a4-4a1f-8f53-ed7328c54c7a-console-config\") pod \"console-58f4f797fc-flqs4\" (UID: \"dac805af-f8a4-4a1f-8f53-ed7328c54c7a\") " pod="openshift-console/console-58f4f797fc-flqs4"
May 21 17:35:40.212490 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:40.212396    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dac805af-f8a4-4a1f-8f53-ed7328c54c7a-oauth-serving-cert\") pod \"console-58f4f797fc-flqs4\" (UID: \"dac805af-f8a4-4a1f-8f53-ed7328c54c7a\") " pod="openshift-console/console-58f4f797fc-flqs4"
May 21 17:35:40.212939 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:40.212915    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dac805af-f8a4-4a1f-8f53-ed7328c54c7a-service-ca\") pod \"console-58f4f797fc-flqs4\" (UID: \"dac805af-f8a4-4a1f-8f53-ed7328c54c7a\") " pod="openshift-console/console-58f4f797fc-flqs4"
May 21 17:35:40.213389 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:40.213326    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dac805af-f8a4-4a1f-8f53-ed7328c54c7a-trusted-ca-bundle\") pod \"console-58f4f797fc-flqs4\" (UID: \"dac805af-f8a4-4a1f-8f53-ed7328c54c7a\") " pod="openshift-console/console-58f4f797fc-flqs4"
May 21 17:35:40.213389 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:40.213340    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dac805af-f8a4-4a1f-8f53-ed7328c54c7a-oauth-serving-cert\") pod \"console-58f4f797fc-flqs4\" (UID: \"dac805af-f8a4-4a1f-8f53-ed7328c54c7a\") " pod="openshift-console/console-58f4f797fc-flqs4"
May 21 17:35:40.213389 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:40.213333    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dac805af-f8a4-4a1f-8f53-ed7328c54c7a-console-config\") pod \"console-58f4f797fc-flqs4\" (UID: \"dac805af-f8a4-4a1f-8f53-ed7328c54c7a\") " pod="openshift-console/console-58f4f797fc-flqs4"
May 21 17:35:40.215118 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:40.215099    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dac805af-f8a4-4a1f-8f53-ed7328c54c7a-console-serving-cert\") pod \"console-58f4f797fc-flqs4\" (UID: \"dac805af-f8a4-4a1f-8f53-ed7328c54c7a\") " pod="openshift-console/console-58f4f797fc-flqs4"
May 21 17:35:40.215248 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:40.215226    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dac805af-f8a4-4a1f-8f53-ed7328c54c7a-console-oauth-config\") pod \"console-58f4f797fc-flqs4\" (UID: \"dac805af-f8a4-4a1f-8f53-ed7328c54c7a\") " pod="openshift-console/console-58f4f797fc-flqs4"
May 21 17:35:40.219800 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:40.219779    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-82plw\" (UniqueName: \"kubernetes.io/projected/dac805af-f8a4-4a1f-8f53-ed7328c54c7a-kube-api-access-82plw\") pod \"console-58f4f797fc-flqs4\" (UID: \"dac805af-f8a4-4a1f-8f53-ed7328c54c7a\") " pod="openshift-console/console-58f4f797fc-flqs4"
May 21 17:35:40.360830 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:40.360800    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-58f4f797fc-flqs4"
May 21 17:35:42.767462 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:42.767424    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7c6f96c7f6-rkb8t"
May 21 17:35:42.767912 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:42.767476    2563 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7c6f96c7f6-rkb8t"
May 21 17:35:42.772677 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:42.772655    2563 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7c6f96c7f6-rkb8t"
May 21 17:35:43.374601 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:43.374573    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7c6f96c7f6-rkb8t"
May 21 17:35:44.098959 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:44.098908    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-58f4f797fc-flqs4"]
May 21 17:35:44.102113 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:35:44.102085    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddac805af_f8a4_4a1f_8f53_ed7328c54c7a.slice/crio-f81b2e91116483c08cf84eb72c549fdedad54131c6c5ec29a64e9359818cb23c WatchSource:0}: Error finding container f81b2e91116483c08cf84eb72c549fdedad54131c6c5ec29a64e9359818cb23c: Status 404 returned error can't find the container with id f81b2e91116483c08cf84eb72c549fdedad54131c6c5ec29a64e9359818cb23c
May 21 17:35:44.381331 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:44.380437    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-w2cbs" event={"ID":"6ff60ab8-04c5-44d0-81da-2c8ae25e723b","Type":"ContainerStarted","Data":"fde96dda7d4570a60e7bb423c69f71446dc444bd402de31e9989c77466ec7109"}
May 21 17:35:44.381331 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:44.380482    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-w2cbs" event={"ID":"6ff60ab8-04c5-44d0-81da-2c8ae25e723b","Type":"ContainerStarted","Data":"211febaf7313dab4eb5bae19970b59be7d8d5c0474b7e7346205962b3d862a74"}
May 21 17:35:44.384597 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:44.384292    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-58f4f797fc-flqs4" event={"ID":"dac805af-f8a4-4a1f-8f53-ed7328c54c7a","Type":"ContainerStarted","Data":"ec09748dfb80e1ae732a66d2c25fc03a3db5f308ed44cc6b0e25cf49ff060860"}
May 21 17:35:44.384597 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:44.384329    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-58f4f797fc-flqs4" event={"ID":"dac805af-f8a4-4a1f-8f53-ed7328c54c7a","Type":"ContainerStarted","Data":"f81b2e91116483c08cf84eb72c549fdedad54131c6c5ec29a64e9359818cb23c"}
May 21 17:35:44.388532 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:44.388507    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-57bd96b888-9t58z" event={"ID":"2ac1cbe0-26ce-432e-930b-bddbf477662a","Type":"ContainerStarted","Data":"1aee48ff0ee16d84f0cf04932578472a3d66ff34841700b4f01bae2a9ce510f2"}
May 21 17:35:44.388868 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:44.388845    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-57bd96b888-9t58z"
May 21 17:35:44.397122 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:44.397089    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-57bd96b888-9t58z"
May 21 17:35:44.400460 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:44.400410    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-w2cbs" podStartSLOduration=10.308749539 podStartE2EDuration="13.400394846s" podCreationTimestamp="2026-05-21 17:35:31 +0000 UTC" firstStartedPulling="2026-05-21 17:35:33.660798307 +0000 UTC m=+164.438170795" lastFinishedPulling="2026-05-21 17:35:36.752443607 +0000 UTC m=+167.529816102" observedRunningTime="2026-05-21 17:35:44.398992906 +0000 UTC m=+175.176365411" watchObservedRunningTime="2026-05-21 17:35:44.400394846 +0000 UTC m=+175.177767353"
May 21 17:35:44.417713 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:44.417626    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-58f4f797fc-flqs4" podStartSLOduration=4.41760974 podStartE2EDuration="4.41760974s" podCreationTimestamp="2026-05-21 17:35:40 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 17:35:44.415435971 +0000 UTC m=+175.192808486" watchObservedRunningTime="2026-05-21 17:35:44.41760974 +0000 UTC m=+175.194982248"
May 21 17:35:44.453211 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:44.453158    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/downloads-57bd96b888-9t58z" podStartSLOduration=1.34863936 podStartE2EDuration="20.45313997s" podCreationTimestamp="2026-05-21 17:35:24 +0000 UTC" firstStartedPulling="2026-05-21 17:35:24.951156832 +0000 UTC m=+155.728529318" lastFinishedPulling="2026-05-21 17:35:44.055657446 +0000 UTC m=+174.833029928" observedRunningTime="2026-05-21 17:35:44.450962192 +0000 UTC m=+175.228334719" watchObservedRunningTime="2026-05-21 17:35:44.45313997 +0000 UTC m=+175.230512475"
May 21 17:35:46.293537 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:46.293501    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-99d98f68d-lq66h"
May 21 17:35:47.405351 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:47.405285    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"27e504bd-cf67-4a9a-a95b-280b565166ad","Type":"ContainerStarted","Data":"5eb480ddafa38fc5e2612510c880418448931199f27053d5fd772c8207d9a4fe"}
May 21 17:35:47.407698 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:47.407658    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xvxtt" event={"ID":"958fb2fd-9a72-40c2-b659-e99b240176d1","Type":"ContainerStarted","Data":"00b083f3a4433cd7cd306af5d2d20fcc51fdf58aff55167a41a2981c84a847e7"}
May 21 17:35:47.409120 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:47.409095    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7dbd559cb4-pwfnq" event={"ID":"d44c6e19-a7a9-4a25-8253-7c83602a8b34","Type":"ContainerStarted","Data":"1f6a131bfc0e3df34e481a7c84b31c4d0c59ddb88fb8bcaf491361ab178378e0"}
May 21 17:35:47.427647 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:47.426209    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-7dbd559cb4-pwfnq" podStartSLOduration=1.214367877 podStartE2EDuration="11.426198231s" podCreationTimestamp="2026-05-21 17:35:36 +0000 UTC" firstStartedPulling="2026-05-21 17:35:36.936283418 +0000 UTC m=+167.713655905" lastFinishedPulling="2026-05-21 17:35:47.148113754 +0000 UTC m=+177.925486259" observedRunningTime="2026-05-21 17:35:47.425614346 +0000 UTC m=+178.202986850" watchObservedRunningTime="2026-05-21 17:35:47.426198231 +0000 UTC m=+178.203570798"
May 21 17:35:48.419815 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:48.419775    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"27e504bd-cf67-4a9a-a95b-280b565166ad","Type":"ContainerStarted","Data":"1bb3c14419f77e002ffb69ffc038a75c7eee21b85ae55535421cfe1232165b7e"}
May 21 17:35:48.419815 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:48.419824    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"27e504bd-cf67-4a9a-a95b-280b565166ad","Type":"ContainerStarted","Data":"f51a44701c713c35a111e1fd21d4e62cf02443b813daa172fa31d37ba4acb062"}
May 21 17:35:48.420618 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:48.419838    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"27e504bd-cf67-4a9a-a95b-280b565166ad","Type":"ContainerStarted","Data":"52c00278226c152e369c689ccb5ba54045717211191d8667adaab3b478ec8b11"}
May 21 17:35:48.420618 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:48.419851    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"27e504bd-cf67-4a9a-a95b-280b565166ad","Type":"ContainerStarted","Data":"75cd80fbf5a5708524443abb445cdc17362e2c265ea682749c735489970332f3"}
May 21 17:35:48.423565 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:48.423531    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xvxtt" event={"ID":"958fb2fd-9a72-40c2-b659-e99b240176d1","Type":"ContainerStarted","Data":"651e6bcf681d4d94cd26a36c8c1f7dfa46436f7bfc533cd136755952b12c0dff"}
May 21 17:35:48.424260 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:48.424236    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-xvxtt"
May 21 17:35:48.441000 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:48.440612    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-xvxtt" podStartSLOduration=136.278850977 podStartE2EDuration="2m26.4405958s" podCreationTimestamp="2026-05-21 17:33:22 +0000 UTC" firstStartedPulling="2026-05-21 17:35:36.99084524 +0000 UTC m=+167.768217726" lastFinishedPulling="2026-05-21 17:35:47.152590053 +0000 UTC m=+177.929962549" observedRunningTime="2026-05-21 17:35:48.439891774 +0000 UTC m=+179.217264279" watchObservedRunningTime="2026-05-21 17:35:48.4405958 +0000 UTC m=+179.217968306"
May 21 17:35:49.429836 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:49.429758    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"27e504bd-cf67-4a9a-a95b-280b565166ad","Type":"ContainerStarted","Data":"8f978a0ce935ea89672c1c877b89495cf585c474ff24f7d23cfabffe2062f1c2"}
May 21 17:35:49.455140 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:49.455089    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.306902335 podStartE2EDuration="17.455070963s" podCreationTimestamp="2026-05-21 17:35:32 +0000 UTC" firstStartedPulling="2026-05-21 17:35:33.964872068 +0000 UTC m=+164.742244553" lastFinishedPulling="2026-05-21 17:35:49.113040684 +0000 UTC m=+179.890413181" observedRunningTime="2026-05-21 17:35:49.453085426 +0000 UTC m=+180.230457930" watchObservedRunningTime="2026-05-21 17:35:49.455070963 +0000 UTC m=+180.232443468"
May 21 17:35:50.360958 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:50.360921    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-58f4f797fc-flqs4"
May 21 17:35:50.361159 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:50.360974    2563 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-58f4f797fc-flqs4"
May 21 17:35:50.366512 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:50.366487    2563 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-58f4f797fc-flqs4"
May 21 17:35:50.436951 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:50.436923    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-58f4f797fc-flqs4"
May 21 17:35:50.482404 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:50.482378    2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7c6f96c7f6-rkb8t"]
May 21 17:35:56.525493 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:56.525461    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-7dbd559cb4-pwfnq"
May 21 17:35:56.525493 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:56.525502    2563 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-7dbd559cb4-pwfnq"
May 21 17:35:59.435454 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:35:59.435421    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-xvxtt"
May 21 17:36:11.498958 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:11.498927    2563 generic.go:358] "Generic (PLEG): container finished" podID="079fa2fb-e0ca-4997-935e-d3aeba409ed2" containerID="df47b014e9e8fc6ef888ed2b63fb52c90a8bbdcb37d8649efd79ead4d56e2b22" exitCode=0
May 21 17:36:11.499382 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:11.498982    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-9zh59" event={"ID":"079fa2fb-e0ca-4997-935e-d3aeba409ed2","Type":"ContainerDied","Data":"df47b014e9e8fc6ef888ed2b63fb52c90a8bbdcb37d8649efd79ead4d56e2b22"}
May 21 17:36:11.499382 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:11.499299    2563 scope.go:117] "RemoveContainer" containerID="df47b014e9e8fc6ef888ed2b63fb52c90a8bbdcb37d8649efd79ead4d56e2b22"
May 21 17:36:12.136573 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:12.136535    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5cf9c7f8d-ggtn8_e3134993-804a-42f3-9f38-67aec00d2b8d/router/0.log"
May 21 17:36:12.146281 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:12.146257    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-d75hh_d8721e69-80fd-48ad-ac87-8f44d8aa94c9/serve-healthcheck-canary/0.log"
May 21 17:36:12.503506 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:12.503429    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-9zh59" event={"ID":"079fa2fb-e0ca-4997-935e-d3aeba409ed2","Type":"ContainerStarted","Data":"5944274a647d46c3b1d7002ab45b52b5c0add4922d7991f233e87f47ec27d540"}
May 21 17:36:15.505929 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:15.505888    2563 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-7c6f96c7f6-rkb8t" podUID="43e7053a-c6f7-4b5b-91eb-4c1afc630a4d" containerName="console" containerID="cri-o://3ba2e385a988993531e3f2427dec24ea9e56f5a981851c43e306dae7a11fb237" gracePeriod=15
May 21 17:36:15.801644 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:15.801620    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7c6f96c7f6-rkb8t_43e7053a-c6f7-4b5b-91eb-4c1afc630a4d/console/0.log"
May 21 17:36:15.801747 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:15.801707    2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c6f96c7f6-rkb8t"
May 21 17:36:15.818128 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:15.818106    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/43e7053a-c6f7-4b5b-91eb-4c1afc630a4d-console-config\") pod \"43e7053a-c6f7-4b5b-91eb-4c1afc630a4d\" (UID: \"43e7053a-c6f7-4b5b-91eb-4c1afc630a4d\") "
May 21 17:36:15.818224 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:15.818138    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/43e7053a-c6f7-4b5b-91eb-4c1afc630a4d-oauth-serving-cert\") pod \"43e7053a-c6f7-4b5b-91eb-4c1afc630a4d\" (UID: \"43e7053a-c6f7-4b5b-91eb-4c1afc630a4d\") "
May 21 17:36:15.818224 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:15.818162    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/43e7053a-c6f7-4b5b-91eb-4c1afc630a4d-service-ca\") pod \"43e7053a-c6f7-4b5b-91eb-4c1afc630a4d\" (UID: \"43e7053a-c6f7-4b5b-91eb-4c1afc630a4d\") "
May 21 17:36:15.818340 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:15.818243    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rq56t\" (UniqueName: \"kubernetes.io/projected/43e7053a-c6f7-4b5b-91eb-4c1afc630a4d-kube-api-access-rq56t\") pod \"43e7053a-c6f7-4b5b-91eb-4c1afc630a4d\" (UID: \"43e7053a-c6f7-4b5b-91eb-4c1afc630a4d\") "
May 21 17:36:15.818340 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:15.818304    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/43e7053a-c6f7-4b5b-91eb-4c1afc630a4d-console-serving-cert\") pod \"43e7053a-c6f7-4b5b-91eb-4c1afc630a4d\" (UID: \"43e7053a-c6f7-4b5b-91eb-4c1afc630a4d\") "
May 21 17:36:15.818340 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:15.818337    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/43e7053a-c6f7-4b5b-91eb-4c1afc630a4d-console-oauth-config\") pod \"43e7053a-c6f7-4b5b-91eb-4c1afc630a4d\" (UID: \"43e7053a-c6f7-4b5b-91eb-4c1afc630a4d\") "
May 21 17:36:15.818526 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:15.818502    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/43e7053a-c6f7-4b5b-91eb-4c1afc630a4d-console-config" (OuterVolumeSpecName: "console-config") pod "43e7053a-c6f7-4b5b-91eb-4c1afc630a4d" (UID: "43e7053a-c6f7-4b5b-91eb-4c1afc630a4d"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 21 17:36:15.818598 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:15.818523    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/43e7053a-c6f7-4b5b-91eb-4c1afc630a4d-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "43e7053a-c6f7-4b5b-91eb-4c1afc630a4d" (UID: "43e7053a-c6f7-4b5b-91eb-4c1afc630a4d"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 21 17:36:15.818700 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:15.818680    2563 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/43e7053a-c6f7-4b5b-91eb-4c1afc630a4d-console-config\") on node \"ip-10-0-140-106.ec2.internal\" DevicePath \"\""
May 21 17:36:15.818777 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:15.818706    2563 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/43e7053a-c6f7-4b5b-91eb-4c1afc630a4d-oauth-serving-cert\") on node \"ip-10-0-140-106.ec2.internal\" DevicePath \"\""
May 21 17:36:15.818869 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:15.818838    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/43e7053a-c6f7-4b5b-91eb-4c1afc630a4d-service-ca" (OuterVolumeSpecName: "service-ca") pod "43e7053a-c6f7-4b5b-91eb-4c1afc630a4d" (UID: "43e7053a-c6f7-4b5b-91eb-4c1afc630a4d"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 21 17:36:15.821094 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:15.821031    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/43e7053a-c6f7-4b5b-91eb-4c1afc630a4d-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "43e7053a-c6f7-4b5b-91eb-4c1afc630a4d" (UID: "43e7053a-c6f7-4b5b-91eb-4c1afc630a4d"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 21 17:36:15.821422 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:15.821395    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/43e7053a-c6f7-4b5b-91eb-4c1afc630a4d-kube-api-access-rq56t" (OuterVolumeSpecName: "kube-api-access-rq56t") pod "43e7053a-c6f7-4b5b-91eb-4c1afc630a4d" (UID: "43e7053a-c6f7-4b5b-91eb-4c1afc630a4d"). InnerVolumeSpecName "kube-api-access-rq56t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 17:36:15.821484 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:15.821433    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/43e7053a-c6f7-4b5b-91eb-4c1afc630a4d-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "43e7053a-c6f7-4b5b-91eb-4c1afc630a4d" (UID: "43e7053a-c6f7-4b5b-91eb-4c1afc630a4d"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 21 17:36:15.919280 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:15.919253    2563 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/43e7053a-c6f7-4b5b-91eb-4c1afc630a4d-service-ca\") on node \"ip-10-0-140-106.ec2.internal\" DevicePath \"\""
May 21 17:36:15.919280 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:15.919277    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rq56t\" (UniqueName: \"kubernetes.io/projected/43e7053a-c6f7-4b5b-91eb-4c1afc630a4d-kube-api-access-rq56t\") on node \"ip-10-0-140-106.ec2.internal\" DevicePath \"\""
May 21 17:36:15.919475 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:15.919287    2563 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/43e7053a-c6f7-4b5b-91eb-4c1afc630a4d-console-serving-cert\") on node \"ip-10-0-140-106.ec2.internal\" DevicePath \"\""
May 21 17:36:15.919475 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:15.919298    2563 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/43e7053a-c6f7-4b5b-91eb-4c1afc630a4d-console-oauth-config\") on node \"ip-10-0-140-106.ec2.internal\" DevicePath \"\""
May 21 17:36:16.516878 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:16.516850    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7c6f96c7f6-rkb8t_43e7053a-c6f7-4b5b-91eb-4c1afc630a4d/console/0.log"
May 21 17:36:16.517302 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:16.516889    2563 generic.go:358] "Generic (PLEG): container finished" podID="43e7053a-c6f7-4b5b-91eb-4c1afc630a4d" containerID="3ba2e385a988993531e3f2427dec24ea9e56f5a981851c43e306dae7a11fb237" exitCode=2
May 21 17:36:16.517302 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:16.516956    2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c6f96c7f6-rkb8t"
May 21 17:36:16.517302 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:16.516969    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c6f96c7f6-rkb8t" event={"ID":"43e7053a-c6f7-4b5b-91eb-4c1afc630a4d","Type":"ContainerDied","Data":"3ba2e385a988993531e3f2427dec24ea9e56f5a981851c43e306dae7a11fb237"}
May 21 17:36:16.517302 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:16.517001    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c6f96c7f6-rkb8t" event={"ID":"43e7053a-c6f7-4b5b-91eb-4c1afc630a4d","Type":"ContainerDied","Data":"174ee5d5c45b15b3e3aa34bced767f1550fcc487cfca047c0609d7e068cb3add"}
May 21 17:36:16.517302 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:16.517017    2563 scope.go:117] "RemoveContainer" containerID="3ba2e385a988993531e3f2427dec24ea9e56f5a981851c43e306dae7a11fb237"
May 21 17:36:16.525380 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:16.525362    2563 scope.go:117] "RemoveContainer" containerID="3ba2e385a988993531e3f2427dec24ea9e56f5a981851c43e306dae7a11fb237"
May 21 17:36:16.525653 ip-10-0-140-106 kubenswrapper[2563]: E0521 17:36:16.525628    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3ba2e385a988993531e3f2427dec24ea9e56f5a981851c43e306dae7a11fb237\": container with ID starting with 3ba2e385a988993531e3f2427dec24ea9e56f5a981851c43e306dae7a11fb237 not found: ID does not exist" containerID="3ba2e385a988993531e3f2427dec24ea9e56f5a981851c43e306dae7a11fb237"
May 21 17:36:16.525710 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:16.525665    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ba2e385a988993531e3f2427dec24ea9e56f5a981851c43e306dae7a11fb237"} err="failed to get container status \"3ba2e385a988993531e3f2427dec24ea9e56f5a981851c43e306dae7a11fb237\": rpc error: code = NotFound desc = could not find container \"3ba2e385a988993531e3f2427dec24ea9e56f5a981851c43e306dae7a11fb237\": container with ID starting with 3ba2e385a988993531e3f2427dec24ea9e56f5a981851c43e306dae7a11fb237 not found: ID does not exist"
May 21 17:36:16.530468 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:16.530449    2563 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-7dbd559cb4-pwfnq"
May 21 17:36:16.534115 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:16.534094    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-7dbd559cb4-pwfnq"
May 21 17:36:16.537409 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:16.537388    2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7c6f96c7f6-rkb8t"]
May 21 17:36:16.540642 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:16.540617    2563 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7c6f96c7f6-rkb8t"]
May 21 17:36:17.803328 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:17.803293    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="43e7053a-c6f7-4b5b-91eb-4c1afc630a4d" path="/var/lib/kubelet/pods/43e7053a-c6f7-4b5b-91eb-4c1afc630a4d/volumes"
May 21 17:36:28.554444 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:28.554408    2563 generic.go:358] "Generic (PLEG): container finished" podID="b7309693-1d8c-4edb-884a-6771748790d7" containerID="c3ba8e75eed47fc13ef4a00728a80016ad59266085678839b77b7b1faaa44bea" exitCode=0
May 21 17:36:28.554808 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:28.554479    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-mhmcm" event={"ID":"b7309693-1d8c-4edb-884a-6771748790d7","Type":"ContainerDied","Data":"c3ba8e75eed47fc13ef4a00728a80016ad59266085678839b77b7b1faaa44bea"}
May 21 17:36:28.554808 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:28.554772    2563 scope.go:117] "RemoveContainer" containerID="c3ba8e75eed47fc13ef4a00728a80016ad59266085678839b77b7b1faaa44bea"
May 21 17:36:29.559506 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:29.559460    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-mhmcm" event={"ID":"b7309693-1d8c-4edb-884a-6771748790d7","Type":"ContainerStarted","Data":"1e98ce7b0755fabdbb6d526004b6877c22a22c345b8580dd5b02b9dc6aadb85a"}
May 21 17:36:52.009912 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:52.009875    2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 21 17:36:52.010356 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:52.010307    2563 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="27e504bd-cf67-4a9a-a95b-280b565166ad" containerName="alertmanager" containerID="cri-o://5eb480ddafa38fc5e2612510c880418448931199f27053d5fd772c8207d9a4fe" gracePeriod=120
May 21 17:36:52.010414 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:52.010361    2563 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="27e504bd-cf67-4a9a-a95b-280b565166ad" containerName="kube-rbac-proxy-web" containerID="cri-o://52c00278226c152e369c689ccb5ba54045717211191d8667adaab3b478ec8b11" gracePeriod=120
May 21 17:36:52.010414 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:52.010385    2563 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="27e504bd-cf67-4a9a-a95b-280b565166ad" containerName="kube-rbac-proxy" containerID="cri-o://f51a44701c713c35a111e1fd21d4e62cf02443b813daa172fa31d37ba4acb062" gracePeriod=120
May 21 17:36:52.010513 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:52.010392    2563 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="27e504bd-cf67-4a9a-a95b-280b565166ad" containerName="prom-label-proxy" containerID="cri-o://8f978a0ce935ea89672c1c877b89495cf585c474ff24f7d23cfabffe2062f1c2" gracePeriod=120
May 21 17:36:52.010513 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:52.010409    2563 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="27e504bd-cf67-4a9a-a95b-280b565166ad" containerName="config-reloader" containerID="cri-o://75cd80fbf5a5708524443abb445cdc17362e2c265ea682749c735489970332f3" gracePeriod=120
May 21 17:36:52.010513 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:52.010324    2563 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="27e504bd-cf67-4a9a-a95b-280b565166ad" containerName="kube-rbac-proxy-metric" containerID="cri-o://1bb3c14419f77e002ffb69ffc038a75c7eee21b85ae55535421cfe1232165b7e" gracePeriod=120
May 21 17:36:52.625815 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:52.625781    2563 generic.go:358] "Generic (PLEG): container finished" podID="27e504bd-cf67-4a9a-a95b-280b565166ad" containerID="8f978a0ce935ea89672c1c877b89495cf585c474ff24f7d23cfabffe2062f1c2" exitCode=0
May 21 17:36:52.625815 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:52.625808    2563 generic.go:358] "Generic (PLEG): container finished" podID="27e504bd-cf67-4a9a-a95b-280b565166ad" containerID="f51a44701c713c35a111e1fd21d4e62cf02443b813daa172fa31d37ba4acb062" exitCode=0
May 21 17:36:52.625815 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:52.625815    2563 generic.go:358] "Generic (PLEG): container finished" podID="27e504bd-cf67-4a9a-a95b-280b565166ad" containerID="75cd80fbf5a5708524443abb445cdc17362e2c265ea682749c735489970332f3" exitCode=0
May 21 17:36:52.625815 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:52.625820    2563 generic.go:358] "Generic (PLEG): container finished" podID="27e504bd-cf67-4a9a-a95b-280b565166ad" containerID="5eb480ddafa38fc5e2612510c880418448931199f27053d5fd772c8207d9a4fe" exitCode=0
May 21 17:36:52.626085 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:52.625849    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"27e504bd-cf67-4a9a-a95b-280b565166ad","Type":"ContainerDied","Data":"8f978a0ce935ea89672c1c877b89495cf585c474ff24f7d23cfabffe2062f1c2"}
May 21 17:36:52.626085 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:52.625880    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"27e504bd-cf67-4a9a-a95b-280b565166ad","Type":"ContainerDied","Data":"f51a44701c713c35a111e1fd21d4e62cf02443b813daa172fa31d37ba4acb062"}
May 21 17:36:52.626085 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:52.625893    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"27e504bd-cf67-4a9a-a95b-280b565166ad","Type":"ContainerDied","Data":"75cd80fbf5a5708524443abb445cdc17362e2c265ea682749c735489970332f3"}
May 21 17:36:52.626085 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:52.625901    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"27e504bd-cf67-4a9a-a95b-280b565166ad","Type":"ContainerDied","Data":"5eb480ddafa38fc5e2612510c880418448931199f27053d5fd772c8207d9a4fe"}
May 21 17:36:53.250868 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:53.250839    2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 21 17:36:53.426618 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:53.426585    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/27e504bd-cf67-4a9a-a95b-280b565166ad-config-volume\") pod \"27e504bd-cf67-4a9a-a95b-280b565166ad\" (UID: \"27e504bd-cf67-4a9a-a95b-280b565166ad\") "
May 21 17:36:53.426795 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:53.426655    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/27e504bd-cf67-4a9a-a95b-280b565166ad-secret-alertmanager-kube-rbac-proxy-web\") pod \"27e504bd-cf67-4a9a-a95b-280b565166ad\" (UID: \"27e504bd-cf67-4a9a-a95b-280b565166ad\") "
May 21 17:36:53.426795 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:53.426696    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/27e504bd-cf67-4a9a-a95b-280b565166ad-alertmanager-main-db\") pod \"27e504bd-cf67-4a9a-a95b-280b565166ad\" (UID: \"27e504bd-cf67-4a9a-a95b-280b565166ad\") "
May 21 17:36:53.426795 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:53.426721    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27e504bd-cf67-4a9a-a95b-280b565166ad-alertmanager-trusted-ca-bundle\") pod \"27e504bd-cf67-4a9a-a95b-280b565166ad\" (UID: \"27e504bd-cf67-4a9a-a95b-280b565166ad\") "
May 21 17:36:53.426795 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:53.426747    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/27e504bd-cf67-4a9a-a95b-280b565166ad-config-out\") pod \"27e504bd-cf67-4a9a-a95b-280b565166ad\" (UID: \"27e504bd-cf67-4a9a-a95b-280b565166ad\") "
May 21 17:36:53.426795 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:53.426780    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/27e504bd-cf67-4a9a-a95b-280b565166ad-secret-alertmanager-kube-rbac-proxy-metric\") pod \"27e504bd-cf67-4a9a-a95b-280b565166ad\" (UID: \"27e504bd-cf67-4a9a-a95b-280b565166ad\") "
May 21 17:36:53.427083 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:53.426822    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/27e504bd-cf67-4a9a-a95b-280b565166ad-secret-alertmanager-kube-rbac-proxy\") pod \"27e504bd-cf67-4a9a-a95b-280b565166ad\" (UID: \"27e504bd-cf67-4a9a-a95b-280b565166ad\") "
May 21 17:36:53.427083 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:53.426850    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lmdmz\" (UniqueName: \"kubernetes.io/projected/27e504bd-cf67-4a9a-a95b-280b565166ad-kube-api-access-lmdmz\") pod \"27e504bd-cf67-4a9a-a95b-280b565166ad\" (UID: \"27e504bd-cf67-4a9a-a95b-280b565166ad\") "
May 21 17:36:53.427083 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:53.426880    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/27e504bd-cf67-4a9a-a95b-280b565166ad-tls-assets\") pod \"27e504bd-cf67-4a9a-a95b-280b565166ad\" (UID: \"27e504bd-cf67-4a9a-a95b-280b565166ad\") "
May 21 17:36:53.427083 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:53.426918    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/27e504bd-cf67-4a9a-a95b-280b565166ad-secret-alertmanager-main-tls\") pod \"27e504bd-cf67-4a9a-a95b-280b565166ad\" (UID: \"27e504bd-cf67-4a9a-a95b-280b565166ad\") "
May 21 17:36:53.427083 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:53.426951    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/27e504bd-cf67-4a9a-a95b-280b565166ad-web-config\") pod \"27e504bd-cf67-4a9a-a95b-280b565166ad\" (UID: \"27e504bd-cf67-4a9a-a95b-280b565166ad\") "
May 21 17:36:53.427083 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:53.426997    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/27e504bd-cf67-4a9a-a95b-280b565166ad-cluster-tls-config\") pod \"27e504bd-cf67-4a9a-a95b-280b565166ad\" (UID: \"27e504bd-cf67-4a9a-a95b-280b565166ad\") "
May 21 17:36:53.427083 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:53.427031    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/27e504bd-cf67-4a9a-a95b-280b565166ad-metrics-client-ca\") pod \"27e504bd-cf67-4a9a-a95b-280b565166ad\" (UID: \"27e504bd-cf67-4a9a-a95b-280b565166ad\") "
May 21 17:36:53.427422 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:53.427091    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/27e504bd-cf67-4a9a-a95b-280b565166ad-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "27e504bd-cf67-4a9a-a95b-280b565166ad" (UID: "27e504bd-cf67-4a9a-a95b-280b565166ad"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 21 17:36:53.427422 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:53.427179    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/27e504bd-cf67-4a9a-a95b-280b565166ad-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "27e504bd-cf67-4a9a-a95b-280b565166ad" (UID: "27e504bd-cf67-4a9a-a95b-280b565166ad"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 21 17:36:53.427572 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:53.427390    2563 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/27e504bd-cf67-4a9a-a95b-280b565166ad-alertmanager-main-db\") on node \"ip-10-0-140-106.ec2.internal\" DevicePath \"\""
May 21 17:36:53.427572 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:53.427511    2563 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27e504bd-cf67-4a9a-a95b-280b565166ad-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-140-106.ec2.internal\" DevicePath \"\""
May 21 17:36:53.427572 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:53.427563    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/27e504bd-cf67-4a9a-a95b-280b565166ad-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "27e504bd-cf67-4a9a-a95b-280b565166ad" (UID: "27e504bd-cf67-4a9a-a95b-280b565166ad"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 21 17:36:53.430594 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:53.430564    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/27e504bd-cf67-4a9a-a95b-280b565166ad-config-volume" (OuterVolumeSpecName: "config-volume") pod "27e504bd-cf67-4a9a-a95b-280b565166ad" (UID: "27e504bd-cf67-4a9a-a95b-280b565166ad"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 21 17:36:53.430715 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:53.430628    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/27e504bd-cf67-4a9a-a95b-280b565166ad-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "27e504bd-cf67-4a9a-a95b-280b565166ad" (UID: "27e504bd-cf67-4a9a-a95b-280b565166ad"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 21 17:36:53.430715 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:53.430709    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/27e504bd-cf67-4a9a-a95b-280b565166ad-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "27e504bd-cf67-4a9a-a95b-280b565166ad" (UID: "27e504bd-cf67-4a9a-a95b-280b565166ad"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 21 17:36:53.430895 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:53.430872    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/27e504bd-cf67-4a9a-a95b-280b565166ad-config-out" (OuterVolumeSpecName: "config-out") pod "27e504bd-cf67-4a9a-a95b-280b565166ad" (UID: "27e504bd-cf67-4a9a-a95b-280b565166ad"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 21 17:36:53.431014 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:53.430986    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/27e504bd-cf67-4a9a-a95b-280b565166ad-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "27e504bd-cf67-4a9a-a95b-280b565166ad" (UID: "27e504bd-cf67-4a9a-a95b-280b565166ad"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 21 17:36:53.431213 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:53.431183    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/27e504bd-cf67-4a9a-a95b-280b565166ad-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "27e504bd-cf67-4a9a-a95b-280b565166ad" (UID: "27e504bd-cf67-4a9a-a95b-280b565166ad"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 17:36:53.431294 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:53.431232    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/27e504bd-cf67-4a9a-a95b-280b565166ad-kube-api-access-lmdmz" (OuterVolumeSpecName: "kube-api-access-lmdmz") pod "27e504bd-cf67-4a9a-a95b-280b565166ad" (UID: "27e504bd-cf67-4a9a-a95b-280b565166ad"). InnerVolumeSpecName "kube-api-access-lmdmz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 17:36:53.431444 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:53.431426    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/27e504bd-cf67-4a9a-a95b-280b565166ad-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "27e504bd-cf67-4a9a-a95b-280b565166ad" (UID: "27e504bd-cf67-4a9a-a95b-280b565166ad"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 21 17:36:53.434287 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:53.434266    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/27e504bd-cf67-4a9a-a95b-280b565166ad-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "27e504bd-cf67-4a9a-a95b-280b565166ad" (UID: "27e504bd-cf67-4a9a-a95b-280b565166ad"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 21 17:36:53.441219 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:53.441198    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/27e504bd-cf67-4a9a-a95b-280b565166ad-web-config" (OuterVolumeSpecName: "web-config") pod "27e504bd-cf67-4a9a-a95b-280b565166ad" (UID: "27e504bd-cf67-4a9a-a95b-280b565166ad"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 21 17:36:53.528523 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:53.528499    2563 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/27e504bd-cf67-4a9a-a95b-280b565166ad-config-volume\") on node \"ip-10-0-140-106.ec2.internal\" DevicePath \"\""
May 21 17:36:53.528613 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:53.528522    2563 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/27e504bd-cf67-4a9a-a95b-280b565166ad-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-140-106.ec2.internal\" DevicePath \"\""
May 21 17:36:53.528613 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:53.528542    2563 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/27e504bd-cf67-4a9a-a95b-280b565166ad-config-out\") on node \"ip-10-0-140-106.ec2.internal\" DevicePath \"\""
May 21 17:36:53.528613 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:53.528551    2563 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/27e504bd-cf67-4a9a-a95b-280b565166ad-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-140-106.ec2.internal\" DevicePath \"\""
May 21 17:36:53.528613 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:53.528560    2563 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/27e504bd-cf67-4a9a-a95b-280b565166ad-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-140-106.ec2.internal\" DevicePath \"\""
May 21 17:36:53.528613 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:53.528571    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lmdmz\" (UniqueName: \"kubernetes.io/projected/27e504bd-cf67-4a9a-a95b-280b565166ad-kube-api-access-lmdmz\") on node \"ip-10-0-140-106.ec2.internal\" DevicePath \"\""
May 21 17:36:53.528613 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:53.528581    2563 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/27e504bd-cf67-4a9a-a95b-280b565166ad-tls-assets\") on node \"ip-10-0-140-106.ec2.internal\" DevicePath \"\""
May 21 17:36:53.528613 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:53.528590    2563 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/27e504bd-cf67-4a9a-a95b-280b565166ad-secret-alertmanager-main-tls\") on node \"ip-10-0-140-106.ec2.internal\" DevicePath \"\""
May 21 17:36:53.528613 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:53.528598    2563 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/27e504bd-cf67-4a9a-a95b-280b565166ad-web-config\") on node \"ip-10-0-140-106.ec2.internal\" DevicePath \"\""
May 21 17:36:53.528613 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:53.528607    2563 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/27e504bd-cf67-4a9a-a95b-280b565166ad-cluster-tls-config\") on node \"ip-10-0-140-106.ec2.internal\" DevicePath \"\""
May 21 17:36:53.528613 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:53.528614    2563 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/27e504bd-cf67-4a9a-a95b-280b565166ad-metrics-client-ca\") on node \"ip-10-0-140-106.ec2.internal\" DevicePath \"\""
May 21 17:36:53.631796 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:53.631773    2563 generic.go:358] "Generic (PLEG): container finished" podID="27e504bd-cf67-4a9a-a95b-280b565166ad" containerID="1bb3c14419f77e002ffb69ffc038a75c7eee21b85ae55535421cfe1232165b7e" exitCode=0
May 21 17:36:53.631796 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:53.631794    2563 generic.go:358] "Generic (PLEG): container finished" podID="27e504bd-cf67-4a9a-a95b-280b565166ad" containerID="52c00278226c152e369c689ccb5ba54045717211191d8667adaab3b478ec8b11" exitCode=0
May 21 17:36:53.631925 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:53.631842    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"27e504bd-cf67-4a9a-a95b-280b565166ad","Type":"ContainerDied","Data":"1bb3c14419f77e002ffb69ffc038a75c7eee21b85ae55535421cfe1232165b7e"}
May 21 17:36:53.631925 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:53.631868    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"27e504bd-cf67-4a9a-a95b-280b565166ad","Type":"ContainerDied","Data":"52c00278226c152e369c689ccb5ba54045717211191d8667adaab3b478ec8b11"}
May 21 17:36:53.631925 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:53.631878    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"27e504bd-cf67-4a9a-a95b-280b565166ad","Type":"ContainerDied","Data":"4bced5285f0f5798ba202f32c4a3666a4657ebf5a6e88593ce23131cacbc8ddb"}
May 21 17:36:53.631925 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:53.631888    2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 21 17:36:53.632042 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:53.631892    2563 scope.go:117] "RemoveContainer" containerID="8f978a0ce935ea89672c1c877b89495cf585c474ff24f7d23cfabffe2062f1c2"
May 21 17:36:53.641485 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:53.641337    2563 scope.go:117] "RemoveContainer" containerID="1bb3c14419f77e002ffb69ffc038a75c7eee21b85ae55535421cfe1232165b7e"
May 21 17:36:53.648041 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:53.648027    2563 scope.go:117] "RemoveContainer" containerID="f51a44701c713c35a111e1fd21d4e62cf02443b813daa172fa31d37ba4acb062"
May 21 17:36:53.654444 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:53.654424    2563 scope.go:117] "RemoveContainer" containerID="52c00278226c152e369c689ccb5ba54045717211191d8667adaab3b478ec8b11"
May 21 17:36:53.656961 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:53.656936    2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 21 17:36:53.660527 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:53.660504    2563 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 21 17:36:53.661285 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:53.661268    2563 scope.go:117] "RemoveContainer" containerID="75cd80fbf5a5708524443abb445cdc17362e2c265ea682749c735489970332f3"
May 21 17:36:53.667300 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:53.667283    2563 scope.go:117] "RemoveContainer" containerID="5eb480ddafa38fc5e2612510c880418448931199f27053d5fd772c8207d9a4fe"
May 21 17:36:53.673561 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:53.673543    2563 scope.go:117] "RemoveContainer" containerID="6d96e55436c12e0ed7f086c90e2e1f09442149ce8cad4c944c5d32fcefcc1d3a"
May 21 17:36:53.679633 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:53.679618    2563 scope.go:117] "RemoveContainer" containerID="8f978a0ce935ea89672c1c877b89495cf585c474ff24f7d23cfabffe2062f1c2"
May 21 17:36:53.679867 ip-10-0-140-106 kubenswrapper[2563]: E0521 17:36:53.679851    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8f978a0ce935ea89672c1c877b89495cf585c474ff24f7d23cfabffe2062f1c2\": container with ID starting with 8f978a0ce935ea89672c1c877b89495cf585c474ff24f7d23cfabffe2062f1c2 not found: ID does not exist" containerID="8f978a0ce935ea89672c1c877b89495cf585c474ff24f7d23cfabffe2062f1c2"
May 21 17:36:53.679914 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:53.679874    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8f978a0ce935ea89672c1c877b89495cf585c474ff24f7d23cfabffe2062f1c2"} err="failed to get container status \"8f978a0ce935ea89672c1c877b89495cf585c474ff24f7d23cfabffe2062f1c2\": rpc error: code = NotFound desc = could not find container \"8f978a0ce935ea89672c1c877b89495cf585c474ff24f7d23cfabffe2062f1c2\": container with ID starting with 8f978a0ce935ea89672c1c877b89495cf585c474ff24f7d23cfabffe2062f1c2 not found: ID does not exist"
May 21 17:36:53.679914 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:53.679892    2563 scope.go:117] "RemoveContainer" containerID="1bb3c14419f77e002ffb69ffc038a75c7eee21b85ae55535421cfe1232165b7e"
May 21 17:36:53.680107 ip-10-0-140-106 kubenswrapper[2563]: E0521 17:36:53.680089    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1bb3c14419f77e002ffb69ffc038a75c7eee21b85ae55535421cfe1232165b7e\": container with ID starting with 1bb3c14419f77e002ffb69ffc038a75c7eee21b85ae55535421cfe1232165b7e not found: ID does not exist" containerID="1bb3c14419f77e002ffb69ffc038a75c7eee21b85ae55535421cfe1232165b7e"
May 21 17:36:53.680145 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:53.680112    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1bb3c14419f77e002ffb69ffc038a75c7eee21b85ae55535421cfe1232165b7e"} err="failed to get container status \"1bb3c14419f77e002ffb69ffc038a75c7eee21b85ae55535421cfe1232165b7e\": rpc error: code = NotFound desc = could not find container \"1bb3c14419f77e002ffb69ffc038a75c7eee21b85ae55535421cfe1232165b7e\": container with ID starting with 1bb3c14419f77e002ffb69ffc038a75c7eee21b85ae55535421cfe1232165b7e not found: ID does not exist"
May 21 17:36:53.680145 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:53.680125    2563 scope.go:117] "RemoveContainer" containerID="f51a44701c713c35a111e1fd21d4e62cf02443b813daa172fa31d37ba4acb062"
May 21 17:36:53.680318 ip-10-0-140-106 kubenswrapper[2563]: E0521 17:36:53.680302    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f51a44701c713c35a111e1fd21d4e62cf02443b813daa172fa31d37ba4acb062\": container with ID starting with f51a44701c713c35a111e1fd21d4e62cf02443b813daa172fa31d37ba4acb062 not found: ID does not exist" containerID="f51a44701c713c35a111e1fd21d4e62cf02443b813daa172fa31d37ba4acb062"
May 21 17:36:53.680358 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:53.680326    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f51a44701c713c35a111e1fd21d4e62cf02443b813daa172fa31d37ba4acb062"} err="failed to get container status \"f51a44701c713c35a111e1fd21d4e62cf02443b813daa172fa31d37ba4acb062\": rpc error: code = NotFound desc = could not find container \"f51a44701c713c35a111e1fd21d4e62cf02443b813daa172fa31d37ba4acb062\": container with ID starting with f51a44701c713c35a111e1fd21d4e62cf02443b813daa172fa31d37ba4acb062 not found: ID does not exist"
May 21 17:36:53.680358 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:53.680340    2563 scope.go:117] "RemoveContainer" containerID="52c00278226c152e369c689ccb5ba54045717211191d8667adaab3b478ec8b11"
May 21 17:36:53.680569 ip-10-0-140-106 kubenswrapper[2563]: E0521 17:36:53.680551    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"52c00278226c152e369c689ccb5ba54045717211191d8667adaab3b478ec8b11\": container with ID starting with 52c00278226c152e369c689ccb5ba54045717211191d8667adaab3b478ec8b11 not found: ID does not exist" containerID="52c00278226c152e369c689ccb5ba54045717211191d8667adaab3b478ec8b11"
May 21 17:36:53.680611 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:53.680575    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"52c00278226c152e369c689ccb5ba54045717211191d8667adaab3b478ec8b11"} err="failed to get container status \"52c00278226c152e369c689ccb5ba54045717211191d8667adaab3b478ec8b11\": rpc error: code = NotFound desc = could not find container \"52c00278226c152e369c689ccb5ba54045717211191d8667adaab3b478ec8b11\": container with ID starting with 52c00278226c152e369c689ccb5ba54045717211191d8667adaab3b478ec8b11 not found: ID does not exist"
May 21 17:36:53.680611 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:53.680597    2563 scope.go:117] "RemoveContainer" containerID="75cd80fbf5a5708524443abb445cdc17362e2c265ea682749c735489970332f3"
May 21 17:36:53.680797 ip-10-0-140-106 kubenswrapper[2563]: E0521 17:36:53.680778    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"75cd80fbf5a5708524443abb445cdc17362e2c265ea682749c735489970332f3\": container with ID starting with 75cd80fbf5a5708524443abb445cdc17362e2c265ea682749c735489970332f3 not found: ID does not exist" containerID="75cd80fbf5a5708524443abb445cdc17362e2c265ea682749c735489970332f3"
May 21 17:36:53.680833 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:53.680804    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"75cd80fbf5a5708524443abb445cdc17362e2c265ea682749c735489970332f3"} err="failed to get container status \"75cd80fbf5a5708524443abb445cdc17362e2c265ea682749c735489970332f3\": rpc error: code = NotFound desc = could not find container \"75cd80fbf5a5708524443abb445cdc17362e2c265ea682749c735489970332f3\": container with ID starting with 75cd80fbf5a5708524443abb445cdc17362e2c265ea682749c735489970332f3 not found: ID does not exist"
May 21 17:36:53.680833 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:53.680821    2563 scope.go:117] "RemoveContainer" containerID="5eb480ddafa38fc5e2612510c880418448931199f27053d5fd772c8207d9a4fe"
May 21 17:36:53.681071 ip-10-0-140-106 kubenswrapper[2563]: E0521 17:36:53.681024    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5eb480ddafa38fc5e2612510c880418448931199f27053d5fd772c8207d9a4fe\": container with ID starting with 5eb480ddafa38fc5e2612510c880418448931199f27053d5fd772c8207d9a4fe not found: ID does not exist" containerID="5eb480ddafa38fc5e2612510c880418448931199f27053d5fd772c8207d9a4fe"
May 21 17:36:53.681071 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:53.681050    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5eb480ddafa38fc5e2612510c880418448931199f27053d5fd772c8207d9a4fe"} err="failed to get container status \"5eb480ddafa38fc5e2612510c880418448931199f27053d5fd772c8207d9a4fe\": rpc error: code = NotFound desc = could not find container \"5eb480ddafa38fc5e2612510c880418448931199f27053d5fd772c8207d9a4fe\": container with ID starting with 5eb480ddafa38fc5e2612510c880418448931199f27053d5fd772c8207d9a4fe not found: ID does not exist"
May 21 17:36:53.681253 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:53.681081    2563 scope.go:117] "RemoveContainer" containerID="6d96e55436c12e0ed7f086c90e2e1f09442149ce8cad4c944c5d32fcefcc1d3a"
May 21 17:36:53.681346 ip-10-0-140-106 kubenswrapper[2563]: E0521 17:36:53.681323    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6d96e55436c12e0ed7f086c90e2e1f09442149ce8cad4c944c5d32fcefcc1d3a\": container with ID starting with 6d96e55436c12e0ed7f086c90e2e1f09442149ce8cad4c944c5d32fcefcc1d3a not found: ID does not exist" containerID="6d96e55436c12e0ed7f086c90e2e1f09442149ce8cad4c944c5d32fcefcc1d3a"
May 21 17:36:53.681402 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:53.681353    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d96e55436c12e0ed7f086c90e2e1f09442149ce8cad4c944c5d32fcefcc1d3a"} err="failed to get container status \"6d96e55436c12e0ed7f086c90e2e1f09442149ce8cad4c944c5d32fcefcc1d3a\": rpc error: code = NotFound desc = could not find container \"6d96e55436c12e0ed7f086c90e2e1f09442149ce8cad4c944c5d32fcefcc1d3a\": container with ID starting with 6d96e55436c12e0ed7f086c90e2e1f09442149ce8cad4c944c5d32fcefcc1d3a not found: ID does not exist"
May 21 17:36:53.681402 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:53.681372    2563 scope.go:117] "RemoveContainer" containerID="8f978a0ce935ea89672c1c877b89495cf585c474ff24f7d23cfabffe2062f1c2"
May 21 17:36:53.681703 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:53.681673    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8f978a0ce935ea89672c1c877b89495cf585c474ff24f7d23cfabffe2062f1c2"} err="failed to get container status \"8f978a0ce935ea89672c1c877b89495cf585c474ff24f7d23cfabffe2062f1c2\": rpc error: code = NotFound desc = could not find container \"8f978a0ce935ea89672c1c877b89495cf585c474ff24f7d23cfabffe2062f1c2\": container with ID starting with 8f978a0ce935ea89672c1c877b89495cf585c474ff24f7d23cfabffe2062f1c2 not found: ID does not exist"
May 21 17:36:53.681703 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:53.681700    2563 scope.go:117] "RemoveContainer" containerID="1bb3c14419f77e002ffb69ffc038a75c7eee21b85ae55535421cfe1232165b7e"
May 21 17:36:53.681982 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:53.681956    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1bb3c14419f77e002ffb69ffc038a75c7eee21b85ae55535421cfe1232165b7e"} err="failed to get container status \"1bb3c14419f77e002ffb69ffc038a75c7eee21b85ae55535421cfe1232165b7e\": rpc error: code = NotFound desc = could not find container \"1bb3c14419f77e002ffb69ffc038a75c7eee21b85ae55535421cfe1232165b7e\": container with ID starting with 1bb3c14419f77e002ffb69ffc038a75c7eee21b85ae55535421cfe1232165b7e not found: ID does not exist"
May 21 17:36:53.682115 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:53.681982    2563 scope.go:117] "RemoveContainer" containerID="f51a44701c713c35a111e1fd21d4e62cf02443b813daa172fa31d37ba4acb062"
May 21 17:36:53.682247 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:53.682227    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f51a44701c713c35a111e1fd21d4e62cf02443b813daa172fa31d37ba4acb062"} err="failed to get container status \"f51a44701c713c35a111e1fd21d4e62cf02443b813daa172fa31d37ba4acb062\": rpc error: code = NotFound desc = could not find container \"f51a44701c713c35a111e1fd21d4e62cf02443b813daa172fa31d37ba4acb062\": container with ID starting with f51a44701c713c35a111e1fd21d4e62cf02443b813daa172fa31d37ba4acb062 not found: ID does not exist"
May 21 17:36:53.682329 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:53.682249    2563 scope.go:117] "RemoveContainer" containerID="52c00278226c152e369c689ccb5ba54045717211191d8667adaab3b478ec8b11"
May 21 17:36:53.682520 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:53.682501    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"52c00278226c152e369c689ccb5ba54045717211191d8667adaab3b478ec8b11"} err="failed to get container status \"52c00278226c152e369c689ccb5ba54045717211191d8667adaab3b478ec8b11\": rpc error: code = NotFound desc = could not find container \"52c00278226c152e369c689ccb5ba54045717211191d8667adaab3b478ec8b11\": container with ID starting with 52c00278226c152e369c689ccb5ba54045717211191d8667adaab3b478ec8b11 not found: ID does not exist"
May 21 17:36:53.682584 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:53.682520    2563 scope.go:117] "RemoveContainer" containerID="75cd80fbf5a5708524443abb445cdc17362e2c265ea682749c735489970332f3"
May 21 17:36:53.682738 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:53.682723    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"75cd80fbf5a5708524443abb445cdc17362e2c265ea682749c735489970332f3"} err="failed to get container status \"75cd80fbf5a5708524443abb445cdc17362e2c265ea682749c735489970332f3\": rpc error: code = NotFound desc = could not find container \"75cd80fbf5a5708524443abb445cdc17362e2c265ea682749c735489970332f3\": container with ID starting with 75cd80fbf5a5708524443abb445cdc17362e2c265ea682749c735489970332f3 not found: ID does not exist"
May 21 17:36:53.682794 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:53.682737    2563 scope.go:117] "RemoveContainer" containerID="5eb480ddafa38fc5e2612510c880418448931199f27053d5fd772c8207d9a4fe"
May 21 17:36:53.682966 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:53.682925    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5eb480ddafa38fc5e2612510c880418448931199f27053d5fd772c8207d9a4fe"} err="failed to get container status \"5eb480ddafa38fc5e2612510c880418448931199f27053d5fd772c8207d9a4fe\": rpc error: code = NotFound desc = could not find container \"5eb480ddafa38fc5e2612510c880418448931199f27053d5fd772c8207d9a4fe\": container with ID starting with 5eb480ddafa38fc5e2612510c880418448931199f27053d5fd772c8207d9a4fe not found: ID does not exist"
May 21 17:36:53.682966 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:53.682942    2563 scope.go:117] "RemoveContainer" containerID="6d96e55436c12e0ed7f086c90e2e1f09442149ce8cad4c944c5d32fcefcc1d3a"
May 21 17:36:53.683221 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:53.683188    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d96e55436c12e0ed7f086c90e2e1f09442149ce8cad4c944c5d32fcefcc1d3a"} err="failed to get container status \"6d96e55436c12e0ed7f086c90e2e1f09442149ce8cad4c944c5d32fcefcc1d3a\": rpc error: code = NotFound desc = could not find container \"6d96e55436c12e0ed7f086c90e2e1f09442149ce8cad4c944c5d32fcefcc1d3a\": container with ID starting with 6d96e55436c12e0ed7f086c90e2e1f09442149ce8cad4c944c5d32fcefcc1d3a not found: ID does not exist"
May 21 17:36:53.683477 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:53.683461    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 21 17:36:53.683739 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:53.683728    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="43e7053a-c6f7-4b5b-91eb-4c1afc630a4d" containerName="console"
May 21 17:36:53.683772 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:53.683741    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="43e7053a-c6f7-4b5b-91eb-4c1afc630a4d" containerName="console"
May 21 17:36:53.683772 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:53.683752    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27e504bd-cf67-4a9a-a95b-280b565166ad" containerName="prom-label-proxy"
May 21 17:36:53.683772 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:53.683758    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="27e504bd-cf67-4a9a-a95b-280b565166ad" containerName="prom-label-proxy"
May 21 17:36:53.683772 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:53.683767    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27e504bd-cf67-4a9a-a95b-280b565166ad" containerName="alertmanager"
May 21 17:36:53.683772 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:53.683773    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="27e504bd-cf67-4a9a-a95b-280b565166ad" containerName="alertmanager"
May 21 17:36:53.683911 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:53.683780    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27e504bd-cf67-4a9a-a95b-280b565166ad" containerName="config-reloader"
May 21 17:36:53.683911 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:53.683785    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="27e504bd-cf67-4a9a-a95b-280b565166ad" containerName="config-reloader"
May 21 17:36:53.683911 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:53.683799    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27e504bd-cf67-4a9a-a95b-280b565166ad" containerName="kube-rbac-proxy-web"
May 21 17:36:53.683911 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:53.683805    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="27e504bd-cf67-4a9a-a95b-280b565166ad" containerName="kube-rbac-proxy-web"
May 21 17:36:53.683911 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:53.683811    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27e504bd-cf67-4a9a-a95b-280b565166ad" containerName="kube-rbac-proxy-metric"
May 21 17:36:53.683911 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:53.683816    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="27e504bd-cf67-4a9a-a95b-280b565166ad" containerName="kube-rbac-proxy-metric"
May 21 17:36:53.683911 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:53.683823    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27e504bd-cf67-4a9a-a95b-280b565166ad" containerName="init-config-reloader"
May 21 17:36:53.683911 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:53.683828    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="27e504bd-cf67-4a9a-a95b-280b565166ad" containerName="init-config-reloader"
May 21 17:36:53.683911 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:53.683834    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27e504bd-cf67-4a9a-a95b-280b565166ad" containerName="kube-rbac-proxy"
May 21 17:36:53.683911 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:53.683839    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="27e504bd-cf67-4a9a-a95b-280b565166ad" containerName="kube-rbac-proxy"
May 21 17:36:53.683911 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:53.683882    2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="27e504bd-cf67-4a9a-a95b-280b565166ad" containerName="kube-rbac-proxy-metric"
May 21 17:36:53.683911 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:53.683890    2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="43e7053a-c6f7-4b5b-91eb-4c1afc630a4d" containerName="console"
May 21 17:36:53.683911 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:53.683897    2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="27e504bd-cf67-4a9a-a95b-280b565166ad" containerName="config-reloader"
May 21 17:36:53.683911 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:53.683903    2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="27e504bd-cf67-4a9a-a95b-280b565166ad" containerName="prom-label-proxy"
May 21 17:36:53.683911 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:53.683910    2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="27e504bd-cf67-4a9a-a95b-280b565166ad" containerName="alertmanager"
May 21 17:36:53.683911 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:53.683917    2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="27e504bd-cf67-4a9a-a95b-280b565166ad" containerName="kube-rbac-proxy-web"
May 21 17:36:53.684353 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:53.683922    2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="27e504bd-cf67-4a9a-a95b-280b565166ad" containerName="kube-rbac-proxy"
May 21 17:36:53.687247 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:53.687231    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 21 17:36:53.689463 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:53.689445    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
May 21 17:36:53.689555 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:53.689464    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
May 21 17:36:53.689619 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:53.689571    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
May 21 17:36:53.689679 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:53.689609    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
May 21 17:36:53.689748 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:53.689730    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
May 21 17:36:53.689880 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:53.689862    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-2ghpd\""
May 21 17:36:53.689959 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:53.689939    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
May 21 17:36:53.690153 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:53.690140    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
May 21 17:36:53.690220 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:53.690168    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
May 21 17:36:53.695100 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:53.695021    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
May 21 17:36:53.697450 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:53.697432    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 21 17:36:53.803969 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:53.803942    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="27e504bd-cf67-4a9a-a95b-280b565166ad" path="/var/lib/kubelet/pods/27e504bd-cf67-4a9a-a95b-280b565166ad/volumes"
May 21 17:36:53.831122 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:53.831099    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b3c1e30f-291e-437d-8861-f72a136fe01b-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"b3c1e30f-291e-437d-8861-f72a136fe01b\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 17:36:53.831229 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:53.831134    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b3c1e30f-291e-437d-8861-f72a136fe01b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"b3c1e30f-291e-437d-8861-f72a136fe01b\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 17:36:53.831229 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:53.831162    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b3c1e30f-291e-437d-8861-f72a136fe01b-config-out\") pod \"alertmanager-main-0\" (UID: \"b3c1e30f-291e-437d-8861-f72a136fe01b\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 17:36:53.831310 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:53.831238    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b3c1e30f-291e-437d-8861-f72a136fe01b-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"b3c1e30f-291e-437d-8861-f72a136fe01b\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 17:36:53.831310 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:53.831287    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b3c1e30f-291e-437d-8861-f72a136fe01b-tls-assets\") pod \"alertmanager-main-0\" (UID: \"b3c1e30f-291e-437d-8861-f72a136fe01b\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 17:36:53.831392 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:53.831321    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-69bwj\" (UniqueName: \"kubernetes.io/projected/b3c1e30f-291e-437d-8861-f72a136fe01b-kube-api-access-69bwj\") pod \"alertmanager-main-0\" (UID: \"b3c1e30f-291e-437d-8861-f72a136fe01b\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 17:36:53.831392 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:53.831348    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b3c1e30f-291e-437d-8861-f72a136fe01b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"b3c1e30f-291e-437d-8861-f72a136fe01b\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 17:36:53.831457 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:53.831392    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b3c1e30f-291e-437d-8861-f72a136fe01b-config-volume\") pod \"alertmanager-main-0\" (UID: \"b3c1e30f-291e-437d-8861-f72a136fe01b\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 17:36:53.831457 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:53.831423    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b3c1e30f-291e-437d-8861-f72a136fe01b-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"b3c1e30f-291e-437d-8861-f72a136fe01b\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 17:36:53.831457 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:53.831448    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b3c1e30f-291e-437d-8861-f72a136fe01b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"b3c1e30f-291e-437d-8861-f72a136fe01b\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 17:36:53.831557 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:53.831471    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b3c1e30f-291e-437d-8861-f72a136fe01b-web-config\") pod \"alertmanager-main-0\" (UID: \"b3c1e30f-291e-437d-8861-f72a136fe01b\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 17:36:53.831557 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:53.831501    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b3c1e30f-291e-437d-8861-f72a136fe01b-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"b3c1e30f-291e-437d-8861-f72a136fe01b\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 17:36:53.831557 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:53.831527    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b3c1e30f-291e-437d-8861-f72a136fe01b-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"b3c1e30f-291e-437d-8861-f72a136fe01b\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 17:36:53.932813 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:53.932754    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b3c1e30f-291e-437d-8861-f72a136fe01b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"b3c1e30f-291e-437d-8861-f72a136fe01b\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 17:36:53.932813 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:53.932783    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b3c1e30f-291e-437d-8861-f72a136fe01b-config-volume\") pod \"alertmanager-main-0\" (UID: \"b3c1e30f-291e-437d-8861-f72a136fe01b\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 17:36:53.932813 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:53.932807    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b3c1e30f-291e-437d-8861-f72a136fe01b-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"b3c1e30f-291e-437d-8861-f72a136fe01b\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 17:36:53.932977 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:53.932849    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b3c1e30f-291e-437d-8861-f72a136fe01b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"b3c1e30f-291e-437d-8861-f72a136fe01b\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 17:36:53.932977 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:53.932882    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b3c1e30f-291e-437d-8861-f72a136fe01b-web-config\") pod \"alertmanager-main-0\" (UID: \"b3c1e30f-291e-437d-8861-f72a136fe01b\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 17:36:53.932977 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:53.932931    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b3c1e30f-291e-437d-8861-f72a136fe01b-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"b3c1e30f-291e-437d-8861-f72a136fe01b\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 17:36:53.932977 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:53.932966    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b3c1e30f-291e-437d-8861-f72a136fe01b-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"b3c1e30f-291e-437d-8861-f72a136fe01b\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 17:36:53.933302 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:53.933021    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b3c1e30f-291e-437d-8861-f72a136fe01b-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"b3c1e30f-291e-437d-8861-f72a136fe01b\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 17:36:53.933302 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:53.933041    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b3c1e30f-291e-437d-8861-f72a136fe01b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"b3c1e30f-291e-437d-8861-f72a136fe01b\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 17:36:53.933302 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:53.933078    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b3c1e30f-291e-437d-8861-f72a136fe01b-config-out\") pod \"alertmanager-main-0\" (UID: \"b3c1e30f-291e-437d-8861-f72a136fe01b\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 17:36:53.933302 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:53.933154    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b3c1e30f-291e-437d-8861-f72a136fe01b-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"b3c1e30f-291e-437d-8861-f72a136fe01b\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 17:36:53.933302 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:53.933194    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b3c1e30f-291e-437d-8861-f72a136fe01b-tls-assets\") pod \"alertmanager-main-0\" (UID: \"b3c1e30f-291e-437d-8861-f72a136fe01b\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 17:36:53.933302 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:53.933220    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-69bwj\" (UniqueName: \"kubernetes.io/projected/b3c1e30f-291e-437d-8861-f72a136fe01b-kube-api-access-69bwj\") pod \"alertmanager-main-0\" (UID: \"b3c1e30f-291e-437d-8861-f72a136fe01b\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 17:36:53.933776 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:53.933748    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b3c1e30f-291e-437d-8861-f72a136fe01b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"b3c1e30f-291e-437d-8861-f72a136fe01b\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 17:36:53.934524 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:53.934499    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b3c1e30f-291e-437d-8861-f72a136fe01b-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"b3c1e30f-291e-437d-8861-f72a136fe01b\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 17:36:53.934798 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:53.934775    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b3c1e30f-291e-437d-8861-f72a136fe01b-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"b3c1e30f-291e-437d-8861-f72a136fe01b\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 17:36:53.936131 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:53.935898    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b3c1e30f-291e-437d-8861-f72a136fe01b-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"b3c1e30f-291e-437d-8861-f72a136fe01b\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 17:36:53.936131 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:53.935973    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b3c1e30f-291e-437d-8861-f72a136fe01b-config-volume\") pod \"alertmanager-main-0\" (UID: \"b3c1e30f-291e-437d-8861-f72a136fe01b\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 17:36:53.936131 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:53.936081    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b3c1e30f-291e-437d-8861-f72a136fe01b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"b3c1e30f-291e-437d-8861-f72a136fe01b\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 17:36:53.936331 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:53.936217    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b3c1e30f-291e-437d-8861-f72a136fe01b-web-config\") pod \"alertmanager-main-0\" (UID: \"b3c1e30f-291e-437d-8861-f72a136fe01b\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 17:36:53.936331 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:53.936250    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b3c1e30f-291e-437d-8861-f72a136fe01b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"b3c1e30f-291e-437d-8861-f72a136fe01b\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 17:36:53.936435 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:53.936354    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b3c1e30f-291e-437d-8861-f72a136fe01b-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"b3c1e30f-291e-437d-8861-f72a136fe01b\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 17:36:53.936557 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:53.936538    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b3c1e30f-291e-437d-8861-f72a136fe01b-tls-assets\") pod \"alertmanager-main-0\" (UID: \"b3c1e30f-291e-437d-8861-f72a136fe01b\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 17:36:53.937202 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:53.937183    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b3c1e30f-291e-437d-8861-f72a136fe01b-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"b3c1e30f-291e-437d-8861-f72a136fe01b\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 17:36:53.937666 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:53.937644    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b3c1e30f-291e-437d-8861-f72a136fe01b-config-out\") pod \"alertmanager-main-0\" (UID: \"b3c1e30f-291e-437d-8861-f72a136fe01b\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 17:36:53.940180 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:53.940165    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-69bwj\" (UniqueName: \"kubernetes.io/projected/b3c1e30f-291e-437d-8861-f72a136fe01b-kube-api-access-69bwj\") pod \"alertmanager-main-0\" (UID: \"b3c1e30f-291e-437d-8861-f72a136fe01b\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 17:36:53.997651 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:53.997629    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 21 17:36:54.124348 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:54.124318    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 21 17:36:54.127226 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:36:54.127190    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3c1e30f_291e_437d_8861_f72a136fe01b.slice/crio-75b821317d8014f9d21af8c0cdc316155b73f63a621a22121b28e22f99ac156c WatchSource:0}: Error finding container 75b821317d8014f9d21af8c0cdc316155b73f63a621a22121b28e22f99ac156c: Status 404 returned error can't find the container with id 75b821317d8014f9d21af8c0cdc316155b73f63a621a22121b28e22f99ac156c
May 21 17:36:54.635608 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:54.635576    2563 generic.go:358] "Generic (PLEG): container finished" podID="b3c1e30f-291e-437d-8861-f72a136fe01b" containerID="891cc1d3d4281d027d240e197d151e99a0d26f14ba69191c5024157f4ebdf256" exitCode=0
May 21 17:36:54.635983 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:54.635663    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b3c1e30f-291e-437d-8861-f72a136fe01b","Type":"ContainerDied","Data":"891cc1d3d4281d027d240e197d151e99a0d26f14ba69191c5024157f4ebdf256"}
May 21 17:36:54.635983 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:54.635704    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b3c1e30f-291e-437d-8861-f72a136fe01b","Type":"ContainerStarted","Data":"75b821317d8014f9d21af8c0cdc316155b73f63a621a22121b28e22f99ac156c"}
May 21 17:36:55.642719 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:55.642680    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b3c1e30f-291e-437d-8861-f72a136fe01b","Type":"ContainerStarted","Data":"410f8e4e96bdcfaa8feadf9ccc221ac309d50e65adf26df4d5ee68c25e53973d"}
May 21 17:36:55.642719 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:55.642722    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b3c1e30f-291e-437d-8861-f72a136fe01b","Type":"ContainerStarted","Data":"aaa1f0ff617c980681d7d5e47f46c647da50fd8d76df85b32f77ac40245aa7e5"}
May 21 17:36:55.643132 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:55.642732    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b3c1e30f-291e-437d-8861-f72a136fe01b","Type":"ContainerStarted","Data":"799a345a9c267ed4e6d521aecc771a6545a585c81f8abd19c06cbf741df36362"}
May 21 17:36:55.643132 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:55.642742    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b3c1e30f-291e-437d-8861-f72a136fe01b","Type":"ContainerStarted","Data":"7f2939072628e889114dbce11c04643482b5a2d417de2cd31365e60a5c046be7"}
May 21 17:36:55.643132 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:55.642750    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b3c1e30f-291e-437d-8861-f72a136fe01b","Type":"ContainerStarted","Data":"bd81b6092f6ffb09719ae47cd41546fb734018ab395d9352d0b631ef58a5f728"}
May 21 17:36:55.643132 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:55.642757    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b3c1e30f-291e-437d-8861-f72a136fe01b","Type":"ContainerStarted","Data":"7103c4f89b8c37563d422ab1ca1e3a88552afb33672873aed87cb55c2103d444"}
May 21 17:36:55.667846 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:55.667805    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.667792064 podStartE2EDuration="2.667792064s" podCreationTimestamp="2026-05-21 17:36:53 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 17:36:55.665293267 +0000 UTC m=+246.442665771" watchObservedRunningTime="2026-05-21 17:36:55.667792064 +0000 UTC m=+246.445164569"
May 21 17:36:56.031723 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:56.031654    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-66f56f8799-gj2nb"]
May 21 17:36:56.034185 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:56.034168    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-66f56f8799-gj2nb"
May 21 17:36:56.036731 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:56.036711    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
May 21 17:36:56.036966 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:56.036945    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
May 21 17:36:56.037420 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:56.037398    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
May 21 17:36:56.037982 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:56.037966    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
May 21 17:36:56.038224 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:56.038211    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
May 21 17:36:56.038633 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:56.038616    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-t6bbc\""
May 21 17:36:56.042463 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:56.042445    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
May 21 17:36:56.047890 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:56.047871    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-66f56f8799-gj2nb"]
May 21 17:36:56.153508 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:56.153479    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9b032f78-144d-4340-8f80-f622ddea0ba9-metrics-client-ca\") pod \"telemeter-client-66f56f8799-gj2nb\" (UID: \"9b032f78-144d-4340-8f80-f622ddea0ba9\") " pod="openshift-monitoring/telemeter-client-66f56f8799-gj2nb"
May 21 17:36:56.153636 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:56.153514    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9b032f78-144d-4340-8f80-f622ddea0ba9-serving-certs-ca-bundle\") pod \"telemeter-client-66f56f8799-gj2nb\" (UID: \"9b032f78-144d-4340-8f80-f622ddea0ba9\") " pod="openshift-monitoring/telemeter-client-66f56f8799-gj2nb"
May 21 17:36:56.153683 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:56.153628    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/9b032f78-144d-4340-8f80-f622ddea0ba9-telemeter-client-tls\") pod \"telemeter-client-66f56f8799-gj2nb\" (UID: \"9b032f78-144d-4340-8f80-f622ddea0ba9\") " pod="openshift-monitoring/telemeter-client-66f56f8799-gj2nb"
May 21 17:36:56.153683 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:56.153654    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9b032f78-144d-4340-8f80-f622ddea0ba9-telemeter-trusted-ca-bundle\") pod \"telemeter-client-66f56f8799-gj2nb\" (UID: \"9b032f78-144d-4340-8f80-f622ddea0ba9\") " pod="openshift-monitoring/telemeter-client-66f56f8799-gj2nb"
May 21 17:36:56.153683 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:56.153676    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/9b032f78-144d-4340-8f80-f622ddea0ba9-federate-client-tls\") pod \"telemeter-client-66f56f8799-gj2nb\" (UID: \"9b032f78-144d-4340-8f80-f622ddea0ba9\") " pod="openshift-monitoring/telemeter-client-66f56f8799-gj2nb"
May 21 17:36:56.153784 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:56.153744    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9b032f78-144d-4340-8f80-f622ddea0ba9-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-66f56f8799-gj2nb\" (UID: \"9b032f78-144d-4340-8f80-f622ddea0ba9\") " pod="openshift-monitoring/telemeter-client-66f56f8799-gj2nb"
May 21 17:36:56.153784 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:56.153765    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8vkdv\" (UniqueName: \"kubernetes.io/projected/9b032f78-144d-4340-8f80-f622ddea0ba9-kube-api-access-8vkdv\") pod \"telemeter-client-66f56f8799-gj2nb\" (UID: \"9b032f78-144d-4340-8f80-f622ddea0ba9\") " pod="openshift-monitoring/telemeter-client-66f56f8799-gj2nb"
May 21 17:36:56.153857 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:56.153782    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/9b032f78-144d-4340-8f80-f622ddea0ba9-secret-telemeter-client\") pod \"telemeter-client-66f56f8799-gj2nb\" (UID: \"9b032f78-144d-4340-8f80-f622ddea0ba9\") " pod="openshift-monitoring/telemeter-client-66f56f8799-gj2nb"
May 21 17:36:56.254783 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:56.254745    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9b032f78-144d-4340-8f80-f622ddea0ba9-metrics-client-ca\") pod \"telemeter-client-66f56f8799-gj2nb\" (UID: \"9b032f78-144d-4340-8f80-f622ddea0ba9\") " pod="openshift-monitoring/telemeter-client-66f56f8799-gj2nb"
May 21 17:36:56.254911 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:56.254785    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9b032f78-144d-4340-8f80-f622ddea0ba9-serving-certs-ca-bundle\") pod \"telemeter-client-66f56f8799-gj2nb\" (UID: \"9b032f78-144d-4340-8f80-f622ddea0ba9\") " pod="openshift-monitoring/telemeter-client-66f56f8799-gj2nb"
May 21 17:36:56.254911 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:56.254872    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/9b032f78-144d-4340-8f80-f622ddea0ba9-telemeter-client-tls\") pod \"telemeter-client-66f56f8799-gj2nb\" (UID: \"9b032f78-144d-4340-8f80-f622ddea0ba9\") " pod="openshift-monitoring/telemeter-client-66f56f8799-gj2nb"
May 21 17:36:56.254911 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:56.254899    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9b032f78-144d-4340-8f80-f622ddea0ba9-telemeter-trusted-ca-bundle\") pod \"telemeter-client-66f56f8799-gj2nb\" (UID: \"9b032f78-144d-4340-8f80-f622ddea0ba9\") " pod="openshift-monitoring/telemeter-client-66f56f8799-gj2nb"
May 21 17:36:56.255092 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:56.254928    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/9b032f78-144d-4340-8f80-f622ddea0ba9-federate-client-tls\") pod \"telemeter-client-66f56f8799-gj2nb\" (UID: \"9b032f78-144d-4340-8f80-f622ddea0ba9\") " pod="openshift-monitoring/telemeter-client-66f56f8799-gj2nb"
May 21 17:36:56.255092 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:56.254969    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9b032f78-144d-4340-8f80-f622ddea0ba9-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-66f56f8799-gj2nb\" (UID: \"9b032f78-144d-4340-8f80-f622ddea0ba9\") " pod="openshift-monitoring/telemeter-client-66f56f8799-gj2nb"
May 21 17:36:56.255203 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:56.255110    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8vkdv\" (UniqueName: \"kubernetes.io/projected/9b032f78-144d-4340-8f80-f622ddea0ba9-kube-api-access-8vkdv\") pod \"telemeter-client-66f56f8799-gj2nb\" (UID: \"9b032f78-144d-4340-8f80-f622ddea0ba9\") " pod="openshift-monitoring/telemeter-client-66f56f8799-gj2nb"
May 21 17:36:56.255203 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:56.255152    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/9b032f78-144d-4340-8f80-f622ddea0ba9-secret-telemeter-client\") pod \"telemeter-client-66f56f8799-gj2nb\" (UID: \"9b032f78-144d-4340-8f80-f622ddea0ba9\") " pod="openshift-monitoring/telemeter-client-66f56f8799-gj2nb"
May 21 17:36:56.255595 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:56.255567    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9b032f78-144d-4340-8f80-f622ddea0ba9-serving-certs-ca-bundle\") pod \"telemeter-client-66f56f8799-gj2nb\" (UID: \"9b032f78-144d-4340-8f80-f622ddea0ba9\") " pod="openshift-monitoring/telemeter-client-66f56f8799-gj2nb"
May 21 17:36:56.255595 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:56.255593    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9b032f78-144d-4340-8f80-f622ddea0ba9-metrics-client-ca\") pod \"telemeter-client-66f56f8799-gj2nb\" (UID: \"9b032f78-144d-4340-8f80-f622ddea0ba9\") " pod="openshift-monitoring/telemeter-client-66f56f8799-gj2nb"
May 21 17:36:56.256131 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:56.256109    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9b032f78-144d-4340-8f80-f622ddea0ba9-telemeter-trusted-ca-bundle\") pod \"telemeter-client-66f56f8799-gj2nb\" (UID: \"9b032f78-144d-4340-8f80-f622ddea0ba9\") " pod="openshift-monitoring/telemeter-client-66f56f8799-gj2nb"
May 21 17:36:56.257603 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:56.257579    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9b032f78-144d-4340-8f80-f622ddea0ba9-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-66f56f8799-gj2nb\" (UID: \"9b032f78-144d-4340-8f80-f622ddea0ba9\") " pod="openshift-monitoring/telemeter-client-66f56f8799-gj2nb"
May 21 17:36:56.257771 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:56.257747    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/9b032f78-144d-4340-8f80-f622ddea0ba9-telemeter-client-tls\") pod \"telemeter-client-66f56f8799-gj2nb\" (UID: \"9b032f78-144d-4340-8f80-f622ddea0ba9\") " pod="openshift-monitoring/telemeter-client-66f56f8799-gj2nb"
May 21 17:36:56.257871 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:56.257853    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/9b032f78-144d-4340-8f80-f622ddea0ba9-federate-client-tls\") pod \"telemeter-client-66f56f8799-gj2nb\" (UID: \"9b032f78-144d-4340-8f80-f622ddea0ba9\") " pod="openshift-monitoring/telemeter-client-66f56f8799-gj2nb"
May 21 17:36:56.257905 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:56.257855    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/9b032f78-144d-4340-8f80-f622ddea0ba9-secret-telemeter-client\") pod \"telemeter-client-66f56f8799-gj2nb\" (UID: \"9b032f78-144d-4340-8f80-f622ddea0ba9\") " pod="openshift-monitoring/telemeter-client-66f56f8799-gj2nb"
May 21 17:36:56.262613 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:56.262594    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8vkdv\" (UniqueName: \"kubernetes.io/projected/9b032f78-144d-4340-8f80-f622ddea0ba9-kube-api-access-8vkdv\") pod \"telemeter-client-66f56f8799-gj2nb\" (UID: \"9b032f78-144d-4340-8f80-f622ddea0ba9\") " pod="openshift-monitoring/telemeter-client-66f56f8799-gj2nb"
May 21 17:36:56.345312 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:56.345288    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-66f56f8799-gj2nb"
May 21 17:36:56.466533 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:56.466502    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-66f56f8799-gj2nb"]
May 21 17:36:56.469369 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:36:56.469344    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b032f78_144d_4340_8f80_f622ddea0ba9.slice/crio-0c8d6355bfa22aac6dde34bcd975e5ff92d44a73bcbbe36ee2c6cef038044beb WatchSource:0}: Error finding container 0c8d6355bfa22aac6dde34bcd975e5ff92d44a73bcbbe36ee2c6cef038044beb: Status 404 returned error can't find the container with id 0c8d6355bfa22aac6dde34bcd975e5ff92d44a73bcbbe36ee2c6cef038044beb
May 21 17:36:56.648162 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:56.648083    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-66f56f8799-gj2nb" event={"ID":"9b032f78-144d-4340-8f80-f622ddea0ba9","Type":"ContainerStarted","Data":"0c8d6355bfa22aac6dde34bcd975e5ff92d44a73bcbbe36ee2c6cef038044beb"}
May 21 17:36:58.660225 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:58.660182    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-66f56f8799-gj2nb" event={"ID":"9b032f78-144d-4340-8f80-f622ddea0ba9","Type":"ContainerStarted","Data":"b3fab2376233d4a58d0bab2a14d5061cbe72c5137bba86ffba79cfd406093d54"}
May 21 17:36:58.660225 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:58.660222    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-66f56f8799-gj2nb" event={"ID":"9b032f78-144d-4340-8f80-f622ddea0ba9","Type":"ContainerStarted","Data":"934d3390cee177eb07420d143d49ced567e7c4eecc64695bbc68492b048d2447"}
May 21 17:36:59.665173 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:59.665134    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-66f56f8799-gj2nb" event={"ID":"9b032f78-144d-4340-8f80-f622ddea0ba9","Type":"ContainerStarted","Data":"1b15062eb5bc34fbc8f0548570a043f353bd5766823d20af9e6ec000be342234"}
May 21 17:36:59.685883 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:36:59.685716    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-66f56f8799-gj2nb" podStartSLOduration=1.63614006 podStartE2EDuration="3.685699136s" podCreationTimestamp="2026-05-21 17:36:56 +0000 UTC" firstStartedPulling="2026-05-21 17:36:56.471218391 +0000 UTC m=+247.248590873" lastFinishedPulling="2026-05-21 17:36:58.520777467 +0000 UTC m=+249.298149949" observedRunningTime="2026-05-21 17:36:59.684654929 +0000 UTC m=+250.462027456" watchObservedRunningTime="2026-05-21 17:36:59.685699136 +0000 UTC m=+250.463071640"
May 21 17:37:00.389532 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:37:00.389498    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-7fb9565f94-m6gz6"]
May 21 17:37:00.391882 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:37:00.391856    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7fb9565f94-m6gz6"
May 21 17:37:00.401354 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:37:00.401331    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7fb9565f94-m6gz6"]
May 21 17:37:00.489126 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:37:00.489098    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f26908b6-ca36-4254-ac77-2e11c1ab505c-oauth-serving-cert\") pod \"console-7fb9565f94-m6gz6\" (UID: \"f26908b6-ca36-4254-ac77-2e11c1ab505c\") " pod="openshift-console/console-7fb9565f94-m6gz6"
May 21 17:37:00.489242 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:37:00.489147    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f26908b6-ca36-4254-ac77-2e11c1ab505c-trusted-ca-bundle\") pod \"console-7fb9565f94-m6gz6\" (UID: \"f26908b6-ca36-4254-ac77-2e11c1ab505c\") " pod="openshift-console/console-7fb9565f94-m6gz6"
May 21 17:37:00.489242 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:37:00.489216    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f26908b6-ca36-4254-ac77-2e11c1ab505c-console-oauth-config\") pod \"console-7fb9565f94-m6gz6\" (UID: \"f26908b6-ca36-4254-ac77-2e11c1ab505c\") " pod="openshift-console/console-7fb9565f94-m6gz6"
May 21 17:37:00.489362 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:37:00.489254    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rf44x\" (UniqueName: \"kubernetes.io/projected/f26908b6-ca36-4254-ac77-2e11c1ab505c-kube-api-access-rf44x\") pod \"console-7fb9565f94-m6gz6\" (UID: \"f26908b6-ca36-4254-ac77-2e11c1ab505c\") " pod="openshift-console/console-7fb9565f94-m6gz6"
May 21 17:37:00.489362 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:37:00.489308    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f26908b6-ca36-4254-ac77-2e11c1ab505c-service-ca\") pod \"console-7fb9565f94-m6gz6\" (UID: \"f26908b6-ca36-4254-ac77-2e11c1ab505c\") " pod="openshift-console/console-7fb9565f94-m6gz6"
May 21 17:37:00.489452 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:37:00.489372    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/44544f15-6623-4cbc-876d-2336ac096e94-metrics-certs\") pod \"network-metrics-daemon-5m8k5\" (UID: \"44544f15-6623-4cbc-876d-2336ac096e94\") " pod="openshift-multus/network-metrics-daemon-5m8k5"
May 21 17:37:00.489452 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:37:00.489419    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f26908b6-ca36-4254-ac77-2e11c1ab505c-console-serving-cert\") pod \"console-7fb9565f94-m6gz6\" (UID: \"f26908b6-ca36-4254-ac77-2e11c1ab505c\") " pod="openshift-console/console-7fb9565f94-m6gz6"
May 21 17:37:00.489452 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:37:00.489448    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f26908b6-ca36-4254-ac77-2e11c1ab505c-console-config\") pod \"console-7fb9565f94-m6gz6\" (UID: \"f26908b6-ca36-4254-ac77-2e11c1ab505c\") " pod="openshift-console/console-7fb9565f94-m6gz6"
May 21 17:37:00.491634 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:37:00.491610    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/44544f15-6623-4cbc-876d-2336ac096e94-metrics-certs\") pod \"network-metrics-daemon-5m8k5\" (UID: \"44544f15-6623-4cbc-876d-2336ac096e94\") " pod="openshift-multus/network-metrics-daemon-5m8k5"
May 21 17:37:00.590050 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:37:00.590017    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f26908b6-ca36-4254-ac77-2e11c1ab505c-trusted-ca-bundle\") pod \"console-7fb9565f94-m6gz6\" (UID: \"f26908b6-ca36-4254-ac77-2e11c1ab505c\") " pod="openshift-console/console-7fb9565f94-m6gz6"
May 21 17:37:00.590207 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:37:00.590088    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f26908b6-ca36-4254-ac77-2e11c1ab505c-console-oauth-config\") pod \"console-7fb9565f94-m6gz6\" (UID: \"f26908b6-ca36-4254-ac77-2e11c1ab505c\") " pod="openshift-console/console-7fb9565f94-m6gz6"
May 21 17:37:00.590207 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:37:00.590114    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rf44x\" (UniqueName: \"kubernetes.io/projected/f26908b6-ca36-4254-ac77-2e11c1ab505c-kube-api-access-rf44x\") pod \"console-7fb9565f94-m6gz6\" (UID: \"f26908b6-ca36-4254-ac77-2e11c1ab505c\") " pod="openshift-console/console-7fb9565f94-m6gz6"
May 21 17:37:00.590207 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:37:00.590171    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f26908b6-ca36-4254-ac77-2e11c1ab505c-service-ca\") pod \"console-7fb9565f94-m6gz6\" (UID: \"f26908b6-ca36-4254-ac77-2e11c1ab505c\") " pod="openshift-console/console-7fb9565f94-m6gz6"
May 21 17:37:00.590316 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:37:00.590225    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f26908b6-ca36-4254-ac77-2e11c1ab505c-console-serving-cert\") pod \"console-7fb9565f94-m6gz6\" (UID: \"f26908b6-ca36-4254-ac77-2e11c1ab505c\") " pod="openshift-console/console-7fb9565f94-m6gz6"
May 21 17:37:00.590316 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:37:00.590260    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f26908b6-ca36-4254-ac77-2e11c1ab505c-console-config\") pod \"console-7fb9565f94-m6gz6\" (UID: \"f26908b6-ca36-4254-ac77-2e11c1ab505c\") " pod="openshift-console/console-7fb9565f94-m6gz6"
May 21 17:37:00.590316 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:37:00.590297    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f26908b6-ca36-4254-ac77-2e11c1ab505c-oauth-serving-cert\") pod \"console-7fb9565f94-m6gz6\" (UID: \"f26908b6-ca36-4254-ac77-2e11c1ab505c\") " pod="openshift-console/console-7fb9565f94-m6gz6"
May 21 17:37:00.590959 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:37:00.590934    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f26908b6-ca36-4254-ac77-2e11c1ab505c-oauth-serving-cert\") pod \"console-7fb9565f94-m6gz6\" (UID: \"f26908b6-ca36-4254-ac77-2e11c1ab505c\") " pod="openshift-console/console-7fb9565f94-m6gz6"
May 21 17:37:00.591087 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:37:00.590943    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f26908b6-ca36-4254-ac77-2e11c1ab505c-trusted-ca-bundle\") pod \"console-7fb9565f94-m6gz6\" (UID: \"f26908b6-ca36-4254-ac77-2e11c1ab505c\") " pod="openshift-console/console-7fb9565f94-m6gz6"
May 21 17:37:00.591087 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:37:00.591013    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f26908b6-ca36-4254-ac77-2e11c1ab505c-service-ca\") pod \"console-7fb9565f94-m6gz6\" (UID: \"f26908b6-ca36-4254-ac77-2e11c1ab505c\") " pod="openshift-console/console-7fb9565f94-m6gz6"
May 21 17:37:00.591087 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:37:00.591015    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f26908b6-ca36-4254-ac77-2e11c1ab505c-console-config\") pod \"console-7fb9565f94-m6gz6\" (UID: \"f26908b6-ca36-4254-ac77-2e11c1ab505c\") " pod="openshift-console/console-7fb9565f94-m6gz6"
May 21 17:37:00.592629 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:37:00.592606    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f26908b6-ca36-4254-ac77-2e11c1ab505c-console-serving-cert\") pod \"console-7fb9565f94-m6gz6\" (UID: \"f26908b6-ca36-4254-ac77-2e11c1ab505c\") " pod="openshift-console/console-7fb9565f94-m6gz6"
May 21 17:37:00.592706 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:37:00.592628    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f26908b6-ca36-4254-ac77-2e11c1ab505c-console-oauth-config\") pod \"console-7fb9565f94-m6gz6\" (UID: \"f26908b6-ca36-4254-ac77-2e11c1ab505c\") " pod="openshift-console/console-7fb9565f94-m6gz6"
May 21 17:37:00.599016 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:37:00.598997    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rf44x\" (UniqueName: \"kubernetes.io/projected/f26908b6-ca36-4254-ac77-2e11c1ab505c-kube-api-access-rf44x\") pod \"console-7fb9565f94-m6gz6\" (UID: \"f26908b6-ca36-4254-ac77-2e11c1ab505c\") " pod="openshift-console/console-7fb9565f94-m6gz6"
May 21 17:37:00.701783 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:37:00.701718    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7fb9565f94-m6gz6"
May 21 17:37:00.702524 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:37:00.702508    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-jx287\""
May 21 17:37:00.711392 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:37:00.711372    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5m8k5"
May 21 17:37:00.831795 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:37:00.831764    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7fb9565f94-m6gz6"]
May 21 17:37:00.834731 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:37:00.834704    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf26908b6_ca36_4254_ac77_2e11c1ab505c.slice/crio-c0ed46ff80665d760b4d89db6b0ccf2bf2959e382b5ab8f0dfb5cf11d4c17287 WatchSource:0}: Error finding container c0ed46ff80665d760b4d89db6b0ccf2bf2959e382b5ab8f0dfb5cf11d4c17287: Status 404 returned error can't find the container with id c0ed46ff80665d760b4d89db6b0ccf2bf2959e382b5ab8f0dfb5cf11d4c17287
May 21 17:37:00.849611 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:37:00.849582    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-5m8k5"]
May 21 17:37:00.852908 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:37:00.852882    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44544f15_6623_4cbc_876d_2336ac096e94.slice/crio-e7d19a7f3bf447cd6733cca6093d62ba1cb0b206fa13ba2aaf237b2858299b7d WatchSource:0}: Error finding container e7d19a7f3bf447cd6733cca6093d62ba1cb0b206fa13ba2aaf237b2858299b7d: Status 404 returned error can't find the container with id e7d19a7f3bf447cd6733cca6093d62ba1cb0b206fa13ba2aaf237b2858299b7d
May 21 17:37:01.676749 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:37:01.676699    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5m8k5" event={"ID":"44544f15-6623-4cbc-876d-2336ac096e94","Type":"ContainerStarted","Data":"e7d19a7f3bf447cd6733cca6093d62ba1cb0b206fa13ba2aaf237b2858299b7d"}
May 21 17:37:01.678439 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:37:01.678397    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7fb9565f94-m6gz6" event={"ID":"f26908b6-ca36-4254-ac77-2e11c1ab505c","Type":"ContainerStarted","Data":"e0a5b6914f7fb09c109e23780812fdc6f5eaf94f36d7ec4b74c628f0aec8aeea"}
May 21 17:37:01.678439 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:37:01.678435    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7fb9565f94-m6gz6" event={"ID":"f26908b6-ca36-4254-ac77-2e11c1ab505c","Type":"ContainerStarted","Data":"c0ed46ff80665d760b4d89db6b0ccf2bf2959e382b5ab8f0dfb5cf11d4c17287"}
May 21 17:37:01.696237 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:37:01.696156    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-7fb9565f94-m6gz6" podStartSLOduration=1.696137524 podStartE2EDuration="1.696137524s" podCreationTimestamp="2026-05-21 17:37:00 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 17:37:01.694397269 +0000 UTC m=+252.471769772" watchObservedRunningTime="2026-05-21 17:37:01.696137524 +0000 UTC m=+252.473510030"
May 21 17:37:02.682617 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:37:02.682576    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5m8k5" event={"ID":"44544f15-6623-4cbc-876d-2336ac096e94","Type":"ContainerStarted","Data":"b16ee03e37fe0b127740f6325027f5938a4199ab2c520a9cef005bb8c3346167"}
May 21 17:37:02.682617 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:37:02.682618    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5m8k5" event={"ID":"44544f15-6623-4cbc-876d-2336ac096e94","Type":"ContainerStarted","Data":"e9e5ccac89d4c6075d9ba7802ca29c021c904cc742dc84ad1e3fde57d082b26b"}
May 21 17:37:02.697432 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:37:02.697387    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-5m8k5" podStartSLOduration=252.81497198 podStartE2EDuration="4m13.697373332s" podCreationTimestamp="2026-05-21 17:32:49 +0000 UTC" firstStartedPulling="2026-05-21 17:37:00.854743713 +0000 UTC m=+251.632116198" lastFinishedPulling="2026-05-21 17:37:01.737145069 +0000 UTC m=+252.514517550" observedRunningTime="2026-05-21 17:37:02.69669029 +0000 UTC m=+253.474062806" watchObservedRunningTime="2026-05-21 17:37:02.697373332 +0000 UTC m=+253.474745835"
May 21 17:37:10.702155 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:37:10.702123    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7fb9565f94-m6gz6"
May 21 17:37:10.702623 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:37:10.702167    2563 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7fb9565f94-m6gz6"
May 21 17:37:10.706947 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:37:10.706926    2563 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7fb9565f94-m6gz6"
May 21 17:37:11.712078 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:37:11.712038    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7fb9565f94-m6gz6"
May 21 17:37:11.753200 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:37:11.753166    2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-58f4f797fc-flqs4"]
May 21 17:37:36.774431 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:37:36.774385    2563 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-58f4f797fc-flqs4" podUID="dac805af-f8a4-4a1f-8f53-ed7328c54c7a" containerName="console" containerID="cri-o://ec09748dfb80e1ae732a66d2c25fc03a3db5f308ed44cc6b0e25cf49ff060860" gracePeriod=15
May 21 17:37:37.035825 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:37:37.035802    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-58f4f797fc-flqs4_dac805af-f8a4-4a1f-8f53-ed7328c54c7a/console/0.log"
May 21 17:37:37.035930 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:37:37.035862    2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-58f4f797fc-flqs4"
May 21 17:37:37.158496 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:37:37.158457    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dac805af-f8a4-4a1f-8f53-ed7328c54c7a-trusted-ca-bundle\") pod \"dac805af-f8a4-4a1f-8f53-ed7328c54c7a\" (UID: \"dac805af-f8a4-4a1f-8f53-ed7328c54c7a\") "
May 21 17:37:37.158672 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:37:37.158549    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dac805af-f8a4-4a1f-8f53-ed7328c54c7a-console-oauth-config\") pod \"dac805af-f8a4-4a1f-8f53-ed7328c54c7a\" (UID: \"dac805af-f8a4-4a1f-8f53-ed7328c54c7a\") "
May 21 17:37:37.158672 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:37:37.158591    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dac805af-f8a4-4a1f-8f53-ed7328c54c7a-console-config\") pod \"dac805af-f8a4-4a1f-8f53-ed7328c54c7a\" (UID: \"dac805af-f8a4-4a1f-8f53-ed7328c54c7a\") "
May 21 17:37:37.158672 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:37:37.158628    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dac805af-f8a4-4a1f-8f53-ed7328c54c7a-service-ca\") pod \"dac805af-f8a4-4a1f-8f53-ed7328c54c7a\" (UID: \"dac805af-f8a4-4a1f-8f53-ed7328c54c7a\") "
May 21 17:37:37.158672 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:37:37.158654    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-82plw\" (UniqueName: \"kubernetes.io/projected/dac805af-f8a4-4a1f-8f53-ed7328c54c7a-kube-api-access-82plw\") pod \"dac805af-f8a4-4a1f-8f53-ed7328c54c7a\" (UID: \"dac805af-f8a4-4a1f-8f53-ed7328c54c7a\") "
May 21 17:37:37.158872 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:37:37.158690    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dac805af-f8a4-4a1f-8f53-ed7328c54c7a-oauth-serving-cert\") pod \"dac805af-f8a4-4a1f-8f53-ed7328c54c7a\" (UID: \"dac805af-f8a4-4a1f-8f53-ed7328c54c7a\") "
May 21 17:37:37.158872 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:37:37.158767    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dac805af-f8a4-4a1f-8f53-ed7328c54c7a-console-serving-cert\") pod \"dac805af-f8a4-4a1f-8f53-ed7328c54c7a\" (UID: \"dac805af-f8a4-4a1f-8f53-ed7328c54c7a\") "
May 21 17:37:37.158872 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:37:37.158856    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dac805af-f8a4-4a1f-8f53-ed7328c54c7a-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "dac805af-f8a4-4a1f-8f53-ed7328c54c7a" (UID: "dac805af-f8a4-4a1f-8f53-ed7328c54c7a"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 21 17:37:37.159045 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:37:37.159011    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dac805af-f8a4-4a1f-8f53-ed7328c54c7a-service-ca" (OuterVolumeSpecName: "service-ca") pod "dac805af-f8a4-4a1f-8f53-ed7328c54c7a" (UID: "dac805af-f8a4-4a1f-8f53-ed7328c54c7a"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 21 17:37:37.159135 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:37:37.159105    2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dac805af-f8a4-4a1f-8f53-ed7328c54c7a-trusted-ca-bundle\") on node \"ip-10-0-140-106.ec2.internal\" DevicePath \"\""
May 21 17:37:37.159135 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:37:37.159109    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dac805af-f8a4-4a1f-8f53-ed7328c54c7a-console-config" (OuterVolumeSpecName: "console-config") pod "dac805af-f8a4-4a1f-8f53-ed7328c54c7a" (UID: "dac805af-f8a4-4a1f-8f53-ed7328c54c7a"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 21 17:37:37.159135 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:37:37.159119    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dac805af-f8a4-4a1f-8f53-ed7328c54c7a-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "dac805af-f8a4-4a1f-8f53-ed7328c54c7a" (UID: "dac805af-f8a4-4a1f-8f53-ed7328c54c7a"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 21 17:37:37.160751 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:37:37.160732    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dac805af-f8a4-4a1f-8f53-ed7328c54c7a-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "dac805af-f8a4-4a1f-8f53-ed7328c54c7a" (UID: "dac805af-f8a4-4a1f-8f53-ed7328c54c7a"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 21 17:37:37.160828 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:37:37.160751    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dac805af-f8a4-4a1f-8f53-ed7328c54c7a-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "dac805af-f8a4-4a1f-8f53-ed7328c54c7a" (UID: "dac805af-f8a4-4a1f-8f53-ed7328c54c7a"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 21 17:37:37.160828 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:37:37.160791    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dac805af-f8a4-4a1f-8f53-ed7328c54c7a-kube-api-access-82plw" (OuterVolumeSpecName: "kube-api-access-82plw") pod "dac805af-f8a4-4a1f-8f53-ed7328c54c7a" (UID: "dac805af-f8a4-4a1f-8f53-ed7328c54c7a"). InnerVolumeSpecName "kube-api-access-82plw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 17:37:37.260409 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:37:37.260358    2563 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dac805af-f8a4-4a1f-8f53-ed7328c54c7a-console-oauth-config\") on node \"ip-10-0-140-106.ec2.internal\" DevicePath \"\""
May 21 17:37:37.260409 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:37:37.260405    2563 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dac805af-f8a4-4a1f-8f53-ed7328c54c7a-console-config\") on node \"ip-10-0-140-106.ec2.internal\" DevicePath \"\""
May 21 17:37:37.260409 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:37:37.260416    2563 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dac805af-f8a4-4a1f-8f53-ed7328c54c7a-service-ca\") on node \"ip-10-0-140-106.ec2.internal\" DevicePath \"\""
May 21 17:37:37.260409 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:37:37.260425    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-82plw\" (UniqueName: \"kubernetes.io/projected/dac805af-f8a4-4a1f-8f53-ed7328c54c7a-kube-api-access-82plw\") on node \"ip-10-0-140-106.ec2.internal\" DevicePath \"\""
May 21 17:37:37.260683 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:37:37.260435    2563 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dac805af-f8a4-4a1f-8f53-ed7328c54c7a-oauth-serving-cert\") on node \"ip-10-0-140-106.ec2.internal\" DevicePath \"\""
May 21 17:37:37.260683 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:37:37.260443    2563 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dac805af-f8a4-4a1f-8f53-ed7328c54c7a-console-serving-cert\") on node \"ip-10-0-140-106.ec2.internal\" DevicePath \"\""
May 21 17:37:37.785531 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:37:37.785504    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-58f4f797fc-flqs4_dac805af-f8a4-4a1f-8f53-ed7328c54c7a/console/0.log"
May 21 17:37:37.785956 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:37:37.785542    2563 generic.go:358] "Generic (PLEG): container finished" podID="dac805af-f8a4-4a1f-8f53-ed7328c54c7a" containerID="ec09748dfb80e1ae732a66d2c25fc03a3db5f308ed44cc6b0e25cf49ff060860" exitCode=2
May 21 17:37:37.785956 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:37:37.785586    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-58f4f797fc-flqs4" event={"ID":"dac805af-f8a4-4a1f-8f53-ed7328c54c7a","Type":"ContainerDied","Data":"ec09748dfb80e1ae732a66d2c25fc03a3db5f308ed44cc6b0e25cf49ff060860"}
May 21 17:37:37.785956 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:37:37.785610    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-58f4f797fc-flqs4" event={"ID":"dac805af-f8a4-4a1f-8f53-ed7328c54c7a","Type":"ContainerDied","Data":"f81b2e91116483c08cf84eb72c549fdedad54131c6c5ec29a64e9359818cb23c"}
May 21 17:37:37.785956 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:37:37.785609    2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-58f4f797fc-flqs4"
May 21 17:37:37.785956 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:37:37.785624    2563 scope.go:117] "RemoveContainer" containerID="ec09748dfb80e1ae732a66d2c25fc03a3db5f308ed44cc6b0e25cf49ff060860"
May 21 17:37:37.793816 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:37:37.793557    2563 scope.go:117] "RemoveContainer" containerID="ec09748dfb80e1ae732a66d2c25fc03a3db5f308ed44cc6b0e25cf49ff060860"
May 21 17:37:37.793962 ip-10-0-140-106 kubenswrapper[2563]: E0521 17:37:37.793934    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ec09748dfb80e1ae732a66d2c25fc03a3db5f308ed44cc6b0e25cf49ff060860\": container with ID starting with ec09748dfb80e1ae732a66d2c25fc03a3db5f308ed44cc6b0e25cf49ff060860 not found: ID does not exist" containerID="ec09748dfb80e1ae732a66d2c25fc03a3db5f308ed44cc6b0e25cf49ff060860"
May 21 17:37:37.794026 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:37:37.793968    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec09748dfb80e1ae732a66d2c25fc03a3db5f308ed44cc6b0e25cf49ff060860"} err="failed to get container status \"ec09748dfb80e1ae732a66d2c25fc03a3db5f308ed44cc6b0e25cf49ff060860\": rpc error: code = NotFound desc = could not find container \"ec09748dfb80e1ae732a66d2c25fc03a3db5f308ed44cc6b0e25cf49ff060860\": container with ID starting with ec09748dfb80e1ae732a66d2c25fc03a3db5f308ed44cc6b0e25cf49ff060860 not found: ID does not exist"
May 21 17:37:37.807280 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:37:37.807244    2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-58f4f797fc-flqs4"]
May 21 17:37:37.808466 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:37:37.808443    2563 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-58f4f797fc-flqs4"]
May 21 17:37:39.803172 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:37:39.803140    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dac805af-f8a4-4a1f-8f53-ed7328c54c7a" path="/var/lib/kubelet/pods/dac805af-f8a4-4a1f-8f53-ed7328c54c7a/volumes"
May 21 17:37:49.692221 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:37:49.691799    2563 kubelet.go:1628] "Image garbage collection succeeded"
May 21 17:38:23.842469 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:38:23.842433    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-6fbf5f8fbc-rmvpk"]
May 21 17:38:23.844208 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:38:23.842742    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dac805af-f8a4-4a1f-8f53-ed7328c54c7a" containerName="console"
May 21 17:38:23.844208 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:38:23.842753    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="dac805af-f8a4-4a1f-8f53-ed7328c54c7a" containerName="console"
May 21 17:38:23.844208 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:38:23.842814    2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="dac805af-f8a4-4a1f-8f53-ed7328c54c7a" containerName="console"
May 21 17:38:23.844682 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:38:23.844668    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6fbf5f8fbc-rmvpk"
May 21 17:38:23.856026 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:38:23.855998    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6fbf5f8fbc-rmvpk"]
May 21 17:38:23.918954 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:38:23.918925    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8a9e7e46-2383-4eed-bb08-b2bbde3259c3-trusted-ca-bundle\") pod \"console-6fbf5f8fbc-rmvpk\" (UID: \"8a9e7e46-2383-4eed-bb08-b2bbde3259c3\") " pod="openshift-console/console-6fbf5f8fbc-rmvpk"
May 21 17:38:23.919141 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:38:23.918958    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nrphn\" (UniqueName: \"kubernetes.io/projected/8a9e7e46-2383-4eed-bb08-b2bbde3259c3-kube-api-access-nrphn\") pod \"console-6fbf5f8fbc-rmvpk\" (UID: \"8a9e7e46-2383-4eed-bb08-b2bbde3259c3\") " pod="openshift-console/console-6fbf5f8fbc-rmvpk"
May 21 17:38:23.919141 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:38:23.918996    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8a9e7e46-2383-4eed-bb08-b2bbde3259c3-service-ca\") pod \"console-6fbf5f8fbc-rmvpk\" (UID: \"8a9e7e46-2383-4eed-bb08-b2bbde3259c3\") " pod="openshift-console/console-6fbf5f8fbc-rmvpk"
May 21 17:38:23.919141 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:38:23.919022    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8a9e7e46-2383-4eed-bb08-b2bbde3259c3-console-config\") pod \"console-6fbf5f8fbc-rmvpk\" (UID: \"8a9e7e46-2383-4eed-bb08-b2bbde3259c3\") " pod="openshift-console/console-6fbf5f8fbc-rmvpk"
May 21 17:38:23.919141 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:38:23.919087    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8a9e7e46-2383-4eed-bb08-b2bbde3259c3-console-serving-cert\") pod \"console-6fbf5f8fbc-rmvpk\" (UID: \"8a9e7e46-2383-4eed-bb08-b2bbde3259c3\") " pod="openshift-console/console-6fbf5f8fbc-rmvpk"
May 21 17:38:23.919308 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:38:23.919168    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8a9e7e46-2383-4eed-bb08-b2bbde3259c3-console-oauth-config\") pod \"console-6fbf5f8fbc-rmvpk\" (UID: \"8a9e7e46-2383-4eed-bb08-b2bbde3259c3\") " pod="openshift-console/console-6fbf5f8fbc-rmvpk"
May 21 17:38:23.919308 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:38:23.919217    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8a9e7e46-2383-4eed-bb08-b2bbde3259c3-oauth-serving-cert\") pod \"console-6fbf5f8fbc-rmvpk\" (UID: \"8a9e7e46-2383-4eed-bb08-b2bbde3259c3\") " pod="openshift-console/console-6fbf5f8fbc-rmvpk"
May 21 17:38:24.019778 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:38:24.019750    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8a9e7e46-2383-4eed-bb08-b2bbde3259c3-console-serving-cert\") pod \"console-6fbf5f8fbc-rmvpk\" (UID: \"8a9e7e46-2383-4eed-bb08-b2bbde3259c3\") " pod="openshift-console/console-6fbf5f8fbc-rmvpk"
May 21 17:38:24.019902 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:38:24.019793    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8a9e7e46-2383-4eed-bb08-b2bbde3259c3-console-oauth-config\") pod \"console-6fbf5f8fbc-rmvpk\" (UID: \"8a9e7e46-2383-4eed-bb08-b2bbde3259c3\") " pod="openshift-console/console-6fbf5f8fbc-rmvpk"
May 21 17:38:24.019965 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:38:24.019916    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8a9e7e46-2383-4eed-bb08-b2bbde3259c3-oauth-serving-cert\") pod \"console-6fbf5f8fbc-rmvpk\" (UID: \"8a9e7e46-2383-4eed-bb08-b2bbde3259c3\") " pod="openshift-console/console-6fbf5f8fbc-rmvpk"
May 21 17:38:24.020020 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:38:24.019993    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8a9e7e46-2383-4eed-bb08-b2bbde3259c3-trusted-ca-bundle\") pod \"console-6fbf5f8fbc-rmvpk\" (UID: \"8a9e7e46-2383-4eed-bb08-b2bbde3259c3\") " pod="openshift-console/console-6fbf5f8fbc-rmvpk"
May 21 17:38:24.020094 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:38:24.020019    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nrphn\" (UniqueName: \"kubernetes.io/projected/8a9e7e46-2383-4eed-bb08-b2bbde3259c3-kube-api-access-nrphn\") pod \"console-6fbf5f8fbc-rmvpk\" (UID: \"8a9e7e46-2383-4eed-bb08-b2bbde3259c3\") " pod="openshift-console/console-6fbf5f8fbc-rmvpk"
May 21 17:38:24.020094 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:38:24.020083    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8a9e7e46-2383-4eed-bb08-b2bbde3259c3-service-ca\") pod \"console-6fbf5f8fbc-rmvpk\" (UID: \"8a9e7e46-2383-4eed-bb08-b2bbde3259c3\") " pod="openshift-console/console-6fbf5f8fbc-rmvpk"
May 21 17:38:24.020204 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:38:24.020117    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8a9e7e46-2383-4eed-bb08-b2bbde3259c3-console-config\") pod \"console-6fbf5f8fbc-rmvpk\" (UID: \"8a9e7e46-2383-4eed-bb08-b2bbde3259c3\") " pod="openshift-console/console-6fbf5f8fbc-rmvpk"
May 21 17:38:24.020730 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:38:24.020701    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8a9e7e46-2383-4eed-bb08-b2bbde3259c3-oauth-serving-cert\") pod \"console-6fbf5f8fbc-rmvpk\" (UID: \"8a9e7e46-2383-4eed-bb08-b2bbde3259c3\") " pod="openshift-console/console-6fbf5f8fbc-rmvpk"
May 21 17:38:24.020823 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:38:24.020759    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8a9e7e46-2383-4eed-bb08-b2bbde3259c3-service-ca\") pod \"console-6fbf5f8fbc-rmvpk\" (UID: \"8a9e7e46-2383-4eed-bb08-b2bbde3259c3\") " pod="openshift-console/console-6fbf5f8fbc-rmvpk"
May 21 17:38:24.020823 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:38:24.020764    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8a9e7e46-2383-4eed-bb08-b2bbde3259c3-console-config\") pod \"console-6fbf5f8fbc-rmvpk\" (UID: \"8a9e7e46-2383-4eed-bb08-b2bbde3259c3\") " pod="openshift-console/console-6fbf5f8fbc-rmvpk"
May 21 17:38:24.020897 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:38:24.020862    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8a9e7e46-2383-4eed-bb08-b2bbde3259c3-trusted-ca-bundle\") pod \"console-6fbf5f8fbc-rmvpk\" (UID: \"8a9e7e46-2383-4eed-bb08-b2bbde3259c3\") " pod="openshift-console/console-6fbf5f8fbc-rmvpk"
May 21 17:38:24.022265 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:38:24.022245    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8a9e7e46-2383-4eed-bb08-b2bbde3259c3-console-serving-cert\") pod \"console-6fbf5f8fbc-rmvpk\" (UID: \"8a9e7e46-2383-4eed-bb08-b2bbde3259c3\") " pod="openshift-console/console-6fbf5f8fbc-rmvpk"
May 21 17:38:24.022348 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:38:24.022291    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8a9e7e46-2383-4eed-bb08-b2bbde3259c3-console-oauth-config\") pod \"console-6fbf5f8fbc-rmvpk\" (UID: \"8a9e7e46-2383-4eed-bb08-b2bbde3259c3\") " pod="openshift-console/console-6fbf5f8fbc-rmvpk"
May 21 17:38:24.028176 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:38:24.028154    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nrphn\" (UniqueName: \"kubernetes.io/projected/8a9e7e46-2383-4eed-bb08-b2bbde3259c3-kube-api-access-nrphn\") pod \"console-6fbf5f8fbc-rmvpk\" (UID: \"8a9e7e46-2383-4eed-bb08-b2bbde3259c3\") " pod="openshift-console/console-6fbf5f8fbc-rmvpk"
May 21 17:38:24.153769 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:38:24.153707    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6fbf5f8fbc-rmvpk"
May 21 17:38:24.276678 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:38:24.276654    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6fbf5f8fbc-rmvpk"]
May 21 17:38:24.279245 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:38:24.279214    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a9e7e46_2383_4eed_bb08_b2bbde3259c3.slice/crio-a1db71ae61520258734ad231d762503c9cc46c0ba85414b68468ee39324ac06a WatchSource:0}: Error finding container a1db71ae61520258734ad231d762503c9cc46c0ba85414b68468ee39324ac06a: Status 404 returned error can't find the container with id a1db71ae61520258734ad231d762503c9cc46c0ba85414b68468ee39324ac06a
May 21 17:38:24.281422 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:38:24.281408    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 21 17:38:24.916697 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:38:24.916656    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6fbf5f8fbc-rmvpk" event={"ID":"8a9e7e46-2383-4eed-bb08-b2bbde3259c3","Type":"ContainerStarted","Data":"6dfe0c02eef93772dcf4f73b3a42a39ffcd670a458baf728c2c2dd451fcb0f9c"}
May 21 17:38:24.916697 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:38:24.916699    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6fbf5f8fbc-rmvpk" event={"ID":"8a9e7e46-2383-4eed-bb08-b2bbde3259c3","Type":"ContainerStarted","Data":"a1db71ae61520258734ad231d762503c9cc46c0ba85414b68468ee39324ac06a"}
May 21 17:38:24.934031 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:38:24.933980    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-6fbf5f8fbc-rmvpk" podStartSLOduration=1.933967472 podStartE2EDuration="1.933967472s" podCreationTimestamp="2026-05-21 17:38:23 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 17:38:24.93208982 +0000 UTC m=+335.709462322" watchObservedRunningTime="2026-05-21 17:38:24.933967472 +0000 UTC m=+335.711339975"
May 21 17:38:34.154562 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:38:34.154471    2563 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6fbf5f8fbc-rmvpk"
May 21 17:38:34.154562 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:38:34.154515    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6fbf5f8fbc-rmvpk"
May 21 17:38:34.159331 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:38:34.159309    2563 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6fbf5f8fbc-rmvpk"
May 21 17:38:34.948294 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:38:34.948260    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6fbf5f8fbc-rmvpk"
May 21 17:38:34.989092 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:38:34.989044    2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7fb9565f94-m6gz6"]
May 21 17:38:38.489392 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:38:38.489360    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-svpcm"]
May 21 17:38:38.491645 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:38:38.491628    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-svpcm"
May 21 17:38:38.493854 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:38:38.493828    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
May 21 17:38:38.499718 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:38:38.499694    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-svpcm"]
May 21 17:38:38.535129 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:38:38.535103    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7caa70cf-485d-48b5-b027-70b17c9832f6-kubelet-config\") pod \"global-pull-secret-syncer-svpcm\" (UID: \"7caa70cf-485d-48b5-b027-70b17c9832f6\") " pod="kube-system/global-pull-secret-syncer-svpcm"
May 21 17:38:38.535229 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:38:38.535133    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7caa70cf-485d-48b5-b027-70b17c9832f6-dbus\") pod \"global-pull-secret-syncer-svpcm\" (UID: \"7caa70cf-485d-48b5-b027-70b17c9832f6\") " pod="kube-system/global-pull-secret-syncer-svpcm"
May 21 17:38:38.535229 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:38:38.535159    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7caa70cf-485d-48b5-b027-70b17c9832f6-original-pull-secret\") pod \"global-pull-secret-syncer-svpcm\" (UID: \"7caa70cf-485d-48b5-b027-70b17c9832f6\") " pod="kube-system/global-pull-secret-syncer-svpcm"
May 21 17:38:38.636479 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:38:38.636455    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7caa70cf-485d-48b5-b027-70b17c9832f6-kubelet-config\") pod \"global-pull-secret-syncer-svpcm\" (UID: \"7caa70cf-485d-48b5-b027-70b17c9832f6\") " pod="kube-system/global-pull-secret-syncer-svpcm"
May 21 17:38:38.636575 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:38:38.636485    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7caa70cf-485d-48b5-b027-70b17c9832f6-dbus\") pod \"global-pull-secret-syncer-svpcm\" (UID: \"7caa70cf-485d-48b5-b027-70b17c9832f6\") " pod="kube-system/global-pull-secret-syncer-svpcm"
May 21 17:38:38.636575 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:38:38.636512    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7caa70cf-485d-48b5-b027-70b17c9832f6-original-pull-secret\") pod \"global-pull-secret-syncer-svpcm\" (UID: \"7caa70cf-485d-48b5-b027-70b17c9832f6\") " pod="kube-system/global-pull-secret-syncer-svpcm"
May 21 17:38:38.636646 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:38:38.636575    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7caa70cf-485d-48b5-b027-70b17c9832f6-kubelet-config\") pod \"global-pull-secret-syncer-svpcm\" (UID: \"7caa70cf-485d-48b5-b027-70b17c9832f6\") " pod="kube-system/global-pull-secret-syncer-svpcm"
May 21 17:38:38.636646 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:38:38.636637    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7caa70cf-485d-48b5-b027-70b17c9832f6-dbus\") pod \"global-pull-secret-syncer-svpcm\" (UID: \"7caa70cf-485d-48b5-b027-70b17c9832f6\") " pod="kube-system/global-pull-secret-syncer-svpcm"
May 21 17:38:38.638681 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:38:38.638658    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7caa70cf-485d-48b5-b027-70b17c9832f6-original-pull-secret\") pod \"global-pull-secret-syncer-svpcm\" (UID: \"7caa70cf-485d-48b5-b027-70b17c9832f6\") " pod="kube-system/global-pull-secret-syncer-svpcm"
May 21 17:38:38.800813 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:38:38.800750    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-svpcm"
May 21 17:38:38.921644 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:38:38.921619    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-svpcm"]
May 21 17:38:38.924413 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:38:38.924386    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7caa70cf_485d_48b5_b027_70b17c9832f6.slice/crio-f3ac4f6cabaac8c3cc3cb31c3f17d8851df99870fd8065e227bdfee0f8afad06 WatchSource:0}: Error finding container f3ac4f6cabaac8c3cc3cb31c3f17d8851df99870fd8065e227bdfee0f8afad06: Status 404 returned error can't find the container with id f3ac4f6cabaac8c3cc3cb31c3f17d8851df99870fd8065e227bdfee0f8afad06
May 21 17:38:38.958098 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:38:38.958071    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-svpcm" event={"ID":"7caa70cf-485d-48b5-b027-70b17c9832f6","Type":"ContainerStarted","Data":"f3ac4f6cabaac8c3cc3cb31c3f17d8851df99870fd8065e227bdfee0f8afad06"}
May 21 17:38:43.973221 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:38:43.973187    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-svpcm" event={"ID":"7caa70cf-485d-48b5-b027-70b17c9832f6","Type":"ContainerStarted","Data":"116f774dab4013f9b1c4625cf719036b48f85ae142f21896ffcaed5538a927a4"}
May 21 17:38:43.988067 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:38:43.988018    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-svpcm" podStartSLOduration=1.560111204 podStartE2EDuration="5.988003634s" podCreationTimestamp="2026-05-21 17:38:38 +0000 UTC" firstStartedPulling="2026-05-21 17:38:38.926076331 +0000 UTC m=+349.703448813" lastFinishedPulling="2026-05-21 17:38:43.353968758 +0000 UTC m=+354.131341243" observedRunningTime="2026-05-21 17:38:43.986599079 +0000 UTC m=+354.763971586" watchObservedRunningTime="2026-05-21 17:38:43.988003634 +0000 UTC m=+354.765376180"
May 21 17:39:00.009043 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:39:00.009003    2563 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-7fb9565f94-m6gz6" podUID="f26908b6-ca36-4254-ac77-2e11c1ab505c" containerName="console" containerID="cri-o://e0a5b6914f7fb09c109e23780812fdc6f5eaf94f36d7ec4b74c628f0aec8aeea" gracePeriod=15
May 21 17:39:00.255536 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:39:00.255513    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7fb9565f94-m6gz6_f26908b6-ca36-4254-ac77-2e11c1ab505c/console/0.log"
May 21 17:39:00.255647 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:39:00.255570    2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7fb9565f94-m6gz6"
May 21 17:39:00.423960 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:39:00.423914    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f26908b6-ca36-4254-ac77-2e11c1ab505c-console-serving-cert\") pod \"f26908b6-ca36-4254-ac77-2e11c1ab505c\" (UID: \"f26908b6-ca36-4254-ac77-2e11c1ab505c\") "
May 21 17:39:00.424169 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:39:00.423981    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rf44x\" (UniqueName: \"kubernetes.io/projected/f26908b6-ca36-4254-ac77-2e11c1ab505c-kube-api-access-rf44x\") pod \"f26908b6-ca36-4254-ac77-2e11c1ab505c\" (UID: \"f26908b6-ca36-4254-ac77-2e11c1ab505c\") "
May 21 17:39:00.424169 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:39:00.424007    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f26908b6-ca36-4254-ac77-2e11c1ab505c-console-oauth-config\") pod \"f26908b6-ca36-4254-ac77-2e11c1ab505c\" (UID: \"f26908b6-ca36-4254-ac77-2e11c1ab505c\") "
May 21 17:39:00.424169 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:39:00.424049    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f26908b6-ca36-4254-ac77-2e11c1ab505c-oauth-serving-cert\") pod \"f26908b6-ca36-4254-ac77-2e11c1ab505c\" (UID: \"f26908b6-ca36-4254-ac77-2e11c1ab505c\") "
May 21 17:39:00.424337 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:39:00.424200    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f26908b6-ca36-4254-ac77-2e11c1ab505c-console-config\") pod \"f26908b6-ca36-4254-ac77-2e11c1ab505c\" (UID: \"f26908b6-ca36-4254-ac77-2e11c1ab505c\") "
May 21 17:39:00.424337 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:39:00.424266    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f26908b6-ca36-4254-ac77-2e11c1ab505c-trusted-ca-bundle\") pod \"f26908b6-ca36-4254-ac77-2e11c1ab505c\" (UID: \"f26908b6-ca36-4254-ac77-2e11c1ab505c\") "
May 21 17:39:00.424440 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:39:00.424337    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f26908b6-ca36-4254-ac77-2e11c1ab505c-service-ca\") pod \"f26908b6-ca36-4254-ac77-2e11c1ab505c\" (UID: \"f26908b6-ca36-4254-ac77-2e11c1ab505c\") "
May 21 17:39:00.424801 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:39:00.424670    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f26908b6-ca36-4254-ac77-2e11c1ab505c-console-config" (OuterVolumeSpecName: "console-config") pod "f26908b6-ca36-4254-ac77-2e11c1ab505c" (UID: "f26908b6-ca36-4254-ac77-2e11c1ab505c"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 21 17:39:00.424930 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:39:00.424812    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f26908b6-ca36-4254-ac77-2e11c1ab505c-service-ca" (OuterVolumeSpecName: "service-ca") pod "f26908b6-ca36-4254-ac77-2e11c1ab505c" (UID: "f26908b6-ca36-4254-ac77-2e11c1ab505c"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 21 17:39:00.424930 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:39:00.424853    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f26908b6-ca36-4254-ac77-2e11c1ab505c-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "f26908b6-ca36-4254-ac77-2e11c1ab505c" (UID: "f26908b6-ca36-4254-ac77-2e11c1ab505c"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 21 17:39:00.425301 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:39:00.425268    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f26908b6-ca36-4254-ac77-2e11c1ab505c-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "f26908b6-ca36-4254-ac77-2e11c1ab505c" (UID: "f26908b6-ca36-4254-ac77-2e11c1ab505c"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 21 17:39:00.426285 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:39:00.426263    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f26908b6-ca36-4254-ac77-2e11c1ab505c-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "f26908b6-ca36-4254-ac77-2e11c1ab505c" (UID: "f26908b6-ca36-4254-ac77-2e11c1ab505c"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 21 17:39:00.426491 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:39:00.426463    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f26908b6-ca36-4254-ac77-2e11c1ab505c-kube-api-access-rf44x" (OuterVolumeSpecName: "kube-api-access-rf44x") pod "f26908b6-ca36-4254-ac77-2e11c1ab505c" (UID: "f26908b6-ca36-4254-ac77-2e11c1ab505c"). InnerVolumeSpecName "kube-api-access-rf44x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 17:39:00.426583 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:39:00.426512    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f26908b6-ca36-4254-ac77-2e11c1ab505c-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "f26908b6-ca36-4254-ac77-2e11c1ab505c" (UID: "f26908b6-ca36-4254-ac77-2e11c1ab505c"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 21 17:39:00.524924 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:39:00.524896    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rf44x\" (UniqueName: \"kubernetes.io/projected/f26908b6-ca36-4254-ac77-2e11c1ab505c-kube-api-access-rf44x\") on node \"ip-10-0-140-106.ec2.internal\" DevicePath \"\""
May 21 17:39:00.524924 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:39:00.524919    2563 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f26908b6-ca36-4254-ac77-2e11c1ab505c-console-oauth-config\") on node \"ip-10-0-140-106.ec2.internal\" DevicePath \"\""
May 21 17:39:00.524924 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:39:00.524928    2563 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f26908b6-ca36-4254-ac77-2e11c1ab505c-oauth-serving-cert\") on node \"ip-10-0-140-106.ec2.internal\" DevicePath \"\""
May 21 17:39:00.525187 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:39:00.524938    2563 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f26908b6-ca36-4254-ac77-2e11c1ab505c-console-config\") on node \"ip-10-0-140-106.ec2.internal\" DevicePath \"\""
May 21 17:39:00.525187 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:39:00.524947    2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f26908b6-ca36-4254-ac77-2e11c1ab505c-trusted-ca-bundle\") on node \"ip-10-0-140-106.ec2.internal\" DevicePath \"\""
May 21 17:39:00.525187 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:39:00.524956    2563 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f26908b6-ca36-4254-ac77-2e11c1ab505c-service-ca\") on node \"ip-10-0-140-106.ec2.internal\" DevicePath \"\""
May 21 17:39:00.525187 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:39:00.524964    2563 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f26908b6-ca36-4254-ac77-2e11c1ab505c-console-serving-cert\") on node \"ip-10-0-140-106.ec2.internal\" DevicePath \"\""
May 21 17:39:01.024509 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:39:01.024481    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7fb9565f94-m6gz6_f26908b6-ca36-4254-ac77-2e11c1ab505c/console/0.log"
May 21 17:39:01.024914 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:39:01.024523    2563 generic.go:358] "Generic (PLEG): container finished" podID="f26908b6-ca36-4254-ac77-2e11c1ab505c" containerID="e0a5b6914f7fb09c109e23780812fdc6f5eaf94f36d7ec4b74c628f0aec8aeea" exitCode=2
May 21 17:39:01.024914 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:39:01.024599    2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7fb9565f94-m6gz6"
May 21 17:39:01.024914 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:39:01.024614    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7fb9565f94-m6gz6" event={"ID":"f26908b6-ca36-4254-ac77-2e11c1ab505c","Type":"ContainerDied","Data":"e0a5b6914f7fb09c109e23780812fdc6f5eaf94f36d7ec4b74c628f0aec8aeea"}
May 21 17:39:01.024914 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:39:01.024651    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7fb9565f94-m6gz6" event={"ID":"f26908b6-ca36-4254-ac77-2e11c1ab505c","Type":"ContainerDied","Data":"c0ed46ff80665d760b4d89db6b0ccf2bf2959e382b5ab8f0dfb5cf11d4c17287"}
May 21 17:39:01.024914 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:39:01.024666    2563 scope.go:117] "RemoveContainer" containerID="e0a5b6914f7fb09c109e23780812fdc6f5eaf94f36d7ec4b74c628f0aec8aeea"
May 21 17:39:01.033120 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:39:01.033103    2563 scope.go:117] "RemoveContainer" containerID="e0a5b6914f7fb09c109e23780812fdc6f5eaf94f36d7ec4b74c628f0aec8aeea"
May 21 17:39:01.033365 ip-10-0-140-106 kubenswrapper[2563]: E0521 17:39:01.033347    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e0a5b6914f7fb09c109e23780812fdc6f5eaf94f36d7ec4b74c628f0aec8aeea\": container with ID starting with e0a5b6914f7fb09c109e23780812fdc6f5eaf94f36d7ec4b74c628f0aec8aeea not found: ID does not exist" containerID="e0a5b6914f7fb09c109e23780812fdc6f5eaf94f36d7ec4b74c628f0aec8aeea"
May 21 17:39:01.033426 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:39:01.033377    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e0a5b6914f7fb09c109e23780812fdc6f5eaf94f36d7ec4b74c628f0aec8aeea"} err="failed to get container status \"e0a5b6914f7fb09c109e23780812fdc6f5eaf94f36d7ec4b74c628f0aec8aeea\": rpc error: code = NotFound desc = could not find container \"e0a5b6914f7fb09c109e23780812fdc6f5eaf94f36d7ec4b74c628f0aec8aeea\": container with ID starting with e0a5b6914f7fb09c109e23780812fdc6f5eaf94f36d7ec4b74c628f0aec8aeea not found: ID does not exist"
May 21 17:39:01.043839 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:39:01.043806    2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7fb9565f94-m6gz6"]
May 21 17:39:01.046818 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:39:01.046799    2563 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7fb9565f94-m6gz6"]
May 21 17:39:01.804429 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:39:01.804397    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f26908b6-ca36-4254-ac77-2e11c1ab505c" path="/var/lib/kubelet/pods/f26908b6-ca36-4254-ac77-2e11c1ab505c/volumes"
May 21 17:39:14.474398 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:39:14.474363    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-tr4ws"]
May 21 17:39:14.474853 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:39:14.474645    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f26908b6-ca36-4254-ac77-2e11c1ab505c" containerName="console"
May 21 17:39:14.474853 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:39:14.474655    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="f26908b6-ca36-4254-ac77-2e11c1ab505c" containerName="console"
May 21 17:39:14.474853 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:39:14.474720    2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="f26908b6-ca36-4254-ac77-2e11c1ab505c" containerName="console"
May 21 17:39:14.479077 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:39:14.479040    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-tr4ws"
May 21 17:39:14.482437 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:39:14.482418    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-gvp7d\""
May 21 17:39:14.482524 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:39:14.482422    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
May 21 17:39:14.482524 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:39:14.482460    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
May 21 17:39:14.490108 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:39:14.490084    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-tr4ws"]
May 21 17:39:14.534953 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:39:14.534930    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4a306312-f596-45f0-a885-bcbba3dd14c4-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-tr4ws\" (UID: \"4a306312-f596-45f0-a885-bcbba3dd14c4\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-tr4ws"
May 21 17:39:14.535039 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:39:14.535000    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cs9px\" (UniqueName: \"kubernetes.io/projected/4a306312-f596-45f0-a885-bcbba3dd14c4-kube-api-access-cs9px\") pod \"cert-manager-operator-controller-manager-54b9655956-tr4ws\" (UID: \"4a306312-f596-45f0-a885-bcbba3dd14c4\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-tr4ws"
May 21 17:39:14.635467 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:39:14.635445    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cs9px\" (UniqueName: \"kubernetes.io/projected/4a306312-f596-45f0-a885-bcbba3dd14c4-kube-api-access-cs9px\") pod \"cert-manager-operator-controller-manager-54b9655956-tr4ws\" (UID: \"4a306312-f596-45f0-a885-bcbba3dd14c4\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-tr4ws"
May 21 17:39:14.635596 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:39:14.635483    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4a306312-f596-45f0-a885-bcbba3dd14c4-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-tr4ws\" (UID: \"4a306312-f596-45f0-a885-bcbba3dd14c4\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-tr4ws"
May 21 17:39:14.635866 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:39:14.635848    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4a306312-f596-45f0-a885-bcbba3dd14c4-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-tr4ws\" (UID: \"4a306312-f596-45f0-a885-bcbba3dd14c4\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-tr4ws"
May 21 17:39:14.643593 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:39:14.643575    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cs9px\" (UniqueName: \"kubernetes.io/projected/4a306312-f596-45f0-a885-bcbba3dd14c4-kube-api-access-cs9px\") pod \"cert-manager-operator-controller-manager-54b9655956-tr4ws\" (UID: \"4a306312-f596-45f0-a885-bcbba3dd14c4\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-tr4ws"
May 21 17:39:14.788534 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:39:14.788444    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-tr4ws"
May 21 17:39:14.921463 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:39:14.921442    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-tr4ws"]
May 21 17:39:14.923899 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:39:14.923872    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a306312_f596_45f0_a885_bcbba3dd14c4.slice/crio-b45cae90e7de2e1e0628c9a7b26a7da0eb9b685820f45bd109f2efe65bece8d9 WatchSource:0}: Error finding container b45cae90e7de2e1e0628c9a7b26a7da0eb9b685820f45bd109f2efe65bece8d9: Status 404 returned error can't find the container with id b45cae90e7de2e1e0628c9a7b26a7da0eb9b685820f45bd109f2efe65bece8d9
May 21 17:39:15.066704 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:39:15.066628    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-tr4ws" event={"ID":"4a306312-f596-45f0-a885-bcbba3dd14c4","Type":"ContainerStarted","Data":"b45cae90e7de2e1e0628c9a7b26a7da0eb9b685820f45bd109f2efe65bece8d9"}
May 21 17:39:18.085779 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:39:18.085751    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-tr4ws" event={"ID":"4a306312-f596-45f0-a885-bcbba3dd14c4","Type":"ContainerStarted","Data":"f08dce33170effca0de11ce27a042c5dec454b7ca06eaeee398ebc5f017a940c"}
May 21 17:39:18.106750 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:39:18.106233    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-tr4ws" podStartSLOduration=1.041094481 podStartE2EDuration="4.106214684s" podCreationTimestamp="2026-05-21 17:39:14 +0000 UTC" firstStartedPulling="2026-05-21 17:39:14.926391333 +0000 UTC m=+385.703763819" lastFinishedPulling="2026-05-21 17:39:17.991511539 +0000 UTC m=+388.768884022" observedRunningTime="2026-05-21 17:39:18.103765112 +0000 UTC m=+388.881137619" watchObservedRunningTime="2026-05-21 17:39:18.106214684 +0000 UTC m=+388.883587195"
May 21 17:39:21.460874 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:39:21.460840    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-xdznm"]
May 21 17:39:21.464236 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:39:21.464219    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-587ccfb98-xdznm"
May 21 17:39:21.466703 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:39:21.466684    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
May 21 17:39:21.466861 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:39:21.466808    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
May 21 17:39:21.467737 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:39:21.467717    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-b5jzd\""
May 21 17:39:21.472001 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:39:21.471980    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-xdznm"]
May 21 17:39:21.494205 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:39:21.494177    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f2ql7\" (UniqueName: \"kubernetes.io/projected/fbb3012f-f0c8-463c-bb9b-9786e7943404-kube-api-access-f2ql7\") pod \"cert-manager-webhook-587ccfb98-xdznm\" (UID: \"fbb3012f-f0c8-463c-bb9b-9786e7943404\") " pod="cert-manager/cert-manager-webhook-587ccfb98-xdznm"
May 21 17:39:21.494339 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:39:21.494214    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fbb3012f-f0c8-463c-bb9b-9786e7943404-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-xdznm\" (UID: \"fbb3012f-f0c8-463c-bb9b-9786e7943404\") " pod="cert-manager/cert-manager-webhook-587ccfb98-xdznm"
May 21 17:39:21.594684 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:39:21.594644    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-f2ql7\" (UniqueName: \"kubernetes.io/projected/fbb3012f-f0c8-463c-bb9b-9786e7943404-kube-api-access-f2ql7\") pod \"cert-manager-webhook-587ccfb98-xdznm\" (UID: \"fbb3012f-f0c8-463c-bb9b-9786e7943404\") " pod="cert-manager/cert-manager-webhook-587ccfb98-xdznm"
May 21 17:39:21.594845 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:39:21.594691    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fbb3012f-f0c8-463c-bb9b-9786e7943404-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-xdznm\" (UID: \"fbb3012f-f0c8-463c-bb9b-9786e7943404\") " pod="cert-manager/cert-manager-webhook-587ccfb98-xdznm"
May 21 17:39:21.602015 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:39:21.601990    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fbb3012f-f0c8-463c-bb9b-9786e7943404-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-xdznm\" (UID: \"fbb3012f-f0c8-463c-bb9b-9786e7943404\") " pod="cert-manager/cert-manager-webhook-587ccfb98-xdznm"
May 21 17:39:21.602159 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:39:21.602144    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f2ql7\" (UniqueName: \"kubernetes.io/projected/fbb3012f-f0c8-463c-bb9b-9786e7943404-kube-api-access-f2ql7\") pod \"cert-manager-webhook-587ccfb98-xdznm\" (UID: \"fbb3012f-f0c8-463c-bb9b-9786e7943404\") " pod="cert-manager/cert-manager-webhook-587ccfb98-xdznm"
May 21 17:39:21.791231 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:39:21.791145    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-587ccfb98-xdznm"
May 21 17:39:21.915675 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:39:21.915650    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-xdznm"]
May 21 17:39:21.918120 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:39:21.918092    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfbb3012f_f0c8_463c_bb9b_9786e7943404.slice/crio-426956d426c823b4d7b9ee5c2b3203f0c5ff074a139494acb84fe18539103177 WatchSource:0}: Error finding container 426956d426c823b4d7b9ee5c2b3203f0c5ff074a139494acb84fe18539103177: Status 404 returned error can't find the container with id 426956d426c823b4d7b9ee5c2b3203f0c5ff074a139494acb84fe18539103177
May 21 17:39:22.098998 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:39:22.098957    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-587ccfb98-xdznm" event={"ID":"fbb3012f-f0c8-463c-bb9b-9786e7943404","Type":"ContainerStarted","Data":"426956d426c823b4d7b9ee5c2b3203f0c5ff074a139494acb84fe18539103177"}
May 21 17:39:22.354187 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:39:22.354110    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-sd8fp"]
May 21 17:39:22.358768 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:39:22.358748    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-68b757865b-sd8fp"
May 21 17:39:22.361318 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:39:22.361279    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-rcqsr\""
May 21 17:39:22.364141 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:39:22.364116    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-sd8fp"]
May 21 17:39:22.401808 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:39:22.401785    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cebe6efe-84f3-4db4-89c0-02209b56f272-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-sd8fp\" (UID: \"cebe6efe-84f3-4db4-89c0-02209b56f272\") " pod="cert-manager/cert-manager-cainjector-68b757865b-sd8fp"
May 21 17:39:22.401897 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:39:22.401818    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xn9mm\" (UniqueName: \"kubernetes.io/projected/cebe6efe-84f3-4db4-89c0-02209b56f272-kube-api-access-xn9mm\") pod \"cert-manager-cainjector-68b757865b-sd8fp\" (UID: \"cebe6efe-84f3-4db4-89c0-02209b56f272\") " pod="cert-manager/cert-manager-cainjector-68b757865b-sd8fp"
May 21 17:39:22.502274 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:39:22.502244    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cebe6efe-84f3-4db4-89c0-02209b56f272-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-sd8fp\" (UID: \"cebe6efe-84f3-4db4-89c0-02209b56f272\") " pod="cert-manager/cert-manager-cainjector-68b757865b-sd8fp"
May 21 17:39:22.502625 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:39:22.502277    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xn9mm\" (UniqueName: \"kubernetes.io/projected/cebe6efe-84f3-4db4-89c0-02209b56f272-kube-api-access-xn9mm\") pod \"cert-manager-cainjector-68b757865b-sd8fp\" (UID: \"cebe6efe-84f3-4db4-89c0-02209b56f272\") " pod="cert-manager/cert-manager-cainjector-68b757865b-sd8fp"
May 21 17:39:22.509567 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:39:22.509546    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cebe6efe-84f3-4db4-89c0-02209b56f272-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-sd8fp\" (UID: \"cebe6efe-84f3-4db4-89c0-02209b56f272\") " pod="cert-manager/cert-manager-cainjector-68b757865b-sd8fp"
May 21 17:39:22.509682 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:39:22.509661    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xn9mm\" (UniqueName: \"kubernetes.io/projected/cebe6efe-84f3-4db4-89c0-02209b56f272-kube-api-access-xn9mm\") pod \"cert-manager-cainjector-68b757865b-sd8fp\" (UID: \"cebe6efe-84f3-4db4-89c0-02209b56f272\") " pod="cert-manager/cert-manager-cainjector-68b757865b-sd8fp"
May 21 17:39:22.669604 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:39:22.669526    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-68b757865b-sd8fp"
May 21 17:39:22.808865 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:39:22.808806    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-sd8fp"]
May 21 17:39:22.811228 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:39:22.811193    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcebe6efe_84f3_4db4_89c0_02209b56f272.slice/crio-7daf853f4382104c287904e116c70df27c2a3b4c86a05f4f36eb83dae6cae94b WatchSource:0}: Error finding container 7daf853f4382104c287904e116c70df27c2a3b4c86a05f4f36eb83dae6cae94b: Status 404 returned error can't find the container with id 7daf853f4382104c287904e116c70df27c2a3b4c86a05f4f36eb83dae6cae94b
May 21 17:39:23.103231 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:39:23.103194    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-68b757865b-sd8fp" event={"ID":"cebe6efe-84f3-4db4-89c0-02209b56f272","Type":"ContainerStarted","Data":"7daf853f4382104c287904e116c70df27c2a3b4c86a05f4f36eb83dae6cae94b"}
May 21 17:39:25.112102 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:39:25.112043    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-587ccfb98-xdznm" event={"ID":"fbb3012f-f0c8-463c-bb9b-9786e7943404","Type":"ContainerStarted","Data":"806786fb8d5e5d8f09876593e476e3766677ce1b255d694b6fd68ea4727582e6"}
May 21 17:39:25.112525 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:39:25.112119    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-587ccfb98-xdznm"
May 21 17:39:25.113365 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:39:25.113341    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-68b757865b-sd8fp" event={"ID":"cebe6efe-84f3-4db4-89c0-02209b56f272","Type":"ContainerStarted","Data":"1712efcfa5a8bc12276c6f6f1a431ffdd1959f455353dc88ba6ed98699ef06db"}
May 21 17:39:25.127872 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:39:25.127825    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-587ccfb98-xdznm" podStartSLOduration=1.412674603 podStartE2EDuration="4.127812982s" podCreationTimestamp="2026-05-21 17:39:21 +0000 UTC" firstStartedPulling="2026-05-21 17:39:21.920004854 +0000 UTC m=+392.697377337" lastFinishedPulling="2026-05-21 17:39:24.635143221 +0000 UTC m=+395.412515716" observedRunningTime="2026-05-21 17:39:25.125729515 +0000 UTC m=+395.903102020" watchObservedRunningTime="2026-05-21 17:39:25.127812982 +0000 UTC m=+395.905185485"
May 21 17:39:25.139468 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:39:25.139426    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-68b757865b-sd8fp" podStartSLOduration=1.311808917 podStartE2EDuration="3.139413811s" podCreationTimestamp="2026-05-21 17:39:22 +0000 UTC" firstStartedPulling="2026-05-21 17:39:22.813535159 +0000 UTC m=+393.590907647" lastFinishedPulling="2026-05-21 17:39:24.641140059 +0000 UTC m=+395.418512541" observedRunningTime="2026-05-21 17:39:25.137931385 +0000 UTC m=+395.915303890" watchObservedRunningTime="2026-05-21 17:39:25.139413811 +0000 UTC m=+395.916786294"
May 21 17:39:31.119576 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:39:31.119544    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-587ccfb98-xdznm"
May 21 17:39:55.571045 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:39:55.571005    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7c9cddc7dd-gmszx"]
May 21 17:39:55.576077 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:39:55.576032    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7c9cddc7dd-gmszx"
May 21 17:39:55.579702 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:39:55.579677    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
May 21 17:39:55.580038 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:39:55.579698    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
May 21 17:39:55.580196 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:39:55.579768    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
May 21 17:39:55.580196 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:39:55.579770    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-flk4z\""
May 21 17:39:55.580330 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:39:55.580288    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
May 21 17:39:55.592442 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:39:55.592422    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7c9cddc7dd-gmszx"]
May 21 17:39:55.665754 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:39:55.665719    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/df3f6149-6a6e-48a7-9f97-2126e1220bf5-webhook-cert\") pod \"opendatahub-operator-controller-manager-7c9cddc7dd-gmszx\" (UID: \"df3f6149-6a6e-48a7-9f97-2126e1220bf5\") " pod="opendatahub/opendatahub-operator-controller-manager-7c9cddc7dd-gmszx"
May 21 17:39:55.665904 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:39:55.665782    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/df3f6149-6a6e-48a7-9f97-2126e1220bf5-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7c9cddc7dd-gmszx\" (UID: \"df3f6149-6a6e-48a7-9f97-2126e1220bf5\") " pod="opendatahub/opendatahub-operator-controller-manager-7c9cddc7dd-gmszx"
May 21 17:39:55.665904 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:39:55.665823    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lpsvl\" (UniqueName: \"kubernetes.io/projected/df3f6149-6a6e-48a7-9f97-2126e1220bf5-kube-api-access-lpsvl\") pod \"opendatahub-operator-controller-manager-7c9cddc7dd-gmszx\" (UID: \"df3f6149-6a6e-48a7-9f97-2126e1220bf5\") " pod="opendatahub/opendatahub-operator-controller-manager-7c9cddc7dd-gmszx"
May 21 17:39:55.767072 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:39:55.767030    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/df3f6149-6a6e-48a7-9f97-2126e1220bf5-webhook-cert\") pod \"opendatahub-operator-controller-manager-7c9cddc7dd-gmszx\" (UID: \"df3f6149-6a6e-48a7-9f97-2126e1220bf5\") " pod="opendatahub/opendatahub-operator-controller-manager-7c9cddc7dd-gmszx"
May 21 17:39:55.767246 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:39:55.767101    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/df3f6149-6a6e-48a7-9f97-2126e1220bf5-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7c9cddc7dd-gmszx\" (UID: \"df3f6149-6a6e-48a7-9f97-2126e1220bf5\") " pod="opendatahub/opendatahub-operator-controller-manager-7c9cddc7dd-gmszx"
May 21 17:39:55.767246 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:39:55.767129    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lpsvl\" (UniqueName: \"kubernetes.io/projected/df3f6149-6a6e-48a7-9f97-2126e1220bf5-kube-api-access-lpsvl\") pod \"opendatahub-operator-controller-manager-7c9cddc7dd-gmszx\" (UID: \"df3f6149-6a6e-48a7-9f97-2126e1220bf5\") " pod="opendatahub/opendatahub-operator-controller-manager-7c9cddc7dd-gmszx"
May 21 17:39:55.769554 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:39:55.769527    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/df3f6149-6a6e-48a7-9f97-2126e1220bf5-webhook-cert\") pod \"opendatahub-operator-controller-manager-7c9cddc7dd-gmszx\" (UID: \"df3f6149-6a6e-48a7-9f97-2126e1220bf5\") " pod="opendatahub/opendatahub-operator-controller-manager-7c9cddc7dd-gmszx"
May 21 17:39:55.769747 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:39:55.769725    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/df3f6149-6a6e-48a7-9f97-2126e1220bf5-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7c9cddc7dd-gmszx\" (UID: \"df3f6149-6a6e-48a7-9f97-2126e1220bf5\") " pod="opendatahub/opendatahub-operator-controller-manager-7c9cddc7dd-gmszx"
May 21 17:39:55.774392 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:39:55.774373    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lpsvl\" (UniqueName: \"kubernetes.io/projected/df3f6149-6a6e-48a7-9f97-2126e1220bf5-kube-api-access-lpsvl\") pod \"opendatahub-operator-controller-manager-7c9cddc7dd-gmszx\" (UID: \"df3f6149-6a6e-48a7-9f97-2126e1220bf5\") " pod="opendatahub/opendatahub-operator-controller-manager-7c9cddc7dd-gmszx"
May 21 17:39:55.889817 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:39:55.889789    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7c9cddc7dd-gmszx"
May 21 17:39:56.022378 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:39:56.022349    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7c9cddc7dd-gmszx"]
May 21 17:39:56.025829 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:39:56.025805    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf3f6149_6a6e_48a7_9f97_2126e1220bf5.slice/crio-3b99a421b93780e29b1605706e4a811e9af1588c81a85535571d1b9ae78a7d17 WatchSource:0}: Error finding container 3b99a421b93780e29b1605706e4a811e9af1588c81a85535571d1b9ae78a7d17: Status 404 returned error can't find the container with id 3b99a421b93780e29b1605706e4a811e9af1588c81a85535571d1b9ae78a7d17
May 21 17:39:56.219486 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:39:56.219407    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7c9cddc7dd-gmszx" event={"ID":"df3f6149-6a6e-48a7-9f97-2126e1220bf5","Type":"ContainerStarted","Data":"3b99a421b93780e29b1605706e4a811e9af1588c81a85535571d1b9ae78a7d17"}
May 21 17:39:59.230424 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:39:59.230388    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7c9cddc7dd-gmszx" event={"ID":"df3f6149-6a6e-48a7-9f97-2126e1220bf5","Type":"ContainerStarted","Data":"3e9906f07be7129bf4f56fb632f2793a715c24cf306428987ab2cd5968ade101"}
May 21 17:39:59.230770 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:39:59.230545    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7c9cddc7dd-gmszx"
May 21 17:39:59.253251 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:39:59.253193    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7c9cddc7dd-gmszx" podStartSLOduration=1.8599844559999998 podStartE2EDuration="4.253176215s" podCreationTimestamp="2026-05-21 17:39:55 +0000 UTC" firstStartedPulling="2026-05-21 17:39:56.027491144 +0000 UTC m=+426.804863626" lastFinishedPulling="2026-05-21 17:39:58.4206829 +0000 UTC m=+429.198055385" observedRunningTime="2026-05-21 17:39:59.250368822 +0000 UTC m=+430.027741327" watchObservedRunningTime="2026-05-21 17:39:59.253176215 +0000 UTC m=+430.030548721"
May 21 17:40:03.133978 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:40:03.133943    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-7f6d69ccc4-6qjtf"]
May 21 17:40:03.137288 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:40:03.137267    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7f6d69ccc4-6qjtf"
May 21 17:40:03.140738 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:40:03.140712    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
May 21 17:40:03.140738 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:40:03.140727    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
May 21 17:40:03.140926 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:40:03.140767    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-cvdqk\""
May 21 17:40:03.140926 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:40:03.140728    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
May 21 17:40:03.140926 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:40:03.140733    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
May 21 17:40:03.140926 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:40:03.140858    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
May 21 17:40:03.145583 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:40:03.145561    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7f6d69ccc4-6qjtf"]
May 21 17:40:03.232104 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:40:03.232046    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5374e30a-f948-445f-982c-ee319a879cd4-cert\") pod \"lws-controller-manager-7f6d69ccc4-6qjtf\" (UID: \"5374e30a-f948-445f-982c-ee319a879cd4\") " pod="openshift-lws-operator/lws-controller-manager-7f6d69ccc4-6qjtf"
May 21 17:40:03.232266 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:40:03.232135    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/5374e30a-f948-445f-982c-ee319a879cd4-manager-config\") pod \"lws-controller-manager-7f6d69ccc4-6qjtf\" (UID: \"5374e30a-f948-445f-982c-ee319a879cd4\") " pod="openshift-lws-operator/lws-controller-manager-7f6d69ccc4-6qjtf"
May 21 17:40:03.232266 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:40:03.232164    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pgdjb\" (UniqueName: \"kubernetes.io/projected/5374e30a-f948-445f-982c-ee319a879cd4-kube-api-access-pgdjb\") pod \"lws-controller-manager-7f6d69ccc4-6qjtf\" (UID: \"5374e30a-f948-445f-982c-ee319a879cd4\") " pod="openshift-lws-operator/lws-controller-manager-7f6d69ccc4-6qjtf"
May 21 17:40:03.232266 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:40:03.232210    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/5374e30a-f948-445f-982c-ee319a879cd4-metrics-cert\") pod \"lws-controller-manager-7f6d69ccc4-6qjtf\" (UID: \"5374e30a-f948-445f-982c-ee319a879cd4\") " pod="openshift-lws-operator/lws-controller-manager-7f6d69ccc4-6qjtf"
May 21 17:40:03.333188 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:40:03.333157    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/5374e30a-f948-445f-982c-ee319a879cd4-metrics-cert\") pod \"lws-controller-manager-7f6d69ccc4-6qjtf\" (UID: \"5374e30a-f948-445f-982c-ee319a879cd4\") " pod="openshift-lws-operator/lws-controller-manager-7f6d69ccc4-6qjtf"
May 21 17:40:03.333327 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:40:03.333211    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5374e30a-f948-445f-982c-ee319a879cd4-cert\") pod \"lws-controller-manager-7f6d69ccc4-6qjtf\" (UID: \"5374e30a-f948-445f-982c-ee319a879cd4\") " pod="openshift-lws-operator/lws-controller-manager-7f6d69ccc4-6qjtf"
May 21 17:40:03.333327 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:40:03.333257    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/5374e30a-f948-445f-982c-ee319a879cd4-manager-config\") pod \"lws-controller-manager-7f6d69ccc4-6qjtf\" (UID: \"5374e30a-f948-445f-982c-ee319a879cd4\") " pod="openshift-lws-operator/lws-controller-manager-7f6d69ccc4-6qjtf"
May 21 17:40:03.333327 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:40:03.333295    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pgdjb\" (UniqueName: \"kubernetes.io/projected/5374e30a-f948-445f-982c-ee319a879cd4-kube-api-access-pgdjb\") pod \"lws-controller-manager-7f6d69ccc4-6qjtf\" (UID: \"5374e30a-f948-445f-982c-ee319a879cd4\") " pod="openshift-lws-operator/lws-controller-manager-7f6d69ccc4-6qjtf"
May 21 17:40:03.333915 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:40:03.333893    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/5374e30a-f948-445f-982c-ee319a879cd4-manager-config\") pod \"lws-controller-manager-7f6d69ccc4-6qjtf\" (UID: \"5374e30a-f948-445f-982c-ee319a879cd4\") " pod="openshift-lws-operator/lws-controller-manager-7f6d69ccc4-6qjtf"
May 21 17:40:03.335622 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:40:03.335604    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/5374e30a-f948-445f-982c-ee319a879cd4-metrics-cert\") pod \"lws-controller-manager-7f6d69ccc4-6qjtf\" (UID: \"5374e30a-f948-445f-982c-ee319a879cd4\") " pod="openshift-lws-operator/lws-controller-manager-7f6d69ccc4-6qjtf"
May 21 17:40:03.335689 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:40:03.335642    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5374e30a-f948-445f-982c-ee319a879cd4-cert\") pod \"lws-controller-manager-7f6d69ccc4-6qjtf\" (UID: \"5374e30a-f948-445f-982c-ee319a879cd4\") " pod="openshift-lws-operator/lws-controller-manager-7f6d69ccc4-6qjtf"
May 21 17:40:03.341072 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:40:03.341037    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pgdjb\" (UniqueName: \"kubernetes.io/projected/5374e30a-f948-445f-982c-ee319a879cd4-kube-api-access-pgdjb\") pod \"lws-controller-manager-7f6d69ccc4-6qjtf\" (UID: \"5374e30a-f948-445f-982c-ee319a879cd4\") " pod="openshift-lws-operator/lws-controller-manager-7f6d69ccc4-6qjtf"
May 21 17:40:03.446573 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:40:03.446496    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7f6d69ccc4-6qjtf"
May 21 17:40:03.570598 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:40:03.570573    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7f6d69ccc4-6qjtf"]
May 21 17:40:03.573291 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:40:03.573264    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5374e30a_f948_445f_982c_ee319a879cd4.slice/crio-e3f1a32b00c5ec13591a7acd0fe434d646e3c953a8306a8ff64de07cd8f2a9fa WatchSource:0}: Error finding container e3f1a32b00c5ec13591a7acd0fe434d646e3c953a8306a8ff64de07cd8f2a9fa: Status 404 returned error can't find the container with id e3f1a32b00c5ec13591a7acd0fe434d646e3c953a8306a8ff64de07cd8f2a9fa
May 21 17:40:04.247912 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:40:04.247874    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7f6d69ccc4-6qjtf" event={"ID":"5374e30a-f948-445f-982c-ee319a879cd4","Type":"ContainerStarted","Data":"e3f1a32b00c5ec13591a7acd0fe434d646e3c953a8306a8ff64de07cd8f2a9fa"}
May 21 17:40:07.259298 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:40:07.259238    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7f6d69ccc4-6qjtf" event={"ID":"5374e30a-f948-445f-982c-ee319a879cd4","Type":"ContainerStarted","Data":"71df558cf44ef447756998029d3c2665ec38c18c284c67e5668a65c338d87f32"}
May 21 17:40:07.259708 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:40:07.259392    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-7f6d69ccc4-6qjtf"
May 21 17:40:07.275517 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:40:07.275473    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-7f6d69ccc4-6qjtf" podStartSLOduration=0.697973358 podStartE2EDuration="4.27545988s" podCreationTimestamp="2026-05-21 17:40:03 +0000 UTC" firstStartedPulling="2026-05-21 17:40:03.575425856 +0000 UTC m=+434.352798337" lastFinishedPulling="2026-05-21 17:40:07.152912368 +0000 UTC m=+437.930284859" observedRunningTime="2026-05-21 17:40:07.273624593 +0000 UTC m=+438.050997096" watchObservedRunningTime="2026-05-21 17:40:07.27545988 +0000 UTC m=+438.052832384"
May 21 17:40:10.235973 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:40:10.235945    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7c9cddc7dd-gmszx"
May 21 17:40:18.264478 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:40:18.264435    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-7f6d69ccc4-6qjtf"
May 21 17:40:45.253628 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:40:45.253594    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8h2vbp"]
May 21 17:40:45.266593 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:40:45.266484    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8h2vbp"
May 21 17:40:45.268590 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:40:45.268562    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8h2vbp"]
May 21 17:40:45.269142 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:40:45.269123    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
May 21 17:40:45.269287 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:40:45.269266    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-n67gd\""
May 21 17:40:45.391002 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:40:45.390974    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/81133154-cc24-4c8e-b545-9438b809628d-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8h2vbp\" (UID: \"81133154-cc24-4c8e-b545-9438b809628d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8h2vbp"
May 21 17:40:45.391192 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:40:45.391011    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/81133154-cc24-4c8e-b545-9438b809628d-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8h2vbp\" (UID: \"81133154-cc24-4c8e-b545-9438b809628d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8h2vbp"
May 21 17:40:45.391192 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:40:45.391113    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/81133154-cc24-4c8e-b545-9438b809628d-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8h2vbp\" (UID: \"81133154-cc24-4c8e-b545-9438b809628d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8h2vbp"
May 21 17:40:45.391192 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:40:45.391151    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/81133154-cc24-4c8e-b545-9438b809628d-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8h2vbp\" (UID: \"81133154-cc24-4c8e-b545-9438b809628d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8h2vbp"
May 21 17:40:45.391376 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:40:45.391199    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/81133154-cc24-4c8e-b545-9438b809628d-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8h2vbp\" (UID: \"81133154-cc24-4c8e-b545-9438b809628d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8h2vbp"
May 21 17:40:45.391376 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:40:45.391224    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8dthd\" (UniqueName: \"kubernetes.io/projected/81133154-cc24-4c8e-b545-9438b809628d-kube-api-access-8dthd\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8h2vbp\" (UID: \"81133154-cc24-4c8e-b545-9438b809628d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8h2vbp"
May 21 17:40:45.391376 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:40:45.391263    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/81133154-cc24-4c8e-b545-9438b809628d-istio-token\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8h2vbp\" (UID: \"81133154-cc24-4c8e-b545-9438b809628d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8h2vbp"
May 21 17:40:45.391376 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:40:45.391320    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/81133154-cc24-4c8e-b545-9438b809628d-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8h2vbp\" (UID: \"81133154-cc24-4c8e-b545-9438b809628d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8h2vbp"
May 21 17:40:45.391530 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:40:45.391373    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/81133154-cc24-4c8e-b545-9438b809628d-istio-data\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8h2vbp\" (UID: \"81133154-cc24-4c8e-b545-9438b809628d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8h2vbp"
May 21 17:40:45.492680 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:40:45.492652    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/81133154-cc24-4c8e-b545-9438b809628d-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8h2vbp\" (UID: \"81133154-cc24-4c8e-b545-9438b809628d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8h2vbp"
May 21 17:40:45.492826 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:40:45.492687    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/81133154-cc24-4c8e-b545-9438b809628d-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8h2vbp\" (UID: \"81133154-cc24-4c8e-b545-9438b809628d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8h2vbp"
May 21 17:40:45.492826 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:40:45.492721    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/81133154-cc24-4c8e-b545-9438b809628d-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8h2vbp\" (UID: \"81133154-cc24-4c8e-b545-9438b809628d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8h2vbp"
May 21 17:40:45.492826 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:40:45.492739    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8dthd\" (UniqueName: \"kubernetes.io/projected/81133154-cc24-4c8e-b545-9438b809628d-kube-api-access-8dthd\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8h2vbp\" (UID: \"81133154-cc24-4c8e-b545-9438b809628d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8h2vbp"
May 21 17:40:45.492826 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:40:45.492775    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/81133154-cc24-4c8e-b545-9438b809628d-istio-token\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8h2vbp\" (UID: \"81133154-cc24-4c8e-b545-9438b809628d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8h2vbp"
May 21 17:40:45.492826 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:40:45.492793    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/81133154-cc24-4c8e-b545-9438b809628d-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8h2vbp\" (UID: \"81133154-cc24-4c8e-b545-9438b809628d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8h2vbp"
May 21 17:40:45.492826 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:40:45.492823    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/81133154-cc24-4c8e-b545-9438b809628d-istio-data\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8h2vbp\" (UID: \"81133154-cc24-4c8e-b545-9438b809628d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8h2vbp"
May 21 17:40:45.493160 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:40:45.493029    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/81133154-cc24-4c8e-b545-9438b809628d-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8h2vbp\" (UID: \"81133154-cc24-4c8e-b545-9438b809628d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8h2vbp"
May 21 17:40:45.493160 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:40:45.493092    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/81133154-cc24-4c8e-b545-9438b809628d-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8h2vbp\" (UID: \"81133154-cc24-4c8e-b545-9438b809628d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8h2vbp"
May 21 17:40:45.493263 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:40:45.493222    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/81133154-cc24-4c8e-b545-9438b809628d-istio-data\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8h2vbp\" (UID: \"81133154-cc24-4c8e-b545-9438b809628d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8h2vbp"
May 21 17:40:45.493263 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:40:45.493251    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/81133154-cc24-4c8e-b545-9438b809628d-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8h2vbp\" (UID: \"81133154-cc24-4c8e-b545-9438b809628d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8h2vbp"
May 21 17:40:45.493439 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:40:45.493420    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/81133154-cc24-4c8e-b545-9438b809628d-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8h2vbp\" (UID: \"81133154-cc24-4c8e-b545-9438b809628d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8h2vbp"
May 21 17:40:45.493551 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:40:45.493466    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/81133154-cc24-4c8e-b545-9438b809628d-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8h2vbp\" (UID: \"81133154-cc24-4c8e-b545-9438b809628d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8h2vbp"
May 21 17:40:45.494865 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:40:45.493852    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/81133154-cc24-4c8e-b545-9438b809628d-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8h2vbp\" (UID: \"81133154-cc24-4c8e-b545-9438b809628d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8h2vbp"
May 21 17:40:45.495194 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:40:45.495176    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/81133154-cc24-4c8e-b545-9438b809628d-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8h2vbp\" (UID: \"81133154-cc24-4c8e-b545-9438b809628d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8h2vbp"
May 21 17:40:45.495332 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:40:45.495312    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/81133154-cc24-4c8e-b545-9438b809628d-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8h2vbp\" (UID: \"81133154-cc24-4c8e-b545-9438b809628d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8h2vbp"
May 21 17:40:45.505532 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:40:45.505476    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8dthd\" (UniqueName: \"kubernetes.io/projected/81133154-cc24-4c8e-b545-9438b809628d-kube-api-access-8dthd\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8h2vbp\" (UID: \"81133154-cc24-4c8e-b545-9438b809628d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8h2vbp"
May 21 17:40:45.505804 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:40:45.505786    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/81133154-cc24-4c8e-b545-9438b809628d-istio-token\") pod \"data-science-gateway-data-science-gateway-class-595b7776f8h2vbp\" (UID: \"81133154-cc24-4c8e-b545-9438b809628d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8h2vbp"
May 21 17:40:45.579091 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:40:45.579032    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8h2vbp"
May 21 17:40:45.712436 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:40:45.712406    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8h2vbp"]
May 21 17:40:45.715029 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:40:45.715002    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81133154_cc24_4c8e_b545_9438b809628d.slice/crio-8afcd68a3e96dc6ed053d39ddf3fe0e4dde82867b05c77c18ff8423240a34866 WatchSource:0}: Error finding container 8afcd68a3e96dc6ed053d39ddf3fe0e4dde82867b05c77c18ff8423240a34866: Status 404 returned error can't find the container with id 8afcd68a3e96dc6ed053d39ddf3fe0e4dde82867b05c77c18ff8423240a34866
May 21 17:40:46.391437 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:40:46.391402    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8h2vbp" event={"ID":"81133154-cc24-4c8e-b545-9438b809628d","Type":"ContainerStarted","Data":"8afcd68a3e96dc6ed053d39ddf3fe0e4dde82867b05c77c18ff8423240a34866"}
May 21 17:40:48.385822 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:40:48.385784    2563 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
May 21 17:40:48.386139 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:40:48.385859    2563 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
May 21 17:40:48.386139 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:40:48.385889    2563 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
May 21 17:40:49.407122 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:40:49.407089    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8h2vbp" event={"ID":"81133154-cc24-4c8e-b545-9438b809628d","Type":"ContainerStarted","Data":"1496e6ccf1d12ae7f41c50728c03bb95ada986902effb5711837a7c6bd323d65"}
May 21 17:40:49.426738 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:40:49.426693    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8h2vbp" podStartSLOduration=1.757978705 podStartE2EDuration="4.426677193s" podCreationTimestamp="2026-05-21 17:40:45 +0000 UTC" firstStartedPulling="2026-05-21 17:40:45.716844626 +0000 UTC m=+476.494217111" lastFinishedPulling="2026-05-21 17:40:48.385543104 +0000 UTC m=+479.162915599" observedRunningTime="2026-05-21 17:40:49.425678518 +0000 UTC m=+480.203051021" watchObservedRunningTime="2026-05-21 17:40:49.426677193 +0000 UTC m=+480.204049697"
May 21 17:40:49.579483 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:40:49.579448    2563 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8h2vbp"
May 21 17:40:49.583877 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:40:49.583837    2563 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8h2vbp"
May 21 17:40:50.410280 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:40:50.410246    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8h2vbp"
May 21 17:40:50.411266 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:40:50.411243    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-595b7776f8h2vbp"
May 21 17:41:14.152195 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:41:14.152161    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-gtn6f"]
May 21 17:41:14.155640 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:41:14.155619    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-gtn6f"
May 21 17:41:14.157910 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:41:14.157889    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
May 21 17:41:14.159047 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:41:14.159019    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
May 21 17:41:14.159217 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:41:14.159019    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-clx6s\""
May 21 17:41:14.161486 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:41:14.161463    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-gtn6f"]
May 21 17:41:14.229193 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:41:14.229162    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lqtgs\" (UniqueName: \"kubernetes.io/projected/61e10b81-16d0-4145-84fc-77e311023061-kube-api-access-lqtgs\") pod \"kuadrant-operator-catalog-gtn6f\" (UID: \"61e10b81-16d0-4145-84fc-77e311023061\") " pod="kuadrant-system/kuadrant-operator-catalog-gtn6f"
May 21 17:41:14.330540 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:41:14.330502    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lqtgs\" (UniqueName: \"kubernetes.io/projected/61e10b81-16d0-4145-84fc-77e311023061-kube-api-access-lqtgs\") pod \"kuadrant-operator-catalog-gtn6f\" (UID: \"61e10b81-16d0-4145-84fc-77e311023061\") " pod="kuadrant-system/kuadrant-operator-catalog-gtn6f"
May 21 17:41:14.338104 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:41:14.338049    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lqtgs\" (UniqueName: \"kubernetes.io/projected/61e10b81-16d0-4145-84fc-77e311023061-kube-api-access-lqtgs\") pod \"kuadrant-operator-catalog-gtn6f\" (UID: \"61e10b81-16d0-4145-84fc-77e311023061\") " pod="kuadrant-system/kuadrant-operator-catalog-gtn6f"
May 21 17:41:14.467031 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:41:14.466963    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-gtn6f"
May 21 17:41:14.511796 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:41:14.511769    2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-gtn6f"]
May 21 17:41:14.604580 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:41:14.604557    2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-gtn6f"]
May 21 17:41:14.606723 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:41:14.606694    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61e10b81_16d0_4145_84fc_77e311023061.slice/crio-082cd4091cf2627c68930be1ba1bfd4073cde913b9d41c673dc7c9d9480363e6 WatchSource:0}: Error finding container 082cd4091cf2627c68930be1ba1bfd4073cde913b9d41c673dc7c9d9480363e6: Status 404 returned error can't find the container with id 082cd4091cf2627c68930be1ba1bfd4073cde913b9d41c673dc7c9d9480363e6
May 21 17:41:14.718654 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:41:14.718584    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-jmm9w"]
May 21 17:41:14.723002 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:41:14.722987    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-jmm9w"
May 21 17:41:14.727243 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:41:14.727217    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-jmm9w"]
May 21 17:41:14.836287 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:41:14.836267    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l7zz6\" (UniqueName: \"kubernetes.io/projected/a6c2cfa5-3393-4fb2-99b4-f9f1bcf4fe57-kube-api-access-l7zz6\") pod \"kuadrant-operator-catalog-jmm9w\" (UID: \"a6c2cfa5-3393-4fb2-99b4-f9f1bcf4fe57\") " pod="kuadrant-system/kuadrant-operator-catalog-jmm9w"
May 21 17:41:14.937157 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:41:14.937124    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l7zz6\" (UniqueName: \"kubernetes.io/projected/a6c2cfa5-3393-4fb2-99b4-f9f1bcf4fe57-kube-api-access-l7zz6\") pod \"kuadrant-operator-catalog-jmm9w\" (UID: \"a6c2cfa5-3393-4fb2-99b4-f9f1bcf4fe57\") " pod="kuadrant-system/kuadrant-operator-catalog-jmm9w"
May 21 17:41:14.944663 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:41:14.944640    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l7zz6\" (UniqueName: \"kubernetes.io/projected/a6c2cfa5-3393-4fb2-99b4-f9f1bcf4fe57-kube-api-access-l7zz6\") pod \"kuadrant-operator-catalog-jmm9w\" (UID: \"a6c2cfa5-3393-4fb2-99b4-f9f1bcf4fe57\") " pod="kuadrant-system/kuadrant-operator-catalog-jmm9w"
May 21 17:41:15.034434 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:41:15.034354    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-jmm9w"
May 21 17:41:15.167680 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:41:15.167653    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-jmm9w"]
May 21 17:41:15.176081 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:41:15.176028    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6c2cfa5_3393_4fb2_99b4_f9f1bcf4fe57.slice/crio-a65855fbbecc43c4dc34e66f0ba27cbf06447dfa149d83798d1655212aa8abba WatchSource:0}: Error finding container a65855fbbecc43c4dc34e66f0ba27cbf06447dfa149d83798d1655212aa8abba: Status 404 returned error can't find the container with id a65855fbbecc43c4dc34e66f0ba27cbf06447dfa149d83798d1655212aa8abba
May 21 17:41:15.493643 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:41:15.493611    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-jmm9w" event={"ID":"a6c2cfa5-3393-4fb2-99b4-f9f1bcf4fe57","Type":"ContainerStarted","Data":"a65855fbbecc43c4dc34e66f0ba27cbf06447dfa149d83798d1655212aa8abba"}
May 21 17:41:15.494627 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:41:15.494603    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-gtn6f" event={"ID":"61e10b81-16d0-4145-84fc-77e311023061","Type":"ContainerStarted","Data":"082cd4091cf2627c68930be1ba1bfd4073cde913b9d41c673dc7c9d9480363e6"}
May 21 17:41:17.503355 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:41:17.503321    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-jmm9w" event={"ID":"a6c2cfa5-3393-4fb2-99b4-f9f1bcf4fe57","Type":"ContainerStarted","Data":"793d6573208cd9fc12b187ab392afea62876766b2216765c3f79f2d9018bc3db"}
May 21 17:41:17.504701 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:41:17.504663    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-gtn6f" event={"ID":"61e10b81-16d0-4145-84fc-77e311023061","Type":"ContainerStarted","Data":"b13c43865b0899bddf6960629da84d540c38759371033348a9e2dd2bc4fb7f63"}
May 21 17:41:17.504701 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:41:17.504684    2563 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-gtn6f" podUID="61e10b81-16d0-4145-84fc-77e311023061" containerName="registry-server" containerID="cri-o://b13c43865b0899bddf6960629da84d540c38759371033348a9e2dd2bc4fb7f63" gracePeriod=2
May 21 17:41:17.517935 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:41:17.517894    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-jmm9w" podStartSLOduration=1.9715012440000002 podStartE2EDuration="3.517880514s" podCreationTimestamp="2026-05-21 17:41:14 +0000 UTC" firstStartedPulling="2026-05-21 17:41:15.177357995 +0000 UTC m=+505.954730477" lastFinishedPulling="2026-05-21 17:41:16.723737266 +0000 UTC m=+507.501109747" observedRunningTime="2026-05-21 17:41:17.516756584 +0000 UTC m=+508.294129089" watchObservedRunningTime="2026-05-21 17:41:17.517880514 +0000 UTC m=+508.295253017"
May 21 17:41:17.529679 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:41:17.529633    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-gtn6f" podStartSLOduration=1.416637055 podStartE2EDuration="3.529618687s" podCreationTimestamp="2026-05-21 17:41:14 +0000 UTC" firstStartedPulling="2026-05-21 17:41:14.60812391 +0000 UTC m=+505.385496392" lastFinishedPulling="2026-05-21 17:41:16.721105539 +0000 UTC m=+507.498478024" observedRunningTime="2026-05-21 17:41:17.528758375 +0000 UTC m=+508.306130879" watchObservedRunningTime="2026-05-21 17:41:17.529618687 +0000 UTC m=+508.306991191"
May 21 17:41:17.752072 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:41:17.752040    2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-gtn6f"
May 21 17:41:17.865725 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:41:17.865706    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lqtgs\" (UniqueName: \"kubernetes.io/projected/61e10b81-16d0-4145-84fc-77e311023061-kube-api-access-lqtgs\") pod \"61e10b81-16d0-4145-84fc-77e311023061\" (UID: \"61e10b81-16d0-4145-84fc-77e311023061\") "
May 21 17:41:17.867839 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:41:17.867809    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/61e10b81-16d0-4145-84fc-77e311023061-kube-api-access-lqtgs" (OuterVolumeSpecName: "kube-api-access-lqtgs") pod "61e10b81-16d0-4145-84fc-77e311023061" (UID: "61e10b81-16d0-4145-84fc-77e311023061"). InnerVolumeSpecName "kube-api-access-lqtgs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 17:41:17.967316 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:41:17.967280    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lqtgs\" (UniqueName: \"kubernetes.io/projected/61e10b81-16d0-4145-84fc-77e311023061-kube-api-access-lqtgs\") on node \"ip-10-0-140-106.ec2.internal\" DevicePath \"\""
May 21 17:41:18.509388 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:41:18.509356    2563 generic.go:358] "Generic (PLEG): container finished" podID="61e10b81-16d0-4145-84fc-77e311023061" containerID="b13c43865b0899bddf6960629da84d540c38759371033348a9e2dd2bc4fb7f63" exitCode=0
May 21 17:41:18.509838 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:41:18.509408    2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-gtn6f"
May 21 17:41:18.509838 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:41:18.509445    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-gtn6f" event={"ID":"61e10b81-16d0-4145-84fc-77e311023061","Type":"ContainerDied","Data":"b13c43865b0899bddf6960629da84d540c38759371033348a9e2dd2bc4fb7f63"}
May 21 17:41:18.509838 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:41:18.509492    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-gtn6f" event={"ID":"61e10b81-16d0-4145-84fc-77e311023061","Type":"ContainerDied","Data":"082cd4091cf2627c68930be1ba1bfd4073cde913b9d41c673dc7c9d9480363e6"}
May 21 17:41:18.509838 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:41:18.509514    2563 scope.go:117] "RemoveContainer" containerID="b13c43865b0899bddf6960629da84d540c38759371033348a9e2dd2bc4fb7f63"
May 21 17:41:18.517997 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:41:18.517983    2563 scope.go:117] "RemoveContainer" containerID="b13c43865b0899bddf6960629da84d540c38759371033348a9e2dd2bc4fb7f63"
May 21 17:41:18.518273 ip-10-0-140-106 kubenswrapper[2563]: E0521 17:41:18.518251    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b13c43865b0899bddf6960629da84d540c38759371033348a9e2dd2bc4fb7f63\": container with ID starting with b13c43865b0899bddf6960629da84d540c38759371033348a9e2dd2bc4fb7f63 not found: ID does not exist" containerID="b13c43865b0899bddf6960629da84d540c38759371033348a9e2dd2bc4fb7f63"
May 21 17:41:18.518373 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:41:18.518282    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b13c43865b0899bddf6960629da84d540c38759371033348a9e2dd2bc4fb7f63"} err="failed to get container status \"b13c43865b0899bddf6960629da84d540c38759371033348a9e2dd2bc4fb7f63\": rpc error: code = NotFound desc = could not find container \"b13c43865b0899bddf6960629da84d540c38759371033348a9e2dd2bc4fb7f63\": container with ID starting with b13c43865b0899bddf6960629da84d540c38759371033348a9e2dd2bc4fb7f63 not found: ID does not exist"
May 21 17:41:18.528908 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:41:18.528885    2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-gtn6f"]
May 21 17:41:18.532442 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:41:18.532412    2563 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-gtn6f"]
May 21 17:41:19.806641 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:41:19.806607    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="61e10b81-16d0-4145-84fc-77e311023061" path="/var/lib/kubelet/pods/61e10b81-16d0-4145-84fc-77e311023061/volumes"
May 21 17:41:25.035078 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:41:25.035021    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-jmm9w"
May 21 17:41:25.035078 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:41:25.035077    2563 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-jmm9w"
May 21 17:41:25.056881 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:41:25.056858    2563 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-jmm9w"
May 21 17:41:25.554523 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:41:25.554496    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-jmm9w"
May 21 17:41:47.647137 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:41:47.647047    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vght4"]
May 21 17:41:47.647582 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:41:47.647471    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61e10b81-16d0-4145-84fc-77e311023061" containerName="registry-server"
May 21 17:41:47.647582 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:41:47.647486    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="61e10b81-16d0-4145-84fc-77e311023061" containerName="registry-server"
May 21 17:41:47.647582 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:41:47.647544    2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="61e10b81-16d0-4145-84fc-77e311023061" containerName="registry-server"
May 21 17:41:47.650802 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:41:47.650784    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vght4"
May 21 17:41:47.653331 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:41:47.653311    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-s49l4\""
May 21 17:41:47.662388 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:41:47.662365    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vght4"]
May 21 17:41:47.807793 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:41:47.807756    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/54c9eae5-7a9b-4ff4-afa2-a3b735837b8a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-vght4\" (UID: \"54c9eae5-7a9b-4ff4-afa2-a3b735837b8a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vght4"
May 21 17:41:47.807938 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:41:47.807851    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7ljk4\" (UniqueName: \"kubernetes.io/projected/54c9eae5-7a9b-4ff4-afa2-a3b735837b8a-kube-api-access-7ljk4\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-vght4\" (UID: \"54c9eae5-7a9b-4ff4-afa2-a3b735837b8a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vght4"
May 21 17:41:47.908400 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:41:47.908327    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/54c9eae5-7a9b-4ff4-afa2-a3b735837b8a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-vght4\" (UID: \"54c9eae5-7a9b-4ff4-afa2-a3b735837b8a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vght4"
May 21 17:41:47.908400 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:41:47.908382    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7ljk4\" (UniqueName: \"kubernetes.io/projected/54c9eae5-7a9b-4ff4-afa2-a3b735837b8a-kube-api-access-7ljk4\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-vght4\" (UID: \"54c9eae5-7a9b-4ff4-afa2-a3b735837b8a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vght4"
May 21 17:41:47.908689 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:41:47.908667    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/54c9eae5-7a9b-4ff4-afa2-a3b735837b8a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-vght4\" (UID: \"54c9eae5-7a9b-4ff4-afa2-a3b735837b8a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vght4"
May 21 17:41:47.921167 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:41:47.921146    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7ljk4\" (UniqueName: \"kubernetes.io/projected/54c9eae5-7a9b-4ff4-afa2-a3b735837b8a-kube-api-access-7ljk4\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-vght4\" (UID: \"54c9eae5-7a9b-4ff4-afa2-a3b735837b8a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vght4"
May 21 17:41:47.961147 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:41:47.961120    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vght4"
May 21 17:41:48.091808 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:41:48.091781    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vght4"]
May 21 17:41:48.094296 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:41:48.094268    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54c9eae5_7a9b_4ff4_afa2_a3b735837b8a.slice/crio-87dc253a8eaf1ccc03b6620ca39a6bd70833f4c3a599ed62f6d06f8abaae6f3c WatchSource:0}: Error finding container 87dc253a8eaf1ccc03b6620ca39a6bd70833f4c3a599ed62f6d06f8abaae6f3c: Status 404 returned error can't find the container with id 87dc253a8eaf1ccc03b6620ca39a6bd70833f4c3a599ed62f6d06f8abaae6f3c
May 21 17:41:48.612435 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:41:48.612395    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vght4" event={"ID":"54c9eae5-7a9b-4ff4-afa2-a3b735837b8a","Type":"ContainerStarted","Data":"87dc253a8eaf1ccc03b6620ca39a6bd70833f4c3a599ed62f6d06f8abaae6f3c"}
May 21 17:41:53.634842 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:41:53.634752    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vght4" event={"ID":"54c9eae5-7a9b-4ff4-afa2-a3b735837b8a","Type":"ContainerStarted","Data":"37d91b643e8c5b5d2f6a3ce0fde874214ebc29da3c9d3e2eab8b288ac000452e"}
May 21 17:41:53.635235 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:41:53.634868    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vght4"
May 21 17:41:53.657869 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:41:53.657818    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vght4" podStartSLOduration=1.38593864 podStartE2EDuration="6.657803601s" podCreationTimestamp="2026-05-21 17:41:47 +0000 UTC" firstStartedPulling="2026-05-21 17:41:48.096655844 +0000 UTC m=+538.874028326" lastFinishedPulling="2026-05-21 17:41:53.368520805 +0000 UTC m=+544.145893287" observedRunningTime="2026-05-21 17:41:53.656593289 +0000 UTC m=+544.433965797" watchObservedRunningTime="2026-05-21 17:41:53.657803601 +0000 UTC m=+544.435176104"
May 21 17:41:55.197309 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:41:55.197279    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-b2z8l"]
May 21 17:41:55.200797 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:41:55.200776    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-b2z8l"
May 21 17:41:55.203308 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:41:55.203287    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-nmw52\""
May 21 17:41:55.206405 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:41:55.206379    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-b2z8l"]
May 21 17:41:55.271675 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:41:55.271654    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5dvfn\" (UniqueName: \"kubernetes.io/projected/26c06b41-3fb9-4a7c-90ad-96fc81d4d83a-kube-api-access-5dvfn\") pod \"limitador-operator-controller-manager-85c4996f8c-b2z8l\" (UID: \"26c06b41-3fb9-4a7c-90ad-96fc81d4d83a\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-b2z8l"
May 21 17:41:55.372159 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:41:55.372130    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5dvfn\" (UniqueName: \"kubernetes.io/projected/26c06b41-3fb9-4a7c-90ad-96fc81d4d83a-kube-api-access-5dvfn\") pod \"limitador-operator-controller-manager-85c4996f8c-b2z8l\" (UID: \"26c06b41-3fb9-4a7c-90ad-96fc81d4d83a\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-b2z8l"
May 21 17:41:55.380028 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:41:55.380007    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5dvfn\" (UniqueName: \"kubernetes.io/projected/26c06b41-3fb9-4a7c-90ad-96fc81d4d83a-kube-api-access-5dvfn\") pod \"limitador-operator-controller-manager-85c4996f8c-b2z8l\" (UID: \"26c06b41-3fb9-4a7c-90ad-96fc81d4d83a\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-b2z8l"
May 21 17:41:55.512206 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:41:55.512146    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-b2z8l"
May 21 17:41:55.665594 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:41:55.665568    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-b2z8l"]
May 21 17:41:55.668152 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:41:55.668110    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26c06b41_3fb9_4a7c_90ad_96fc81d4d83a.slice/crio-be53e59ca48c70fa7c1cf59316587d0dedc7db54f26c75e0d29bb13ecf1f4ada WatchSource:0}: Error finding container be53e59ca48c70fa7c1cf59316587d0dedc7db54f26c75e0d29bb13ecf1f4ada: Status 404 returned error can't find the container with id be53e59ca48c70fa7c1cf59316587d0dedc7db54f26c75e0d29bb13ecf1f4ada
May 21 17:41:56.653316 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:41:56.653274    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-b2z8l" event={"ID":"26c06b41-3fb9-4a7c-90ad-96fc81d4d83a","Type":"ContainerStarted","Data":"be53e59ca48c70fa7c1cf59316587d0dedc7db54f26c75e0d29bb13ecf1f4ada"}
May 21 17:41:57.664873 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:41:57.664829    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-b2z8l" event={"ID":"26c06b41-3fb9-4a7c-90ad-96fc81d4d83a","Type":"ContainerStarted","Data":"e6609f01cce274c664e619611927f538e05b81f8bdeda32fa59155299beae807"}
May 21 17:41:57.665319 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:41:57.664902    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-b2z8l"
May 21 17:41:57.680484 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:41:57.680385    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-b2z8l" podStartSLOduration=0.932886667 podStartE2EDuration="2.680371681s" podCreationTimestamp="2026-05-21 17:41:55 +0000 UTC" firstStartedPulling="2026-05-21 17:41:55.670327165 +0000 UTC m=+546.447699647" lastFinishedPulling="2026-05-21 17:41:57.417812169 +0000 UTC m=+548.195184661" observedRunningTime="2026-05-21 17:41:57.67890996 +0000 UTC m=+548.456282462" watchObservedRunningTime="2026-05-21 17:41:57.680371681 +0000 UTC m=+548.457744185"
May 21 17:42:00.806749 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:00.806717    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-797474c4f-qrmpj"]
May 21 17:42:00.810015 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:00.809998    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-797474c4f-qrmpj"
May 21 17:42:00.819690 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:00.819667    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/89743e36-47ab-4ab9-a92e-94e7694e80d8-trusted-ca-bundle\") pod \"console-797474c4f-qrmpj\" (UID: \"89743e36-47ab-4ab9-a92e-94e7694e80d8\") " pod="openshift-console/console-797474c4f-qrmpj"
May 21 17:42:00.819795 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:00.819698    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7bcgh\" (UniqueName: \"kubernetes.io/projected/89743e36-47ab-4ab9-a92e-94e7694e80d8-kube-api-access-7bcgh\") pod \"console-797474c4f-qrmpj\" (UID: \"89743e36-47ab-4ab9-a92e-94e7694e80d8\") " pod="openshift-console/console-797474c4f-qrmpj"
May 21 17:42:00.819844 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:00.819802    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/89743e36-47ab-4ab9-a92e-94e7694e80d8-oauth-serving-cert\") pod \"console-797474c4f-qrmpj\" (UID: \"89743e36-47ab-4ab9-a92e-94e7694e80d8\") " pod="openshift-console/console-797474c4f-qrmpj"
May 21 17:42:00.819877 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:00.819849    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/89743e36-47ab-4ab9-a92e-94e7694e80d8-console-serving-cert\") pod \"console-797474c4f-qrmpj\" (UID: \"89743e36-47ab-4ab9-a92e-94e7694e80d8\") " pod="openshift-console/console-797474c4f-qrmpj"
May 21 17:42:00.819919 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:00.819899    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/89743e36-47ab-4ab9-a92e-94e7694e80d8-console-oauth-config\") pod \"console-797474c4f-qrmpj\" (UID: \"89743e36-47ab-4ab9-a92e-94e7694e80d8\") " pod="openshift-console/console-797474c4f-qrmpj"
May 21 17:42:00.819962 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:00.819930    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/89743e36-47ab-4ab9-a92e-94e7694e80d8-console-config\") pod \"console-797474c4f-qrmpj\" (UID: \"89743e36-47ab-4ab9-a92e-94e7694e80d8\") " pod="openshift-console/console-797474c4f-qrmpj"
May 21 17:42:00.820009 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:00.819993    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/89743e36-47ab-4ab9-a92e-94e7694e80d8-service-ca\") pod \"console-797474c4f-qrmpj\" (UID: \"89743e36-47ab-4ab9-a92e-94e7694e80d8\") " pod="openshift-console/console-797474c4f-qrmpj"
May 21 17:42:00.820455 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:00.820436    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-797474c4f-qrmpj"]
May 21 17:42:00.920976 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:00.920946    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/89743e36-47ab-4ab9-a92e-94e7694e80d8-oauth-serving-cert\") pod \"console-797474c4f-qrmpj\" (UID: \"89743e36-47ab-4ab9-a92e-94e7694e80d8\") " pod="openshift-console/console-797474c4f-qrmpj"
May 21 17:42:00.921161 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:00.920989    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/89743e36-47ab-4ab9-a92e-94e7694e80d8-console-serving-cert\") pod \"console-797474c4f-qrmpj\" (UID: \"89743e36-47ab-4ab9-a92e-94e7694e80d8\") " pod="openshift-console/console-797474c4f-qrmpj"
May 21 17:42:00.921161 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:00.921029    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/89743e36-47ab-4ab9-a92e-94e7694e80d8-console-oauth-config\") pod \"console-797474c4f-qrmpj\" (UID: \"89743e36-47ab-4ab9-a92e-94e7694e80d8\") " pod="openshift-console/console-797474c4f-qrmpj"
May 21 17:42:00.921161 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:00.921051    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/89743e36-47ab-4ab9-a92e-94e7694e80d8-console-config\") pod \"console-797474c4f-qrmpj\" (UID: \"89743e36-47ab-4ab9-a92e-94e7694e80d8\") " pod="openshift-console/console-797474c4f-qrmpj"
May 21 17:42:00.921161 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:00.921113    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/89743e36-47ab-4ab9-a92e-94e7694e80d8-service-ca\") pod \"console-797474c4f-qrmpj\" (UID: \"89743e36-47ab-4ab9-a92e-94e7694e80d8\") " pod="openshift-console/console-797474c4f-qrmpj"
May 21 17:42:00.921369 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:00.921173    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/89743e36-47ab-4ab9-a92e-94e7694e80d8-trusted-ca-bundle\") pod \"console-797474c4f-qrmpj\" (UID: \"89743e36-47ab-4ab9-a92e-94e7694e80d8\") " pod="openshift-console/console-797474c4f-qrmpj"
May 21 17:42:00.921369 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:00.921202    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7bcgh\" (UniqueName: \"kubernetes.io/projected/89743e36-47ab-4ab9-a92e-94e7694e80d8-kube-api-access-7bcgh\") pod \"console-797474c4f-qrmpj\" (UID: \"89743e36-47ab-4ab9-a92e-94e7694e80d8\") " pod="openshift-console/console-797474c4f-qrmpj"
May 21 17:42:00.921811 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:00.921785    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/89743e36-47ab-4ab9-a92e-94e7694e80d8-oauth-serving-cert\") pod \"console-797474c4f-qrmpj\" (UID: \"89743e36-47ab-4ab9-a92e-94e7694e80d8\") " pod="openshift-console/console-797474c4f-qrmpj"
May 21 17:42:00.921902 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:00.921811    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/89743e36-47ab-4ab9-a92e-94e7694e80d8-console-config\") pod \"console-797474c4f-qrmpj\" (UID: \"89743e36-47ab-4ab9-a92e-94e7694e80d8\") " pod="openshift-console/console-797474c4f-qrmpj"
May 21 17:42:00.921902 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:00.921887    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/89743e36-47ab-4ab9-a92e-94e7694e80d8-service-ca\") pod \"console-797474c4f-qrmpj\" (UID: \"89743e36-47ab-4ab9-a92e-94e7694e80d8\") " pod="openshift-console/console-797474c4f-qrmpj"
May 21 17:42:00.922175 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:00.922157    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/89743e36-47ab-4ab9-a92e-94e7694e80d8-trusted-ca-bundle\") pod \"console-797474c4f-qrmpj\" (UID: \"89743e36-47ab-4ab9-a92e-94e7694e80d8\") " pod="openshift-console/console-797474c4f-qrmpj"
May 21 17:42:00.923837 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:00.923813    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/89743e36-47ab-4ab9-a92e-94e7694e80d8-console-oauth-config\") pod \"console-797474c4f-qrmpj\" (UID: \"89743e36-47ab-4ab9-a92e-94e7694e80d8\") " pod="openshift-console/console-797474c4f-qrmpj"
May 21 17:42:00.924048 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:00.924027    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/89743e36-47ab-4ab9-a92e-94e7694e80d8-console-serving-cert\") pod \"console-797474c4f-qrmpj\" (UID: \"89743e36-47ab-4ab9-a92e-94e7694e80d8\") " pod="openshift-console/console-797474c4f-qrmpj"
May 21 17:42:00.929587 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:00.929567    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7bcgh\" (UniqueName: \"kubernetes.io/projected/89743e36-47ab-4ab9-a92e-94e7694e80d8-kube-api-access-7bcgh\") pod \"console-797474c4f-qrmpj\" (UID: \"89743e36-47ab-4ab9-a92e-94e7694e80d8\") " pod="openshift-console/console-797474c4f-qrmpj"
May 21 17:42:01.119433 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:01.119410    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-797474c4f-qrmpj"
May 21 17:42:01.246894 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:01.246870    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-797474c4f-qrmpj"]
May 21 17:42:01.249557 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:42:01.249530    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89743e36_47ab_4ab9_a92e_94e7694e80d8.slice/crio-8d59a845616a890ecd08cb0628301ebc3881f3df86ea8849c79b8cf61b854090 WatchSource:0}: Error finding container 8d59a845616a890ecd08cb0628301ebc3881f3df86ea8849c79b8cf61b854090: Status 404 returned error can't find the container with id 8d59a845616a890ecd08cb0628301ebc3881f3df86ea8849c79b8cf61b854090
May 21 17:42:01.685753 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:01.685716    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-797474c4f-qrmpj" event={"ID":"89743e36-47ab-4ab9-a92e-94e7694e80d8","Type":"ContainerStarted","Data":"4fb7eceea30fbaaebbbe3c0a2def8d9e183beed6f5a8e8cfc4e989e64121003a"}
May 21 17:42:01.685753 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:01.685756    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-797474c4f-qrmpj" event={"ID":"89743e36-47ab-4ab9-a92e-94e7694e80d8","Type":"ContainerStarted","Data":"8d59a845616a890ecd08cb0628301ebc3881f3df86ea8849c79b8cf61b854090"}
May 21 17:42:01.711879 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:01.711829    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-797474c4f-qrmpj" podStartSLOduration=1.7118142459999999 podStartE2EDuration="1.711814246s" podCreationTimestamp="2026-05-21 17:42:00 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 17:42:01.709154887 +0000 UTC m=+552.486527392" watchObservedRunningTime="2026-05-21 17:42:01.711814246 +0000 UTC m=+552.489186750"
May 21 17:42:04.640816 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:04.640781    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vght4"
May 21 17:42:06.536240 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:06.536203    2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vght4"]
May 21 17:42:06.536657 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:06.536404    2563 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vght4" podUID="54c9eae5-7a9b-4ff4-afa2-a3b735837b8a" containerName="manager" containerID="cri-o://37d91b643e8c5b5d2f6a3ce0fde874214ebc29da3c9d3e2eab8b288ac000452e" gracePeriod=2
May 21 17:42:06.541655 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:06.541630    2563 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vght4"]
May 21 17:42:06.558828 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:06.558800    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-2pmqz"]
May 21 17:42:06.559397 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:06.559379    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54c9eae5-7a9b-4ff4-afa2-a3b735837b8a" containerName="manager"
May 21 17:42:06.559456 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:06.559402    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="54c9eae5-7a9b-4ff4-afa2-a3b735837b8a" containerName="manager"
May 21 17:42:06.559523 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:06.559497    2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="54c9eae5-7a9b-4ff4-afa2-a3b735837b8a" containerName="manager"
May 21 17:42:06.567322 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:06.567300    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-2pmqz"
May 21 17:42:06.572830 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:06.572806    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-2pmqz"]
May 21 17:42:06.579980 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:06.579959    2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-b2z8l"]
May 21 17:42:06.580265 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:06.580228    2563 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-b2z8l" podUID="26c06b41-3fb9-4a7c-90ad-96fc81d4d83a" containerName="manager" containerID="cri-o://e6609f01cce274c664e619611927f538e05b81f8bdeda32fa59155299beae807" gracePeriod=2
May 21 17:42:06.582144 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:06.582105    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-b2z8l"
May 21 17:42:06.585769 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:06.585745    2563 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-b2z8l"]
May 21 17:42:06.602789 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:06.602351    2563 status_manager.go:895] "Failed to get status for pod" podUID="54c9eae5-7a9b-4ff4-afa2-a3b735837b8a" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vght4" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-vght4\" is forbidden: User \"system:node:ip-10-0-140-106.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-106.ec2.internal' and this object"
May 21 17:42:06.606974 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:06.604634    2563 status_manager.go:895] "Failed to get status for pod" podUID="26c06b41-3fb9-4a7c-90ad-96fc81d4d83a" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-b2z8l" err="pods \"limitador-operator-controller-manager-85c4996f8c-b2z8l\" is forbidden: User \"system:node:ip-10-0-140-106.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-106.ec2.internal' and this object"
May 21 17:42:06.606974 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:06.606712    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-rxhj7"]
May 21 17:42:06.607241 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:06.606964    2563 status_manager.go:895] "Failed to get status for pod" podUID="54c9eae5-7a9b-4ff4-afa2-a3b735837b8a" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vght4" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-vght4\" is forbidden: User \"system:node:ip-10-0-140-106.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-106.ec2.internal' and this object"
May 21 17:42:06.608114 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:06.607523    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26c06b41-3fb9-4a7c-90ad-96fc81d4d83a" containerName="manager"
May 21 17:42:06.608114 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:06.607544    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="26c06b41-3fb9-4a7c-90ad-96fc81d4d83a" containerName="manager"
May 21 17:42:06.608114 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:06.607744    2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="26c06b41-3fb9-4a7c-90ad-96fc81d4d83a" containerName="manager"
May 21 17:42:06.611773 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:06.611751    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-rxhj7"
May 21 17:42:06.613733 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:06.613701    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-rxhj7"]
May 21 17:42:06.614446 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:06.614413    2563 status_manager.go:895] "Failed to get status for pod" podUID="26c06b41-3fb9-4a7c-90ad-96fc81d4d83a" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-b2z8l" err="pods \"limitador-operator-controller-manager-85c4996f8c-b2z8l\" is forbidden: User \"system:node:ip-10-0-140-106.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-106.ec2.internal' and this object"
May 21 17:42:06.637635 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:06.637611    2563 status_manager.go:895] "Failed to get status for pod" podUID="54c9eae5-7a9b-4ff4-afa2-a3b735837b8a" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vght4" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-vght4\" is forbidden: User \"system:node:ip-10-0-140-106.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-106.ec2.internal' and this object"
May 21 17:42:06.677984 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:06.677962    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vhlxp\" (UniqueName: \"kubernetes.io/projected/8468f633-7898-4ed2-9ce9-a6252e166d86-kube-api-access-vhlxp\") pod \"limitador-operator-controller-manager-85c4996f8c-rxhj7\" (UID: \"8468f633-7898-4ed2-9ce9-a6252e166d86\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-rxhj7"
May 21 17:42:06.678125 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:06.678036    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vr8sq\" (UniqueName: \"kubernetes.io/projected/87d896e7-5373-4522-a136-6419cd89171e-kube-api-access-vr8sq\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-2pmqz\" (UID: \"87d896e7-5373-4522-a136-6419cd89171e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-2pmqz"
May 21 17:42:06.678125 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:06.678112    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/87d896e7-5373-4522-a136-6419cd89171e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-2pmqz\" (UID: \"87d896e7-5373-4522-a136-6419cd89171e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-2pmqz"
May 21 17:42:06.706003 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:06.705973    2563 generic.go:358] "Generic (PLEG): container finished" podID="54c9eae5-7a9b-4ff4-afa2-a3b735837b8a" containerID="37d91b643e8c5b5d2f6a3ce0fde874214ebc29da3c9d3e2eab8b288ac000452e" exitCode=0
May 21 17:42:06.707645 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:06.707618    2563 generic.go:358] "Generic (PLEG): container finished" podID="26c06b41-3fb9-4a7c-90ad-96fc81d4d83a" containerID="e6609f01cce274c664e619611927f538e05b81f8bdeda32fa59155299beae807" exitCode=0
May 21 17:42:06.778743 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:06.778708    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vhlxp\" (UniqueName: \"kubernetes.io/projected/8468f633-7898-4ed2-9ce9-a6252e166d86-kube-api-access-vhlxp\") pod \"limitador-operator-controller-manager-85c4996f8c-rxhj7\" (UID: \"8468f633-7898-4ed2-9ce9-a6252e166d86\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-rxhj7"
May 21 17:42:06.778891 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:06.778773    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vr8sq\" (UniqueName: \"kubernetes.io/projected/87d896e7-5373-4522-a136-6419cd89171e-kube-api-access-vr8sq\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-2pmqz\" (UID: \"87d896e7-5373-4522-a136-6419cd89171e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-2pmqz"
May 21 17:42:06.778891 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:06.778810    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/87d896e7-5373-4522-a136-6419cd89171e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-2pmqz\" (UID: \"87d896e7-5373-4522-a136-6419cd89171e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-2pmqz"
May 21 17:42:06.779314 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:06.779281    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/87d896e7-5373-4522-a136-6419cd89171e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-2pmqz\" (UID: \"87d896e7-5373-4522-a136-6419cd89171e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-2pmqz"
May 21 17:42:06.792866 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:06.792800    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vhlxp\" (UniqueName: \"kubernetes.io/projected/8468f633-7898-4ed2-9ce9-a6252e166d86-kube-api-access-vhlxp\") pod \"limitador-operator-controller-manager-85c4996f8c-rxhj7\" (UID: \"8468f633-7898-4ed2-9ce9-a6252e166d86\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-rxhj7"
May 21 17:42:06.792866 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:06.792832    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vr8sq\" (UniqueName: \"kubernetes.io/projected/87d896e7-5373-4522-a136-6419cd89171e-kube-api-access-vr8sq\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-2pmqz\" (UID: \"87d896e7-5373-4522-a136-6419cd89171e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-2pmqz"
May 21 17:42:06.838708 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:06.838684    2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vght4"
May 21 17:42:06.841186 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:06.841160    2563 status_manager.go:895] "Failed to get status for pod" podUID="26c06b41-3fb9-4a7c-90ad-96fc81d4d83a" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-b2z8l" err="pods \"limitador-operator-controller-manager-85c4996f8c-b2z8l\" is forbidden: User \"system:node:ip-10-0-140-106.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-106.ec2.internal' and this object"
May 21 17:42:06.841974 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:06.841957    2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-b2z8l"
May 21 17:42:06.843441 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:06.843420    2563 status_manager.go:895] "Failed to get status for pod" podUID="54c9eae5-7a9b-4ff4-afa2-a3b735837b8a" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vght4" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-vght4\" is forbidden: User \"system:node:ip-10-0-140-106.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-106.ec2.internal' and this object"
May 21 17:42:06.845653 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:06.845632    2563 status_manager.go:895] "Failed to get status for pod" podUID="26c06b41-3fb9-4a7c-90ad-96fc81d4d83a" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-b2z8l" err="pods \"limitador-operator-controller-manager-85c4996f8c-b2z8l\" is forbidden: User \"system:node:ip-10-0-140-106.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-106.ec2.internal' and this object"
May 21 17:42:06.847770 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:06.847747    2563 status_manager.go:895] "Failed to get status for pod" podUID="54c9eae5-7a9b-4ff4-afa2-a3b735837b8a" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vght4" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-vght4\" is forbidden: User \"system:node:ip-10-0-140-106.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-106.ec2.internal' and this object"
May 21 17:42:06.879142 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:06.879120    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/54c9eae5-7a9b-4ff4-afa2-a3b735837b8a-extensions-socket-volume\") pod \"54c9eae5-7a9b-4ff4-afa2-a3b735837b8a\" (UID: \"54c9eae5-7a9b-4ff4-afa2-a3b735837b8a\") "
May 21 17:42:06.879218 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:06.879188    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7ljk4\" (UniqueName: \"kubernetes.io/projected/54c9eae5-7a9b-4ff4-afa2-a3b735837b8a-kube-api-access-7ljk4\") pod \"54c9eae5-7a9b-4ff4-afa2-a3b735837b8a\" (UID: \"54c9eae5-7a9b-4ff4-afa2-a3b735837b8a\") "
May 21 17:42:06.879259 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:06.879245    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5dvfn\" (UniqueName: \"kubernetes.io/projected/26c06b41-3fb9-4a7c-90ad-96fc81d4d83a-kube-api-access-5dvfn\") pod \"26c06b41-3fb9-4a7c-90ad-96fc81d4d83a\" (UID: \"26c06b41-3fb9-4a7c-90ad-96fc81d4d83a\") "
May 21 17:42:06.879675 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:06.879644    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/54c9eae5-7a9b-4ff4-afa2-a3b735837b8a-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "54c9eae5-7a9b-4ff4-afa2-a3b735837b8a" (UID: "54c9eae5-7a9b-4ff4-afa2-a3b735837b8a"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 21 17:42:06.881261 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:06.881239    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/26c06b41-3fb9-4a7c-90ad-96fc81d4d83a-kube-api-access-5dvfn" (OuterVolumeSpecName: "kube-api-access-5dvfn") pod "26c06b41-3fb9-4a7c-90ad-96fc81d4d83a" (UID: "26c06b41-3fb9-4a7c-90ad-96fc81d4d83a"). InnerVolumeSpecName "kube-api-access-5dvfn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 17:42:06.881327 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:06.881261    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/54c9eae5-7a9b-4ff4-afa2-a3b735837b8a-kube-api-access-7ljk4" (OuterVolumeSpecName: "kube-api-access-7ljk4") pod "54c9eae5-7a9b-4ff4-afa2-a3b735837b8a" (UID: "54c9eae5-7a9b-4ff4-afa2-a3b735837b8a"). InnerVolumeSpecName "kube-api-access-7ljk4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 17:42:06.967284 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:06.967252    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-2pmqz"
May 21 17:42:06.971945 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:06.971929    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-rxhj7"
May 21 17:42:06.980855 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:06.980832    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5dvfn\" (UniqueName: \"kubernetes.io/projected/26c06b41-3fb9-4a7c-90ad-96fc81d4d83a-kube-api-access-5dvfn\") on node \"ip-10-0-140-106.ec2.internal\" DevicePath \"\""
May 21 17:42:06.980935 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:06.980857    2563 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/54c9eae5-7a9b-4ff4-afa2-a3b735837b8a-extensions-socket-volume\") on node \"ip-10-0-140-106.ec2.internal\" DevicePath \"\""
May 21 17:42:06.980935 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:06.980868    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7ljk4\" (UniqueName: \"kubernetes.io/projected/54c9eae5-7a9b-4ff4-afa2-a3b735837b8a-kube-api-access-7ljk4\") on node \"ip-10-0-140-106.ec2.internal\" DevicePath \"\""
May 21 17:42:07.113619 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:07.113591    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-2pmqz"]
May 21 17:42:07.115436 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:42:07.115403    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87d896e7_5373_4522_a136_6419cd89171e.slice/crio-c09b51f90460939fef51bbdf76617b6a30e9a96c1f0fec33ca572ad15a72433e WatchSource:0}: Error finding container c09b51f90460939fef51bbdf76617b6a30e9a96c1f0fec33ca572ad15a72433e: Status 404 returned error can't find the container with id c09b51f90460939fef51bbdf76617b6a30e9a96c1f0fec33ca572ad15a72433e
May 21 17:42:07.135980 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:07.135958    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-rxhj7"]
May 21 17:42:07.138295 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:42:07.138271    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8468f633_7898_4ed2_9ce9_a6252e166d86.slice/crio-6b78361c70aab6d0ddfd28b6205027c63b8c5de08b9129ba938ffbf8ed50dbf9 WatchSource:0}: Error finding container 6b78361c70aab6d0ddfd28b6205027c63b8c5de08b9129ba938ffbf8ed50dbf9: Status 404 returned error can't find the container with id 6b78361c70aab6d0ddfd28b6205027c63b8c5de08b9129ba938ffbf8ed50dbf9
May 21 17:42:07.712988 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:07.712953    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-2pmqz" event={"ID":"87d896e7-5373-4522-a136-6419cd89171e","Type":"ContainerStarted","Data":"942d8670f9baba7243c0c2b21a2e259a22db34f7524baf126440adff6fc3a015"}
May 21 17:42:07.712988 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:07.712991    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-2pmqz" event={"ID":"87d896e7-5373-4522-a136-6419cd89171e","Type":"ContainerStarted","Data":"c09b51f90460939fef51bbdf76617b6a30e9a96c1f0fec33ca572ad15a72433e"}
May 21 17:42:07.713499 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:07.713030    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-2pmqz"
May 21 17:42:07.714175 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:07.714158    2563 scope.go:117] "RemoveContainer" containerID="37d91b643e8c5b5d2f6a3ce0fde874214ebc29da3c9d3e2eab8b288ac000452e"
May 21 17:42:07.714276 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:07.714158    2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vght4"
May 21 17:42:07.715560 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:07.715535    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-rxhj7" event={"ID":"8468f633-7898-4ed2-9ce9-a6252e166d86","Type":"ContainerStarted","Data":"21ea8baaffbba46cb4cf52834c0a668891b997c539bed5e765f8488be68256ee"}
May 21 17:42:07.715658 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:07.715564    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-rxhj7" event={"ID":"8468f633-7898-4ed2-9ce9-a6252e166d86","Type":"ContainerStarted","Data":"6b78361c70aab6d0ddfd28b6205027c63b8c5de08b9129ba938ffbf8ed50dbf9"}
May 21 17:42:07.715658 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:07.715645    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-rxhj7"
May 21 17:42:07.716032 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:07.716003    2563 status_manager.go:895] "Failed to get status for pod" podUID="54c9eae5-7a9b-4ff4-afa2-a3b735837b8a" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vght4" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-vght4\" is forbidden: User \"system:node:ip-10-0-140-106.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-106.ec2.internal' and this object"
May 21 17:42:07.716806 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:07.716789    2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-b2z8l"
May 21 17:42:07.723585 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:07.723567    2563 scope.go:117] "RemoveContainer" containerID="e6609f01cce274c664e619611927f538e05b81f8bdeda32fa59155299beae807"
May 21 17:42:07.742432 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:07.742387    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-2pmqz" podStartSLOduration=1.7423751269999999 podStartE2EDuration="1.742375127s" podCreationTimestamp="2026-05-21 17:42:06 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 17:42:07.741087584 +0000 UTC m=+558.518460086" watchObservedRunningTime="2026-05-21 17:42:07.742375127 +0000 UTC m=+558.519747630"
May 21 17:42:07.743157 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:07.743129    2563 status_manager.go:895] "Failed to get status for pod" podUID="26c06b41-3fb9-4a7c-90ad-96fc81d4d83a" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-b2z8l" err="pods \"limitador-operator-controller-manager-85c4996f8c-b2z8l\" is forbidden: User \"system:node:ip-10-0-140-106.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-106.ec2.internal' and this object"
May 21 17:42:07.745078 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:07.745042    2563 status_manager.go:895] "Failed to get status for pod" podUID="54c9eae5-7a9b-4ff4-afa2-a3b735837b8a" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vght4" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-vght4\" is forbidden: User \"system:node:ip-10-0-140-106.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-106.ec2.internal' and this object"
May 21 17:42:07.746918 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:07.746895    2563 status_manager.go:895] "Failed to get status for pod" podUID="26c06b41-3fb9-4a7c-90ad-96fc81d4d83a" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-b2z8l" err="pods \"limitador-operator-controller-manager-85c4996f8c-b2z8l\" is forbidden: User \"system:node:ip-10-0-140-106.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-106.ec2.internal' and this object"
May 21 17:42:07.765238 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:07.765188    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-rxhj7" podStartSLOduration=1.7651776080000001 podStartE2EDuration="1.765177608s" podCreationTimestamp="2026-05-21 17:42:06 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 17:42:07.763867994 +0000 UTC m=+558.541240501" watchObservedRunningTime="2026-05-21 17:42:07.765177608 +0000 UTC m=+558.542550113"
May 21 17:42:07.804662 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:07.804636    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="26c06b41-3fb9-4a7c-90ad-96fc81d4d83a" path="/var/lib/kubelet/pods/26c06b41-3fb9-4a7c-90ad-96fc81d4d83a/volumes"
May 21 17:42:07.804967 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:07.804954    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="54c9eae5-7a9b-4ff4-afa2-a3b735837b8a" path="/var/lib/kubelet/pods/54c9eae5-7a9b-4ff4-afa2-a3b735837b8a/volumes"
May 21 17:42:11.119729 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:11.119699    2563 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-797474c4f-qrmpj"
May 21 17:42:11.119729 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:11.119735    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-797474c4f-qrmpj"
May 21 17:42:11.124480 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:11.124459    2563 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-797474c4f-qrmpj"
May 21 17:42:11.736315 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:11.736280    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-797474c4f-qrmpj"
May 21 17:42:11.782718 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:11.782688    2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6fbf5f8fbc-rmvpk"]
May 21 17:42:18.725131 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:18.725094    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-rxhj7"
May 21 17:42:18.725732 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:18.725448    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-2pmqz"
May 21 17:42:22.061094 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:22.061043    2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-2pmqz"]
May 21 17:42:22.061589 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:22.061283    2563 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-2pmqz" podUID="87d896e7-5373-4522-a136-6419cd89171e" containerName="manager" containerID="cri-o://942d8670f9baba7243c0c2b21a2e259a22db34f7524baf126440adff6fc3a015" gracePeriod=10
May 21 17:42:22.300261 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:22.300237    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-rgp78"]
May 21 17:42:22.304500 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:22.304412    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-rgp78"
May 21 17:42:22.314903 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:22.314849    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-rgp78"]
May 21 17:42:22.318332 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:22.318311    2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-2pmqz"
May 21 17:42:22.415030 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:22.415005    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/87d896e7-5373-4522-a136-6419cd89171e-extensions-socket-volume\") pod \"87d896e7-5373-4522-a136-6419cd89171e\" (UID: \"87d896e7-5373-4522-a136-6419cd89171e\") "
May 21 17:42:22.415170 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:22.415117    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vr8sq\" (UniqueName: \"kubernetes.io/projected/87d896e7-5373-4522-a136-6419cd89171e-kube-api-access-vr8sq\") pod \"87d896e7-5373-4522-a136-6419cd89171e\" (UID: \"87d896e7-5373-4522-a136-6419cd89171e\") "
May 21 17:42:22.415313 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:22.415288    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7qzgr\" (UniqueName: \"kubernetes.io/projected/b486acd6-f6dd-4be2-9df3-d6bb72219d68-kube-api-access-7qzgr\") pod \"kuadrant-operator-controller-manager-55c7f4c975-rgp78\" (UID: \"b486acd6-f6dd-4be2-9df3-d6bb72219d68\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-rgp78"
May 21 17:42:22.415425 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:22.415357    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/87d896e7-5373-4522-a136-6419cd89171e-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "87d896e7-5373-4522-a136-6419cd89171e" (UID: "87d896e7-5373-4522-a136-6419cd89171e"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 21 17:42:22.415425 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:22.415362    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b486acd6-f6dd-4be2-9df3-d6bb72219d68-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-rgp78\" (UID: \"b486acd6-f6dd-4be2-9df3-d6bb72219d68\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-rgp78"
May 21 17:42:22.415506 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:22.415459    2563 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/87d896e7-5373-4522-a136-6419cd89171e-extensions-socket-volume\") on node \"ip-10-0-140-106.ec2.internal\" DevicePath \"\""
May 21 17:42:22.417158 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:22.417137    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/87d896e7-5373-4522-a136-6419cd89171e-kube-api-access-vr8sq" (OuterVolumeSpecName: "kube-api-access-vr8sq") pod "87d896e7-5373-4522-a136-6419cd89171e" (UID: "87d896e7-5373-4522-a136-6419cd89171e"). InnerVolumeSpecName "kube-api-access-vr8sq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 17:42:22.516406 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:22.516373    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7qzgr\" (UniqueName: \"kubernetes.io/projected/b486acd6-f6dd-4be2-9df3-d6bb72219d68-kube-api-access-7qzgr\") pod \"kuadrant-operator-controller-manager-55c7f4c975-rgp78\" (UID: \"b486acd6-f6dd-4be2-9df3-d6bb72219d68\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-rgp78"
May 21 17:42:22.516543 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:22.516427    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b486acd6-f6dd-4be2-9df3-d6bb72219d68-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-rgp78\" (UID: \"b486acd6-f6dd-4be2-9df3-d6bb72219d68\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-rgp78"
May 21 17:42:22.516543 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:22.516491    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vr8sq\" (UniqueName: \"kubernetes.io/projected/87d896e7-5373-4522-a136-6419cd89171e-kube-api-access-vr8sq\") on node \"ip-10-0-140-106.ec2.internal\" DevicePath \"\""
May 21 17:42:22.516800 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:22.516780    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b486acd6-f6dd-4be2-9df3-d6bb72219d68-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-rgp78\" (UID: \"b486acd6-f6dd-4be2-9df3-d6bb72219d68\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-rgp78"
May 21 17:42:22.524903 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:22.524884    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7qzgr\" (UniqueName: \"kubernetes.io/projected/b486acd6-f6dd-4be2-9df3-d6bb72219d68-kube-api-access-7qzgr\") pod \"kuadrant-operator-controller-manager-55c7f4c975-rgp78\" (UID: \"b486acd6-f6dd-4be2-9df3-d6bb72219d68\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-rgp78"
May 21 17:42:22.627870 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:22.627846    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-rgp78"
May 21 17:42:22.753594 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:22.753553    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-rgp78"]
May 21 17:42:22.756374 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:42:22.756345    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb486acd6_f6dd_4be2_9df3_d6bb72219d68.slice/crio-9a4ced62713acaaaf8dc03be5032339709227b70b2795fec36a413ad904cc65f WatchSource:0}: Error finding container 9a4ced62713acaaaf8dc03be5032339709227b70b2795fec36a413ad904cc65f: Status 404 returned error can't find the container with id 9a4ced62713acaaaf8dc03be5032339709227b70b2795fec36a413ad904cc65f
May 21 17:42:22.772977 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:22.772953    2563 generic.go:358] "Generic (PLEG): container finished" podID="87d896e7-5373-4522-a136-6419cd89171e" containerID="942d8670f9baba7243c0c2b21a2e259a22db34f7524baf126440adff6fc3a015" exitCode=0
May 21 17:42:22.773101 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:22.773031    2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-2pmqz"
May 21 17:42:22.773101 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:22.773039    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-2pmqz" event={"ID":"87d896e7-5373-4522-a136-6419cd89171e","Type":"ContainerDied","Data":"942d8670f9baba7243c0c2b21a2e259a22db34f7524baf126440adff6fc3a015"}
May 21 17:42:22.773101 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:22.773100    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-2pmqz" event={"ID":"87d896e7-5373-4522-a136-6419cd89171e","Type":"ContainerDied","Data":"c09b51f90460939fef51bbdf76617b6a30e9a96c1f0fec33ca572ad15a72433e"}
May 21 17:42:22.773251 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:22.773120    2563 scope.go:117] "RemoveContainer" containerID="942d8670f9baba7243c0c2b21a2e259a22db34f7524baf126440adff6fc3a015"
May 21 17:42:22.774398 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:22.774374    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-rgp78" event={"ID":"b486acd6-f6dd-4be2-9df3-d6bb72219d68","Type":"ContainerStarted","Data":"9a4ced62713acaaaf8dc03be5032339709227b70b2795fec36a413ad904cc65f"}
May 21 17:42:22.783882 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:22.783860    2563 scope.go:117] "RemoveContainer" containerID="942d8670f9baba7243c0c2b21a2e259a22db34f7524baf126440adff6fc3a015"
May 21 17:42:22.784152 ip-10-0-140-106 kubenswrapper[2563]: E0521 17:42:22.784128    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"942d8670f9baba7243c0c2b21a2e259a22db34f7524baf126440adff6fc3a015\": container with ID starting with 942d8670f9baba7243c0c2b21a2e259a22db34f7524baf126440adff6fc3a015 not found: ID does not exist" containerID="942d8670f9baba7243c0c2b21a2e259a22db34f7524baf126440adff6fc3a015"
May 21 17:42:22.784230 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:22.784163    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"942d8670f9baba7243c0c2b21a2e259a22db34f7524baf126440adff6fc3a015"} err="failed to get container status \"942d8670f9baba7243c0c2b21a2e259a22db34f7524baf126440adff6fc3a015\": rpc error: code = NotFound desc = could not find container \"942d8670f9baba7243c0c2b21a2e259a22db34f7524baf126440adff6fc3a015\": container with ID starting with 942d8670f9baba7243c0c2b21a2e259a22db34f7524baf126440adff6fc3a015 not found: ID does not exist"
May 21 17:42:22.804469 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:22.804438    2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-2pmqz"]
May 21 17:42:22.807604 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:22.807583    2563 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-2pmqz"]
May 21 17:42:23.779103 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:23.779043    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-rgp78" event={"ID":"b486acd6-f6dd-4be2-9df3-d6bb72219d68","Type":"ContainerStarted","Data":"9177b0a4f69ee412bb6ec92408007c568e23016b491e8878f7429c6fb713956a"}
May 21 17:42:23.779513 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:23.779113    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-rgp78"
May 21 17:42:23.800912 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:23.800867    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-rgp78" podStartSLOduration=1.800854495 podStartE2EDuration="1.800854495s" podCreationTimestamp="2026-05-21 17:42:22 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 17:42:23.798423693 +0000 UTC m=+574.575796202" watchObservedRunningTime="2026-05-21 17:42:23.800854495 +0000 UTC m=+574.578226999"
May 21 17:42:23.804157 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:23.804136    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="87d896e7-5373-4522-a136-6419cd89171e" path="/var/lib/kubelet/pods/87d896e7-5373-4522-a136-6419cd89171e/volumes"
May 21 17:42:34.785592 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:34.785559    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-rgp78"
May 21 17:42:36.807407 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:36.807371    2563 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-6fbf5f8fbc-rmvpk" podUID="8a9e7e46-2383-4eed-bb08-b2bbde3259c3" containerName="console" containerID="cri-o://6dfe0c02eef93772dcf4f73b3a42a39ffcd670a458baf728c2c2dd451fcb0f9c" gracePeriod=15
May 21 17:42:37.057038 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:37.057012    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6fbf5f8fbc-rmvpk_8a9e7e46-2383-4eed-bb08-b2bbde3259c3/console/0.log"
May 21 17:42:37.057164 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:37.057102    2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6fbf5f8fbc-rmvpk"
May 21 17:42:37.145093 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:37.145047    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8a9e7e46-2383-4eed-bb08-b2bbde3259c3-console-oauth-config\") pod \"8a9e7e46-2383-4eed-bb08-b2bbde3259c3\" (UID: \"8a9e7e46-2383-4eed-bb08-b2bbde3259c3\") "
May 21 17:42:37.145093 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:37.145099    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8a9e7e46-2383-4eed-bb08-b2bbde3259c3-trusted-ca-bundle\") pod \"8a9e7e46-2383-4eed-bb08-b2bbde3259c3\" (UID: \"8a9e7e46-2383-4eed-bb08-b2bbde3259c3\") "
May 21 17:42:37.145288 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:37.145121    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8a9e7e46-2383-4eed-bb08-b2bbde3259c3-console-serving-cert\") pod \"8a9e7e46-2383-4eed-bb08-b2bbde3259c3\" (UID: \"8a9e7e46-2383-4eed-bb08-b2bbde3259c3\") "
May 21 17:42:37.145288 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:37.145168    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8a9e7e46-2383-4eed-bb08-b2bbde3259c3-oauth-serving-cert\") pod \"8a9e7e46-2383-4eed-bb08-b2bbde3259c3\" (UID: \"8a9e7e46-2383-4eed-bb08-b2bbde3259c3\") "
May 21 17:42:37.145288 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:37.145214    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nrphn\" (UniqueName: \"kubernetes.io/projected/8a9e7e46-2383-4eed-bb08-b2bbde3259c3-kube-api-access-nrphn\") pod \"8a9e7e46-2383-4eed-bb08-b2bbde3259c3\" (UID: \"8a9e7e46-2383-4eed-bb08-b2bbde3259c3\") "
May 21 17:42:37.145288 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:37.145261    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8a9e7e46-2383-4eed-bb08-b2bbde3259c3-console-config\") pod \"8a9e7e46-2383-4eed-bb08-b2bbde3259c3\" (UID: \"8a9e7e46-2383-4eed-bb08-b2bbde3259c3\") "
May 21 17:42:37.145486 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:37.145294    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8a9e7e46-2383-4eed-bb08-b2bbde3259c3-service-ca\") pod \"8a9e7e46-2383-4eed-bb08-b2bbde3259c3\" (UID: \"8a9e7e46-2383-4eed-bb08-b2bbde3259c3\") "
May 21 17:42:37.145672 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:37.145627    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8a9e7e46-2383-4eed-bb08-b2bbde3259c3-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "8a9e7e46-2383-4eed-bb08-b2bbde3259c3" (UID: "8a9e7e46-2383-4eed-bb08-b2bbde3259c3"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 21 17:42:37.145780 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:37.145695    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8a9e7e46-2383-4eed-bb08-b2bbde3259c3-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "8a9e7e46-2383-4eed-bb08-b2bbde3259c3" (UID: "8a9e7e46-2383-4eed-bb08-b2bbde3259c3"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 21 17:42:37.145780 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:37.145701    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8a9e7e46-2383-4eed-bb08-b2bbde3259c3-console-config" (OuterVolumeSpecName: "console-config") pod "8a9e7e46-2383-4eed-bb08-b2bbde3259c3" (UID: "8a9e7e46-2383-4eed-bb08-b2bbde3259c3"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 21 17:42:37.145911 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:37.145891    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8a9e7e46-2383-4eed-bb08-b2bbde3259c3-service-ca" (OuterVolumeSpecName: "service-ca") pod "8a9e7e46-2383-4eed-bb08-b2bbde3259c3" (UID: "8a9e7e46-2383-4eed-bb08-b2bbde3259c3"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 21 17:42:37.147464 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:37.147437    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8a9e7e46-2383-4eed-bb08-b2bbde3259c3-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "8a9e7e46-2383-4eed-bb08-b2bbde3259c3" (UID: "8a9e7e46-2383-4eed-bb08-b2bbde3259c3"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 21 17:42:37.147942 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:37.147920    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8a9e7e46-2383-4eed-bb08-b2bbde3259c3-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "8a9e7e46-2383-4eed-bb08-b2bbde3259c3" (UID: "8a9e7e46-2383-4eed-bb08-b2bbde3259c3"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 21 17:42:37.148007 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:37.147956    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a9e7e46-2383-4eed-bb08-b2bbde3259c3-kube-api-access-nrphn" (OuterVolumeSpecName: "kube-api-access-nrphn") pod "8a9e7e46-2383-4eed-bb08-b2bbde3259c3" (UID: "8a9e7e46-2383-4eed-bb08-b2bbde3259c3"). InnerVolumeSpecName "kube-api-access-nrphn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 17:42:37.246591 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:37.246566    2563 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8a9e7e46-2383-4eed-bb08-b2bbde3259c3-oauth-serving-cert\") on node \"ip-10-0-140-106.ec2.internal\" DevicePath \"\""
May 21 17:42:37.246591 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:37.246590    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nrphn\" (UniqueName: \"kubernetes.io/projected/8a9e7e46-2383-4eed-bb08-b2bbde3259c3-kube-api-access-nrphn\") on node \"ip-10-0-140-106.ec2.internal\" DevicePath \"\""
May 21 17:42:37.246735 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:37.246601    2563 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8a9e7e46-2383-4eed-bb08-b2bbde3259c3-console-config\") on node \"ip-10-0-140-106.ec2.internal\" DevicePath \"\""
May 21 17:42:37.246735 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:37.246610    2563 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8a9e7e46-2383-4eed-bb08-b2bbde3259c3-service-ca\") on node \"ip-10-0-140-106.ec2.internal\" DevicePath \"\""
May 21 17:42:37.246735 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:37.246618    2563 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8a9e7e46-2383-4eed-bb08-b2bbde3259c3-console-oauth-config\") on node \"ip-10-0-140-106.ec2.internal\" DevicePath \"\""
May 21 17:42:37.246735 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:37.246627    2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8a9e7e46-2383-4eed-bb08-b2bbde3259c3-trusted-ca-bundle\") on node \"ip-10-0-140-106.ec2.internal\" DevicePath \"\""
May 21 17:42:37.246735 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:37.246641    2563 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8a9e7e46-2383-4eed-bb08-b2bbde3259c3-console-serving-cert\") on node \"ip-10-0-140-106.ec2.internal\" DevicePath \"\""
May 21 17:42:37.826828 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:37.826798    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6fbf5f8fbc-rmvpk_8a9e7e46-2383-4eed-bb08-b2bbde3259c3/console/0.log"
May 21 17:42:37.827183 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:37.826836    2563 generic.go:358] "Generic (PLEG): container finished" podID="8a9e7e46-2383-4eed-bb08-b2bbde3259c3" containerID="6dfe0c02eef93772dcf4f73b3a42a39ffcd670a458baf728c2c2dd451fcb0f9c" exitCode=2
May 21 17:42:37.827183 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:37.826896    2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6fbf5f8fbc-rmvpk"
May 21 17:42:37.827183 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:37.826903    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6fbf5f8fbc-rmvpk" event={"ID":"8a9e7e46-2383-4eed-bb08-b2bbde3259c3","Type":"ContainerDied","Data":"6dfe0c02eef93772dcf4f73b3a42a39ffcd670a458baf728c2c2dd451fcb0f9c"}
May 21 17:42:37.827183 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:37.826992    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6fbf5f8fbc-rmvpk" event={"ID":"8a9e7e46-2383-4eed-bb08-b2bbde3259c3","Type":"ContainerDied","Data":"a1db71ae61520258734ad231d762503c9cc46c0ba85414b68468ee39324ac06a"}
May 21 17:42:37.827183 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:37.827013    2563 scope.go:117] "RemoveContainer" containerID="6dfe0c02eef93772dcf4f73b3a42a39ffcd670a458baf728c2c2dd451fcb0f9c"
May 21 17:42:37.841850 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:37.841816    2563 scope.go:117] "RemoveContainer" containerID="6dfe0c02eef93772dcf4f73b3a42a39ffcd670a458baf728c2c2dd451fcb0f9c"
May 21 17:42:37.842165 ip-10-0-140-106 kubenswrapper[2563]: E0521 17:42:37.842139    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6dfe0c02eef93772dcf4f73b3a42a39ffcd670a458baf728c2c2dd451fcb0f9c\": container with ID starting with 6dfe0c02eef93772dcf4f73b3a42a39ffcd670a458baf728c2c2dd451fcb0f9c not found: ID does not exist" containerID="6dfe0c02eef93772dcf4f73b3a42a39ffcd670a458baf728c2c2dd451fcb0f9c"
May 21 17:42:37.842250 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:37.842175    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6dfe0c02eef93772dcf4f73b3a42a39ffcd670a458baf728c2c2dd451fcb0f9c"} err="failed to get container status \"6dfe0c02eef93772dcf4f73b3a42a39ffcd670a458baf728c2c2dd451fcb0f9c\": rpc error: code = NotFound desc = could not find container \"6dfe0c02eef93772dcf4f73b3a42a39ffcd670a458baf728c2c2dd451fcb0f9c\": container with ID starting with 6dfe0c02eef93772dcf4f73b3a42a39ffcd670a458baf728c2c2dd451fcb0f9c not found: ID does not exist"
May 21 17:42:37.844919 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:37.844897    2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6fbf5f8fbc-rmvpk"]
May 21 17:42:37.853486 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:37.853463    2563 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6fbf5f8fbc-rmvpk"]
May 21 17:42:39.804727 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:39.804691    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8a9e7e46-2383-4eed-bb08-b2bbde3259c3" path="/var/lib/kubelet/pods/8a9e7e46-2383-4eed-bb08-b2bbde3259c3/volumes"
May 21 17:42:58.060804 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:58.060715    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-7sh4z"]
May 21 17:42:58.061271 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:58.061066    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87d896e7-5373-4522-a136-6419cd89171e" containerName="manager"
May 21 17:42:58.061271 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:58.061078    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="87d896e7-5373-4522-a136-6419cd89171e" containerName="manager"
May 21 17:42:58.061271 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:58.061095    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a9e7e46-2383-4eed-bb08-b2bbde3259c3" containerName="console"
May 21 17:42:58.061271 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:58.061100    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a9e7e46-2383-4eed-bb08-b2bbde3259c3" containerName="console"
May 21 17:42:58.061271 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:58.061153    2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="8a9e7e46-2383-4eed-bb08-b2bbde3259c3" containerName="console"
May 21 17:42:58.061271 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:58.061167    2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="87d896e7-5373-4522-a136-6419cd89171e" containerName="manager"
May 21 17:42:58.064327 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:58.064283    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-7sh4z"
May 21 17:42:58.067042 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:58.067019    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-qmstj\""
May 21 17:42:58.068381 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:58.068358    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-7sh4z"]
May 21 17:42:58.111766 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:58.111743    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ctx9j\" (UniqueName: \"kubernetes.io/projected/75f1f5cb-cc23-4410-9c79-598f7ed8d0d1-kube-api-access-ctx9j\") pod \"authorino-f99f4b5cd-7sh4z\" (UID: \"75f1f5cb-cc23-4410-9c79-598f7ed8d0d1\") " pod="kuadrant-system/authorino-f99f4b5cd-7sh4z"
May 21 17:42:58.213173 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:58.213152    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ctx9j\" (UniqueName: \"kubernetes.io/projected/75f1f5cb-cc23-4410-9c79-598f7ed8d0d1-kube-api-access-ctx9j\") pod \"authorino-f99f4b5cd-7sh4z\" (UID: \"75f1f5cb-cc23-4410-9c79-598f7ed8d0d1\") " pod="kuadrant-system/authorino-f99f4b5cd-7sh4z"
May 21 17:42:58.223885 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:58.223860    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ctx9j\" (UniqueName: \"kubernetes.io/projected/75f1f5cb-cc23-4410-9c79-598f7ed8d0d1-kube-api-access-ctx9j\") pod \"authorino-f99f4b5cd-7sh4z\" (UID: \"75f1f5cb-cc23-4410-9c79-598f7ed8d0d1\") " pod="kuadrant-system/authorino-f99f4b5cd-7sh4z"
May 21 17:42:58.374716 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:58.374688    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-7sh4z"
May 21 17:42:58.397299 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:58.397271    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7498df8756-hdjjt"]
May 21 17:42:58.401811 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:58.401793    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-hdjjt"
May 21 17:42:58.412297 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:58.412271    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7498df8756-hdjjt"]
May 21 17:42:58.500577 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:58.500436    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-7sh4z"]
May 21 17:42:58.503521 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:42:58.503493    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod75f1f5cb_cc23_4410_9c79_598f7ed8d0d1.slice/crio-4d2c45c7a148fbe59d55fe79871b474665cc6a23d92059c8e5bef496348078ee WatchSource:0}: Error finding container 4d2c45c7a148fbe59d55fe79871b474665cc6a23d92059c8e5bef496348078ee: Status 404 returned error can't find the container with id 4d2c45c7a148fbe59d55fe79871b474665cc6a23d92059c8e5bef496348078ee
May 21 17:42:58.514650 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:58.514628    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j7j6n\" (UniqueName: \"kubernetes.io/projected/b52f1b16-5083-4e2a-af4d-39c2158677aa-kube-api-access-j7j6n\") pod \"authorino-7498df8756-hdjjt\" (UID: \"b52f1b16-5083-4e2a-af4d-39c2158677aa\") " pod="kuadrant-system/authorino-7498df8756-hdjjt"
May 21 17:42:58.615343 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:58.615316    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-j7j6n\" (UniqueName: \"kubernetes.io/projected/b52f1b16-5083-4e2a-af4d-39c2158677aa-kube-api-access-j7j6n\") pod \"authorino-7498df8756-hdjjt\" (UID: \"b52f1b16-5083-4e2a-af4d-39c2158677aa\") " pod="kuadrant-system/authorino-7498df8756-hdjjt"
May 21 17:42:58.622617 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:58.622595    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j7j6n\" (UniqueName: \"kubernetes.io/projected/b52f1b16-5083-4e2a-af4d-39c2158677aa-kube-api-access-j7j6n\") pod \"authorino-7498df8756-hdjjt\" (UID: \"b52f1b16-5083-4e2a-af4d-39c2158677aa\") " pod="kuadrant-system/authorino-7498df8756-hdjjt"
May 21 17:42:58.711580 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:58.711523    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-hdjjt"
May 21 17:42:58.835110 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:58.835085    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7498df8756-hdjjt"]
May 21 17:42:58.837541 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:42:58.837515    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb52f1b16_5083_4e2a_af4d_39c2158677aa.slice/crio-595b7c9816a8316b15c9cafd087cf5ec27290531d10e8bf45e76f2f0a8c27a0d WatchSource:0}: Error finding container 595b7c9816a8316b15c9cafd087cf5ec27290531d10e8bf45e76f2f0a8c27a0d: Status 404 returned error can't find the container with id 595b7c9816a8316b15c9cafd087cf5ec27290531d10e8bf45e76f2f0a8c27a0d
May 21 17:42:58.898698 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:58.898663    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-7sh4z" event={"ID":"75f1f5cb-cc23-4410-9c79-598f7ed8d0d1","Type":"ContainerStarted","Data":"4d2c45c7a148fbe59d55fe79871b474665cc6a23d92059c8e5bef496348078ee"}
May 21 17:42:58.899723 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:42:58.899700    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-hdjjt" event={"ID":"b52f1b16-5083-4e2a-af4d-39c2158677aa","Type":"ContainerStarted","Data":"595b7c9816a8316b15c9cafd087cf5ec27290531d10e8bf45e76f2f0a8c27a0d"}
May 21 17:43:02.917050 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:43:02.917011    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-hdjjt" event={"ID":"b52f1b16-5083-4e2a-af4d-39c2158677aa","Type":"ContainerStarted","Data":"236a835d7f5b63b80f10779590d88fff2b7f401caa5f911b765d5ec3a6c4d946"}
May 21 17:43:02.918315 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:43:02.918292    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-7sh4z" event={"ID":"75f1f5cb-cc23-4410-9c79-598f7ed8d0d1","Type":"ContainerStarted","Data":"6de0157d9a16cd2b325d6adaeb376ce368bc96a12ba26cec258951d6d1379d56"}
May 21 17:43:02.930433 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:43:02.930392    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-7498df8756-hdjjt" podStartSLOduration=1.80706508 podStartE2EDuration="4.930379716s" podCreationTimestamp="2026-05-21 17:42:58 +0000 UTC" firstStartedPulling="2026-05-21 17:42:58.838724525 +0000 UTC m=+609.616097007" lastFinishedPulling="2026-05-21 17:43:01.962039147 +0000 UTC m=+612.739411643" observedRunningTime="2026-05-21 17:43:02.929183259 +0000 UTC m=+613.706555774" watchObservedRunningTime="2026-05-21 17:43:02.930379716 +0000 UTC m=+613.707752219"
May 21 17:43:02.942778 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:43:02.942736    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-f99f4b5cd-7sh4z" podStartSLOduration=1.495865771 podStartE2EDuration="4.942721208s" podCreationTimestamp="2026-05-21 17:42:58 +0000 UTC" firstStartedPulling="2026-05-21 17:42:58.504784596 +0000 UTC m=+609.282157078" lastFinishedPulling="2026-05-21 17:43:01.951640018 +0000 UTC m=+612.729012515" observedRunningTime="2026-05-21 17:43:02.941407024 +0000 UTC m=+613.718779527" watchObservedRunningTime="2026-05-21 17:43:02.942721208 +0000 UTC m=+613.720093712"
May 21 17:43:02.967087 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:43:02.967044    2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-7sh4z"]
May 21 17:43:04.925139 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:43:04.925095    2563 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-f99f4b5cd-7sh4z" podUID="75f1f5cb-cc23-4410-9c79-598f7ed8d0d1" containerName="authorino" containerID="cri-o://6de0157d9a16cd2b325d6adaeb376ce368bc96a12ba26cec258951d6d1379d56" gracePeriod=30
May 21 17:43:05.169616 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:43:05.169591    2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-7sh4z"
May 21 17:43:05.278029 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:43:05.277938    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ctx9j\" (UniqueName: \"kubernetes.io/projected/75f1f5cb-cc23-4410-9c79-598f7ed8d0d1-kube-api-access-ctx9j\") pod \"75f1f5cb-cc23-4410-9c79-598f7ed8d0d1\" (UID: \"75f1f5cb-cc23-4410-9c79-598f7ed8d0d1\") "
May 21 17:43:05.280131 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:43:05.280098    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/75f1f5cb-cc23-4410-9c79-598f7ed8d0d1-kube-api-access-ctx9j" (OuterVolumeSpecName: "kube-api-access-ctx9j") pod "75f1f5cb-cc23-4410-9c79-598f7ed8d0d1" (UID: "75f1f5cb-cc23-4410-9c79-598f7ed8d0d1"). InnerVolumeSpecName "kube-api-access-ctx9j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 17:43:05.379284 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:43:05.379245    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ctx9j\" (UniqueName: \"kubernetes.io/projected/75f1f5cb-cc23-4410-9c79-598f7ed8d0d1-kube-api-access-ctx9j\") on node \"ip-10-0-140-106.ec2.internal\" DevicePath \"\""
May 21 17:43:05.929976 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:43:05.929943    2563 generic.go:358] "Generic (PLEG): container finished" podID="75f1f5cb-cc23-4410-9c79-598f7ed8d0d1" containerID="6de0157d9a16cd2b325d6adaeb376ce368bc96a12ba26cec258951d6d1379d56" exitCode=0
May 21 17:43:05.930484 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:43:05.929983    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-7sh4z" event={"ID":"75f1f5cb-cc23-4410-9c79-598f7ed8d0d1","Type":"ContainerDied","Data":"6de0157d9a16cd2b325d6adaeb376ce368bc96a12ba26cec258951d6d1379d56"}
May 21 17:43:05.930484 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:43:05.930006    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-7sh4z" event={"ID":"75f1f5cb-cc23-4410-9c79-598f7ed8d0d1","Type":"ContainerDied","Data":"4d2c45c7a148fbe59d55fe79871b474665cc6a23d92059c8e5bef496348078ee"}
May 21 17:43:05.930484 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:43:05.930006    2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-7sh4z"
May 21 17:43:05.930484 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:43:05.930020    2563 scope.go:117] "RemoveContainer" containerID="6de0157d9a16cd2b325d6adaeb376ce368bc96a12ba26cec258951d6d1379d56"
May 21 17:43:05.938118 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:43:05.938103    2563 scope.go:117] "RemoveContainer" containerID="6de0157d9a16cd2b325d6adaeb376ce368bc96a12ba26cec258951d6d1379d56"
May 21 17:43:05.938367 ip-10-0-140-106 kubenswrapper[2563]: E0521 17:43:05.938348    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6de0157d9a16cd2b325d6adaeb376ce368bc96a12ba26cec258951d6d1379d56\": container with ID starting with 6de0157d9a16cd2b325d6adaeb376ce368bc96a12ba26cec258951d6d1379d56 not found: ID does not exist" containerID="6de0157d9a16cd2b325d6adaeb376ce368bc96a12ba26cec258951d6d1379d56"
May 21 17:43:05.938429 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:43:05.938379    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6de0157d9a16cd2b325d6adaeb376ce368bc96a12ba26cec258951d6d1379d56"} err="failed to get container status \"6de0157d9a16cd2b325d6adaeb376ce368bc96a12ba26cec258951d6d1379d56\": rpc error: code = NotFound desc = could not find container \"6de0157d9a16cd2b325d6adaeb376ce368bc96a12ba26cec258951d6d1379d56\": container with ID starting with 6de0157d9a16cd2b325d6adaeb376ce368bc96a12ba26cec258951d6d1379d56 not found: ID does not exist"
May 21 17:43:05.945313 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:43:05.945288    2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-7sh4z"]
May 21 17:43:05.949076 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:43:05.949043    2563 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-7sh4z"]
May 21 17:43:07.804583 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:43:07.804547    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="75f1f5cb-cc23-4410-9c79-598f7ed8d0d1" path="/var/lib/kubelet/pods/75f1f5cb-cc23-4410-9c79-598f7ed8d0d1/volumes"
May 21 17:43:26.836105 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:43:26.836052    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-8b475cf9f-pdp84"]
May 21 17:43:26.837557 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:43:26.836537    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="75f1f5cb-cc23-4410-9c79-598f7ed8d0d1" containerName="authorino"
May 21 17:43:26.837557 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:43:26.836553    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="75f1f5cb-cc23-4410-9c79-598f7ed8d0d1" containerName="authorino"
May 21 17:43:26.837557 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:43:26.836630    2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="75f1f5cb-cc23-4410-9c79-598f7ed8d0d1" containerName="authorino"
May 21 17:43:26.838352 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:43:26.838338    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-pdp84"
May 21 17:43:26.844609 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:43:26.844583    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-pdp84"]
May 21 17:43:26.963050 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:43:26.963014    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qdtl6\" (UniqueName: \"kubernetes.io/projected/3eeb5234-2692-4289-88c9-5ac02fe54c90-kube-api-access-qdtl6\") pod \"authorino-8b475cf9f-pdp84\" (UID: \"3eeb5234-2692-4289-88c9-5ac02fe54c90\") " pod="kuadrant-system/authorino-8b475cf9f-pdp84"
May 21 17:43:27.063173 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:43:27.063143    2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-pdp84"]
May 21 17:43:27.063427 ip-10-0-140-106 kubenswrapper[2563]: E0521 17:43:27.063407    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-qdtl6], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-8b475cf9f-pdp84" podUID="3eeb5234-2692-4289-88c9-5ac02fe54c90"
May 21 17:43:27.063531 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:43:27.063508    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qdtl6\" (UniqueName: \"kubernetes.io/projected/3eeb5234-2692-4289-88c9-5ac02fe54c90-kube-api-access-qdtl6\") pod \"authorino-8b475cf9f-pdp84\" (UID: \"3eeb5234-2692-4289-88c9-5ac02fe54c90\") " pod="kuadrant-system/authorino-8b475cf9f-pdp84"
May 21 17:43:27.077516 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:43:27.077492    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qdtl6\" (UniqueName: \"kubernetes.io/projected/3eeb5234-2692-4289-88c9-5ac02fe54c90-kube-api-access-qdtl6\") pod \"authorino-8b475cf9f-pdp84\" (UID: \"3eeb5234-2692-4289-88c9-5ac02fe54c90\") " pod="kuadrant-system/authorino-8b475cf9f-pdp84"
May 21 17:43:27.087463 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:43:27.087440    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-57cdb4fcb-g966d"]
May 21 17:43:27.089765 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:43:27.089744    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57cdb4fcb-g966d"
May 21 17:43:27.097484 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:43:27.097463    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-57cdb4fcb-g966d"]
May 21 17:43:27.164149 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:43:27.164124    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hbhl7\" (UniqueName: \"kubernetes.io/projected/51f0a0a0-6a60-4578-b8c6-4143c0bb9381-kube-api-access-hbhl7\") pod \"authorino-57cdb4fcb-g966d\" (UID: \"51f0a0a0-6a60-4578-b8c6-4143c0bb9381\") " pod="kuadrant-system/authorino-57cdb4fcb-g966d"
May 21 17:43:27.264855 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:43:27.264828    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hbhl7\" (UniqueName: \"kubernetes.io/projected/51f0a0a0-6a60-4578-b8c6-4143c0bb9381-kube-api-access-hbhl7\") pod \"authorino-57cdb4fcb-g966d\" (UID: \"51f0a0a0-6a60-4578-b8c6-4143c0bb9381\") " pod="kuadrant-system/authorino-57cdb4fcb-g966d"
May 21 17:43:27.272228 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:43:27.272210    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hbhl7\" (UniqueName: \"kubernetes.io/projected/51f0a0a0-6a60-4578-b8c6-4143c0bb9381-kube-api-access-hbhl7\") pod \"authorino-57cdb4fcb-g966d\" (UID: \"51f0a0a0-6a60-4578-b8c6-4143c0bb9381\") " pod="kuadrant-system/authorino-57cdb4fcb-g966d"
May 21 17:43:27.400410 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:43:27.400348    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57cdb4fcb-g966d"
May 21 17:43:27.524351 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:43:27.524323    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-57cdb4fcb-g966d"]
May 21 17:43:27.526741 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:43:27.526714    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod51f0a0a0_6a60_4578_b8c6_4143c0bb9381.slice/crio-c5e9c03bee667f68f679936e4ae85c7a67ec73410d3efd393dbc584655f29330 WatchSource:0}: Error finding container c5e9c03bee667f68f679936e4ae85c7a67ec73410d3efd393dbc584655f29330: Status 404 returned error can't find the container with id c5e9c03bee667f68f679936e4ae85c7a67ec73410d3efd393dbc584655f29330
May 21 17:43:27.528215 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:43:27.528197    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 21 17:43:27.971163 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:43:27.971125    2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-57cdb4fcb-g966d"]
May 21 17:43:27.998111 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:43:27.998087    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7d9b5dfd8-ss255"]
May 21 17:43:28.002150 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:43:28.002129    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7d9b5dfd8-ss255"
May 21 17:43:28.004382 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:43:28.004364    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
May 21 17:43:28.007418 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:43:28.007396    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7d9b5dfd8-ss255"]
May 21 17:43:28.013069 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:43:28.013041    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-pdp84"
May 21 17:43:28.013555 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:43:28.013536    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57cdb4fcb-g966d" event={"ID":"51f0a0a0-6a60-4578-b8c6-4143c0bb9381","Type":"ContainerStarted","Data":"7ea0f580b1f5dd3e9d17c6060e1514b38a3f52de11bebc0c9d544a76187cb528"}
May 21 17:43:28.013642 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:43:28.013560    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57cdb4fcb-g966d" event={"ID":"51f0a0a0-6a60-4578-b8c6-4143c0bb9381","Type":"ContainerStarted","Data":"c5e9c03bee667f68f679936e4ae85c7a67ec73410d3efd393dbc584655f29330"}
May 21 17:43:28.016970 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:43:28.016952    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-pdp84"
May 21 17:43:28.030651 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:43:28.030610    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-57cdb4fcb-g966d" podStartSLOduration=0.743247578 podStartE2EDuration="1.030598156s" podCreationTimestamp="2026-05-21 17:43:27 +0000 UTC" firstStartedPulling="2026-05-21 17:43:27.528315303 +0000 UTC m=+638.305687785" lastFinishedPulling="2026-05-21 17:43:27.815665881 +0000 UTC m=+638.593038363" observedRunningTime="2026-05-21 17:43:28.029515434 +0000 UTC m=+638.806887940" watchObservedRunningTime="2026-05-21 17:43:28.030598156 +0000 UTC m=+638.807970659"
May 21 17:43:28.173494 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:43:28.173468    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qdtl6\" (UniqueName: \"kubernetes.io/projected/3eeb5234-2692-4289-88c9-5ac02fe54c90-kube-api-access-qdtl6\") pod \"3eeb5234-2692-4289-88c9-5ac02fe54c90\" (UID: \"3eeb5234-2692-4289-88c9-5ac02fe54c90\") "
May 21 17:43:28.173662 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:43:28.173571    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2s4zl\" (UniqueName: \"kubernetes.io/projected/a7e14ddb-bb5e-47a0-bf0c-8ad16091ab1a-kube-api-access-2s4zl\") pod \"authorino-7d9b5dfd8-ss255\" (UID: \"a7e14ddb-bb5e-47a0-bf0c-8ad16091ab1a\") " pod="kuadrant-system/authorino-7d9b5dfd8-ss255"
May 21 17:43:28.173662 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:43:28.173647    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a7e14ddb-bb5e-47a0-bf0c-8ad16091ab1a-tls-cert\") pod \"authorino-7d9b5dfd8-ss255\" (UID: \"a7e14ddb-bb5e-47a0-bf0c-8ad16091ab1a\") " pod="kuadrant-system/authorino-7d9b5dfd8-ss255"
May 21 17:43:28.175505 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:43:28.175481    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3eeb5234-2692-4289-88c9-5ac02fe54c90-kube-api-access-qdtl6" (OuterVolumeSpecName: "kube-api-access-qdtl6") pod "3eeb5234-2692-4289-88c9-5ac02fe54c90" (UID: "3eeb5234-2692-4289-88c9-5ac02fe54c90"). InnerVolumeSpecName "kube-api-access-qdtl6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 17:43:28.274450 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:43:28.274420    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2s4zl\" (UniqueName: \"kubernetes.io/projected/a7e14ddb-bb5e-47a0-bf0c-8ad16091ab1a-kube-api-access-2s4zl\") pod \"authorino-7d9b5dfd8-ss255\" (UID: \"a7e14ddb-bb5e-47a0-bf0c-8ad16091ab1a\") " pod="kuadrant-system/authorino-7d9b5dfd8-ss255"
May 21 17:43:28.274569 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:43:28.274516    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a7e14ddb-bb5e-47a0-bf0c-8ad16091ab1a-tls-cert\") pod \"authorino-7d9b5dfd8-ss255\" (UID: \"a7e14ddb-bb5e-47a0-bf0c-8ad16091ab1a\") " pod="kuadrant-system/authorino-7d9b5dfd8-ss255"
May 21 17:43:28.274636 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:43:28.274614    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qdtl6\" (UniqueName: \"kubernetes.io/projected/3eeb5234-2692-4289-88c9-5ac02fe54c90-kube-api-access-qdtl6\") on node \"ip-10-0-140-106.ec2.internal\" DevicePath \"\""
May 21 17:43:28.276824 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:43:28.276800    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a7e14ddb-bb5e-47a0-bf0c-8ad16091ab1a-tls-cert\") pod \"authorino-7d9b5dfd8-ss255\" (UID: \"a7e14ddb-bb5e-47a0-bf0c-8ad16091ab1a\") " pod="kuadrant-system/authorino-7d9b5dfd8-ss255"
May 21 17:43:28.281377 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:43:28.281352    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2s4zl\" (UniqueName: \"kubernetes.io/projected/a7e14ddb-bb5e-47a0-bf0c-8ad16091ab1a-kube-api-access-2s4zl\") pod \"authorino-7d9b5dfd8-ss255\" (UID: \"a7e14ddb-bb5e-47a0-bf0c-8ad16091ab1a\") " pod="kuadrant-system/authorino-7d9b5dfd8-ss255"
May 21 17:43:28.312689 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:43:28.312669    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7d9b5dfd8-ss255"
May 21 17:43:28.433697 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:43:28.433675    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7d9b5dfd8-ss255"]
May 21 17:43:28.435821 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:43:28.435796    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda7e14ddb_bb5e_47a0_bf0c_8ad16091ab1a.slice/crio-b5145f0508591eb69e68605eba7a442f65f9b2a4e067a9435c633a29574abdba WatchSource:0}: Error finding container b5145f0508591eb69e68605eba7a442f65f9b2a4e067a9435c633a29574abdba: Status 404 returned error can't find the container with id b5145f0508591eb69e68605eba7a442f65f9b2a4e067a9435c633a29574abdba
May 21 17:43:29.018104 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:43:29.018001    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7d9b5dfd8-ss255" event={"ID":"a7e14ddb-bb5e-47a0-bf0c-8ad16091ab1a","Type":"ContainerStarted","Data":"0aac0c18a31ffe3e681e1fcef4d3e0f8bd04394704bc43c2131ae9eff6adccce"}
May 21 17:43:29.018104 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:43:29.018040    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7d9b5dfd8-ss255" event={"ID":"a7e14ddb-bb5e-47a0-bf0c-8ad16091ab1a","Type":"ContainerStarted","Data":"b5145f0508591eb69e68605eba7a442f65f9b2a4e067a9435c633a29574abdba"}
May 21 17:43:29.018605 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:43:29.018167    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-pdp84"
May 21 17:43:29.018605 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:43:29.018354    2563 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-57cdb4fcb-g966d" podUID="51f0a0a0-6a60-4578-b8c6-4143c0bb9381" containerName="authorino" containerID="cri-o://7ea0f580b1f5dd3e9d17c6060e1514b38a3f52de11bebc0c9d544a76187cb528" gracePeriod=30
May 21 17:43:29.033160 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:43:29.033111    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-7d9b5dfd8-ss255" podStartSLOduration=1.746562764 podStartE2EDuration="2.033093149s" podCreationTimestamp="2026-05-21 17:43:27 +0000 UTC" firstStartedPulling="2026-05-21 17:43:28.437158873 +0000 UTC m=+639.214531359" lastFinishedPulling="2026-05-21 17:43:28.723689263 +0000 UTC m=+639.501061744" observedRunningTime="2026-05-21 17:43:29.03095423 +0000 UTC m=+639.808326751" watchObservedRunningTime="2026-05-21 17:43:29.033093149 +0000 UTC m=+639.810465654"
May 21 17:43:29.064811 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:43:29.064779    2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7498df8756-hdjjt"]
May 21 17:43:29.065013 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:43:29.064992    2563 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-7498df8756-hdjjt" podUID="b52f1b16-5083-4e2a-af4d-39c2158677aa" containerName="authorino" containerID="cri-o://236a835d7f5b63b80f10779590d88fff2b7f401caa5f911b765d5ec3a6c4d946" gracePeriod=30
May 21 17:43:29.069919 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:43:29.069891    2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-pdp84"]
May 21 17:43:29.075599 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:43:29.075576    2563 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-pdp84"]
May 21 17:43:29.332793 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:43:29.332775    2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57cdb4fcb-g966d"
May 21 17:43:29.336186 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:43:29.336169    2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-hdjjt"
May 21 17:43:29.486403 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:43:29.486375    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hbhl7\" (UniqueName: \"kubernetes.io/projected/51f0a0a0-6a60-4578-b8c6-4143c0bb9381-kube-api-access-hbhl7\") pod \"51f0a0a0-6a60-4578-b8c6-4143c0bb9381\" (UID: \"51f0a0a0-6a60-4578-b8c6-4143c0bb9381\") "
May 21 17:43:29.486547 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:43:29.486417    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j7j6n\" (UniqueName: \"kubernetes.io/projected/b52f1b16-5083-4e2a-af4d-39c2158677aa-kube-api-access-j7j6n\") pod \"b52f1b16-5083-4e2a-af4d-39c2158677aa\" (UID: \"b52f1b16-5083-4e2a-af4d-39c2158677aa\") "
May 21 17:43:29.488506 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:43:29.488484    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b52f1b16-5083-4e2a-af4d-39c2158677aa-kube-api-access-j7j6n" (OuterVolumeSpecName: "kube-api-access-j7j6n") pod "b52f1b16-5083-4e2a-af4d-39c2158677aa" (UID: "b52f1b16-5083-4e2a-af4d-39c2158677aa"). InnerVolumeSpecName "kube-api-access-j7j6n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 17:43:29.488634 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:43:29.488614    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/51f0a0a0-6a60-4578-b8c6-4143c0bb9381-kube-api-access-hbhl7" (OuterVolumeSpecName: "kube-api-access-hbhl7") pod "51f0a0a0-6a60-4578-b8c6-4143c0bb9381" (UID: "51f0a0a0-6a60-4578-b8c6-4143c0bb9381"). InnerVolumeSpecName "kube-api-access-hbhl7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 17:43:29.587227 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:43:29.587205    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hbhl7\" (UniqueName: \"kubernetes.io/projected/51f0a0a0-6a60-4578-b8c6-4143c0bb9381-kube-api-access-hbhl7\") on node \"ip-10-0-140-106.ec2.internal\" DevicePath \"\""
May 21 17:43:29.587339 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:43:29.587231    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j7j6n\" (UniqueName: \"kubernetes.io/projected/b52f1b16-5083-4e2a-af4d-39c2158677aa-kube-api-access-j7j6n\") on node \"ip-10-0-140-106.ec2.internal\" DevicePath \"\""
May 21 17:43:29.805476 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:43:29.805447    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3eeb5234-2692-4289-88c9-5ac02fe54c90" path="/var/lib/kubelet/pods/3eeb5234-2692-4289-88c9-5ac02fe54c90/volumes"
May 21 17:43:30.022367 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:43:30.022279    2563 generic.go:358] "Generic (PLEG): container finished" podID="51f0a0a0-6a60-4578-b8c6-4143c0bb9381" containerID="7ea0f580b1f5dd3e9d17c6060e1514b38a3f52de11bebc0c9d544a76187cb528" exitCode=0
May 21 17:43:30.022367 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:43:30.022334    2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57cdb4fcb-g966d"
May 21 17:43:30.022856 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:43:30.022362    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57cdb4fcb-g966d" event={"ID":"51f0a0a0-6a60-4578-b8c6-4143c0bb9381","Type":"ContainerDied","Data":"7ea0f580b1f5dd3e9d17c6060e1514b38a3f52de11bebc0c9d544a76187cb528"}
May 21 17:43:30.022856 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:43:30.022399    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57cdb4fcb-g966d" event={"ID":"51f0a0a0-6a60-4578-b8c6-4143c0bb9381","Type":"ContainerDied","Data":"c5e9c03bee667f68f679936e4ae85c7a67ec73410d3efd393dbc584655f29330"}
May 21 17:43:30.022856 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:43:30.022414    2563 scope.go:117] "RemoveContainer" containerID="7ea0f580b1f5dd3e9d17c6060e1514b38a3f52de11bebc0c9d544a76187cb528"
May 21 17:43:30.023733 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:43:30.023567    2563 generic.go:358] "Generic (PLEG): container finished" podID="b52f1b16-5083-4e2a-af4d-39c2158677aa" containerID="236a835d7f5b63b80f10779590d88fff2b7f401caa5f911b765d5ec3a6c4d946" exitCode=0
May 21 17:43:30.023733 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:43:30.023618    2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-hdjjt"
May 21 17:43:30.023733 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:43:30.023654    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-hdjjt" event={"ID":"b52f1b16-5083-4e2a-af4d-39c2158677aa","Type":"ContainerDied","Data":"236a835d7f5b63b80f10779590d88fff2b7f401caa5f911b765d5ec3a6c4d946"}
May 21 17:43:30.023733 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:43:30.023686    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-hdjjt" event={"ID":"b52f1b16-5083-4e2a-af4d-39c2158677aa","Type":"ContainerDied","Data":"595b7c9816a8316b15c9cafd087cf5ec27290531d10e8bf45e76f2f0a8c27a0d"}
May 21 17:43:30.031645 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:43:30.031627    2563 scope.go:117] "RemoveContainer" containerID="7ea0f580b1f5dd3e9d17c6060e1514b38a3f52de11bebc0c9d544a76187cb528"
May 21 17:43:30.031897 ip-10-0-140-106 kubenswrapper[2563]: E0521 17:43:30.031878    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7ea0f580b1f5dd3e9d17c6060e1514b38a3f52de11bebc0c9d544a76187cb528\": container with ID starting with 7ea0f580b1f5dd3e9d17c6060e1514b38a3f52de11bebc0c9d544a76187cb528 not found: ID does not exist" containerID="7ea0f580b1f5dd3e9d17c6060e1514b38a3f52de11bebc0c9d544a76187cb528"
May 21 17:43:30.031956 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:43:30.031907    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ea0f580b1f5dd3e9d17c6060e1514b38a3f52de11bebc0c9d544a76187cb528"} err="failed to get container status \"7ea0f580b1f5dd3e9d17c6060e1514b38a3f52de11bebc0c9d544a76187cb528\": rpc error: code = NotFound desc = could not find container \"7ea0f580b1f5dd3e9d17c6060e1514b38a3f52de11bebc0c9d544a76187cb528\": container with ID starting with 7ea0f580b1f5dd3e9d17c6060e1514b38a3f52de11bebc0c9d544a76187cb528 not found: ID does not exist"
May 21 17:43:30.031956 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:43:30.031925    2563 scope.go:117] "RemoveContainer" containerID="236a835d7f5b63b80f10779590d88fff2b7f401caa5f911b765d5ec3a6c4d946"
May 21 17:43:30.040164 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:43:30.040136    2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7498df8756-hdjjt"]
May 21 17:43:30.040454 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:43:30.040435    2563 scope.go:117] "RemoveContainer" containerID="236a835d7f5b63b80f10779590d88fff2b7f401caa5f911b765d5ec3a6c4d946"
May 21 17:43:30.040755 ip-10-0-140-106 kubenswrapper[2563]: E0521 17:43:30.040737    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"236a835d7f5b63b80f10779590d88fff2b7f401caa5f911b765d5ec3a6c4d946\": container with ID starting with 236a835d7f5b63b80f10779590d88fff2b7f401caa5f911b765d5ec3a6c4d946 not found: ID does not exist" containerID="236a835d7f5b63b80f10779590d88fff2b7f401caa5f911b765d5ec3a6c4d946"
May 21 17:43:30.040830 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:43:30.040763    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"236a835d7f5b63b80f10779590d88fff2b7f401caa5f911b765d5ec3a6c4d946"} err="failed to get container status \"236a835d7f5b63b80f10779590d88fff2b7f401caa5f911b765d5ec3a6c4d946\": rpc error: code = NotFound desc = could not find container \"236a835d7f5b63b80f10779590d88fff2b7f401caa5f911b765d5ec3a6c4d946\": container with ID starting with 236a835d7f5b63b80f10779590d88fff2b7f401caa5f911b765d5ec3a6c4d946 not found: ID does not exist"
May 21 17:43:30.041931 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:43:30.041911    2563 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7498df8756-hdjjt"]
May 21 17:43:30.050808 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:43:30.050766    2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-57cdb4fcb-g966d"]
May 21 17:43:30.052243 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:43:30.052223    2563 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-57cdb4fcb-g966d"]
May 21 17:43:31.805439 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:43:31.805405    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="51f0a0a0-6a60-4578-b8c6-4143c0bb9381" path="/var/lib/kubelet/pods/51f0a0a0-6a60-4578-b8c6-4143c0bb9381/volumes"
May 21 17:43:31.805806 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:43:31.805726    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b52f1b16-5083-4e2a-af4d-39c2158677aa" path="/var/lib/kubelet/pods/b52f1b16-5083-4e2a-af4d-39c2158677aa/volumes"
May 21 17:43:32.017961 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:43:32.017928    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7df575f8c9-bgd5d"]
May 21 17:43:32.018294 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:43:32.018281    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51f0a0a0-6a60-4578-b8c6-4143c0bb9381" containerName="authorino"
May 21 17:43:32.018351 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:43:32.018296    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="51f0a0a0-6a60-4578-b8c6-4143c0bb9381" containerName="authorino"
May 21 17:43:32.018351 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:43:32.018315    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b52f1b16-5083-4e2a-af4d-39c2158677aa" containerName="authorino"
May 21 17:43:32.018351 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:43:32.018321    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="b52f1b16-5083-4e2a-af4d-39c2158677aa" containerName="authorino"
May 21 17:43:32.018442 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:43:32.018370    2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="b52f1b16-5083-4e2a-af4d-39c2158677aa" containerName="authorino"
May 21 17:43:32.018442 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:43:32.018379    2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="51f0a0a0-6a60-4578-b8c6-4143c0bb9381" containerName="authorino"
May 21 17:43:32.020455 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:43:32.020438    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7df575f8c9-bgd5d"
May 21 17:43:32.022862 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:43:32.022837    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-l7lfd\""
May 21 17:43:32.022963 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:43:32.022872    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
May 21 17:43:32.032824 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:43:32.032798    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7df575f8c9-bgd5d"]
May 21 17:43:32.209229 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:43:32.209196    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jfppd\" (UniqueName: \"kubernetes.io/projected/1353c2a7-11ff-468e-a4ed-e524e4748a0f-kube-api-access-jfppd\") pod \"maas-controller-7df575f8c9-bgd5d\" (UID: \"1353c2a7-11ff-468e-a4ed-e524e4748a0f\") " pod="opendatahub/maas-controller-7df575f8c9-bgd5d"
May 21 17:43:32.282519 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:43:32.282487    2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7df575f8c9-bgd5d"]
May 21 17:43:32.282745 ip-10-0-140-106 kubenswrapper[2563]: E0521 17:43:32.282727    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-jfppd], unattached volumes=[], failed to process volumes=[]: context canceled" pod="opendatahub/maas-controller-7df575f8c9-bgd5d" podUID="1353c2a7-11ff-468e-a4ed-e524e4748a0f"
May 21 17:43:32.310119 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:43:32.310088    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jfppd\" (UniqueName: \"kubernetes.io/projected/1353c2a7-11ff-468e-a4ed-e524e4748a0f-kube-api-access-jfppd\") pod \"maas-controller-7df575f8c9-bgd5d\" (UID: \"1353c2a7-11ff-468e-a4ed-e524e4748a0f\") " pod="opendatahub/maas-controller-7df575f8c9-bgd5d"
May 21 17:43:32.321841 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:43:32.321817    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jfppd\" (UniqueName: \"kubernetes.io/projected/1353c2a7-11ff-468e-a4ed-e524e4748a0f-kube-api-access-jfppd\") pod \"maas-controller-7df575f8c9-bgd5d\" (UID: \"1353c2a7-11ff-468e-a4ed-e524e4748a0f\") " pod="opendatahub/maas-controller-7df575f8c9-bgd5d"
May 21 17:43:33.039969 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:43:33.039937    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7df575f8c9-bgd5d"
May 21 17:43:33.045073 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:43:33.045035    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7df575f8c9-bgd5d"
May 21 17:43:33.216489 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:43:33.216458    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jfppd\" (UniqueName: \"kubernetes.io/projected/1353c2a7-11ff-468e-a4ed-e524e4748a0f-kube-api-access-jfppd\") pod \"1353c2a7-11ff-468e-a4ed-e524e4748a0f\" (UID: \"1353c2a7-11ff-468e-a4ed-e524e4748a0f\") "
May 21 17:43:33.218497 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:43:33.218464    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1353c2a7-11ff-468e-a4ed-e524e4748a0f-kube-api-access-jfppd" (OuterVolumeSpecName: "kube-api-access-jfppd") pod "1353c2a7-11ff-468e-a4ed-e524e4748a0f" (UID: "1353c2a7-11ff-468e-a4ed-e524e4748a0f"). InnerVolumeSpecName "kube-api-access-jfppd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 17:43:33.318011 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:43:33.317930    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jfppd\" (UniqueName: \"kubernetes.io/projected/1353c2a7-11ff-468e-a4ed-e524e4748a0f-kube-api-access-jfppd\") on node \"ip-10-0-140-106.ec2.internal\" DevicePath \"\""
May 21 17:43:34.043415 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:43:34.043376    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7df575f8c9-bgd5d"
May 21 17:43:34.069348 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:43:34.069282    2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7df575f8c9-bgd5d"]
May 21 17:43:34.072008 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:43:34.071986    2563 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7df575f8c9-bgd5d"]
May 21 17:43:35.805530 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:43:35.805487    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1353c2a7-11ff-468e-a4ed-e524e4748a0f" path="/var/lib/kubelet/pods/1353c2a7-11ff-468e-a4ed-e524e4748a0f/volumes"
May 21 17:44:52.322997 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:44:52.322965    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84db68679b-skzpk"]
May 21 17:44:52.326689 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:44:52.326669    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-skzpk"
May 21 17:44:52.330745 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:44:52.330711    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
May 21 17:44:52.330745 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:44:52.330738    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
May 21 17:44:52.331800 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:44:52.331784    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-dnpq5\""
May 21 17:44:52.331912 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:44:52.331895    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
May 21 17:44:52.336337 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:44:52.336013    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84db68679b-skzpk"]
May 21 17:44:52.372867 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:44:52.372840    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/54d6abda-e24c-4765-8e5f-d29f8a8cddc9-dshm\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-skzpk\" (UID: \"54d6abda-e24c-4765-8e5f-d29f8a8cddc9\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-skzpk"
May 21 17:44:52.372992 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:44:52.372894    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/54d6abda-e24c-4765-8e5f-d29f8a8cddc9-home\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-skzpk\" (UID: \"54d6abda-e24c-4765-8e5f-d29f8a8cddc9\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-skzpk"
May 21 17:44:52.372992 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:44:52.372957    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/54d6abda-e24c-4765-8e5f-d29f8a8cddc9-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-skzpk\" (UID: \"54d6abda-e24c-4765-8e5f-d29f8a8cddc9\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-skzpk"
May 21 17:44:52.372992 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:44:52.372984    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/54d6abda-e24c-4765-8e5f-d29f8a8cddc9-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-skzpk\" (UID: \"54d6abda-e24c-4765-8e5f-d29f8a8cddc9\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-skzpk"
May 21 17:44:52.373159 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:44:52.373012    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/54d6abda-e24c-4765-8e5f-d29f8a8cddc9-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-skzpk\" (UID: \"54d6abda-e24c-4765-8e5f-d29f8a8cddc9\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-skzpk"
May 21 17:44:52.373159 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:44:52.373111    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-454wq\" (UniqueName: \"kubernetes.io/projected/54d6abda-e24c-4765-8e5f-d29f8a8cddc9-kube-api-access-454wq\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-skzpk\" (UID: \"54d6abda-e24c-4765-8e5f-d29f8a8cddc9\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-skzpk"
May 21 17:44:52.474404 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:44:52.474379    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/54d6abda-e24c-4765-8e5f-d29f8a8cddc9-home\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-skzpk\" (UID: \"54d6abda-e24c-4765-8e5f-d29f8a8cddc9\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-skzpk"
May 21 17:44:52.474547 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:44:52.474416    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/54d6abda-e24c-4765-8e5f-d29f8a8cddc9-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-skzpk\" (UID: \"54d6abda-e24c-4765-8e5f-d29f8a8cddc9\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-skzpk"
May 21 17:44:52.474547 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:44:52.474435    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/54d6abda-e24c-4765-8e5f-d29f8a8cddc9-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-skzpk\" (UID: \"54d6abda-e24c-4765-8e5f-d29f8a8cddc9\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-skzpk"
May 21 17:44:52.474658 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:44:52.474635    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/54d6abda-e24c-4765-8e5f-d29f8a8cddc9-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-skzpk\" (UID: \"54d6abda-e24c-4765-8e5f-d29f8a8cddc9\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-skzpk"
May 21 17:44:52.474729 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:44:52.474714    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/54d6abda-e24c-4765-8e5f-d29f8a8cddc9-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-skzpk\" (UID: \"54d6abda-e24c-4765-8e5f-d29f8a8cddc9\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-skzpk"
May 21 17:44:52.474774 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:44:52.474734    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-454wq\" (UniqueName: \"kubernetes.io/projected/54d6abda-e24c-4765-8e5f-d29f8a8cddc9-kube-api-access-454wq\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-skzpk\" (UID: \"54d6abda-e24c-4765-8e5f-d29f8a8cddc9\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-skzpk"
May 21 17:44:52.474837 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:44:52.474780    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/54d6abda-e24c-4765-8e5f-d29f8a8cddc9-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-skzpk\" (UID: \"54d6abda-e24c-4765-8e5f-d29f8a8cddc9\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-skzpk"
May 21 17:44:52.474890 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:44:52.474834    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/54d6abda-e24c-4765-8e5f-d29f8a8cddc9-dshm\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-skzpk\" (UID: \"54d6abda-e24c-4765-8e5f-d29f8a8cddc9\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-skzpk"
May 21 17:44:52.474890 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:44:52.474867    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/54d6abda-e24c-4765-8e5f-d29f8a8cddc9-home\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-skzpk\" (UID: \"54d6abda-e24c-4765-8e5f-d29f8a8cddc9\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-skzpk"
May 21 17:44:52.477007 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:44:52.476978    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/54d6abda-e24c-4765-8e5f-d29f8a8cddc9-dshm\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-skzpk\" (UID: \"54d6abda-e24c-4765-8e5f-d29f8a8cddc9\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-skzpk"
May 21 17:44:52.477382 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:44:52.477361    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/54d6abda-e24c-4765-8e5f-d29f8a8cddc9-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-skzpk\" (UID: \"54d6abda-e24c-4765-8e5f-d29f8a8cddc9\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-skzpk"
May 21 17:44:52.481726 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:44:52.481706    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-454wq\" (UniqueName: \"kubernetes.io/projected/54d6abda-e24c-4765-8e5f-d29f8a8cddc9-kube-api-access-454wq\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-skzpk\" (UID: \"54d6abda-e24c-4765-8e5f-d29f8a8cddc9\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-skzpk"
May 21 17:44:52.639951 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:44:52.639923    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-skzpk"
May 21 17:44:52.769030 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:44:52.769005    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84db68679b-skzpk"]
May 21 17:44:52.770882 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:44:52.770854    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54d6abda_e24c_4765_8e5f_d29f8a8cddc9.slice/crio-4604299c276cd206406ec9138af230680c8a08393d2e6284239c66d29bbeae10 WatchSource:0}: Error finding container 4604299c276cd206406ec9138af230680c8a08393d2e6284239c66d29bbeae10: Status 404 returned error can't find the container with id 4604299c276cd206406ec9138af230680c8a08393d2e6284239c66d29bbeae10
May 21 17:44:53.321477 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:44:53.321436    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-skzpk" event={"ID":"54d6abda-e24c-4765-8e5f-d29f8a8cddc9","Type":"ContainerStarted","Data":"4604299c276cd206406ec9138af230680c8a08393d2e6284239c66d29bbeae10"}
May 21 17:44:58.343289 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:44:58.343250    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-skzpk" event={"ID":"54d6abda-e24c-4765-8e5f-d29f8a8cddc9","Type":"ContainerStarted","Data":"986023c693e5a52cf9a3951945b690c0a55548e53b00fb408fc5c8854362ec69"}
May 21 17:45:03.362433 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:45:03.362395    2563 generic.go:358] "Generic (PLEG): container finished" podID="54d6abda-e24c-4765-8e5f-d29f8a8cddc9" containerID="986023c693e5a52cf9a3951945b690c0a55548e53b00fb408fc5c8854362ec69" exitCode=0
May 21 17:45:03.362811 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:45:03.362465    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-skzpk" event={"ID":"54d6abda-e24c-4765-8e5f-d29f8a8cddc9","Type":"ContainerDied","Data":"986023c693e5a52cf9a3951945b690c0a55548e53b00fb408fc5c8854362ec69"}
May 21 17:45:05.373309 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:45:05.373277    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-skzpk" event={"ID":"54d6abda-e24c-4765-8e5f-d29f8a8cddc9","Type":"ContainerStarted","Data":"d750b75a791d8309ccb9ec3eeab1b21cba6ee12e2949a4c3ef96cdc0c242793d"}
May 21 17:45:05.373761 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:45:05.373507    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-skzpk"
May 21 17:45:05.390154 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:45:05.390105    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-skzpk" podStartSLOduration=1.437708201 podStartE2EDuration="13.390091467s" podCreationTimestamp="2026-05-21 17:44:52 +0000 UTC" firstStartedPulling="2026-05-21 17:44:52.773141491 +0000 UTC m=+723.550513987" lastFinishedPulling="2026-05-21 17:45:04.725524767 +0000 UTC m=+735.502897253" observedRunningTime="2026-05-21 17:45:05.388766277 +0000 UTC m=+736.166138781" watchObservedRunningTime="2026-05-21 17:45:05.390091467 +0000 UTC m=+736.167463971"
May 21 17:45:16.389576 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:45:16.389547    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-skzpk"
May 21 17:45:42.595837 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:45:42.595793    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-c75994d4f-vjdjs"]
May 21 17:45:42.598394 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:45:42.598371    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-c75994d4f-vjdjs"
May 21 17:45:42.606395 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:45:42.606374    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-c75994d4f-vjdjs"]
May 21 17:45:42.722958 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:45:42.722928    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/72ea8e34-196f-4bd4-bd32-2168a8ae81e5-tls-cert\") pod \"authorino-c75994d4f-vjdjs\" (UID: \"72ea8e34-196f-4bd4-bd32-2168a8ae81e5\") " pod="kuadrant-system/authorino-c75994d4f-vjdjs"
May 21 17:45:42.723143 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:45:42.722989    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fw4lw\" (UniqueName: \"kubernetes.io/projected/72ea8e34-196f-4bd4-bd32-2168a8ae81e5-kube-api-access-fw4lw\") pod \"authorino-c75994d4f-vjdjs\" (UID: \"72ea8e34-196f-4bd4-bd32-2168a8ae81e5\") " pod="kuadrant-system/authorino-c75994d4f-vjdjs"
May 21 17:45:42.824030 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:45:42.824001    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fw4lw\" (UniqueName: \"kubernetes.io/projected/72ea8e34-196f-4bd4-bd32-2168a8ae81e5-kube-api-access-fw4lw\") pod \"authorino-c75994d4f-vjdjs\" (UID: \"72ea8e34-196f-4bd4-bd32-2168a8ae81e5\") " pod="kuadrant-system/authorino-c75994d4f-vjdjs"
May 21 17:45:42.824183 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:45:42.824087    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/72ea8e34-196f-4bd4-bd32-2168a8ae81e5-tls-cert\") pod \"authorino-c75994d4f-vjdjs\" (UID: \"72ea8e34-196f-4bd4-bd32-2168a8ae81e5\") " pod="kuadrant-system/authorino-c75994d4f-vjdjs"
May 21 17:45:42.826562 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:45:42.826540    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/72ea8e34-196f-4bd4-bd32-2168a8ae81e5-tls-cert\") pod \"authorino-c75994d4f-vjdjs\" (UID: \"72ea8e34-196f-4bd4-bd32-2168a8ae81e5\") " pod="kuadrant-system/authorino-c75994d4f-vjdjs"
May 21 17:45:42.831619 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:45:42.831600    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fw4lw\" (UniqueName: \"kubernetes.io/projected/72ea8e34-196f-4bd4-bd32-2168a8ae81e5-kube-api-access-fw4lw\") pod \"authorino-c75994d4f-vjdjs\" (UID: \"72ea8e34-196f-4bd4-bd32-2168a8ae81e5\") " pod="kuadrant-system/authorino-c75994d4f-vjdjs"
May 21 17:45:42.909655 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:45:42.909590    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-c75994d4f-vjdjs"
May 21 17:45:43.038575 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:45:43.038554    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-c75994d4f-vjdjs"]
May 21 17:45:43.040880 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:45:43.040852    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod72ea8e34_196f_4bd4_bd32_2168a8ae81e5.slice/crio-2f3bf8f197e2380b9a882448e90efc15997d0e54bea0e1a0493c18079b8c2206 WatchSource:0}: Error finding container 2f3bf8f197e2380b9a882448e90efc15997d0e54bea0e1a0493c18079b8c2206: Status 404 returned error can't find the container with id 2f3bf8f197e2380b9a882448e90efc15997d0e54bea0e1a0493c18079b8c2206
May 21 17:45:43.508887 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:45:43.508863    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-c75994d4f-vjdjs" event={"ID":"72ea8e34-196f-4bd4-bd32-2168a8ae81e5","Type":"ContainerStarted","Data":"2f3bf8f197e2380b9a882448e90efc15997d0e54bea0e1a0493c18079b8c2206"}
May 21 17:45:44.517005 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:45:44.516961    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-c75994d4f-vjdjs" event={"ID":"72ea8e34-196f-4bd4-bd32-2168a8ae81e5","Type":"ContainerStarted","Data":"994f81986047603a8c398a68106883fc70207a2888bd0add61bd5aa346679895"}
May 21 17:45:44.530664 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:45:44.530622    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-c75994d4f-vjdjs" podStartSLOduration=2.108027601 podStartE2EDuration="2.53059998s" podCreationTimestamp="2026-05-21 17:45:42 +0000 UTC" firstStartedPulling="2026-05-21 17:45:43.042217367 +0000 UTC m=+773.819589848" lastFinishedPulling="2026-05-21 17:45:43.464789729 +0000 UTC m=+774.242162227" observedRunningTime="2026-05-21 17:45:44.530453803 +0000 UTC m=+775.307826305" watchObservedRunningTime="2026-05-21 17:45:44.53059998 +0000 UTC m=+775.307972481"
May 21 17:45:44.555515 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:45:44.555484    2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7d9b5dfd8-ss255"]
May 21 17:45:44.555743 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:45:44.555719    2563 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-7d9b5dfd8-ss255" podUID="a7e14ddb-bb5e-47a0-bf0c-8ad16091ab1a" containerName="authorino" containerID="cri-o://0aac0c18a31ffe3e681e1fcef4d3e0f8bd04394704bc43c2131ae9eff6adccce" gracePeriod=30
May 21 17:45:44.812144 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:45:44.812121    2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7d9b5dfd8-ss255"
May 21 17:45:44.946698 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:45:44.946663    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2s4zl\" (UniqueName: \"kubernetes.io/projected/a7e14ddb-bb5e-47a0-bf0c-8ad16091ab1a-kube-api-access-2s4zl\") pod \"a7e14ddb-bb5e-47a0-bf0c-8ad16091ab1a\" (UID: \"a7e14ddb-bb5e-47a0-bf0c-8ad16091ab1a\") "
May 21 17:45:44.946893 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:45:44.946736    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a7e14ddb-bb5e-47a0-bf0c-8ad16091ab1a-tls-cert\") pod \"a7e14ddb-bb5e-47a0-bf0c-8ad16091ab1a\" (UID: \"a7e14ddb-bb5e-47a0-bf0c-8ad16091ab1a\") "
May 21 17:45:44.948826 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:45:44.948793    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a7e14ddb-bb5e-47a0-bf0c-8ad16091ab1a-kube-api-access-2s4zl" (OuterVolumeSpecName: "kube-api-access-2s4zl") pod "a7e14ddb-bb5e-47a0-bf0c-8ad16091ab1a" (UID: "a7e14ddb-bb5e-47a0-bf0c-8ad16091ab1a"). InnerVolumeSpecName "kube-api-access-2s4zl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 17:45:44.957045 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:45:44.957016    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a7e14ddb-bb5e-47a0-bf0c-8ad16091ab1a-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "a7e14ddb-bb5e-47a0-bf0c-8ad16091ab1a" (UID: "a7e14ddb-bb5e-47a0-bf0c-8ad16091ab1a"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 21 17:45:45.047824 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:45:45.047750    2563 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a7e14ddb-bb5e-47a0-bf0c-8ad16091ab1a-tls-cert\") on node \"ip-10-0-140-106.ec2.internal\" DevicePath \"\""
May 21 17:45:45.047824 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:45:45.047784    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2s4zl\" (UniqueName: \"kubernetes.io/projected/a7e14ddb-bb5e-47a0-bf0c-8ad16091ab1a-kube-api-access-2s4zl\") on node \"ip-10-0-140-106.ec2.internal\" DevicePath \"\""
May 21 17:45:45.521861 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:45:45.521821    2563 generic.go:358] "Generic (PLEG): container finished" podID="a7e14ddb-bb5e-47a0-bf0c-8ad16091ab1a" containerID="0aac0c18a31ffe3e681e1fcef4d3e0f8bd04394704bc43c2131ae9eff6adccce" exitCode=0
May 21 17:45:45.521861 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:45:45.521863    2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7d9b5dfd8-ss255"
May 21 17:45:45.522364 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:45:45.521894    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7d9b5dfd8-ss255" event={"ID":"a7e14ddb-bb5e-47a0-bf0c-8ad16091ab1a","Type":"ContainerDied","Data":"0aac0c18a31ffe3e681e1fcef4d3e0f8bd04394704bc43c2131ae9eff6adccce"}
May 21 17:45:45.522364 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:45:45.521933    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7d9b5dfd8-ss255" event={"ID":"a7e14ddb-bb5e-47a0-bf0c-8ad16091ab1a","Type":"ContainerDied","Data":"b5145f0508591eb69e68605eba7a442f65f9b2a4e067a9435c633a29574abdba"}
May 21 17:45:45.522364 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:45:45.521948    2563 scope.go:117] "RemoveContainer" containerID="0aac0c18a31ffe3e681e1fcef4d3e0f8bd04394704bc43c2131ae9eff6adccce"
May 21 17:45:45.532212 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:45:45.532195    2563 scope.go:117] "RemoveContainer" containerID="0aac0c18a31ffe3e681e1fcef4d3e0f8bd04394704bc43c2131ae9eff6adccce"
May 21 17:45:45.532480 ip-10-0-140-106 kubenswrapper[2563]: E0521 17:45:45.532460    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0aac0c18a31ffe3e681e1fcef4d3e0f8bd04394704bc43c2131ae9eff6adccce\": container with ID starting with 0aac0c18a31ffe3e681e1fcef4d3e0f8bd04394704bc43c2131ae9eff6adccce not found: ID does not exist" containerID="0aac0c18a31ffe3e681e1fcef4d3e0f8bd04394704bc43c2131ae9eff6adccce"
May 21 17:45:45.532527 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:45:45.532489    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0aac0c18a31ffe3e681e1fcef4d3e0f8bd04394704bc43c2131ae9eff6adccce"} err="failed to get container status \"0aac0c18a31ffe3e681e1fcef4d3e0f8bd04394704bc43c2131ae9eff6adccce\": rpc error: code = NotFound desc = could not find container \"0aac0c18a31ffe3e681e1fcef4d3e0f8bd04394704bc43c2131ae9eff6adccce\": container with ID starting with 0aac0c18a31ffe3e681e1fcef4d3e0f8bd04394704bc43c2131ae9eff6adccce not found: ID does not exist"
May 21 17:45:45.546469 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:45:45.546443    2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7d9b5dfd8-ss255"]
May 21 17:45:45.559216 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:45:45.559188    2563 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7d9b5dfd8-ss255"]
May 21 17:45:45.804297 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:45:45.804216    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a7e14ddb-bb5e-47a0-bf0c-8ad16091ab1a" path="/var/lib/kubelet/pods/a7e14ddb-bb5e-47a0-bf0c-8ad16091ab1a/volumes"
May 21 17:45:53.822910 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:45:53.822874    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-7f849f6b56-2vxf8"]
May 21 17:45:53.823448 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:45:53.823427    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a7e14ddb-bb5e-47a0-bf0c-8ad16091ab1a" containerName="authorino"
May 21 17:45:53.823543 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:45:53.823451    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7e14ddb-bb5e-47a0-bf0c-8ad16091ab1a" containerName="authorino"
May 21 17:45:53.823600 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:45:53.823575    2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="a7e14ddb-bb5e-47a0-bf0c-8ad16091ab1a" containerName="authorino"
May 21 17:45:53.826591 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:45:53.826568    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-2vxf8"
May 21 17:45:53.828755 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:45:53.828735    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
May 21 17:45:53.833504 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:45:53.833476    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-7f849f6b56-2vxf8"]
May 21 17:45:53.925564 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:45:53.925534    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lhz7g\" (UniqueName: \"kubernetes.io/projected/02305d55-9939-453a-9e16-d9f76e9fb0d1-kube-api-access-lhz7g\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-2vxf8\" (UID: \"02305d55-9939-453a-9e16-d9f76e9fb0d1\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-2vxf8"
May 21 17:45:53.925722 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:45:53.925585    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/02305d55-9939-453a-9e16-d9f76e9fb0d1-dshm\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-2vxf8\" (UID: \"02305d55-9939-453a-9e16-d9f76e9fb0d1\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-2vxf8"
May 21 17:45:53.925722 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:45:53.925665    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/02305d55-9939-453a-9e16-d9f76e9fb0d1-model-cache\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-2vxf8\" (UID: \"02305d55-9939-453a-9e16-d9f76e9fb0d1\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-2vxf8"
May 21 17:45:53.925722 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:45:53.925714    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/02305d55-9939-453a-9e16-d9f76e9fb0d1-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-2vxf8\" (UID: \"02305d55-9939-453a-9e16-d9f76e9fb0d1\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-2vxf8"
May 21 17:45:53.925829 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:45:53.925789    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/02305d55-9939-453a-9e16-d9f76e9fb0d1-home\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-2vxf8\" (UID: \"02305d55-9939-453a-9e16-d9f76e9fb0d1\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-2vxf8"
May 21 17:45:53.925829 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:45:53.925810    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/02305d55-9939-453a-9e16-d9f76e9fb0d1-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-2vxf8\" (UID: \"02305d55-9939-453a-9e16-d9f76e9fb0d1\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-2vxf8"
May 21 17:45:54.026561 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:45:54.026532    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/02305d55-9939-453a-9e16-d9f76e9fb0d1-home\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-2vxf8\" (UID: \"02305d55-9939-453a-9e16-d9f76e9fb0d1\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-2vxf8"
May 21 17:45:54.026561 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:45:54.026565    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/02305d55-9939-453a-9e16-d9f76e9fb0d1-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-2vxf8\" (UID: \"02305d55-9939-453a-9e16-d9f76e9fb0d1\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-2vxf8"
May 21 17:45:54.026802 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:45:54.026595    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lhz7g\" (UniqueName: \"kubernetes.io/projected/02305d55-9939-453a-9e16-d9f76e9fb0d1-kube-api-access-lhz7g\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-2vxf8\" (UID: \"02305d55-9939-453a-9e16-d9f76e9fb0d1\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-2vxf8"
May 21 17:45:54.026802 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:45:54.026631    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/02305d55-9939-453a-9e16-d9f76e9fb0d1-dshm\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-2vxf8\" (UID: \"02305d55-9939-453a-9e16-d9f76e9fb0d1\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-2vxf8"
May 21 17:45:54.026802 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:45:54.026739    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/02305d55-9939-453a-9e16-d9f76e9fb0d1-model-cache\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-2vxf8\" (UID: \"02305d55-9939-453a-9e16-d9f76e9fb0d1\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-2vxf8"
May 21 17:45:54.026802 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:45:54.026798    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/02305d55-9939-453a-9e16-d9f76e9fb0d1-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-2vxf8\" (UID: \"02305d55-9939-453a-9e16-d9f76e9fb0d1\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-2vxf8"
May 21 17:45:54.027022 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:45:54.026963    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/02305d55-9939-453a-9e16-d9f76e9fb0d1-home\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-2vxf8\" (UID: \"02305d55-9939-453a-9e16-d9f76e9fb0d1\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-2vxf8"
May 21 17:45:54.027110 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:45:54.027026    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/02305d55-9939-453a-9e16-d9f76e9fb0d1-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-2vxf8\" (UID: \"02305d55-9939-453a-9e16-d9f76e9fb0d1\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-2vxf8"
May 21 17:45:54.027179 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:45:54.027116    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/02305d55-9939-453a-9e16-d9f76e9fb0d1-model-cache\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-2vxf8\" (UID: \"02305d55-9939-453a-9e16-d9f76e9fb0d1\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-2vxf8"
May 21 17:45:54.028980 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:45:54.028955    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/02305d55-9939-453a-9e16-d9f76e9fb0d1-dshm\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-2vxf8\" (UID: \"02305d55-9939-453a-9e16-d9f76e9fb0d1\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-2vxf8"
May 21 17:45:54.029145 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:45:54.029127    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/02305d55-9939-453a-9e16-d9f76e9fb0d1-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-2vxf8\" (UID: \"02305d55-9939-453a-9e16-d9f76e9fb0d1\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-2vxf8"
May 21 17:45:54.033605 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:45:54.033587    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lhz7g\" (UniqueName: \"kubernetes.io/projected/02305d55-9939-453a-9e16-d9f76e9fb0d1-kube-api-access-lhz7g\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-2vxf8\" (UID: \"02305d55-9939-453a-9e16-d9f76e9fb0d1\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-2vxf8"
May 21 17:45:54.138074 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:45:54.138029    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-2vxf8"
May 21 17:45:54.272842 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:45:54.272731    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-7f849f6b56-2vxf8"]
May 21 17:45:54.275182 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:45:54.275155    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02305d55_9939_453a_9e16_d9f76e9fb0d1.slice/crio-d9ae8e7107d8ff2b1b20cdf8e9dffb0b86bf77ced9d9230ab1041440ef4ce60a WatchSource:0}: Error finding container d9ae8e7107d8ff2b1b20cdf8e9dffb0b86bf77ced9d9230ab1041440ef4ce60a: Status 404 returned error can't find the container with id d9ae8e7107d8ff2b1b20cdf8e9dffb0b86bf77ced9d9230ab1041440ef4ce60a
May 21 17:45:54.556709 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:45:54.556628    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-2vxf8" event={"ID":"02305d55-9939-453a-9e16-d9f76e9fb0d1","Type":"ContainerStarted","Data":"6d1de2a316fcbd8129515b97f658626caf24cf7897de6ecfac616d654bfc5eca"}
May 21 17:45:54.556709 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:45:54.556674    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-2vxf8" event={"ID":"02305d55-9939-453a-9e16-d9f76e9fb0d1","Type":"ContainerStarted","Data":"d9ae8e7107d8ff2b1b20cdf8e9dffb0b86bf77ced9d9230ab1041440ef4ce60a"}
May 21 17:45:59.576613 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:45:59.576584    2563 generic.go:358] "Generic (PLEG): container finished" podID="02305d55-9939-453a-9e16-d9f76e9fb0d1" containerID="6d1de2a316fcbd8129515b97f658626caf24cf7897de6ecfac616d654bfc5eca" exitCode=0
May 21 17:45:59.576961 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:45:59.576656    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-2vxf8" event={"ID":"02305d55-9939-453a-9e16-d9f76e9fb0d1","Type":"ContainerDied","Data":"6d1de2a316fcbd8129515b97f658626caf24cf7897de6ecfac616d654bfc5eca"}
May 21 17:46:00.581205 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:46:00.581169    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-2vxf8" event={"ID":"02305d55-9939-453a-9e16-d9f76e9fb0d1","Type":"ContainerStarted","Data":"6dbe481fe910949b3bba6c6ae2171b2b4ecc84910be4b3ed01589262147f048b"}
May 21 17:46:00.581661 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:46:00.581394    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-2vxf8"
May 21 17:46:00.599846 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:46:00.599801    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-2vxf8" podStartSLOduration=7.281874257 podStartE2EDuration="7.599790734s" podCreationTimestamp="2026-05-21 17:45:53 +0000 UTC" firstStartedPulling="2026-05-21 17:45:59.577278101 +0000 UTC m=+790.354650582" lastFinishedPulling="2026-05-21 17:45:59.895194562 +0000 UTC m=+790.672567059" observedRunningTime="2026-05-21 17:46:00.597548549 +0000 UTC m=+791.374921054" watchObservedRunningTime="2026-05-21 17:46:00.599790734 +0000 UTC m=+791.377163237"
May 21 17:46:11.597309 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:46:11.597279    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-2vxf8"
May 21 17:57:25.608978 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:57:25.608949    2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-rgp78"]
May 21 17:57:25.610417 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:57:25.609189    2563 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-rgp78" podUID="b486acd6-f6dd-4be2-9df3-d6bb72219d68" containerName="manager" containerID="cri-o://9177b0a4f69ee412bb6ec92408007c568e23016b491e8878f7429c6fb713956a" gracePeriod=10
May 21 17:57:26.669364 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:57:26.669337    2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-rgp78"
May 21 17:57:26.826104 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:57:26.825994    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7qzgr\" (UniqueName: \"kubernetes.io/projected/b486acd6-f6dd-4be2-9df3-d6bb72219d68-kube-api-access-7qzgr\") pod \"b486acd6-f6dd-4be2-9df3-d6bb72219d68\" (UID: \"b486acd6-f6dd-4be2-9df3-d6bb72219d68\") "
May 21 17:57:26.826104 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:57:26.826053    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b486acd6-f6dd-4be2-9df3-d6bb72219d68-extensions-socket-volume\") pod \"b486acd6-f6dd-4be2-9df3-d6bb72219d68\" (UID: \"b486acd6-f6dd-4be2-9df3-d6bb72219d68\") "
May 21 17:57:26.826446 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:57:26.826423    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b486acd6-f6dd-4be2-9df3-d6bb72219d68-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "b486acd6-f6dd-4be2-9df3-d6bb72219d68" (UID: "b486acd6-f6dd-4be2-9df3-d6bb72219d68"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 21 17:57:26.827990 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:57:26.827968    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b486acd6-f6dd-4be2-9df3-d6bb72219d68-kube-api-access-7qzgr" (OuterVolumeSpecName: "kube-api-access-7qzgr") pod "b486acd6-f6dd-4be2-9df3-d6bb72219d68" (UID: "b486acd6-f6dd-4be2-9df3-d6bb72219d68"). InnerVolumeSpecName "kube-api-access-7qzgr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 17:57:26.927315 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:57:26.927282    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7qzgr\" (UniqueName: \"kubernetes.io/projected/b486acd6-f6dd-4be2-9df3-d6bb72219d68-kube-api-access-7qzgr\") on node \"ip-10-0-140-106.ec2.internal\" DevicePath \"\""
May 21 17:57:26.927315 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:57:26.927313    2563 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b486acd6-f6dd-4be2-9df3-d6bb72219d68-extensions-socket-volume\") on node \"ip-10-0-140-106.ec2.internal\" DevicePath \"\""
May 21 17:57:27.001450 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:57:27.001420    2563 generic.go:358] "Generic (PLEG): container finished" podID="b486acd6-f6dd-4be2-9df3-d6bb72219d68" containerID="9177b0a4f69ee412bb6ec92408007c568e23016b491e8878f7429c6fb713956a" exitCode=0
May 21 17:57:27.001592 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:57:27.001474    2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-rgp78"
May 21 17:57:27.001592 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:57:27.001511    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-rgp78" event={"ID":"b486acd6-f6dd-4be2-9df3-d6bb72219d68","Type":"ContainerDied","Data":"9177b0a4f69ee412bb6ec92408007c568e23016b491e8878f7429c6fb713956a"}
May 21 17:57:27.001592 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:57:27.001558    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-rgp78" event={"ID":"b486acd6-f6dd-4be2-9df3-d6bb72219d68","Type":"ContainerDied","Data":"9a4ced62713acaaaf8dc03be5032339709227b70b2795fec36a413ad904cc65f"}
May 21 17:57:27.001592 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:57:27.001577    2563 scope.go:117] "RemoveContainer" containerID="9177b0a4f69ee412bb6ec92408007c568e23016b491e8878f7429c6fb713956a"
May 21 17:57:27.010587 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:57:27.010570    2563 scope.go:117] "RemoveContainer" containerID="9177b0a4f69ee412bb6ec92408007c568e23016b491e8878f7429c6fb713956a"
May 21 17:57:27.010814 ip-10-0-140-106 kubenswrapper[2563]: E0521 17:57:27.010796    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9177b0a4f69ee412bb6ec92408007c568e23016b491e8878f7429c6fb713956a\": container with ID starting with 9177b0a4f69ee412bb6ec92408007c568e23016b491e8878f7429c6fb713956a not found: ID does not exist" containerID="9177b0a4f69ee412bb6ec92408007c568e23016b491e8878f7429c6fb713956a"
May 21 17:57:27.010854 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:57:27.010823    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9177b0a4f69ee412bb6ec92408007c568e23016b491e8878f7429c6fb713956a"} err="failed to get container status \"9177b0a4f69ee412bb6ec92408007c568e23016b491e8878f7429c6fb713956a\": rpc error: code = NotFound desc = could not find container \"9177b0a4f69ee412bb6ec92408007c568e23016b491e8878f7429c6fb713956a\": container with ID starting with 9177b0a4f69ee412bb6ec92408007c568e23016b491e8878f7429c6fb713956a not found: ID does not exist"
May 21 17:57:27.021584 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:57:27.021562    2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-rgp78"]
May 21 17:57:27.026129 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:57:27.026108    2563 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-rgp78"]
May 21 17:57:27.804238 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:57:27.804200    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b486acd6-f6dd-4be2-9df3-d6bb72219d68" path="/var/lib/kubelet/pods/b486acd6-f6dd-4be2-9df3-d6bb72219d68/volumes"
May 21 17:58:31.746122 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:58:31.746032    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-6n56p"]
May 21 17:58:31.746574 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:58:31.746428    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b486acd6-f6dd-4be2-9df3-d6bb72219d68" containerName="manager"
May 21 17:58:31.746574 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:58:31.746440    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="b486acd6-f6dd-4be2-9df3-d6bb72219d68" containerName="manager"
May 21 17:58:31.746574 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:58:31.746497    2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="b486acd6-f6dd-4be2-9df3-d6bb72219d68" containerName="manager"
May 21 17:58:31.749431 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:58:31.749414    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-6n56p"
May 21 17:58:31.751757 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:58:31.751736    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-s49l4\""
May 21 17:58:31.760468 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:58:31.760444    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-6n56p"]
May 21 17:58:31.866570 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:58:31.866545    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wmnsq\" (UniqueName: \"kubernetes.io/projected/38c9d41b-8b67-4945-89ac-311fe2fc2031-kube-api-access-wmnsq\") pod \"kuadrant-operator-controller-manager-55c7f4c975-6n56p\" (UID: \"38c9d41b-8b67-4945-89ac-311fe2fc2031\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-6n56p"
May 21 17:58:31.866670 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:58:31.866627    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/38c9d41b-8b67-4945-89ac-311fe2fc2031-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-6n56p\" (UID: \"38c9d41b-8b67-4945-89ac-311fe2fc2031\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-6n56p"
May 21 17:58:31.967881 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:58:31.967855    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wmnsq\" (UniqueName: \"kubernetes.io/projected/38c9d41b-8b67-4945-89ac-311fe2fc2031-kube-api-access-wmnsq\") pod \"kuadrant-operator-controller-manager-55c7f4c975-6n56p\" (UID: \"38c9d41b-8b67-4945-89ac-311fe2fc2031\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-6n56p"
May 21 17:58:31.968012 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:58:31.967953    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/38c9d41b-8b67-4945-89ac-311fe2fc2031-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-6n56p\" (UID: \"38c9d41b-8b67-4945-89ac-311fe2fc2031\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-6n56p"
May 21 17:58:31.968338 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:58:31.968318    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/38c9d41b-8b67-4945-89ac-311fe2fc2031-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-6n56p\" (UID: \"38c9d41b-8b67-4945-89ac-311fe2fc2031\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-6n56p"
May 21 17:58:31.978238 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:58:31.978218    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wmnsq\" (UniqueName: \"kubernetes.io/projected/38c9d41b-8b67-4945-89ac-311fe2fc2031-kube-api-access-wmnsq\") pod \"kuadrant-operator-controller-manager-55c7f4c975-6n56p\" (UID: \"38c9d41b-8b67-4945-89ac-311fe2fc2031\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-6n56p"
May 21 17:58:32.060215 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:58:32.060153    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-6n56p"
May 21 17:58:32.190540 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:58:32.190517    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-6n56p"]
May 21 17:58:32.193192 ip-10-0-140-106 kubenswrapper[2563]: W0521 17:58:32.193163    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38c9d41b_8b67_4945_89ac_311fe2fc2031.slice/crio-9302fd3cedf69bceaa81162b605b3af19df254a62fbd282031797f62dd58a8d5 WatchSource:0}: Error finding container 9302fd3cedf69bceaa81162b605b3af19df254a62fbd282031797f62dd58a8d5: Status 404 returned error can't find the container with id 9302fd3cedf69bceaa81162b605b3af19df254a62fbd282031797f62dd58a8d5
May 21 17:58:32.195615 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:58:32.195598    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 21 17:58:32.241925 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:58:32.241899    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-6n56p" event={"ID":"38c9d41b-8b67-4945-89ac-311fe2fc2031","Type":"ContainerStarted","Data":"9302fd3cedf69bceaa81162b605b3af19df254a62fbd282031797f62dd58a8d5"}
May 21 17:58:33.246650 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:58:33.246611    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-6n56p" event={"ID":"38c9d41b-8b67-4945-89ac-311fe2fc2031","Type":"ContainerStarted","Data":"d5e7ea089f2e0daf10fc6d6afcdd4bd9c3f5497f7443162b15aca863c0ce3c9d"}
May 21 17:58:33.247144 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:58:33.246779    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-6n56p"
May 21 17:58:33.267014 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:58:33.266963    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-6n56p" podStartSLOduration=2.266948775 podStartE2EDuration="2.266948775s" podCreationTimestamp="2026-05-21 17:58:31 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 17:58:33.264209443 +0000 UTC m=+1544.041581946" watchObservedRunningTime="2026-05-21 17:58:33.266948775 +0000 UTC m=+1544.044321341"
May 21 17:58:44.252667 ip-10-0-140-106 kubenswrapper[2563]: I0521 17:58:44.252637    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-6n56p"
May 21 18:08:15.399133 ip-10-0-140-106 kubenswrapper[2563]: I0521 18:08:15.399102    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-c75994d4f-vjdjs_72ea8e34-196f-4bd4-bd32-2168a8ae81e5/authorino/0.log"
May 21 18:08:20.854335 ip-10-0-140-106 kubenswrapper[2563]: I0521 18:08:20.854296    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7c9cddc7dd-gmszx_df3f6149-6a6e-48a7-9f97-2126e1220bf5/manager/0.log"
May 21 18:08:22.354162 ip-10-0-140-106 kubenswrapper[2563]: I0521 18:08:22.354121    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-c75994d4f-vjdjs_72ea8e34-196f-4bd4-bd32-2168a8ae81e5/authorino/0.log"
May 21 18:08:22.805626 ip-10-0-140-106 kubenswrapper[2563]: I0521 18:08:22.805544    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-jmm9w_a6c2cfa5-3393-4fb2-99b4-f9f1bcf4fe57/registry-server/0.log"
May 21 18:08:22.941671 ip-10-0-140-106 kubenswrapper[2563]: I0521 18:08:22.941623    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-55c7f4c975-6n56p_38c9d41b-8b67-4945-89ac-311fe2fc2031/manager/0.log"
May 21 18:08:23.178936 ip-10-0-140-106 kubenswrapper[2563]: I0521 18:08:23.178905    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-85c4996f8c-rxhj7_8468f633-7898-4ed2-9ce9-a6252e166d86/manager/0.log"
May 21 18:08:23.523311 ip-10-0-140-106 kubenswrapper[2563]: I0521 18:08:23.523231    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-595b7776f8h2vbp_81133154-cc24-4c8e-b545-9438b809628d/istio-proxy/0.log"
May 21 18:08:24.258930 ip-10-0-140-106 kubenswrapper[2563]: I0521 18:08:24.258899    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5cf9c7f8d-ggtn8_e3134993-804a-42f3-9f38-67aec00d2b8d/router/0.log"
May 21 18:08:24.610761 ip-10-0-140-106 kubenswrapper[2563]: I0521 18:08:24.610725    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-7f849f6b56-2vxf8_02305d55-9939-453a-9e16-d9f76e9fb0d1/main/0.log"
May 21 18:08:24.616476 ip-10-0-140-106 kubenswrapper[2563]: I0521 18:08:24.616450    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-7f849f6b56-2vxf8_02305d55-9939-453a-9e16-d9f76e9fb0d1/storage-initializer/0.log"
May 21 18:08:24.853047 ip-10-0-140-106 kubenswrapper[2563]: I0521 18:08:24.853015    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-84db68679b-skzpk_54d6abda-e24c-4765-8e5f-d29f8a8cddc9/main/0.log"
May 21 18:08:24.859169 ip-10-0-140-106 kubenswrapper[2563]: I0521 18:08:24.859140    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-84db68679b-skzpk_54d6abda-e24c-4765-8e5f-d29f8a8cddc9/storage-initializer/0.log"
May 21 18:08:29.451374 ip-10-0-140-106 kubenswrapper[2563]: I0521 18:08:29.451286    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-n5jnr/must-gather-grjq7"]
May 21 18:08:29.454912 ip-10-0-140-106 kubenswrapper[2563]: I0521 18:08:29.454892    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-n5jnr/must-gather-grjq7"
May 21 18:08:29.458646 ip-10-0-140-106 kubenswrapper[2563]: I0521 18:08:29.458622    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-n5jnr\"/\"default-dockercfg-j7btw\""
May 21 18:08:29.459638 ip-10-0-140-106 kubenswrapper[2563]: I0521 18:08:29.459618    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-n5jnr\"/\"kube-root-ca.crt\""
May 21 18:08:29.460207 ip-10-0-140-106 kubenswrapper[2563]: I0521 18:08:29.460192    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-n5jnr\"/\"openshift-service-ca.crt\""
May 21 18:08:29.478115 ip-10-0-140-106 kubenswrapper[2563]: I0521 18:08:29.478091    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-n5jnr/must-gather-grjq7"]
May 21 18:08:29.573655 ip-10-0-140-106 kubenswrapper[2563]: I0521 18:08:29.573627    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2bbz7\" (UniqueName: \"kubernetes.io/projected/9e6020c7-0d9a-4b97-8eec-5dca3f59da81-kube-api-access-2bbz7\") pod \"must-gather-grjq7\" (UID: \"9e6020c7-0d9a-4b97-8eec-5dca3f59da81\") " pod="openshift-must-gather-n5jnr/must-gather-grjq7"
May 21 18:08:29.573776 ip-10-0-140-106 kubenswrapper[2563]: I0521 18:08:29.573666    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/9e6020c7-0d9a-4b97-8eec-5dca3f59da81-must-gather-output\") pod \"must-gather-grjq7\" (UID: \"9e6020c7-0d9a-4b97-8eec-5dca3f59da81\") " pod="openshift-must-gather-n5jnr/must-gather-grjq7"
May 21 18:08:29.674162 ip-10-0-140-106 kubenswrapper[2563]: I0521 18:08:29.674137    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2bbz7\" (UniqueName: \"kubernetes.io/projected/9e6020c7-0d9a-4b97-8eec-5dca3f59da81-kube-api-access-2bbz7\") pod \"must-gather-grjq7\" (UID: \"9e6020c7-0d9a-4b97-8eec-5dca3f59da81\") " pod="openshift-must-gather-n5jnr/must-gather-grjq7"
May 21 18:08:29.674276 ip-10-0-140-106 kubenswrapper[2563]: I0521 18:08:29.674169    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/9e6020c7-0d9a-4b97-8eec-5dca3f59da81-must-gather-output\") pod \"must-gather-grjq7\" (UID: \"9e6020c7-0d9a-4b97-8eec-5dca3f59da81\") " pod="openshift-must-gather-n5jnr/must-gather-grjq7"
May 21 18:08:29.674519 ip-10-0-140-106 kubenswrapper[2563]: I0521 18:08:29.674503    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/9e6020c7-0d9a-4b97-8eec-5dca3f59da81-must-gather-output\") pod \"must-gather-grjq7\" (UID: \"9e6020c7-0d9a-4b97-8eec-5dca3f59da81\") " pod="openshift-must-gather-n5jnr/must-gather-grjq7"
May 21 18:08:29.684144 ip-10-0-140-106 kubenswrapper[2563]: I0521 18:08:29.684117    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2bbz7\" (UniqueName: \"kubernetes.io/projected/9e6020c7-0d9a-4b97-8eec-5dca3f59da81-kube-api-access-2bbz7\") pod \"must-gather-grjq7\" (UID: \"9e6020c7-0d9a-4b97-8eec-5dca3f59da81\") " pod="openshift-must-gather-n5jnr/must-gather-grjq7"
May 21 18:08:29.764983 ip-10-0-140-106 kubenswrapper[2563]: I0521 18:08:29.764926    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-n5jnr/must-gather-grjq7"
May 21 18:08:29.931882 ip-10-0-140-106 kubenswrapper[2563]: I0521 18:08:29.931857    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-n5jnr/must-gather-grjq7"]
May 21 18:08:29.933969 ip-10-0-140-106 kubenswrapper[2563]: W0521 18:08:29.933944    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9e6020c7_0d9a_4b97_8eec_5dca3f59da81.slice/crio-8db33a5a7336123d09781839534d3cdafa0ca73980177699a72ac5bf2ea758e5 WatchSource:0}: Error finding container 8db33a5a7336123d09781839534d3cdafa0ca73980177699a72ac5bf2ea758e5: Status 404 returned error can't find the container with id 8db33a5a7336123d09781839534d3cdafa0ca73980177699a72ac5bf2ea758e5
May 21 18:08:29.935916 ip-10-0-140-106 kubenswrapper[2563]: I0521 18:08:29.935897    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 21 18:08:30.350572 ip-10-0-140-106 kubenswrapper[2563]: I0521 18:08:30.350527    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-n5jnr/must-gather-grjq7" event={"ID":"9e6020c7-0d9a-4b97-8eec-5dca3f59da81","Type":"ContainerStarted","Data":"8db33a5a7336123d09781839534d3cdafa0ca73980177699a72ac5bf2ea758e5"}
May 21 18:08:31.357356 ip-10-0-140-106 kubenswrapper[2563]: I0521 18:08:31.357317    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-n5jnr/must-gather-grjq7" event={"ID":"9e6020c7-0d9a-4b97-8eec-5dca3f59da81","Type":"ContainerStarted","Data":"c7ba7de5886fa9701906b0ac158f2955e69a1c984d5e3b068d22841e149a7570"}
May 21 18:08:31.357764 ip-10-0-140-106 kubenswrapper[2563]: I0521 18:08:31.357365    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-n5jnr/must-gather-grjq7" event={"ID":"9e6020c7-0d9a-4b97-8eec-5dca3f59da81","Type":"ContainerStarted","Data":"abebd1cdbb676da5e79490f3d59339d12b2854ba9ba4695a3bc6117dd993f8e6"}
May 21 18:08:31.374456 ip-10-0-140-106 kubenswrapper[2563]: I0521 18:08:31.374400    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-n5jnr/must-gather-grjq7" podStartSLOduration=1.5600425900000001 podStartE2EDuration="2.374381552s" podCreationTimestamp="2026-05-21 18:08:29 +0000 UTC" firstStartedPulling="2026-05-21 18:08:29.936123969 +0000 UTC m=+2140.713496465" lastFinishedPulling="2026-05-21 18:08:30.750462939 +0000 UTC m=+2141.527835427" observedRunningTime="2026-05-21 18:08:31.373040333 +0000 UTC m=+2142.150412838" watchObservedRunningTime="2026-05-21 18:08:31.374381552 +0000 UTC m=+2142.151754059"
May 21 18:08:32.415442 ip-10-0-140-106 kubenswrapper[2563]: I0521 18:08:32.415396    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-svpcm_7caa70cf-485d-48b5-b027-70b17c9832f6/global-pull-secret-syncer/0.log"
May 21 18:08:32.476824 ip-10-0-140-106 kubenswrapper[2563]: I0521 18:08:32.476789    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-mjdmf_cda57dfb-738d-462c-98d6-f8f03db1d69d/konnectivity-agent/0.log"
May 21 18:08:32.613829 ip-10-0-140-106 kubenswrapper[2563]: I0521 18:08:32.613792    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-140-106.ec2.internal_0842e044b1618ebb8b3bbc536a394d83/haproxy/0.log"
May 21 18:08:36.527698 ip-10-0-140-106 kubenswrapper[2563]: I0521 18:08:36.527587    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-c75994d4f-vjdjs_72ea8e34-196f-4bd4-bd32-2168a8ae81e5/authorino/0.log"
May 21 18:08:36.678729 ip-10-0-140-106 kubenswrapper[2563]: I0521 18:08:36.678697    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-jmm9w_a6c2cfa5-3393-4fb2-99b4-f9f1bcf4fe57/registry-server/0.log"
May 21 18:08:36.773252 ip-10-0-140-106 kubenswrapper[2563]: I0521 18:08:36.773225    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-55c7f4c975-6n56p_38c9d41b-8b67-4945-89ac-311fe2fc2031/manager/0.log"
May 21 18:08:36.938917 ip-10-0-140-106 kubenswrapper[2563]: I0521 18:08:36.938885    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-85c4996f8c-rxhj7_8468f633-7898-4ed2-9ce9-a6252e166d86/manager/0.log"
May 21 18:08:38.240481 ip-10-0-140-106 kubenswrapper[2563]: I0521 18:08:38.240448    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b3c1e30f-291e-437d-8861-f72a136fe01b/alertmanager/0.log"
May 21 18:08:38.268111 ip-10-0-140-106 kubenswrapper[2563]: I0521 18:08:38.268080    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b3c1e30f-291e-437d-8861-f72a136fe01b/config-reloader/0.log"
May 21 18:08:38.293943 ip-10-0-140-106 kubenswrapper[2563]: I0521 18:08:38.293900    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b3c1e30f-291e-437d-8861-f72a136fe01b/kube-rbac-proxy-web/0.log"
May 21 18:08:38.324674 ip-10-0-140-106 kubenswrapper[2563]: I0521 18:08:38.324634    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b3c1e30f-291e-437d-8861-f72a136fe01b/kube-rbac-proxy/0.log"
May 21 18:08:38.341812 ip-10-0-140-106 kubenswrapper[2563]: I0521 18:08:38.341783    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b3c1e30f-291e-437d-8861-f72a136fe01b/kube-rbac-proxy-metric/0.log"
May 21 18:08:38.370770 ip-10-0-140-106 kubenswrapper[2563]: I0521 18:08:38.370712    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b3c1e30f-291e-437d-8861-f72a136fe01b/prom-label-proxy/0.log"
May 21 18:08:38.399367 ip-10-0-140-106 kubenswrapper[2563]: I0521 18:08:38.399342    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b3c1e30f-291e-437d-8861-f72a136fe01b/init-config-reloader/0.log"
May 21 18:08:38.481893 ip-10-0-140-106 kubenswrapper[2563]: I0521 18:08:38.481861    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-5n24h_9090d3c1-ac89-44c4-891f-095f109a4d69/kube-state-metrics/0.log"
May 21 18:08:38.507982 ip-10-0-140-106 kubenswrapper[2563]: I0521 18:08:38.507910    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-5n24h_9090d3c1-ac89-44c4-891f-095f109a4d69/kube-rbac-proxy-main/0.log"
May 21 18:08:38.533997 ip-10-0-140-106 kubenswrapper[2563]: I0521 18:08:38.533973    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-5n24h_9090d3c1-ac89-44c4-891f-095f109a4d69/kube-rbac-proxy-self/0.log"
May 21 18:08:38.582604 ip-10-0-140-106 kubenswrapper[2563]: I0521 18:08:38.582579    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-7dbd559cb4-pwfnq_d44c6e19-a7a9-4a25-8253-7c83602a8b34/metrics-server/0.log"
May 21 18:08:38.801026 ip-10-0-140-106 kubenswrapper[2563]: I0521 18:08:38.800947    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-w2cbs_6ff60ab8-04c5-44d0-81da-2c8ae25e723b/node-exporter/0.log"
May 21 18:08:38.847706 ip-10-0-140-106 kubenswrapper[2563]: I0521 18:08:38.847677    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-w2cbs_6ff60ab8-04c5-44d0-81da-2c8ae25e723b/kube-rbac-proxy/0.log"
May 21 18:08:38.898448 ip-10-0-140-106 kubenswrapper[2563]: I0521 18:08:38.898422    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-w2cbs_6ff60ab8-04c5-44d0-81da-2c8ae25e723b/init-textfile/0.log"
May 21 18:08:39.690752 ip-10-0-140-106 kubenswrapper[2563]: I0521 18:08:39.690725    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-6c4bbc67b7-xgg2n_d31013c7-826d-4686-be6b-c03c1b81d08f/prometheus-operator-admission-webhook/0.log"
May 21 18:08:39.757894 ip-10-0-140-106 kubenswrapper[2563]: I0521 18:08:39.757859    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-66f56f8799-gj2nb_9b032f78-144d-4340-8f80-f622ddea0ba9/telemeter-client/0.log"
May 21 18:08:39.810359 ip-10-0-140-106 kubenswrapper[2563]: I0521 18:08:39.810331    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-66f56f8799-gj2nb_9b032f78-144d-4340-8f80-f622ddea0ba9/reload/0.log"
May 21 18:08:39.857748 ip-10-0-140-106 kubenswrapper[2563]: I0521 18:08:39.857704    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-66f56f8799-gj2nb_9b032f78-144d-4340-8f80-f622ddea0ba9/kube-rbac-proxy/0.log"
May 21 18:08:41.034871 ip-10-0-140-106 kubenswrapper[2563]: I0521 18:08:41.034837    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-n5jnr/perf-node-gather-daemonset-gz55l"]
May 21 18:08:41.040484 ip-10-0-140-106 kubenswrapper[2563]: I0521 18:08:41.040460    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-n5jnr/perf-node-gather-daemonset-gz55l"
May 21 18:08:41.054239 ip-10-0-140-106 kubenswrapper[2563]: I0521 18:08:41.054212    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-n5jnr/perf-node-gather-daemonset-gz55l"]
May 21 18:08:41.096918 ip-10-0-140-106 kubenswrapper[2563]: I0521 18:08:41.096887    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5qshd\" (UniqueName: \"kubernetes.io/projected/ed6cf52f-9481-441a-b3c4-37eaafe6cfc9-kube-api-access-5qshd\") pod \"perf-node-gather-daemonset-gz55l\" (UID: \"ed6cf52f-9481-441a-b3c4-37eaafe6cfc9\") " pod="openshift-must-gather-n5jnr/perf-node-gather-daemonset-gz55l"
May 21 18:08:41.097137 ip-10-0-140-106 kubenswrapper[2563]: I0521 18:08:41.096927    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ed6cf52f-9481-441a-b3c4-37eaafe6cfc9-podres\") pod \"perf-node-gather-daemonset-gz55l\" (UID: \"ed6cf52f-9481-441a-b3c4-37eaafe6cfc9\") " pod="openshift-must-gather-n5jnr/perf-node-gather-daemonset-gz55l"
May 21 18:08:41.097137 ip-10-0-140-106 kubenswrapper[2563]: I0521 18:08:41.096949    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ed6cf52f-9481-441a-b3c4-37eaafe6cfc9-lib-modules\") pod \"perf-node-gather-daemonset-gz55l\" (UID: \"ed6cf52f-9481-441a-b3c4-37eaafe6cfc9\") " pod="openshift-must-gather-n5jnr/perf-node-gather-daemonset-gz55l"
May 21 18:08:41.097137 ip-10-0-140-106 kubenswrapper[2563]: I0521 18:08:41.097047    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ed6cf52f-9481-441a-b3c4-37eaafe6cfc9-proc\") pod \"perf-node-gather-daemonset-gz55l\" (UID: \"ed6cf52f-9481-441a-b3c4-37eaafe6cfc9\") " pod="openshift-must-gather-n5jnr/perf-node-gather-daemonset-gz55l"
May 21 18:08:41.097137 ip-10-0-140-106 kubenswrapper[2563]: I0521 18:08:41.097090    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ed6cf52f-9481-441a-b3c4-37eaafe6cfc9-sys\") pod \"perf-node-gather-daemonset-gz55l\" (UID: \"ed6cf52f-9481-441a-b3c4-37eaafe6cfc9\") " pod="openshift-must-gather-n5jnr/perf-node-gather-daemonset-gz55l"
May 21 18:08:41.197705 ip-10-0-140-106 kubenswrapper[2563]: I0521 18:08:41.197663    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5qshd\" (UniqueName: \"kubernetes.io/projected/ed6cf52f-9481-441a-b3c4-37eaafe6cfc9-kube-api-access-5qshd\") pod \"perf-node-gather-daemonset-gz55l\" (UID: \"ed6cf52f-9481-441a-b3c4-37eaafe6cfc9\") " pod="openshift-must-gather-n5jnr/perf-node-gather-daemonset-gz55l"
May 21 18:08:41.197900 ip-10-0-140-106 kubenswrapper[2563]: I0521 18:08:41.197737    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ed6cf52f-9481-441a-b3c4-37eaafe6cfc9-podres\") pod \"perf-node-gather-daemonset-gz55l\" (UID: \"ed6cf52f-9481-441a-b3c4-37eaafe6cfc9\") " pod="openshift-must-gather-n5jnr/perf-node-gather-daemonset-gz55l"
May 21 18:08:41.197900 ip-10-0-140-106 kubenswrapper[2563]: I0521 18:08:41.197772    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ed6cf52f-9481-441a-b3c4-37eaafe6cfc9-lib-modules\") pod \"perf-node-gather-daemonset-gz55l\" (UID: \"ed6cf52f-9481-441a-b3c4-37eaafe6cfc9\") " pod="openshift-must-gather-n5jnr/perf-node-gather-daemonset-gz55l"
May 21 18:08:41.197900 ip-10-0-140-106 kubenswrapper[2563]: I0521 18:08:41.197860    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ed6cf52f-9481-441a-b3c4-37eaafe6cfc9-proc\") pod \"perf-node-gather-daemonset-gz55l\" (UID: \"ed6cf52f-9481-441a-b3c4-37eaafe6cfc9\") " pod="openshift-must-gather-n5jnr/perf-node-gather-daemonset-gz55l"
May 21 18:08:41.198082 ip-10-0-140-106 kubenswrapper[2563]: I0521 18:08:41.197902    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ed6cf52f-9481-441a-b3c4-37eaafe6cfc9-sys\") pod \"perf-node-gather-daemonset-gz55l\" (UID: \"ed6cf52f-9481-441a-b3c4-37eaafe6cfc9\") " pod="openshift-must-gather-n5jnr/perf-node-gather-daemonset-gz55l"
May 21 18:08:41.198082 ip-10-0-140-106 kubenswrapper[2563]: I0521 18:08:41.198044    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ed6cf52f-9481-441a-b3c4-37eaafe6cfc9-sys\") pod \"perf-node-gather-daemonset-gz55l\" (UID: \"ed6cf52f-9481-441a-b3c4-37eaafe6cfc9\") " pod="openshift-must-gather-n5jnr/perf-node-gather-daemonset-gz55l"
May 21 18:08:41.198477 ip-10-0-140-106 kubenswrapper[2563]: I0521 18:08:41.198448    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ed6cf52f-9481-441a-b3c4-37eaafe6cfc9-podres\") pod \"perf-node-gather-daemonset-gz55l\" (UID: \"ed6cf52f-9481-441a-b3c4-37eaafe6cfc9\") " pod="openshift-must-gather-n5jnr/perf-node-gather-daemonset-gz55l"
May 21 18:08:41.198588 ip-10-0-140-106 kubenswrapper[2563]: I0521 18:08:41.198548    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ed6cf52f-9481-441a-b3c4-37eaafe6cfc9-lib-modules\") pod \"perf-node-gather-daemonset-gz55l\" (UID: \"ed6cf52f-9481-441a-b3c4-37eaafe6cfc9\") " pod="openshift-must-gather-n5jnr/perf-node-gather-daemonset-gz55l"
May 21 18:08:41.198650 ip-10-0-140-106 kubenswrapper[2563]: I0521 18:08:41.198598    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ed6cf52f-9481-441a-b3c4-37eaafe6cfc9-proc\") pod \"perf-node-gather-daemonset-gz55l\" (UID: \"ed6cf52f-9481-441a-b3c4-37eaafe6cfc9\") " pod="openshift-must-gather-n5jnr/perf-node-gather-daemonset-gz55l"
May 21 18:08:41.208192 ip-10-0-140-106 kubenswrapper[2563]: I0521 18:08:41.208167    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5qshd\" (UniqueName: \"kubernetes.io/projected/ed6cf52f-9481-441a-b3c4-37eaafe6cfc9-kube-api-access-5qshd\") pod \"perf-node-gather-daemonset-gz55l\" (UID: \"ed6cf52f-9481-441a-b3c4-37eaafe6cfc9\") " pod="openshift-must-gather-n5jnr/perf-node-gather-daemonset-gz55l"
May 21 18:08:41.353492 ip-10-0-140-106 kubenswrapper[2563]: I0521 18:08:41.353456    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-n5jnr/perf-node-gather-daemonset-gz55l"
May 21 18:08:41.517243 ip-10-0-140-106 kubenswrapper[2563]: I0521 18:08:41.517205    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-n5jnr/perf-node-gather-daemonset-gz55l"]
May 21 18:08:41.521596 ip-10-0-140-106 kubenswrapper[2563]: W0521 18:08:41.521562    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-poded6cf52f_9481_441a_b3c4_37eaafe6cfc9.slice/crio-b4d111feebbd1be7ee9079382275b62042bc515d2f8385acbc0a01898073b739 WatchSource:0}: Error finding container b4d111feebbd1be7ee9079382275b62042bc515d2f8385acbc0a01898073b739: Status 404 returned error can't find the container with id b4d111feebbd1be7ee9079382275b62042bc515d2f8385acbc0a01898073b739
May 21 18:08:42.407383 ip-10-0-140-106 kubenswrapper[2563]: I0521 18:08:42.407355    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-797474c4f-qrmpj_89743e36-47ab-4ab9-a92e-94e7694e80d8/console/0.log"
May 21 18:08:42.434809 ip-10-0-140-106 kubenswrapper[2563]: I0521 18:08:42.434770    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-n5jnr/perf-node-gather-daemonset-gz55l" event={"ID":"ed6cf52f-9481-441a-b3c4-37eaafe6cfc9","Type":"ContainerStarted","Data":"ee59b5a6d4459c233b56e59fe1f9cc6cd2088463c0718a7055493265e2809d8b"}
May 21 18:08:42.434809 ip-10-0-140-106 kubenswrapper[2563]: I0521 18:08:42.434814    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-n5jnr/perf-node-gather-daemonset-gz55l" event={"ID":"ed6cf52f-9481-441a-b3c4-37eaafe6cfc9","Type":"ContainerStarted","Data":"b4d111feebbd1be7ee9079382275b62042bc515d2f8385acbc0a01898073b739"}
May 21 18:08:42.435104 ip-10-0-140-106 kubenswrapper[2563]: I0521 18:08:42.434840    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-n5jnr/perf-node-gather-daemonset-gz55l"
May 21 18:08:42.444608 ip-10-0-140-106 kubenswrapper[2563]: I0521 18:08:42.444577    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-57bd96b888-9t58z_2ac1cbe0-26ce-432e-930b-bddbf477662a/download-server/0.log"
May 21 18:08:42.451299 ip-10-0-140-106 kubenswrapper[2563]: I0521 18:08:42.451255    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-n5jnr/perf-node-gather-daemonset-gz55l" podStartSLOduration=1.451240873 podStartE2EDuration="1.451240873s" podCreationTimestamp="2026-05-21 18:08:41 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 18:08:42.450761391 +0000 UTC m=+2153.228133898" watchObservedRunningTime="2026-05-21 18:08:42.451240873 +0000 UTC m=+2153.228613377"
May 21 18:08:43.763515 ip-10-0-140-106 kubenswrapper[2563]: I0521 18:08:43.763483    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-xvxtt_958fb2fd-9a72-40c2-b659-e99b240176d1/dns/0.log"
May 21 18:08:43.785598 ip-10-0-140-106 kubenswrapper[2563]: I0521 18:08:43.785575    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-xvxtt_958fb2fd-9a72-40c2-b659-e99b240176d1/kube-rbac-proxy/0.log"
May 21 18:08:43.832586 ip-10-0-140-106 kubenswrapper[2563]: I0521 18:08:43.832549    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-9tfbv_c47ca98f-38f9-4d7d-bae8-b6e89f01fba1/dns-node-resolver/0.log"
May 21 18:08:44.327633 ip-10-0-140-106 kubenswrapper[2563]: I0521 18:08:44.327599    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-99d98f68d-lq66h_0fc0b33b-b75f-4e8c-9013-b4cb993741b8/registry/0.log"
May 21 18:08:44.399530 ip-10-0-140-106 kubenswrapper[2563]: I0521 18:08:44.399504    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wxdwr_f81b0bfa-3067-444d-9daf-734b247ab575/node-ca/0.log"
May 21 18:08:45.291634 ip-10-0-140-106 kubenswrapper[2563]: I0521 18:08:45.291603    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-595b7776f8h2vbp_81133154-cc24-4c8e-b545-9438b809628d/istio-proxy/0.log"
May 21 18:08:45.782690 ip-10-0-140-106 kubenswrapper[2563]: I0521 18:08:45.782664    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5cf9c7f8d-ggtn8_e3134993-804a-42f3-9f38-67aec00d2b8d/router/0.log"
May 21 18:08:46.385998 ip-10-0-140-106 kubenswrapper[2563]: I0521 18:08:46.385967    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-d75hh_d8721e69-80fd-48ad-ac87-8f44d8aa94c9/serve-healthcheck-canary/0.log"
May 21 18:08:46.975386 ip-10-0-140-106 kubenswrapper[2563]: I0521 18:08:46.975357    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-78bdfb888c-9zh59_079fa2fb-e0ca-4997-935e-d3aeba409ed2/insights-operator/0.log"
May 21 18:08:46.976086 ip-10-0-140-106 kubenswrapper[2563]: I0521 18:08:46.976041    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-78bdfb888c-9zh59_079fa2fb-e0ca-4997-935e-d3aeba409ed2/insights-operator/1.log"
May 21 18:08:47.001187 ip-10-0-140-106 kubenswrapper[2563]: I0521 18:08:47.001161    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-tw8qw_3f5d2a8f-d5b5-4fef-b3f5-c79f42570c4b/kube-rbac-proxy/0.log"
May 21 18:08:47.029438 ip-10-0-140-106 kubenswrapper[2563]: I0521 18:08:47.029416    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-tw8qw_3f5d2a8f-d5b5-4fef-b3f5-c79f42570c4b/exporter/0.log"
May 21 18:08:47.062614 ip-10-0-140-106 kubenswrapper[2563]: I0521 18:08:47.062593    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-tw8qw_3f5d2a8f-d5b5-4fef-b3f5-c79f42570c4b/extractor/0.log"
May 21 18:08:48.448205 ip-10-0-140-106 kubenswrapper[2563]: I0521 18:08:48.448178    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-n5jnr/perf-node-gather-daemonset-gz55l"
May 21 18:08:49.904422 ip-10-0-140-106 kubenswrapper[2563]: I0521 18:08:49.904382    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7c9cddc7dd-gmszx_df3f6149-6a6e-48a7-9f97-2126e1220bf5/manager/0.log"
May 21 18:08:51.328037 ip-10-0-140-106 kubenswrapper[2563]: I0521 18:08:51.327956    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-7f6d69ccc4-6qjtf_5374e30a-f948-445f-982c-ee319a879cd4/manager/0.log"
May 21 18:08:56.979421 ip-10-0-140-106 kubenswrapper[2563]: I0521 18:08:56.979386    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-565644f49-mhmcm_b7309693-1d8c-4edb-884a-6771748790d7/kube-storage-version-migrator-operator/1.log"
May 21 18:08:56.981110 ip-10-0-140-106 kubenswrapper[2563]: I0521 18:08:56.981080    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-565644f49-mhmcm_b7309693-1d8c-4edb-884a-6771748790d7/kube-storage-version-migrator-operator/0.log"
May 21 18:08:58.190204 ip-10-0-140-106 kubenswrapper[2563]: I0521 18:08:58.190159    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lwm7w_bbbebc0e-c07f-479d-add3-16a2e09e96f8/kube-multus-additional-cni-plugins/0.log"
May 21 18:08:58.214290 ip-10-0-140-106 kubenswrapper[2563]: I0521 18:08:58.214260    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lwm7w_bbbebc0e-c07f-479d-add3-16a2e09e96f8/egress-router-binary-copy/0.log"
May 21 18:08:58.236400 ip-10-0-140-106 kubenswrapper[2563]: I0521 18:08:58.236372    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lwm7w_bbbebc0e-c07f-479d-add3-16a2e09e96f8/cni-plugins/0.log"
May 21 18:08:58.262649 ip-10-0-140-106 kubenswrapper[2563]: I0521 18:08:58.262623    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lwm7w_bbbebc0e-c07f-479d-add3-16a2e09e96f8/bond-cni-plugin/0.log"