May 20 19:44:17.438872 ip-10-0-134-167 systemd[1]: Starting Kubernetes Kubelet...
May 20 19:44:17.851901 ip-10-0-134-167 kubenswrapper[2578]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 20 19:44:17.851901 ip-10-0-134-167 kubenswrapper[2578]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
May 20 19:44:17.851901 ip-10-0-134-167 kubenswrapper[2578]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 20 19:44:17.851901 ip-10-0-134-167 kubenswrapper[2578]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
May 20 19:44:17.851901 ip-10-0-134-167 kubenswrapper[2578]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 20 19:44:17.852550 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.851969    2578 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
May 20 19:44:17.856331 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.856314    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 20 19:44:17.856331 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.856330    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 20 19:44:17.856400 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.856334    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 20 19:44:17.856400 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.856337    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 20 19:44:17.856400 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.856340    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 20 19:44:17.856400 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.856343    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 20 19:44:17.856400 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.856346    2578 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 20 19:44:17.856400 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.856349    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 20 19:44:17.856400 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.856352    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
May 20 19:44:17.856400 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.856355    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 20 19:44:17.856400 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.856358    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 20 19:44:17.856400 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.856360    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 20 19:44:17.856400 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.856373    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 20 19:44:17.856400 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.856375    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 20 19:44:17.856400 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.856378    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 20 19:44:17.856400 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.856381    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 20 19:44:17.856400 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.856384    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 20 19:44:17.856400 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.856388    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 20 19:44:17.856400 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.856392    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 20 19:44:17.856400 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.856394    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 20 19:44:17.856400 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.856397    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 20 19:44:17.856861 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.856400    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 20 19:44:17.856861 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.856403    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 20 19:44:17.856861 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.856405    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 20 19:44:17.856861 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.856408    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 20 19:44:17.856861 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.856411    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 20 19:44:17.856861 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.856413    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 20 19:44:17.856861 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.856416    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 20 19:44:17.856861 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.856418    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 20 19:44:17.856861 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.856421    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 20 19:44:17.856861 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.856423    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 20 19:44:17.856861 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.856426    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 20 19:44:17.856861 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.856428    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 20 19:44:17.856861 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.856431    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 20 19:44:17.856861 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.856433    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 20 19:44:17.856861 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.856436    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 20 19:44:17.856861 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.856439    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 20 19:44:17.856861 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.856441    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 20 19:44:17.856861 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.856444    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 20 19:44:17.856861 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.856446    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 20 19:44:17.856861 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.856448    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 20 19:44:17.857372 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.856451    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 20 19:44:17.857372 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.856453    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 20 19:44:17.857372 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.856456    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 20 19:44:17.857372 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.856460    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 20 19:44:17.857372 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.856464    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 20 19:44:17.857372 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.856467    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 20 19:44:17.857372 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.856469    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 20 19:44:17.857372 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.856473    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 20 19:44:17.857372 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.856475    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 20 19:44:17.857372 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.856478    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 20 19:44:17.857372 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.856480    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 20 19:44:17.857372 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.856482    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 20 19:44:17.857372 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.856485    2578 feature_gate.go:328] unrecognized feature gate: Example2
May 20 19:44:17.857372 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.856488    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 20 19:44:17.857372 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.856491    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 20 19:44:17.857372 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.856493    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 20 19:44:17.857372 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.856496    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 20 19:44:17.857372 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.856499    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 20 19:44:17.857372 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.856501    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 20 19:44:17.857372 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.856504    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 20 19:44:17.857861 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.856506    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 20 19:44:17.857861 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.856509    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 20 19:44:17.857861 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.856511    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 20 19:44:17.857861 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.856514    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 20 19:44:17.857861 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.856516    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 20 19:44:17.857861 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.856519    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 20 19:44:17.857861 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.856521    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 20 19:44:17.857861 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.856524    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 20 19:44:17.857861 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.856526    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 20 19:44:17.857861 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.856528    2578 feature_gate.go:328] unrecognized feature gate: Example
May 20 19:44:17.857861 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.856531    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 20 19:44:17.857861 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.856534    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
May 20 19:44:17.857861 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.856537    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 20 19:44:17.857861 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.856539    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 20 19:44:17.857861 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.856542    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 20 19:44:17.857861 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.856545    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 20 19:44:17.857861 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.856547    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 20 19:44:17.857861 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.856551    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 20 19:44:17.857861 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.856553    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 20 19:44:17.857861 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.856556    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 20 19:44:17.858366 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.856559    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 20 19:44:17.858366 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.856562    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 20 19:44:17.858366 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.856564    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 20 19:44:17.858366 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.856567    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 20 19:44:17.858366 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.856569    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 20 19:44:17.858366 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.856998    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 20 19:44:17.858366 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.857004    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 20 19:44:17.858366 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.857008    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 20 19:44:17.858366 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.857012    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 20 19:44:17.858366 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.857016    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 20 19:44:17.858366 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.857019    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 20 19:44:17.858366 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.857022    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 20 19:44:17.858366 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.857025    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 20 19:44:17.858366 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.857028    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 20 19:44:17.858366 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.857031    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
May 20 19:44:17.858366 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.857033    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 20 19:44:17.858366 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.857036    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 20 19:44:17.858366 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.857038    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 20 19:44:17.858366 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.857041    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 20 19:44:17.858828 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.857043    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 20 19:44:17.858828 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.857046    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 20 19:44:17.858828 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.857048    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 20 19:44:17.858828 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.857051    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 20 19:44:17.858828 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.857053    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 20 19:44:17.858828 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.857056    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 20 19:44:17.858828 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.857059    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 20 19:44:17.858828 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.857061    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 20 19:44:17.858828 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.857064    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 20 19:44:17.858828 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.857067    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 20 19:44:17.858828 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.857070    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 20 19:44:17.858828 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.857072    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 20 19:44:17.858828 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.857075    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 20 19:44:17.858828 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.857077    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 20 19:44:17.858828 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.857080    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 20 19:44:17.858828 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.857082    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 20 19:44:17.858828 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.857085    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 20 19:44:17.858828 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.857087    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 20 19:44:17.858828 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.857090    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 20 19:44:17.859321 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.857093    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 20 19:44:17.859321 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.857095    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 20 19:44:17.859321 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.857098    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 20 19:44:17.859321 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.857102    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 20 19:44:17.859321 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.857104    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 20 19:44:17.859321 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.857107    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 20 19:44:17.859321 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.857109    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 20 19:44:17.859321 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.857112    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 20 19:44:17.859321 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.857114    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 20 19:44:17.859321 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.857117    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 20 19:44:17.859321 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.857119    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 20 19:44:17.859321 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.857122    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
May 20 19:44:17.859321 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.857124    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 20 19:44:17.859321 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.857127    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 20 19:44:17.859321 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.857130    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 20 19:44:17.859321 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.857132    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 20 19:44:17.859321 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.857135    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 20 19:44:17.859321 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.857137    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 20 19:44:17.859321 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.857140    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 20 19:44:17.859321 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.857142    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 20 19:44:17.859816 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.857146    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 20 19:44:17.859816 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.857150    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 20 19:44:17.859816 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.857153    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 20 19:44:17.859816 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.857156    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 20 19:44:17.859816 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.857158    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 20 19:44:17.859816 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.857161    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 20 19:44:17.859816 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.857163    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 20 19:44:17.859816 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.857166    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 20 19:44:17.859816 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.857168    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 20 19:44:17.859816 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.857171    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 20 19:44:17.859816 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.857173    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 20 19:44:17.859816 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.857176    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 20 19:44:17.859816 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.857179    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 20 19:44:17.859816 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.857183    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 20 19:44:17.859816 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.857185    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 20 19:44:17.859816 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.857188    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 20 19:44:17.859816 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.857190    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 20 19:44:17.859816 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.857192    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 20 19:44:17.859816 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.857195    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 20 19:44:17.860273 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.857197    2578 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 20 19:44:17.860273 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.857200    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 20 19:44:17.860273 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.857202    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 20 19:44:17.860273 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.857205    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 20 19:44:17.860273 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.857207    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 20 19:44:17.860273 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.857210    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 20 19:44:17.860273 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.857212    2578 feature_gate.go:328] unrecognized feature gate: Example
May 20 19:44:17.860273 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.857215    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 20 19:44:17.860273 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.857218    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 20 19:44:17.860273 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.857220    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 20 19:44:17.860273 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.857222    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 20 19:44:17.860273 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.857225    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 20 19:44:17.860273 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.857227    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 20 19:44:17.860273 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.857230    2578 feature_gate.go:328] unrecognized feature gate: Example2
May 20 19:44:17.860273 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.858437    2578 flags.go:64] FLAG: --address="0.0.0.0"
May 20 19:44:17.860273 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.858446    2578 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
May 20 19:44:17.860273 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.858454    2578 flags.go:64] FLAG: --anonymous-auth="true"
May 20 19:44:17.860273 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.858459    2578 flags.go:64] FLAG: --application-metrics-count-limit="100"
May 20 19:44:17.860273 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.858463    2578 flags.go:64] FLAG: --authentication-token-webhook="false"
May 20 19:44:17.860273 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.858466    2578 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
May 20 19:44:17.860273 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.858470    2578 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
May 20 19:44:17.860799 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.858474    2578 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
May 20 19:44:17.860799 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.858478    2578 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
May 20 19:44:17.860799 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.858481    2578 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
May 20 19:44:17.860799 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.858485    2578 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
May 20 19:44:17.860799 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.858488    2578 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
May 20 19:44:17.860799 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.858491    2578 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
May 20 19:44:17.860799 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.858494    2578 flags.go:64] FLAG: --cgroup-root=""
May 20 19:44:17.860799 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.858497    2578 flags.go:64] FLAG: --cgroups-per-qos="true"
May 20 19:44:17.860799 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.858500    2578 flags.go:64] FLAG: --client-ca-file=""
May 20 19:44:17.860799 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.858503    2578 flags.go:64] FLAG: --cloud-config=""
May 20 19:44:17.860799 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.858505    2578 flags.go:64] FLAG: --cloud-provider="external"
May 20 19:44:17.860799 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.858508    2578 flags.go:64] FLAG: --cluster-dns="[]"
May 20 19:44:17.860799 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.858513    2578 flags.go:64] FLAG: --cluster-domain=""
May 20 19:44:17.860799 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.858516    2578 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
May 20 19:44:17.860799 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.858519    2578 flags.go:64] FLAG: --config-dir=""
May 20 19:44:17.860799 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.858521    2578 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
May 20 19:44:17.860799 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.858525    2578 flags.go:64] FLAG: --container-log-max-files="5"
May 20 19:44:17.860799 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.858528    2578 flags.go:64] FLAG: --container-log-max-size="10Mi"
May 20 19:44:17.860799 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.858532    2578 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
May 20 19:44:17.860799 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.858535    2578 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
May 20 19:44:17.860799 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.858539    2578 flags.go:64] FLAG: --containerd-namespace="k8s.io"
May 20 19:44:17.860799 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.858542    2578 flags.go:64] FLAG: --contention-profiling="false"
May 20 19:44:17.860799 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.858545    2578 flags.go:64] FLAG: --cpu-cfs-quota="true"
May 20 19:44:17.860799 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.858548    2578 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
May 20 19:44:17.861383 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.858551    2578 flags.go:64] FLAG: --cpu-manager-policy="none"
May 20 19:44:17.861383 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.858554    2578 flags.go:64] FLAG: --cpu-manager-policy-options=""
May 20 19:44:17.861383 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.858558    2578 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
May 20 19:44:17.861383 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.858561    2578 flags.go:64] FLAG: --enable-controller-attach-detach="true"
May 20 19:44:17.861383 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.858564    2578 flags.go:64] FLAG: --enable-debugging-handlers="true"
May 20 19:44:17.861383 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.858567    2578 flags.go:64] FLAG: --enable-load-reader="false"
May 20 19:44:17.861383 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.858570    2578 flags.go:64] FLAG: --enable-server="true"
May 20 19:44:17.861383 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.858573    2578 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
May 20 19:44:17.861383 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.858590    2578 flags.go:64] FLAG: --event-burst="100"
May 20 19:44:17.861383 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.858594    2578 flags.go:64] FLAG: --event-qps="50"
May 20 19:44:17.861383 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.858597    2578 flags.go:64] FLAG: --event-storage-age-limit="default=0"
May 20 19:44:17.861383 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.858601    2578 flags.go:64] FLAG: --event-storage-event-limit="default=0"
May 20 19:44:17.861383 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.858604    2578 flags.go:64] FLAG: --eviction-hard=""
May 20 19:44:17.861383 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.858608    2578 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
May 20 19:44:17.861383 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.858610    2578 flags.go:64] FLAG: --eviction-minimum-reclaim=""
May 20 19:44:17.861383 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.858613    2578 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
May 20 19:44:17.861383 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.858616    2578 flags.go:64] FLAG: --eviction-soft=""
May 20 19:44:17.861383 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.858619    2578 flags.go:64] FLAG: --eviction-soft-grace-period=""
May 20 19:44:17.861383 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.858622    2578 flags.go:64] FLAG: --exit-on-lock-contention="false"
May 20 19:44:17.861383 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.858625    2578 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
May 20 19:44:17.861383 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.858627    2578 flags.go:64] FLAG: --experimental-mounter-path=""
May 20 19:44:17.861383 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.858630    2578 flags.go:64] FLAG: --fail-cgroupv1="false"
May 20 19:44:17.861383 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.858633    2578 flags.go:64] FLAG: --fail-swap-on="true"
May 20 19:44:17.861383 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.858636    2578 flags.go:64] FLAG: --feature-gates=""
May 20 19:44:17.861383 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.858640    2578 flags.go:64] FLAG: --file-check-frequency="20s"
May 20 19:44:17.862064 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.858643    2578 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
May 20 19:44:17.862064 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.858646    2578 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
May 20 19:44:17.862064 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.858649    2578 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
May 20 19:44:17.862064 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.858653    2578 flags.go:64] FLAG: --healthz-port="10248"
May 20 19:44:17.862064 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.858656    2578 flags.go:64] FLAG: --help="false"
May 20 19:44:17.862064 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.858659    2578 flags.go:64] FLAG: --hostname-override="ip-10-0-134-167.ec2.internal"
May 20 19:44:17.862064 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.858662    2578 flags.go:64] FLAG: --housekeeping-interval="10s"
May 20 19:44:17.862064 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.858665    2578 flags.go:64] FLAG: --http-check-frequency="20s"
May 20 19:44:17.862064 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.858668    2578 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
May 20 19:44:17.862064 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.858672    2578 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
May 20 19:44:17.862064 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.858675    2578 flags.go:64] FLAG: --image-gc-high-threshold="85"
May 20 19:44:17.862064 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.858678    2578 flags.go:64] FLAG: --image-gc-low-threshold="80"
May 20 19:44:17.862064 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.858681    2578 flags.go:64] FLAG: --image-service-endpoint=""
May 20 19:44:17.862064 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.858684    2578 flags.go:64] FLAG: --kernel-memcg-notification="false"
May 20 19:44:17.862064 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.858687    2578 flags.go:64] FLAG: --kube-api-burst="100"
May 20 19:44:17.862064 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.858690    2578 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
May 20 19:44:17.862064 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.858693    2578 flags.go:64] FLAG: --kube-api-qps="50"
May 20 19:44:17.862064 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.858696    2578 flags.go:64] FLAG: --kube-reserved=""
May 20 19:44:17.862064 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.858699    2578 flags.go:64] FLAG: --kube-reserved-cgroup=""
May 20 19:44:17.862064 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.858702    2578 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
May 20 19:44:17.862064 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.858705    2578 flags.go:64] FLAG: --kubelet-cgroups=""
May 20 19:44:17.862064 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.858707    2578 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
May 20 19:44:17.862064 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.858710    2578 flags.go:64] FLAG: --lock-file=""
May 20 19:44:17.862064 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.858713    2578 flags.go:64] FLAG: --log-cadvisor-usage="false"
May 20 19:44:17.862649 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.858716    2578 flags.go:64] FLAG: --log-flush-frequency="5s"
May 20 19:44:17.862649 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.858719    2578 flags.go:64] FLAG: --log-json-info-buffer-size="0"
May 20 19:44:17.862649 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.858724    2578 flags.go:64] FLAG: --log-json-split-stream="false"
May 20 19:44:17.862649 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.858727    2578 flags.go:64] FLAG: --log-text-info-buffer-size="0"
May 20 19:44:17.862649 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.858730    2578 flags.go:64] FLAG: --log-text-split-stream="false"
May 20 19:44:17.862649 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.858732    2578 flags.go:64] FLAG: --logging-format="text"
May 20 19:44:17.862649 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.858735    2578 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
May 20 19:44:17.862649 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.858738    2578 flags.go:64] FLAG: --make-iptables-util-chains="true"
May 20 19:44:17.862649 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.858741    2578 flags.go:64] FLAG: --manifest-url=""
May 20 19:44:17.862649 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.858744    2578 flags.go:64] FLAG: --manifest-url-header=""
May 20 19:44:17.862649 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.858748    2578 flags.go:64] FLAG: --max-housekeeping-interval="15s"
May 20 19:44:17.862649 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.858752    2578 flags.go:64] FLAG: --max-open-files="1000000"
May 20 19:44:17.862649 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.858756    2578 flags.go:64] FLAG: --max-pods="110"
May 20 19:44:17.862649 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.858759    2578 flags.go:64] FLAG: --maximum-dead-containers="-1"
May 20 19:44:17.862649 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.858762    2578 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
May 20 19:44:17.862649 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.858764    2578 flags.go:64] FLAG: --memory-manager-policy="None"
May 20 19:44:17.862649 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.858767    2578 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
May 20 19:44:17.862649 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.858770    2578 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
May 20 19:44:17.862649 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.858773    2578 flags.go:64] FLAG: --node-ip="0.0.0.0"
May 20 19:44:17.862649 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.858776    2578 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
May 20 19:44:17.862649 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.858783    2578 flags.go:64] FLAG: --node-status-max-images="50"
May 20 19:44:17.862649 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.858787    2578 flags.go:64] FLAG: --node-status-update-frequency="10s"
May 20 19:44:17.862649 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.858791    2578 flags.go:64] FLAG: --oom-score-adj="-999"
May 20 19:44:17.862649 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.858794    2578 flags.go:64] FLAG: --pod-cidr=""
May 20 19:44:17.863232 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.858797    2578 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc"
May 20 19:44:17.863232 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.858803    2578 flags.go:64] FLAG: --pod-manifest-path=""
May 20 19:44:17.863232 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.858806    2578 flags.go:64] FLAG: --pod-max-pids="-1"
May 20 19:44:17.863232 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.858809    2578 flags.go:64] FLAG: --pods-per-core="0"
May 20 19:44:17.863232 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.858812    2578 flags.go:64] FLAG: --port="10250"
May 20 19:44:17.863232 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.858815    2578 flags.go:64] FLAG: --protect-kernel-defaults="false"
May 20 19:44:17.863232 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.858818    2578 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0fefb5d3e6cf8c3b1"
May 20 19:44:17.863232 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.858821    2578 flags.go:64] FLAG: --qos-reserved=""
May 20 19:44:17.863232 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.858824    2578 flags.go:64] FLAG: --read-only-port="10255"
May 20 19:44:17.863232 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.858827    2578 flags.go:64] FLAG: --register-node="true"
May 20 19:44:17.863232 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.858830    2578 flags.go:64] FLAG: --register-schedulable="true"
May 20 19:44:17.863232 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.858833    2578 flags.go:64] FLAG: --register-with-taints=""
May 20 19:44:17.863232 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.858837    2578 flags.go:64] FLAG: --registry-burst="10"
May 20 19:44:17.863232 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.858840    2578 flags.go:64] FLAG: --registry-qps="5"
May 20 19:44:17.863232 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.858843    2578 flags.go:64] FLAG: --reserved-cpus=""
May 20 19:44:17.863232 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.858846    2578 flags.go:64] FLAG: --reserved-memory=""
May 20 19:44:17.863232 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.858849    2578 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
May 20 19:44:17.863232 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.858853    2578 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
May 20 19:44:17.863232 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.858856    2578 flags.go:64] FLAG: --rotate-certificates="false"
May 20 19:44:17.863232 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.858859    2578 flags.go:64] FLAG: --rotate-server-certificates="false"
May 20 19:44:17.863232 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.858862    2578 flags.go:64] FLAG: --runonce="false"
May 20 19:44:17.863232 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.858865    2578 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
May 20 19:44:17.863232 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.858868    2578 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
May 20 19:44:17.863232 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.858871    2578 flags.go:64] FLAG: --seccomp-default="false"
May 20 19:44:17.863232 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.858874    2578 flags.go:64] FLAG: --serialize-image-pulls="true"
May 20 19:44:17.863834 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.858877    2578 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
May 20 19:44:17.863834 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.858880    2578 flags.go:64] FLAG: --storage-driver-db="cadvisor"
May 20 19:44:17.863834 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.858883    2578 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
May 20 19:44:17.863834 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.858887    2578 flags.go:64] FLAG: --storage-driver-password="root"
May 20 19:44:17.863834 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.858890    2578 flags.go:64] FLAG: --storage-driver-secure="false"
May 20 19:44:17.863834 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.858893    2578 flags.go:64] FLAG: --storage-driver-table="stats"
May 20 19:44:17.863834 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.858897    2578 flags.go:64] FLAG: --storage-driver-user="root"
May 20 19:44:17.863834 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.858900    2578 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
May 20 19:44:17.863834 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.858903    2578 flags.go:64] FLAG: --sync-frequency="1m0s"
May 20 19:44:17.863834 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.858906    2578 flags.go:64] FLAG: --system-cgroups=""
May 20 19:44:17.863834 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.858909    2578 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
May 20 19:44:17.863834 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.858914    2578 flags.go:64] FLAG: --system-reserved-cgroup=""
May 20 19:44:17.863834 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.858917    2578 flags.go:64] FLAG: --tls-cert-file=""
May 20 19:44:17.863834 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.858920    2578 flags.go:64] FLAG: --tls-cipher-suites="[]"
May 20 19:44:17.863834 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.858924    2578 flags.go:64] FLAG: --tls-min-version=""
May 20 19:44:17.863834 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.858927    2578 flags.go:64] FLAG: --tls-private-key-file=""
May 20 19:44:17.863834 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.858929    2578 flags.go:64] FLAG: --topology-manager-policy="none"
May 20 19:44:17.863834 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.858932    2578 flags.go:64] FLAG: --topology-manager-policy-options=""
May 20 19:44:17.863834 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.858935    2578 flags.go:64] FLAG: --topology-manager-scope="container"
May 20 19:44:17.863834 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.858938    2578 flags.go:64] FLAG: --v="2"
May 20 19:44:17.863834 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.858942    2578 flags.go:64] FLAG: --version="false"
May 20 19:44:17.863834 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.858946    2578 flags.go:64] FLAG: --vmodule=""
May 20 19:44:17.863834 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.858950    2578 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
May 20 19:44:17.863834 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.858958    2578 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
May 20 19:44:17.863834 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.859072    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 20 19:44:17.864450 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.859075    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 20 19:44:17.864450 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.859079    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 20 19:44:17.864450 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.859082    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 20 19:44:17.864450 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.859084    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 20 19:44:17.864450 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.859087    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 20 19:44:17.864450 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.859090    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 20 19:44:17.864450 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.859093    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 20 19:44:17.864450 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.859095    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
May 20 19:44:17.864450 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.859098    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 20 19:44:17.864450 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.859100    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 20 19:44:17.864450 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.859103    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 20 19:44:17.864450 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.859105    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 20 19:44:17.864450 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.859108    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 20 19:44:17.864450 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.859112    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 20 19:44:17.864450 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.859115    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 20 19:44:17.864450 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.859117    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 20 19:44:17.864450 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.859120    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 20 19:44:17.864450 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.859122    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 20 19:44:17.864450 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.859125    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 20 19:44:17.864450 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.859127    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 20 19:44:17.864980 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.859130    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 20 19:44:17.864980 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.859132    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 20 19:44:17.864980 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.859135    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 20 19:44:17.864980 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.859137    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 20 19:44:17.864980 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.859139    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 20 19:44:17.864980 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.859142    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 20 19:44:17.864980 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.859144    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 20 19:44:17.864980 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.859147    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 20 19:44:17.864980 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.859149    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 20 19:44:17.864980 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.859151    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 20 19:44:17.864980 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.859155    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 20 19:44:17.864980 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.859159    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 20 19:44:17.864980 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.859162    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 20 19:44:17.864980 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.859164    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 20 19:44:17.864980 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.859167    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 20 19:44:17.864980 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.859170    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 20 19:44:17.864980 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.859172    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 20 19:44:17.864980 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.859175    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 20 19:44:17.864980 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.859177    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 20 19:44:17.864980 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.859180    2578 feature_gate.go:328] unrecognized feature gate: Example
May 20 19:44:17.865468 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.859182    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 20 19:44:17.865468 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.859185    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 20 19:44:17.865468 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.859187    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 20 19:44:17.865468 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.859190    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 20 19:44:17.865468 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.859192    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 20 19:44:17.865468 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.859194    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 20 19:44:17.865468 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.859197    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 20 19:44:17.865468 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.859200    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 20 19:44:17.865468 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.859202    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 20 19:44:17.865468 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.859205    2578 feature_gate.go:328] unrecognized feature gate: Example2
May 20 19:44:17.865468 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.859207    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 20 19:44:17.865468 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.859210    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 20 19:44:17.865468 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.859212    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 20 19:44:17.865468 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.859215    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 20 19:44:17.865468 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.859217    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 20 19:44:17.865468 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.859220    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 20 19:44:17.865468 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.859222    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
May 20 19:44:17.865468 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.859225    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 20 19:44:17.865468 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.859227    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 20 19:44:17.865468 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.859230    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 20 19:44:17.865982 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.859232    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 20 19:44:17.865982 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.859235    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 20 19:44:17.865982 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.859239    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 20 19:44:17.865982 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.859242    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 20 19:44:17.865982 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.859246    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 20 19:44:17.865982 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.859250    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 20 19:44:17.865982 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.859255    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 20 19:44:17.865982 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.859258    2578 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 20 19:44:17.865982 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.859260    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 20 19:44:17.865982 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.859263    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 20 19:44:17.865982 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.859266    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 20 19:44:17.865982 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.859268    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 20 19:44:17.865982 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.859271    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 20 19:44:17.865982 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.859273    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 20 19:44:17.865982 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.859276    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 20 19:44:17.865982 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.859278    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 20 19:44:17.865982 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.859281    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 20 19:44:17.865982 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.859283    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 20 19:44:17.865982 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.859286    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 20 19:44:17.866519 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.859289    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 20 19:44:17.866519 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.859292    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 20 19:44:17.866519 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.859294    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 20 19:44:17.866519 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.859296    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 20 19:44:17.866519 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.859299    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 20 19:44:17.866519 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.859301    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 20 19:44:17.866519 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.859909    2578 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 20 19:44:17.867551 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.867530    2578 server.go:530] "Kubelet version" kubeletVersion="v1.33.11"
May 20 19:44:17.867551 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.867549    2578 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
May 20 19:44:17.867676 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.867613    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 20 19:44:17.867676 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.867619    2578 feature_gate.go:328] unrecognized feature gate: Example
May 20 19:44:17.867676 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.867622    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 20 19:44:17.867676 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.867625    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 20 19:44:17.867676 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.867628    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 20 19:44:17.867676 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.867631    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 20 19:44:17.867676 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.867634    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 20 19:44:17.867676 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.867637    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 20 19:44:17.867676 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.867640    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 20 19:44:17.867676 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.867642    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 20 19:44:17.867676 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.867645    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 20 19:44:17.867676 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.867647    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 20 19:44:17.867676 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.867650    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 20 19:44:17.867676 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.867652    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 20 19:44:17.867676 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.867655    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 20 19:44:17.867676 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.867658    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 20 19:44:17.867676 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.867660    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 20 19:44:17.867676 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.867663    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 20 19:44:17.867676 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.867665    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 20 19:44:17.867676 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.867667    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 20 19:44:17.868165 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.867670    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 20 19:44:17.868165 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.867674    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 20 19:44:17.868165 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.867676    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 20 19:44:17.868165 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.867679    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 20 19:44:17.868165 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.867681    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 20 19:44:17.868165 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.867684    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 20 19:44:17.868165 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.867687    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 20 19:44:17.868165 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.867691    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 20 19:44:17.868165 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.867695    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 20 19:44:17.868165 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.867698    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 20 19:44:17.868165 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.867700    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 20 19:44:17.868165 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.867703    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 20 19:44:17.868165 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.867705    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 20 19:44:17.868165 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.867708    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 20 19:44:17.868165 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.867710    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 20 19:44:17.868165 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.867712    2578 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 20 19:44:17.868165 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.867715    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 20 19:44:17.868165 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.867718    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 20 19:44:17.868165 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.867720    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 20 19:44:17.868646 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.867723    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 20 19:44:17.868646 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.867725    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 20 19:44:17.868646 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.867727    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 20 19:44:17.868646 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.867730    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 20 19:44:17.868646 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.867732    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 20 19:44:17.868646 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.867735    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 20 19:44:17.868646 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.867737    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 20 19:44:17.868646 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.867740    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 20 19:44:17.868646 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.867742    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 20 19:44:17.868646 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.867744    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 20 19:44:17.868646 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.867747    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 20 19:44:17.868646 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.867749    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 20 19:44:17.868646 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.867751    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 20 19:44:17.868646 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.867754    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 20 19:44:17.868646 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.867757    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 20 19:44:17.868646 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.867760    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 20 19:44:17.868646 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.867762    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 20 19:44:17.868646 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.867764    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 20 19:44:17.868646 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.867767    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 20 19:44:17.869142 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.867769    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 20 19:44:17.869142 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.867772    2578 feature_gate.go:328] unrecognized feature gate: Example2
May 20 19:44:17.869142 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.867775    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 20 19:44:17.869142 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.867777    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 20 19:44:17.869142 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.867780    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 20 19:44:17.869142 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.867782    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 20 19:44:17.869142 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.867784    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 20 19:44:17.869142 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.867787    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 20 19:44:17.869142 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.867789    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 20 19:44:17.869142 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.867791    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 20 19:44:17.869142 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.867794    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 20 19:44:17.869142 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.867796    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
May 20 19:44:17.869142 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.867799    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 20 19:44:17.869142 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.867801    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 20 19:44:17.869142 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.867803    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 20 19:44:17.869142 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.867806    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 20 19:44:17.869142 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.867808    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
May 20 19:44:17.869142 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.867811    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 20 19:44:17.869142 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.867814    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 20 19:44:17.869142 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.867816    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 20 19:44:17.869142 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.867819    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 20 19:44:17.869667 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.867821    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 20 19:44:17.869667 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.867824    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 20 19:44:17.869667 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.867827    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 20 19:44:17.869667 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.867832    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 20 19:44:17.869667 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.867835    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 20 19:44:17.869667 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.867838    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 20 19:44:17.869667 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.867841    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 20 19:44:17.869667 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.867847    2578 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 20 19:44:17.869667 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.867938    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 20 19:44:17.869667 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.867943    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 20 19:44:17.869667 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.867946    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 20 19:44:17.869667 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.867949    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 20 19:44:17.869667 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.867952    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 20 19:44:17.869667 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.867954    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 20 19:44:17.869667 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.867957    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 20 19:44:17.870037 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.867960    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 20 19:44:17.870037 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.867963    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 20 19:44:17.870037 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.867965    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 20 19:44:17.870037 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.867968    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 20 19:44:17.870037 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.867971    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 20 19:44:17.870037 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.867973    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 20 19:44:17.870037 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.867976    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 20 19:44:17.870037 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.867979    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 20 19:44:17.870037 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.867981    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 20 19:44:17.870037 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.867984    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 20 19:44:17.870037 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.867986    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 20 19:44:17.870037 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.867988    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 20 19:44:17.870037 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.867991    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 20 19:44:17.870037 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.867993    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 20 19:44:17.870037 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.867996    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 20 19:44:17.870037 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.867999    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 20 19:44:17.870037 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.868001    2578 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 20 19:44:17.870037 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.868004    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 20 19:44:17.870037 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.868006    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 20 19:44:17.870508 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.868008    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 20 19:44:17.870508 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.868011    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 20 19:44:17.870508 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.868013    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 20 19:44:17.870508 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.868015    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 20 19:44:17.870508 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.868018    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 20 19:44:17.870508 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.868021    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 20 19:44:17.870508 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.868023    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 20 19:44:17.870508 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.868026    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 20 19:44:17.870508 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.868029    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
May 20 19:44:17.870508 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.868032    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 20 19:44:17.870508 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.868034    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 20 19:44:17.870508 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.868037    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 20 19:44:17.870508 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.868039    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 20 19:44:17.870508 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.868042    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 20 19:44:17.870508 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.868044    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 20 19:44:17.870508 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.868047    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 20 19:44:17.870508 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.868049    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 20 19:44:17.870508 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.868051    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 20 19:44:17.870508 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.868054    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 20 19:44:17.870508 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.868056    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 20 19:44:17.871020 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.868059    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 20 19:44:17.871020 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.868061    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 20 19:44:17.871020 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.868063    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 20 19:44:17.871020 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.868066    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 20 19:44:17.871020 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.868068    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 20 19:44:17.871020 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.868070    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 20 19:44:17.871020 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.868073    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
May 20 19:44:17.871020 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.868075    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 20 19:44:17.871020 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.868078    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 20 19:44:17.871020 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.868081    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 20 19:44:17.871020 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.868084    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 20 19:44:17.871020 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.868086    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 20 19:44:17.871020 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.868089    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 20 19:44:17.871020 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.868091    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 20 19:44:17.871020 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.868093    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 20 19:44:17.871020 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.868096    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 20 19:44:17.871020 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.868100    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 20 19:44:17.871020 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.868103    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 20 19:44:17.871020 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.868106    2578 feature_gate.go:328] unrecognized feature gate: Example
May 20 19:44:17.871020 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.868108    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 20 19:44:17.871489 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.868111    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 20 19:44:17.871489 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.868113    2578 feature_gate.go:328] unrecognized feature gate: Example2
May 20 19:44:17.871489 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.868116    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 20 19:44:17.871489 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.868118    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 20 19:44:17.871489 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.868121    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 20 19:44:17.871489 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.868124    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 20 19:44:17.871489 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.868128    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 20 19:44:17.871489 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.868130    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 20 19:44:17.871489 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.868133    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 20 19:44:17.871489 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.868135    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 20 19:44:17.871489 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.868138    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 20 19:44:17.871489 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.868140    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 20 19:44:17.871489 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.868143    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 20 19:44:17.871489 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.868145    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 20 19:44:17.871489 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.868147    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 20 19:44:17.871489 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.868150    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 20 19:44:17.871489 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.868152    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 20 19:44:17.871489 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.868154    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 20 19:44:17.871489 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.868157    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 20 19:44:17.871955 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:17.868159    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 20 19:44:17.871955 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.868164    2578 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 20 19:44:17.871955 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.868897    2578 server.go:962] "Client rotation is on, will bootstrap in background"
May 20 19:44:17.872668 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.872654    2578 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
May 20 19:44:17.873733 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.873721    2578 server.go:1019] "Starting client certificate rotation"
May 20 19:44:17.873863 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.873827    2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 20 19:44:17.873899 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.873864    2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 20 19:44:17.897237 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.897215    2578 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 20 19:44:17.899185 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.899166    2578 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 20 19:44:17.913736 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.913712    2578 log.go:25] "Validated CRI v1 runtime API"
May 20 19:44:17.918934 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.918917    2578 log.go:25] "Validated CRI v1 image API"
May 20 19:44:17.920152 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.920134    2578 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
May 20 19:44:17.925151 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.925130    2578 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 20 19:44:17.925323 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.925301    2578 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 960b454e-a349-4601-87ae-6c51ea8079d0:/dev/nvme0n1p3 e7373d8c-a068-4246-875e-8058ad0bc78f:/dev/nvme0n1p4]
May 20 19:44:17.925364 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.925325    2578 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
May 20 19:44:17.930599 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.930460    2578 manager.go:217] Machine: {Timestamp:2026-05-20 19:44:17.929523051 +0000 UTC m=+0.378071898 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3163404 MemoryCapacity:32812167168 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec282b53861e9e878c71fc4697e69efe SystemUUID:ec282b53-861e-9e87-8c71-fc4697e69efe BootID:0694b775-2c5e-4001-ac1a-f51aea6ee2fe Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406081536 Type:vfs Inodes:4005391 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:27:82:d4:c9:1f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:27:82:d4:c9:1f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:26:10:30:04:ed:75 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812167168 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
May 20 19:44:17.931257 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.931245    2578 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
May 20 19:44:17.931348 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.931336    2578 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
May 20 19:44:17.933271 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.933244    2578 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
May 20 19:44:17.933410 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.933273    2578 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-134-167.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
May 20 19:44:17.933463 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.933420    2578 topology_manager.go:138] "Creating topology manager with none policy"
May 20 19:44:17.933463 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.933430    2578 container_manager_linux.go:306] "Creating device plugin manager"
May 20 19:44:17.933463 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.933438    2578 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
May 20 19:44:17.934030 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.934019    2578 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
May 20 19:44:17.935444 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.935434    2578 state_mem.go:36] "Initialized new in-memory state store"
May 20 19:44:17.935550 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.935540    2578 server.go:1267] "Using root directory" path="/var/lib/kubelet"
May 20 19:44:17.938148 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.938138    2578 kubelet.go:491] "Attempting to sync node with API server"
May 20 19:44:17.938187 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.938151    2578 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests"
May 20 19:44:17.938187 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.938164    2578 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
May 20 19:44:17.938187 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.938174    2578 kubelet.go:397] "Adding apiserver pod source"
May 20 19:44:17.938187 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.938184    2578 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
May 20 19:44:17.939250 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.939237    2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 20 19:44:17.939295 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.939257    2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 20 19:44:17.942097 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.942081    2578 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1"
May 20 19:44:17.943863 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.943849    2578 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
May 20 19:44:17.944737 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.944724    2578 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
May 20 19:44:17.944795 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.944746    2578 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
May 20 19:44:17.944795 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.944755    2578 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
May 20 19:44:17.944795 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.944761    2578 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
May 20 19:44:17.944795 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.944769    2578 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
May 20 19:44:17.944795 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.944775    2578 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret"
May 20 19:44:17.944795 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.944781    2578 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
May 20 19:44:17.944795 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.944786    2578 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
May 20 19:44:17.944795 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.944794    2578 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc"
May 20 19:44:17.945037 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.944804    2578 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
May 20 19:44:17.945037 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.944826    2578 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected"
May 20 19:44:17.945132 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.945123    2578 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
May 20 19:44:17.947475 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.947460    2578 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi"
May 20 19:44:17.947475 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.947475    2578 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image"
May 20 19:44:17.952101 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.952086    2578 watchdog_linux.go:99] "Systemd watchdog is not enabled"
May 20 19:44:17.952183 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.952129    2578 server.go:1295] "Started kubelet"
May 20 19:44:17.952241 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.952129    2578 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-167.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
May 20 19:44:17.952241 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.952175    2578 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
May 20 19:44:17.952342 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.952256    2578 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
May 20 19:44:17.952342 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.952335    2578 server_v1.go:47] "podresources" method="list" useActivePods=true
May 20 19:44:17.952434 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:44:17.952382    2578 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-134-167.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
May 20 19:44:17.952483 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:44:17.952464    2578 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
May 20 19:44:17.953036 ip-10-0-134-167 systemd[1]: Started Kubernetes Kubelet.
May 20 19:44:17.953524 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.953369    2578 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
May 20 19:44:17.954653 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.954640    2578 server.go:317] "Adding debug handlers to kubelet server"
May 20 19:44:17.957899 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:44:17.956639    2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-167.ec2.internal.18b15d9d4bdd4ee1  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-167.ec2.internal,UID:ip-10-0-134-167.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-134-167.ec2.internal,},FirstTimestamp:2026-05-20 19:44:17.952100065 +0000 UTC m=+0.400648912,LastTimestamp:2026-05-20 19:44:17.952100065 +0000 UTC m=+0.400648912,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-167.ec2.internal,}"
May 20 19:44:17.959566 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.959543    2578 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
May 20 19:44:17.959566 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.959559    2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
May 20 19:44:17.959735 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.959616    2578 volume_manager.go:295] "The desired_state_of_world populator starts"
May 20 19:44:17.959735 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.959625    2578 volume_manager.go:297] "Starting Kubelet Volume Manager"
May 20 19:44:17.959831 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.959739    2578 desired_state_of_world_populator.go:150] "Desired state populator starts to run"
May 20 19:44:17.959831 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.959784    2578 reconstruct.go:97] "Volume reconstruction finished"
May 20 19:44:17.959831 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.959792    2578 reconciler.go:26] "Reconciler: start to sync state"
May 20 19:44:17.960363 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:44:17.960343    2578 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-167.ec2.internal\" not found"
May 20 19:44:17.960983 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.960965    2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-9gscr"
May 20 19:44:17.963898 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.963879    2578 factory.go:55] Registering systemd factory
May 20 19:44:17.964062 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.964044    2578 factory.go:223] Registration of the systemd container factory successfully
May 20 19:44:17.964623 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.964605    2578 factory.go:153] Registering CRI-O factory
May 20 19:44:17.964715 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.964627    2578 factory.go:223] Registration of the crio container factory successfully
May 20 19:44:17.964715 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.964684    2578 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
May 20 19:44:17.964715 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.964711    2578 factory.go:103] Registering Raw factory
May 20 19:44:17.964852 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.964732    2578 manager.go:1196] Started watching for new ooms in manager
May 20 19:44:17.965422 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.965405    2578 manager.go:319] Starting recovery of all containers
May 20 19:44:17.970553 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.970389    2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-9gscr"
May 20 19:44:17.974152 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:44:17.974127    2578 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
May 20 19:44:17.974264 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:44:17.974238    2578 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-134-167.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
May 20 19:44:17.976347 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.976332    2578 manager.go:324] Recovery completed
May 20 19:44:17.980401 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.980387    2578 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 20 19:44:17.983261 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.983241    2578 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-167.ec2.internal" event="NodeHasSufficientMemory"
May 20 19:44:17.983348 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.983276    2578 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-167.ec2.internal" event="NodeHasNoDiskPressure"
May 20 19:44:17.983348 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.983290    2578 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-167.ec2.internal" event="NodeHasSufficientPID"
May 20 19:44:17.983732 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.983718    2578 cpu_manager.go:222] "Starting CPU manager" policy="none"
May 20 19:44:17.983732 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.983731    2578 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
May 20 19:44:17.983839 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.983749    2578 state_mem.go:36] "Initialized new in-memory state store"
May 20 19:44:17.987208 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.987190    2578 policy_none.go:49] "None policy: Start"
May 20 19:44:17.987208 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.987207    2578 memory_manager.go:186] "Starting memorymanager" policy="None"
May 20 19:44:17.987351 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:17.987219    2578 state_mem.go:35] "Initializing new in-memory state store"
May 20 19:44:18.042092 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:18.026149    2578 manager.go:341] "Starting Device Plugin manager"
May 20 19:44:18.042092 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:44:18.026189    2578 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
May 20 19:44:18.042092 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:18.026205    2578 server.go:85] "Starting device plugin registration server"
May 20 19:44:18.042092 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:18.026456    2578 eviction_manager.go:189] "Eviction manager: starting control loop"
May 20 19:44:18.042092 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:18.026467    2578 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
May 20 19:44:18.042092 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:18.026542    2578 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
May 20 19:44:18.042092 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:18.026668    2578 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
May 20 19:44:18.042092 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:18.026677    2578 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
May 20 19:44:18.042092 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:44:18.027105    2578 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
May 20 19:44:18.042092 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:44:18.027148    2578 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-134-167.ec2.internal\" not found"
May 20 19:44:18.094497 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:18.094455    2578 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4"
May 20 19:44:18.095804 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:18.095784    2578 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6"
May 20 19:44:18.095804 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:18.095807    2578 status_manager.go:230] "Starting to sync pod status with apiserver"
May 20 19:44:18.095981 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:18.095826    2578 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
May 20 19:44:18.095981 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:18.095834    2578 kubelet.go:2451] "Starting kubelet main sync loop"
May 20 19:44:18.095981 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:44:18.095876    2578 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
May 20 19:44:18.099088 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:18.099071    2578 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 20 19:44:18.127038 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:18.127014    2578 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 20 19:44:18.128106 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:18.128089    2578 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-167.ec2.internal" event="NodeHasSufficientMemory"
May 20 19:44:18.128214 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:18.128119    2578 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-167.ec2.internal" event="NodeHasNoDiskPressure"
May 20 19:44:18.128214 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:18.128135    2578 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-167.ec2.internal" event="NodeHasSufficientPID"
May 20 19:44:18.128214 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:18.128165    2578 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-167.ec2.internal"
May 20 19:44:18.135913 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:18.135898    2578 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-134-167.ec2.internal"
May 20 19:44:18.136006 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:44:18.135924    2578 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-134-167.ec2.internal\": node \"ip-10-0-134-167.ec2.internal\" not found"
May 20 19:44:18.152871 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:44:18.152846    2578 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-167.ec2.internal\" not found"
May 20 19:44:18.196781 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:18.196755    2578 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-134-167.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-167.ec2.internal"]
May 20 19:44:18.196944 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:18.196833    2578 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 20 19:44:18.197821 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:18.197804    2578 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-167.ec2.internal" event="NodeHasSufficientMemory"
May 20 19:44:18.197914 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:18.197838    2578 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-167.ec2.internal" event="NodeHasNoDiskPressure"
May 20 19:44:18.197914 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:18.197855    2578 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-167.ec2.internal" event="NodeHasSufficientPID"
May 20 19:44:18.200250 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:18.200235    2578 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 20 19:44:18.200395 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:18.200378    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-167.ec2.internal"
May 20 19:44:18.200442 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:18.200413    2578 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 20 19:44:18.200978 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:18.200950    2578 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-167.ec2.internal" event="NodeHasSufficientMemory"
May 20 19:44:18.200978 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:18.200979    2578 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-167.ec2.internal" event="NodeHasNoDiskPressure"
May 20 19:44:18.201100 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:18.200990    2578 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-167.ec2.internal" event="NodeHasSufficientPID"
May 20 19:44:18.201100 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:18.200994    2578 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-167.ec2.internal" event="NodeHasSufficientMemory"
May 20 19:44:18.201100 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:18.201015    2578 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-167.ec2.internal" event="NodeHasNoDiskPressure"
May 20 19:44:18.201100 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:18.201025    2578 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-167.ec2.internal" event="NodeHasSufficientPID"
May 20 19:44:18.203097 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:18.203079    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-167.ec2.internal"
May 20 19:44:18.203192 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:18.203104    2578 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 20 19:44:18.203760 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:18.203742    2578 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-167.ec2.internal" event="NodeHasSufficientMemory"
May 20 19:44:18.203830 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:18.203766    2578 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-167.ec2.internal" event="NodeHasNoDiskPressure"
May 20 19:44:18.203830 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:18.203775    2578 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-167.ec2.internal" event="NodeHasSufficientPID"
May 20 19:44:18.227236 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:44:18.227216    2578 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-167.ec2.internal\" not found" node="ip-10-0-134-167.ec2.internal"
May 20 19:44:18.231728 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:44:18.231713    2578 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-167.ec2.internal\" not found" node="ip-10-0-134-167.ec2.internal"
May 20 19:44:18.253391 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:44:18.253367    2578 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-167.ec2.internal\" not found"
May 20 19:44:18.261337 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:18.261310    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8736a515541c78203a4ba66250257011-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-167.ec2.internal\" (UID: \"8736a515541c78203a4ba66250257011\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-167.ec2.internal"
May 20 19:44:18.261398 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:18.261344    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8736a515541c78203a4ba66250257011-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-167.ec2.internal\" (UID: \"8736a515541c78203a4ba66250257011\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-167.ec2.internal"
May 20 19:44:18.261398 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:18.261363    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c154af641d973d5a0b0e558435e3a97e-config\") pod \"kube-apiserver-proxy-ip-10-0-134-167.ec2.internal\" (UID: \"c154af641d973d5a0b0e558435e3a97e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-167.ec2.internal"
May 20 19:44:18.354136 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:44:18.354091    2578 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-167.ec2.internal\" not found"
May 20 19:44:18.362471 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:18.362446    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8736a515541c78203a4ba66250257011-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-167.ec2.internal\" (UID: \"8736a515541c78203a4ba66250257011\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-167.ec2.internal"
May 20 19:44:18.362528 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:18.362479    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8736a515541c78203a4ba66250257011-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-167.ec2.internal\" (UID: \"8736a515541c78203a4ba66250257011\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-167.ec2.internal"
May 20 19:44:18.362528 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:18.362497    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c154af641d973d5a0b0e558435e3a97e-config\") pod \"kube-apiserver-proxy-ip-10-0-134-167.ec2.internal\" (UID: \"c154af641d973d5a0b0e558435e3a97e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-167.ec2.internal"
May 20 19:44:18.362528 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:18.362523    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c154af641d973d5a0b0e558435e3a97e-config\") pod \"kube-apiserver-proxy-ip-10-0-134-167.ec2.internal\" (UID: \"c154af641d973d5a0b0e558435e3a97e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-167.ec2.internal"
May 20 19:44:18.362673 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:18.362545    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8736a515541c78203a4ba66250257011-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-167.ec2.internal\" (UID: \"8736a515541c78203a4ba66250257011\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-167.ec2.internal"
May 20 19:44:18.362673 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:18.362563    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8736a515541c78203a4ba66250257011-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-167.ec2.internal\" (UID: \"8736a515541c78203a4ba66250257011\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-167.ec2.internal"
May 20 19:44:18.454967 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:44:18.454893    2578 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-167.ec2.internal\" not found"
May 20 19:44:18.530427 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:18.530401    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-167.ec2.internal"
May 20 19:44:18.534097 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:18.534081    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-167.ec2.internal"
May 20 19:44:18.556294 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:44:18.556258    2578 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-167.ec2.internal\" not found"
May 20 19:44:18.656814 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:44:18.656757    2578 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-167.ec2.internal\" not found"
May 20 19:44:18.757344 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:44:18.757255    2578 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-167.ec2.internal\" not found"
May 20 19:44:18.857776 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:44:18.857738    2578 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-167.ec2.internal\" not found"
May 20 19:44:18.873134 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:18.873098    2578 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
May 20 19:44:18.873295 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:18.873275    2578 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 20 19:44:18.923116 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:18.923094    2578 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
May 20 19:44:18.957892 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:44:18.957862    2578 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-167.ec2.internal\" not found"
May 20 19:44:18.960267 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:18.960240    2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
May 20 19:44:18.970983 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:18.970957    2578 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 20 19:44:18.974955 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:18.974917    2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-19 19:39:17 +0000 UTC" deadline="2028-02-20 00:40:14.159175014 +0000 UTC"
May 20 19:44:18.974955 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:18.974950    2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15364h55m55.184229163s"
May 20 19:44:18.992036 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:18.992010    2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-tbvg4"
May 20 19:44:19.000206 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:19.000169    2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-tbvg4"
May 20 19:44:19.030873 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:19.030810    2578 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
May 20 19:44:19.058811 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:44:19.058780    2578 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-167.ec2.internal\" not found"
May 20 19:44:19.076947 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:19.076908    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8736a515541c78203a4ba66250257011.slice/crio-df680afaab4b73fb0708a0c7e839730edb490e4f160c26ec3354d0d749d95b34 WatchSource:0}: Error finding container df680afaab4b73fb0708a0c7e839730edb490e4f160c26ec3354d0d749d95b34: Status 404 returned error can't find the container with id df680afaab4b73fb0708a0c7e839730edb490e4f160c26ec3354d0d749d95b34
May 20 19:44:19.081807 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:19.081790    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 20 19:44:19.090528 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:19.090503    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc154af641d973d5a0b0e558435e3a97e.slice/crio-3c94c47d3f68ea3a8adde60a63e58576ac84bb8d60e7c653eb66d620bcb6330b WatchSource:0}: Error finding container 3c94c47d3f68ea3a8adde60a63e58576ac84bb8d60e7c653eb66d620bcb6330b: Status 404 returned error can't find the container with id 3c94c47d3f68ea3a8adde60a63e58576ac84bb8d60e7c653eb66d620bcb6330b
May 20 19:44:19.098557 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:19.098514    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-167.ec2.internal" event={"ID":"8736a515541c78203a4ba66250257011","Type":"ContainerStarted","Data":"df680afaab4b73fb0708a0c7e839730edb490e4f160c26ec3354d0d749d95b34"}
May 20 19:44:19.099378 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:19.099357    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-167.ec2.internal" event={"ID":"c154af641d973d5a0b0e558435e3a97e","Type":"ContainerStarted","Data":"3c94c47d3f68ea3a8adde60a63e58576ac84bb8d60e7c653eb66d620bcb6330b"}
May 20 19:44:19.159657 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:44:19.159600    2578 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-167.ec2.internal\" not found"
May 20 19:44:19.260080 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:44:19.260023    2578 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-167.ec2.internal\" not found"
May 20 19:44:19.305668 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:19.305574    2578 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
May 20 19:44:19.360648 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:19.360602    2578 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-167.ec2.internal"
May 20 19:44:19.370627 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:19.370595    2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 20 19:44:19.371577 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:19.371559    2578 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-167.ec2.internal"
May 20 19:44:19.382165 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:19.382142    2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 20 19:44:19.939685 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:19.939650    2578 apiserver.go:52] "Watching apiserver"
May 20 19:44:19.946531 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:19.946503    2578 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
May 20 19:44:19.948574 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:19.948541    2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-gwj68","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-djpd5","openshift-dns/node-resolver-lmf6r","openshift-image-registry/node-ca-mszww","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-167.ec2.internal","openshift-multus/multus-additional-cni-plugins-jljg9","openshift-multus/multus-lx5m7","openshift-multus/network-metrics-daemon-p6zpg","kube-system/kube-apiserver-proxy-ip-10-0-134-167.ec2.internal","openshift-cluster-node-tuning-operator/tuned-67wbm","openshift-network-diagnostics/network-check-target-8qqbv","openshift-network-operator/iptables-alerter-znlb8","openshift-ovn-kubernetes/ovnkube-node-8nrkk"]
May 20 19:44:19.951917 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:19.951898    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-lx5m7"
May 20 19:44:19.954090 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:19.954072    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-djpd5"
May 20 19:44:19.954202 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:19.954170    2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
May 20 19:44:19.954361 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:19.954343    2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-zfjkj\""
May 20 19:44:19.954450 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:19.954367    2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
May 20 19:44:19.954499 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:19.954464    2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
May 20 19:44:19.954699 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:19.954679    2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
May 20 19:44:19.956424 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:19.956207    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-lmf6r"
May 20 19:44:19.956424 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:19.956241    2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
May 20 19:44:19.956562 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:19.956441    2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
May 20 19:44:19.956562 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:19.956548    2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
May 20 19:44:19.956763 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:19.956743    2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-hxbqt\""
May 20 19:44:19.958225 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:19.958206    2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-2bhx8\""
May 20 19:44:19.958355 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:19.958340    2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
May 20 19:44:19.958478 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:19.958348    2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
May 20 19:44:19.958657 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:19.958640    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-mszww"
May 20 19:44:19.960443 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:19.960424    2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
May 20 19:44:19.960533 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:19.960462    2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-9n7d5\""
May 20 19:44:19.960533 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:19.960492    2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
May 20 19:44:19.960785 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:19.960768    2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
May 20 19:44:19.962965 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:19.962947    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-jljg9"
May 20 19:44:19.963241 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:19.963220    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-gwj68"
May 20 19:44:19.965302 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:19.965280    2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
May 20 19:44:19.965302 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:19.965295    2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-s5fxj\""
May 20 19:44:19.965490 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:19.965376    2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
May 20 19:44:19.965639 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:19.965625    2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
May 20 19:44:19.965835 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:19.965819    2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-pgpdx\""
May 20 19:44:19.966050 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:19.966035    2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
May 20 19:44:19.968214 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:19.967975    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p6zpg"
May 20 19:44:19.968214 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:19.968010    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-67wbm"
May 20 19:44:19.968214 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:44:19.968068    2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p6zpg" podUID="8adc751e-abba-4cb1-ab06-d0c915b18a28"
May 20 19:44:19.970715 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:19.970694    2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
May 20 19:44:19.970808 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:19.970727    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/54a38c71-1de1-4978-9238-80cbb2312e7c-cnibin\") pod \"multus-lx5m7\" (UID: \"54a38c71-1de1-4978-9238-80cbb2312e7c\") " pod="openshift-multus/multus-lx5m7"
May 20 19:44:19.970808 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:19.970769    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/54a38c71-1de1-4978-9238-80cbb2312e7c-host-run-k8s-cni-cncf-io\") pod \"multus-lx5m7\" (UID: \"54a38c71-1de1-4978-9238-80cbb2312e7c\") " pod="openshift-multus/multus-lx5m7"
May 20 19:44:19.970808 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:19.970778    2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-b86zc\""
May 20 19:44:19.970808 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:19.970798    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/54a38c71-1de1-4978-9238-80cbb2312e7c-host-run-netns\") pod \"multus-lx5m7\" (UID: \"54a38c71-1de1-4978-9238-80cbb2312e7c\") " pod="openshift-multus/multus-lx5m7"
May 20 19:44:19.971002 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:19.970804    2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
May 20 19:44:19.971002 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:19.970838    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/54a38c71-1de1-4978-9238-80cbb2312e7c-host-var-lib-cni-multus\") pod \"multus-lx5m7\" (UID: \"54a38c71-1de1-4978-9238-80cbb2312e7c\") " pod="openshift-multus/multus-lx5m7"
May 20 19:44:19.971002 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:19.970871    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/54a38c71-1de1-4978-9238-80cbb2312e7c-multus-daemon-config\") pod \"multus-lx5m7\" (UID: \"54a38c71-1de1-4978-9238-80cbb2312e7c\") " pod="openshift-multus/multus-lx5m7"
May 20 19:44:19.971002 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:19.970902    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cb2e0a0a-0a02-4144-8e95-2888159f5bd2-tmp-dir\") pod \"node-resolver-lmf6r\" (UID: \"cb2e0a0a-0a02-4144-8e95-2888159f5bd2\") " pod="openshift-dns/node-resolver-lmf6r"
May 20 19:44:19.971002 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:19.970962    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/eb87a0e6-d519-4b67-9256-6c83f9095723-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jljg9\" (UID: \"eb87a0e6-d519-4b67-9256-6c83f9095723\") " pod="openshift-multus/multus-additional-cni-plugins-jljg9"
May 20 19:44:19.971216 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:19.971028    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/54a38c71-1de1-4978-9238-80cbb2312e7c-cni-binary-copy\") pod \"multus-lx5m7\" (UID: \"54a38c71-1de1-4978-9238-80cbb2312e7c\") " pod="openshift-multus/multus-lx5m7"
May 20 19:44:19.971216 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:19.971155    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/54a38c71-1de1-4978-9238-80cbb2312e7c-etc-kubernetes\") pod \"multus-lx5m7\" (UID: \"54a38c71-1de1-4978-9238-80cbb2312e7c\") " pod="openshift-multus/multus-lx5m7"
May 20 19:44:19.971216 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:19.971190    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/423625dd-477f-440c-acc3-b97d8fcdedc4-kubelet-dir\") pod \"aws-ebs-csi-driver-node-djpd5\" (UID: \"423625dd-477f-440c-acc3-b97d8fcdedc4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-djpd5"
May 20 19:44:19.971347 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:19.971210    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/cb2e0a0a-0a02-4144-8e95-2888159f5bd2-hosts-file\") pod \"node-resolver-lmf6r\" (UID: \"cb2e0a0a-0a02-4144-8e95-2888159f5bd2\") " pod="openshift-dns/node-resolver-lmf6r"
May 20 19:44:19.971347 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:19.971251    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/eb87a0e6-d519-4b67-9256-6c83f9095723-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jljg9\" (UID: \"eb87a0e6-d519-4b67-9256-6c83f9095723\") " pod="openshift-multus/multus-additional-cni-plugins-jljg9"
May 20 19:44:19.971347 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:19.971287    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q5rkv\" (UniqueName: \"kubernetes.io/projected/eb87a0e6-d519-4b67-9256-6c83f9095723-kube-api-access-q5rkv\") pod \"multus-additional-cni-plugins-jljg9\" (UID: \"eb87a0e6-d519-4b67-9256-6c83f9095723\") " pod="openshift-multus/multus-additional-cni-plugins-jljg9"
May 20 19:44:19.971480 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:19.971397    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/54a38c71-1de1-4978-9238-80cbb2312e7c-system-cni-dir\") pod \"multus-lx5m7\" (UID: \"54a38c71-1de1-4978-9238-80cbb2312e7c\") " pod="openshift-multus/multus-lx5m7"
May 20 19:44:19.971480 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:19.971428    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/54a38c71-1de1-4978-9238-80cbb2312e7c-multus-socket-dir-parent\") pod \"multus-lx5m7\" (UID: \"54a38c71-1de1-4978-9238-80cbb2312e7c\") " pod="openshift-multus/multus-lx5m7"
May 20 19:44:19.971480 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:19.971454    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/54a38c71-1de1-4978-9238-80cbb2312e7c-hostroot\") pod \"multus-lx5m7\" (UID: \"54a38c71-1de1-4978-9238-80cbb2312e7c\") " pod="openshift-multus/multus-lx5m7"
May 20 19:44:19.971644 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:19.971502    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/423625dd-477f-440c-acc3-b97d8fcdedc4-registration-dir\") pod \"aws-ebs-csi-driver-node-djpd5\" (UID: \"423625dd-477f-440c-acc3-b97d8fcdedc4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-djpd5"
May 20 19:44:19.971644 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:19.971552    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d5ptw\" (UniqueName: \"kubernetes.io/projected/cb2e0a0a-0a02-4144-8e95-2888159f5bd2-kube-api-access-d5ptw\") pod \"node-resolver-lmf6r\" (UID: \"cb2e0a0a-0a02-4144-8e95-2888159f5bd2\") " pod="openshift-dns/node-resolver-lmf6r"
May 20 19:44:19.971644 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:19.971607    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4639ddbd-2055-4d5f-8bda-d0cd32aca639-serviceca\") pod \"node-ca-mszww\" (UID: \"4639ddbd-2055-4d5f-8bda-d0cd32aca639\") " pod="openshift-image-registry/node-ca-mszww"
May 20 19:44:19.971644 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:19.971628    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/eb87a0e6-d519-4b67-9256-6c83f9095723-cnibin\") pod \"multus-additional-cni-plugins-jljg9\" (UID: \"eb87a0e6-d519-4b67-9256-6c83f9095723\") " pod="openshift-multus/multus-additional-cni-plugins-jljg9"
May 20 19:44:19.972114 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:19.971647    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/54a38c71-1de1-4978-9238-80cbb2312e7c-multus-cni-dir\") pod \"multus-lx5m7\" (UID: \"54a38c71-1de1-4978-9238-80cbb2312e7c\") " pod="openshift-multus/multus-lx5m7"
May 20 19:44:19.972114 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:19.971671    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/54a38c71-1de1-4978-9238-80cbb2312e7c-host-var-lib-kubelet\") pod \"multus-lx5m7\" (UID: \"54a38c71-1de1-4978-9238-80cbb2312e7c\") " pod="openshift-multus/multus-lx5m7"
May 20 19:44:19.972114 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:19.971697    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/423625dd-477f-440c-acc3-b97d8fcdedc4-etc-selinux\") pod \"aws-ebs-csi-driver-node-djpd5\" (UID: \"423625dd-477f-440c-acc3-b97d8fcdedc4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-djpd5"
May 20 19:44:19.972114 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:19.971720    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/423625dd-477f-440c-acc3-b97d8fcdedc4-sys-fs\") pod \"aws-ebs-csi-driver-node-djpd5\" (UID: \"423625dd-477f-440c-acc3-b97d8fcdedc4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-djpd5"
May 20 19:44:19.972114 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:19.971875    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/eb87a0e6-d519-4b67-9256-6c83f9095723-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jljg9\" (UID: \"eb87a0e6-d519-4b67-9256-6c83f9095723\") " pod="openshift-multus/multus-additional-cni-plugins-jljg9"
May 20 19:44:19.972114 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:19.971913    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/54a38c71-1de1-4978-9238-80cbb2312e7c-host-var-lib-cni-bin\") pod \"multus-lx5m7\" (UID: \"54a38c71-1de1-4978-9238-80cbb2312e7c\") " pod="openshift-multus/multus-lx5m7"
May 20 19:44:19.972114 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:19.971941    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/54a38c71-1de1-4978-9238-80cbb2312e7c-host-run-multus-certs\") pod \"multus-lx5m7\" (UID: \"54a38c71-1de1-4978-9238-80cbb2312e7c\") " pod="openshift-multus/multus-lx5m7"
May 20 19:44:19.972114 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:19.971973    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/423625dd-477f-440c-acc3-b97d8fcdedc4-socket-dir\") pod \"aws-ebs-csi-driver-node-djpd5\" (UID: \"423625dd-477f-440c-acc3-b97d8fcdedc4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-djpd5"
May 20 19:44:19.972573 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:19.972526    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/423625dd-477f-440c-acc3-b97d8fcdedc4-device-dir\") pod \"aws-ebs-csi-driver-node-djpd5\" (UID: \"423625dd-477f-440c-acc3-b97d8fcdedc4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-djpd5"
May 20 19:44:19.972649 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:19.972569    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4639ddbd-2055-4d5f-8bda-d0cd32aca639-host\") pod \"node-ca-mszww\" (UID: \"4639ddbd-2055-4d5f-8bda-d0cd32aca639\") " pod="openshift-image-registry/node-ca-mszww"
May 20 19:44:19.972697 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:19.972655    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/eb87a0e6-d519-4b67-9256-6c83f9095723-os-release\") pod \"multus-additional-cni-plugins-jljg9\" (UID: \"eb87a0e6-d519-4b67-9256-6c83f9095723\") " pod="openshift-multus/multus-additional-cni-plugins-jljg9"
May 20 19:44:19.972697 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:19.972691    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/eb87a0e6-d519-4b67-9256-6c83f9095723-cni-binary-copy\") pod \"multus-additional-cni-plugins-jljg9\" (UID: \"eb87a0e6-d519-4b67-9256-6c83f9095723\") " pod="openshift-multus/multus-additional-cni-plugins-jljg9"
May 20 19:44:19.972788 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:19.972722    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/54a38c71-1de1-4978-9238-80cbb2312e7c-multus-conf-dir\") pod \"multus-lx5m7\" (UID: \"54a38c71-1de1-4978-9238-80cbb2312e7c\") " pod="openshift-multus/multus-lx5m7"
May 20 19:44:19.972788 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:19.972756    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l6xjr\" (UniqueName: \"kubernetes.io/projected/54a38c71-1de1-4978-9238-80cbb2312e7c-kube-api-access-l6xjr\") pod \"multus-lx5m7\" (UID: \"54a38c71-1de1-4978-9238-80cbb2312e7c\") " pod="openshift-multus/multus-lx5m7"
May 20 19:44:19.972857 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:19.972785    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9kzwz\" (UniqueName: \"kubernetes.io/projected/423625dd-477f-440c-acc3-b97d8fcdedc4-kube-api-access-9kzwz\") pod \"aws-ebs-csi-driver-node-djpd5\" (UID: \"423625dd-477f-440c-acc3-b97d8fcdedc4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-djpd5"
May 20 19:44:19.972857 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:19.972817    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/54a38c71-1de1-4978-9238-80cbb2312e7c-os-release\") pod \"multus-lx5m7\" (UID: \"54a38c71-1de1-4978-9238-80cbb2312e7c\") " pod="openshift-multus/multus-lx5m7"
May 20 19:44:19.972927 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:19.972869    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8sdst\" (UniqueName: \"kubernetes.io/projected/4639ddbd-2055-4d5f-8bda-d0cd32aca639-kube-api-access-8sdst\") pod \"node-ca-mszww\" (UID: \"4639ddbd-2055-4d5f-8bda-d0cd32aca639\") " pod="openshift-image-registry/node-ca-mszww"
May 20 19:44:19.972927 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:19.972901    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/eb87a0e6-d519-4b67-9256-6c83f9095723-system-cni-dir\") pod \"multus-additional-cni-plugins-jljg9\" (UID: \"eb87a0e6-d519-4b67-9256-6c83f9095723\") " pod="openshift-multus/multus-additional-cni-plugins-jljg9"
May 20 19:44:19.974358 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:19.974324    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8qqbv"
May 20 19:44:19.974452 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:44:19.974410    2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8qqbv" podUID="4ab5f609-836c-4e9d-907a-620d6c9d56e2"
May 20 19:44:19.974517 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:19.974460    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-znlb8"
May 20 19:44:19.976478 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:19.976461    2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
May 20 19:44:19.976752 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:19.976732    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-8nrkk"
May 20 19:44:19.976852 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:19.976809    2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
May 20 19:44:19.977003 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:19.976984    2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-gcd22\""
May 20 19:44:19.977187 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:19.977168    2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
May 20 19:44:19.979837 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:19.979674    2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
May 20 19:44:19.979837 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:19.979695    2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
May 20 19:44:19.979837 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:19.979728    2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
May 20 19:44:19.979837 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:19.979763    2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-68sdr\""
May 20 19:44:19.979837 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:19.979698    2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
May 20 19:44:19.979837 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:19.979674    2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
May 20 19:44:19.980153 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:19.980037    2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
May 20 19:44:20.000852 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.000828    2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-19 19:39:18 +0000 UTC" deadline="2028-02-03 11:26:03.07534345 +0000 UTC"
May 20 19:44:20.000852 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.000849    2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14967h41m43.074495966s"
May 20 19:44:20.061327 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.061299    2578 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world"
May 20 19:44:20.073857 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.073815    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/eb87a0e6-d519-4b67-9256-6c83f9095723-system-cni-dir\") pod \"multus-additional-cni-plugins-jljg9\" (UID: \"eb87a0e6-d519-4b67-9256-6c83f9095723\") " pod="openshift-multus/multus-additional-cni-plugins-jljg9"
May 20 19:44:20.074019 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.073866    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3bb0c612-bb6f-4213-a7d8-88534ba9e6ee-run-openvswitch\") pod \"ovnkube-node-8nrkk\" (UID: \"3bb0c612-bb6f-4213-a7d8-88534ba9e6ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nrkk"
May 20 19:44:20.074019 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.073893    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3bb0c612-bb6f-4213-a7d8-88534ba9e6ee-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8nrkk\" (UID: \"3bb0c612-bb6f-4213-a7d8-88534ba9e6ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nrkk"
May 20 19:44:20.074019 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.073937    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/eb87a0e6-d519-4b67-9256-6c83f9095723-system-cni-dir\") pod \"multus-additional-cni-plugins-jljg9\" (UID: \"eb87a0e6-d519-4b67-9256-6c83f9095723\") " pod="openshift-multus/multus-additional-cni-plugins-jljg9"
May 20 19:44:20.074019 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.073933    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/54a38c71-1de1-4978-9238-80cbb2312e7c-host-run-k8s-cni-cncf-io\") pod \"multus-lx5m7\" (UID: \"54a38c71-1de1-4978-9238-80cbb2312e7c\") " pod="openshift-multus/multus-lx5m7"
May 20 19:44:20.074019 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.073987    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/54a38c71-1de1-4978-9238-80cbb2312e7c-host-run-k8s-cni-cncf-io\") pod \"multus-lx5m7\" (UID: \"54a38c71-1de1-4978-9238-80cbb2312e7c\") " pod="openshift-multus/multus-lx5m7"
May 20 19:44:20.074019 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.074000    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/54a38c71-1de1-4978-9238-80cbb2312e7c-host-run-netns\") pod \"multus-lx5m7\" (UID: \"54a38c71-1de1-4978-9238-80cbb2312e7c\") " pod="openshift-multus/multus-lx5m7"
May 20 19:44:20.074326 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.074036    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cb2e0a0a-0a02-4144-8e95-2888159f5bd2-tmp-dir\") pod \"node-resolver-lmf6r\" (UID: \"cb2e0a0a-0a02-4144-8e95-2888159f5bd2\") " pod="openshift-dns/node-resolver-lmf6r"
May 20 19:44:20.074326 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.074040    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/54a38c71-1de1-4978-9238-80cbb2312e7c-host-run-netns\") pod \"multus-lx5m7\" (UID: \"54a38c71-1de1-4978-9238-80cbb2312e7c\") " pod="openshift-multus/multus-lx5m7"
May 20 19:44:20.074326 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.074070    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/eb87a0e6-d519-4b67-9256-6c83f9095723-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jljg9\" (UID: \"eb87a0e6-d519-4b67-9256-6c83f9095723\") " pod="openshift-multus/multus-additional-cni-plugins-jljg9"
May 20 19:44:20.074326 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.074099    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b7fa6461-bfcd-43f2-b780-cfe899ac7f49-etc-systemd\") pod \"tuned-67wbm\" (UID: \"b7fa6461-bfcd-43f2-b780-cfe899ac7f49\") " pod="openshift-cluster-node-tuning-operator/tuned-67wbm"
May 20 19:44:20.074326 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.074125    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pqrk7\" (UniqueName: \"kubernetes.io/projected/4ab5f609-836c-4e9d-907a-620d6c9d56e2-kube-api-access-pqrk7\") pod \"network-check-target-8qqbv\" (UID: \"4ab5f609-836c-4e9d-907a-620d6c9d56e2\") " pod="openshift-network-diagnostics/network-check-target-8qqbv"
May 20 19:44:20.074326 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.074151    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/32f98a02-52ac-4222-805b-97bfd60ec8dc-konnectivity-ca\") pod \"konnectivity-agent-gwj68\" (UID: \"32f98a02-52ac-4222-805b-97bfd60ec8dc\") " pod="kube-system/konnectivity-agent-gwj68"
May 20 19:44:20.074326 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.074179    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3bb0c612-bb6f-4213-a7d8-88534ba9e6ee-host-cni-netd\") pod \"ovnkube-node-8nrkk\" (UID: \"3bb0c612-bb6f-4213-a7d8-88534ba9e6ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nrkk"
May 20 19:44:20.074326 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.074208    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b7fa6461-bfcd-43f2-b780-cfe899ac7f49-etc-sysctl-conf\") pod \"tuned-67wbm\" (UID: \"b7fa6461-bfcd-43f2-b780-cfe899ac7f49\") " pod="openshift-cluster-node-tuning-operator/tuned-67wbm"
May 20 19:44:20.074326 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.074235    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/54a38c71-1de1-4978-9238-80cbb2312e7c-etc-kubernetes\") pod \"multus-lx5m7\" (UID: \"54a38c71-1de1-4978-9238-80cbb2312e7c\") " pod="openshift-multus/multus-lx5m7"
May 20 19:44:20.074326 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.074262    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/423625dd-477f-440c-acc3-b97d8fcdedc4-kubelet-dir\") pod \"aws-ebs-csi-driver-node-djpd5\" (UID: \"423625dd-477f-440c-acc3-b97d8fcdedc4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-djpd5"
May 20 19:44:20.074326 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.074286    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/eb87a0e6-d519-4b67-9256-6c83f9095723-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jljg9\" (UID: \"eb87a0e6-d519-4b67-9256-6c83f9095723\") " pod="openshift-multus/multus-additional-cni-plugins-jljg9"
May 20 19:44:20.074326 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.074313    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-q5rkv\" (UniqueName: \"kubernetes.io/projected/eb87a0e6-d519-4b67-9256-6c83f9095723-kube-api-access-q5rkv\") pod \"multus-additional-cni-plugins-jljg9\" (UID: \"eb87a0e6-d519-4b67-9256-6c83f9095723\") " pod="openshift-multus/multus-additional-cni-plugins-jljg9"
May 20 19:44:20.074882 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.074341    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cb2e0a0a-0a02-4144-8e95-2888159f5bd2-tmp-dir\") pod \"node-resolver-lmf6r\" (UID: \"cb2e0a0a-0a02-4144-8e95-2888159f5bd2\") " pod="openshift-dns/node-resolver-lmf6r"
May 20 19:44:20.074882 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.074430    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/54a38c71-1de1-4978-9238-80cbb2312e7c-etc-kubernetes\") pod \"multus-lx5m7\" (UID: \"54a38c71-1de1-4978-9238-80cbb2312e7c\") " pod="openshift-multus/multus-lx5m7"
May 20 19:44:20.074882 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.074455    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/eb87a0e6-d519-4b67-9256-6c83f9095723-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jljg9\" (UID: \"eb87a0e6-d519-4b67-9256-6c83f9095723\") " pod="openshift-multus/multus-additional-cni-plugins-jljg9"
May 20 19:44:20.074882 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.074507    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/423625dd-477f-440c-acc3-b97d8fcdedc4-kubelet-dir\") pod \"aws-ebs-csi-driver-node-djpd5\" (UID: \"423625dd-477f-440c-acc3-b97d8fcdedc4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-djpd5"
May 20 19:44:20.074882 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.074644    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d768873b-b1f6-45b4-b6d3-c31b1d96e67a-iptables-alerter-script\") pod \"iptables-alerter-znlb8\" (UID: \"d768873b-b1f6-45b4-b6d3-c31b1d96e67a\") " pod="openshift-network-operator/iptables-alerter-znlb8"
May 20 19:44:20.074882 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.074683    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b7fa6461-bfcd-43f2-b780-cfe899ac7f49-etc-tuned\") pod \"tuned-67wbm\" (UID: \"b7fa6461-bfcd-43f2-b780-cfe899ac7f49\") " pod="openshift-cluster-node-tuning-operator/tuned-67wbm"
May 20 19:44:20.074882 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.074711    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/54a38c71-1de1-4978-9238-80cbb2312e7c-multus-socket-dir-parent\") pod \"multus-lx5m7\" (UID: \"54a38c71-1de1-4978-9238-80cbb2312e7c\") " pod="openshift-multus/multus-lx5m7"
May 20 19:44:20.074882 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.074738    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/54a38c71-1de1-4978-9238-80cbb2312e7c-hostroot\") pod \"multus-lx5m7\" (UID: \"54a38c71-1de1-4978-9238-80cbb2312e7c\") " pod="openshift-multus/multus-lx5m7"
May 20 19:44:20.074882 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.074764    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/423625dd-477f-440c-acc3-b97d8fcdedc4-registration-dir\") pod \"aws-ebs-csi-driver-node-djpd5\" (UID: \"423625dd-477f-440c-acc3-b97d8fcdedc4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-djpd5"
May 20 19:44:20.074882 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.074773    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/54a38c71-1de1-4978-9238-80cbb2312e7c-multus-socket-dir-parent\") pod \"multus-lx5m7\" (UID: \"54a38c71-1de1-4978-9238-80cbb2312e7c\") " pod="openshift-multus/multus-lx5m7"
May 20 19:44:20.074882 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.074791    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d5ptw\" (UniqueName: \"kubernetes.io/projected/cb2e0a0a-0a02-4144-8e95-2888159f5bd2-kube-api-access-d5ptw\") pod \"node-resolver-lmf6r\" (UID: \"cb2e0a0a-0a02-4144-8e95-2888159f5bd2\") " pod="openshift-dns/node-resolver-lmf6r"
May 20 19:44:20.074882 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.074815    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4639ddbd-2055-4d5f-8bda-d0cd32aca639-serviceca\") pod \"node-ca-mszww\" (UID: \"4639ddbd-2055-4d5f-8bda-d0cd32aca639\") " pod="openshift-image-registry/node-ca-mszww"
May 20 19:44:20.074882 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.074837    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/423625dd-477f-440c-acc3-b97d8fcdedc4-registration-dir\") pod \"aws-ebs-csi-driver-node-djpd5\" (UID: \"423625dd-477f-440c-acc3-b97d8fcdedc4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-djpd5"
May 20 19:44:20.074882 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.074849    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8ccqc\" (UniqueName: \"kubernetes.io/projected/b7fa6461-bfcd-43f2-b780-cfe899ac7f49-kube-api-access-8ccqc\") pod \"tuned-67wbm\" (UID: \"b7fa6461-bfcd-43f2-b780-cfe899ac7f49\") " pod="openshift-cluster-node-tuning-operator/tuned-67wbm"
May 20 19:44:20.074882 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.074866    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/54a38c71-1de1-4978-9238-80cbb2312e7c-hostroot\") pod \"multus-lx5m7\" (UID: \"54a38c71-1de1-4978-9238-80cbb2312e7c\") " pod="openshift-multus/multus-lx5m7"
May 20 19:44:20.074882 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.074876    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/32f98a02-52ac-4222-805b-97bfd60ec8dc-agent-certs\") pod \"konnectivity-agent-gwj68\" (UID: \"32f98a02-52ac-4222-805b-97bfd60ec8dc\") " pod="kube-system/konnectivity-agent-gwj68"
May 20 19:44:20.075605 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.074904    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/54a38c71-1de1-4978-9238-80cbb2312e7c-host-var-lib-kubelet\") pod \"multus-lx5m7\" (UID: \"54a38c71-1de1-4978-9238-80cbb2312e7c\") " pod="openshift-multus/multus-lx5m7"
May 20 19:44:20.075605 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.074929    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/423625dd-477f-440c-acc3-b97d8fcdedc4-etc-selinux\") pod \"aws-ebs-csi-driver-node-djpd5\" (UID: \"423625dd-477f-440c-acc3-b97d8fcdedc4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-djpd5"
May 20 19:44:20.075605 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.074972    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/423625dd-477f-440c-acc3-b97d8fcdedc4-sys-fs\") pod \"aws-ebs-csi-driver-node-djpd5\" (UID: \"423625dd-477f-440c-acc3-b97d8fcdedc4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-djpd5"
May 20 19:44:20.075605 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.074998    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/eb87a0e6-d519-4b67-9256-6c83f9095723-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jljg9\" (UID: \"eb87a0e6-d519-4b67-9256-6c83f9095723\") " pod="openshift-multus/multus-additional-cni-plugins-jljg9"
May 20 19:44:20.075605 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.075002    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/eb87a0e6-d519-4b67-9256-6c83f9095723-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jljg9\" (UID: \"eb87a0e6-d519-4b67-9256-6c83f9095723\") " pod="openshift-multus/multus-additional-cni-plugins-jljg9"
May 20 19:44:20.075605 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.075027    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b7fa6461-bfcd-43f2-b780-cfe899ac7f49-etc-kubernetes\") pod \"tuned-67wbm\" (UID: \"b7fa6461-bfcd-43f2-b780-cfe899ac7f49\") " pod="openshift-cluster-node-tuning-operator/tuned-67wbm"
May 20 19:44:20.075605 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.075059    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b7fa6461-bfcd-43f2-b780-cfe899ac7f49-etc-sysctl-d\") pod \"tuned-67wbm\" (UID: \"b7fa6461-bfcd-43f2-b780-cfe899ac7f49\") " pod="openshift-cluster-node-tuning-operator/tuned-67wbm"
May 20 19:44:20.075605 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.075071    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/54a38c71-1de1-4978-9238-80cbb2312e7c-host-var-lib-kubelet\") pod \"multus-lx5m7\" (UID: \"54a38c71-1de1-4978-9238-80cbb2312e7c\") " pod="openshift-multus/multus-lx5m7"
May 20 19:44:20.075605 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.075084    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/54a38c71-1de1-4978-9238-80cbb2312e7c-host-var-lib-cni-bin\") pod \"multus-lx5m7\" (UID: \"54a38c71-1de1-4978-9238-80cbb2312e7c\") " pod="openshift-multus/multus-lx5m7"
May 20 19:44:20.075605 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.075235    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4639ddbd-2055-4d5f-8bda-d0cd32aca639-serviceca\") pod \"node-ca-mszww\" (UID: \"4639ddbd-2055-4d5f-8bda-d0cd32aca639\") " pod="openshift-image-registry/node-ca-mszww"
May 20 19:44:20.075605 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.075295    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/423625dd-477f-440c-acc3-b97d8fcdedc4-sys-fs\") pod \"aws-ebs-csi-driver-node-djpd5\" (UID: \"423625dd-477f-440c-acc3-b97d8fcdedc4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-djpd5"
May 20 19:44:20.075605 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.075370    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/54a38c71-1de1-4978-9238-80cbb2312e7c-host-run-multus-certs\") pod \"multus-lx5m7\" (UID: \"54a38c71-1de1-4978-9238-80cbb2312e7c\") " pod="openshift-multus/multus-lx5m7"
May 20 19:44:20.075605 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.075406    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/54a38c71-1de1-4978-9238-80cbb2312e7c-host-var-lib-cni-bin\") pod \"multus-lx5m7\" (UID: \"54a38c71-1de1-4978-9238-80cbb2312e7c\") " pod="openshift-multus/multus-lx5m7"
May 20 19:44:20.075605 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.075415    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/423625dd-477f-440c-acc3-b97d8fcdedc4-socket-dir\") pod \"aws-ebs-csi-driver-node-djpd5\" (UID: \"423625dd-477f-440c-acc3-b97d8fcdedc4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-djpd5"
May 20 19:44:20.075605 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.075441    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4639ddbd-2055-4d5f-8bda-d0cd32aca639-host\") pod \"node-ca-mszww\" (UID: \"4639ddbd-2055-4d5f-8bda-d0cd32aca639\") " pod="openshift-image-registry/node-ca-mszww"
May 20 19:44:20.075605 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.075447    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/54a38c71-1de1-4978-9238-80cbb2312e7c-host-run-multus-certs\") pod \"multus-lx5m7\" (UID: \"54a38c71-1de1-4978-9238-80cbb2312e7c\") " pod="openshift-multus/multus-lx5m7"
May 20 19:44:20.075605 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.075377    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/423625dd-477f-440c-acc3-b97d8fcdedc4-etc-selinux\") pod \"aws-ebs-csi-driver-node-djpd5\" (UID: \"423625dd-477f-440c-acc3-b97d8fcdedc4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-djpd5"
May 20 19:44:20.076351 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.075483    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/eb87a0e6-d519-4b67-9256-6c83f9095723-os-release\") pod \"multus-additional-cni-plugins-jljg9\" (UID: \"eb87a0e6-d519-4b67-9256-6c83f9095723\") " pod="openshift-multus/multus-additional-cni-plugins-jljg9"
May 20 19:44:20.076351 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.075512    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3bb0c612-bb6f-4213-a7d8-88534ba9e6ee-run-ovn\") pod \"ovnkube-node-8nrkk\" (UID: \"3bb0c612-bb6f-4213-a7d8-88534ba9e6ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nrkk"
May 20 19:44:20.076351 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.075512    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/eb87a0e6-d519-4b67-9256-6c83f9095723-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jljg9\" (UID: \"eb87a0e6-d519-4b67-9256-6c83f9095723\") " pod="openshift-multus/multus-additional-cni-plugins-jljg9"
May 20 19:44:20.076351 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.075534    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/423625dd-477f-440c-acc3-b97d8fcdedc4-socket-dir\") pod \"aws-ebs-csi-driver-node-djpd5\" (UID: \"423625dd-477f-440c-acc3-b97d8fcdedc4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-djpd5"
May 20 19:44:20.076351 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.075537    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l6xjr\" (UniqueName: \"kubernetes.io/projected/54a38c71-1de1-4978-9238-80cbb2312e7c-kube-api-access-l6xjr\") pod \"multus-lx5m7\" (UID: \"54a38c71-1de1-4978-9238-80cbb2312e7c\") " pod="openshift-multus/multus-lx5m7"
May 20 19:44:20.076351 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.075568    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b7fa6461-bfcd-43f2-b780-cfe899ac7f49-run\") pod \"tuned-67wbm\" (UID: \"b7fa6461-bfcd-43f2-b780-cfe899ac7f49\") " pod="openshift-cluster-node-tuning-operator/tuned-67wbm"
May 20 19:44:20.076351 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.075602    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/eb87a0e6-d519-4b67-9256-6c83f9095723-os-release\") pod \"multus-additional-cni-plugins-jljg9\" (UID: \"eb87a0e6-d519-4b67-9256-6c83f9095723\") " pod="openshift-multus/multus-additional-cni-plugins-jljg9"
May 20 19:44:20.076351 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.075614    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j7qmj\" (UniqueName: \"kubernetes.io/projected/d768873b-b1f6-45b4-b6d3-c31b1d96e67a-kube-api-access-j7qmj\") pod \"iptables-alerter-znlb8\" (UID: \"d768873b-b1f6-45b4-b6d3-c31b1d96e67a\") " pod="openshift-network-operator/iptables-alerter-znlb8"
May 20 19:44:20.076351 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.075640    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4639ddbd-2055-4d5f-8bda-d0cd32aca639-host\") pod \"node-ca-mszww\" (UID: \"4639ddbd-2055-4d5f-8bda-d0cd32aca639\") " pod="openshift-image-registry/node-ca-mszww"
May 20 19:44:20.076351 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.075670    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3bb0c612-bb6f-4213-a7d8-88534ba9e6ee-env-overrides\") pod \"ovnkube-node-8nrkk\" (UID: \"3bb0c612-bb6f-4213-a7d8-88534ba9e6ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nrkk"
May 20 19:44:20.076351 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.075720    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b7fa6461-bfcd-43f2-b780-cfe899ac7f49-tmp\") pod \"tuned-67wbm\" (UID: \"b7fa6461-bfcd-43f2-b780-cfe899ac7f49\") " pod="openshift-cluster-node-tuning-operator/tuned-67wbm"
May 20 19:44:20.076351 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.075765    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3bb0c612-bb6f-4213-a7d8-88534ba9e6ee-log-socket\") pod \"ovnkube-node-8nrkk\" (UID: \"3bb0c612-bb6f-4213-a7d8-88534ba9e6ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nrkk"
May 20 19:44:20.076351 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.075803    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3bb0c612-bb6f-4213-a7d8-88534ba9e6ee-ovnkube-config\") pod \"ovnkube-node-8nrkk\" (UID: \"3bb0c612-bb6f-4213-a7d8-88534ba9e6ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nrkk"
May 20 19:44:20.076351 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.075839    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3bb0c612-bb6f-4213-a7d8-88534ba9e6ee-ovn-node-metrics-cert\") pod \"ovnkube-node-8nrkk\" (UID: \"3bb0c612-bb6f-4213-a7d8-88534ba9e6ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nrkk"
May 20 19:44:20.076351 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.075865    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/54a38c71-1de1-4978-9238-80cbb2312e7c-os-release\") pod \"multus-lx5m7\" (UID: \"54a38c71-1de1-4978-9238-80cbb2312e7c\") " pod="openshift-multus/multus-lx5m7"
May 20 19:44:20.076351 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.075891    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8sdst\" (UniqueName: \"kubernetes.io/projected/4639ddbd-2055-4d5f-8bda-d0cd32aca639-kube-api-access-8sdst\") pod \"node-ca-mszww\" (UID: \"4639ddbd-2055-4d5f-8bda-d0cd32aca639\") " pod="openshift-image-registry/node-ca-mszww"
May 20 19:44:20.076351 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.075918    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b7fa6461-bfcd-43f2-b780-cfe899ac7f49-etc-modprobe-d\") pod \"tuned-67wbm\" (UID: \"b7fa6461-bfcd-43f2-b780-cfe899ac7f49\") " pod="openshift-cluster-node-tuning-operator/tuned-67wbm"
May 20 19:44:20.076946 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.075942    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b7fa6461-bfcd-43f2-b780-cfe899ac7f49-sys\") pod \"tuned-67wbm\" (UID: \"b7fa6461-bfcd-43f2-b780-cfe899ac7f49\") " pod="openshift-cluster-node-tuning-operator/tuned-67wbm"
May 20 19:44:20.076946 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.075957    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/54a38c71-1de1-4978-9238-80cbb2312e7c-os-release\") pod \"multus-lx5m7\" (UID: \"54a38c71-1de1-4978-9238-80cbb2312e7c\") " pod="openshift-multus/multus-lx5m7"
May 20 19:44:20.076946 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.075968    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b7fa6461-bfcd-43f2-b780-cfe899ac7f49-var-lib-kubelet\") pod \"tuned-67wbm\" (UID: \"b7fa6461-bfcd-43f2-b780-cfe899ac7f49\") " pod="openshift-cluster-node-tuning-operator/tuned-67wbm"
May 20 19:44:20.076946 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.075997    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/54a38c71-1de1-4978-9238-80cbb2312e7c-cnibin\") pod \"multus-lx5m7\" (UID: \"54a38c71-1de1-4978-9238-80cbb2312e7c\") " pod="openshift-multus/multus-lx5m7"
May 20 19:44:20.076946 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.076027    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/54a38c71-1de1-4978-9238-80cbb2312e7c-host-var-lib-cni-multus\") pod \"multus-lx5m7\" (UID: \"54a38c71-1de1-4978-9238-80cbb2312e7c\") " pod="openshift-multus/multus-lx5m7"
May 20 19:44:20.076946 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.076048    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/54a38c71-1de1-4978-9238-80cbb2312e7c-multus-daemon-config\") pod \"multus-lx5m7\" (UID: \"54a38c71-1de1-4978-9238-80cbb2312e7c\") " pod="openshift-multus/multus-lx5m7"
May 20 19:44:20.076946 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.076063    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/54a38c71-1de1-4978-9238-80cbb2312e7c-cni-binary-copy\") pod \"multus-lx5m7\" (UID: \"54a38c71-1de1-4978-9238-80cbb2312e7c\") " pod="openshift-multus/multus-lx5m7"
May 20 19:44:20.076946 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.076078    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/cb2e0a0a-0a02-4144-8e95-2888159f5bd2-hosts-file\") pod \"node-resolver-lmf6r\" (UID: \"cb2e0a0a-0a02-4144-8e95-2888159f5bd2\") " pod="openshift-dns/node-resolver-lmf6r"
May 20 19:44:20.076946 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.076084    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/54a38c71-1de1-4978-9238-80cbb2312e7c-cnibin\") pod \"multus-lx5m7\" (UID: \"54a38c71-1de1-4978-9238-80cbb2312e7c\") " pod="openshift-multus/multus-lx5m7"
May 20 19:44:20.076946 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.076091    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/54a38c71-1de1-4978-9238-80cbb2312e7c-host-var-lib-cni-multus\") pod \"multus-lx5m7\" (UID: \"54a38c71-1de1-4978-9238-80cbb2312e7c\") " pod="openshift-multus/multus-lx5m7"
May 20 19:44:20.076946 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.076104    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8adc751e-abba-4cb1-ab06-d0c915b18a28-metrics-certs\") pod \"network-metrics-daemon-p6zpg\" (UID: \"8adc751e-abba-4cb1-ab06-d0c915b18a28\") " pod="openshift-multus/network-metrics-daemon-p6zpg"
May 20 19:44:20.076946 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.076128    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d768873b-b1f6-45b4-b6d3-c31b1d96e67a-host-slash\") pod \"iptables-alerter-znlb8\" (UID: \"d768873b-b1f6-45b4-b6d3-c31b1d96e67a\") " pod="openshift-network-operator/iptables-alerter-znlb8"
May 20 19:44:20.076946 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.076150    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3bb0c612-bb6f-4213-a7d8-88534ba9e6ee-host-kubelet\") pod \"ovnkube-node-8nrkk\" (UID: \"3bb0c612-bb6f-4213-a7d8-88534ba9e6ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nrkk"
May 20 19:44:20.076946 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.076175    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3bb0c612-bb6f-4213-a7d8-88534ba9e6ee-run-systemd\") pod \"ovnkube-node-8nrkk\" (UID: \"3bb0c612-bb6f-4213-a7d8-88534ba9e6ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nrkk"
May 20 19:44:20.076946 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.076172    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/cb2e0a0a-0a02-4144-8e95-2888159f5bd2-hosts-file\") pod \"node-resolver-lmf6r\" (UID: \"cb2e0a0a-0a02-4144-8e95-2888159f5bd2\") " pod="openshift-dns/node-resolver-lmf6r"
May 20 19:44:20.076946 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.076197    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3bb0c612-bb6f-4213-a7d8-88534ba9e6ee-host-run-ovn-kubernetes\") pod \"ovnkube-node-8nrkk\" (UID: \"3bb0c612-bb6f-4213-a7d8-88534ba9e6ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nrkk"
May 20 19:44:20.076946 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.076224    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/54a38c71-1de1-4978-9238-80cbb2312e7c-system-cni-dir\") pod \"multus-lx5m7\" (UID: \"54a38c71-1de1-4978-9238-80cbb2312e7c\") " pod="openshift-multus/multus-lx5m7"
May 20 19:44:20.076946 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.076245    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/eb87a0e6-d519-4b67-9256-6c83f9095723-cnibin\") pod \"multus-additional-cni-plugins-jljg9\" (UID: \"eb87a0e6-d519-4b67-9256-6c83f9095723\") " pod="openshift-multus/multus-additional-cni-plugins-jljg9"
May 20 19:44:20.077650 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.076268    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3bb0c612-bb6f-4213-a7d8-88534ba9e6ee-systemd-units\") pod \"ovnkube-node-8nrkk\" (UID: \"3bb0c612-bb6f-4213-a7d8-88534ba9e6ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nrkk"
May 20 19:44:20.077650 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.076280    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/eb87a0e6-d519-4b67-9256-6c83f9095723-cnibin\") pod \"multus-additional-cni-plugins-jljg9\" (UID: \"eb87a0e6-d519-4b67-9256-6c83f9095723\") " pod="openshift-multus/multus-additional-cni-plugins-jljg9"
May 20 19:44:20.077650 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.076292    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3bb0c612-bb6f-4213-a7d8-88534ba9e6ee-host-slash\") pod \"ovnkube-node-8nrkk\" (UID: \"3bb0c612-bb6f-4213-a7d8-88534ba9e6ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nrkk"
May 20 19:44:20.077650 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.076299    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/54a38c71-1de1-4978-9238-80cbb2312e7c-system-cni-dir\") pod \"multus-lx5m7\" (UID: \"54a38c71-1de1-4978-9238-80cbb2312e7c\") " pod="openshift-multus/multus-lx5m7"
May 20 19:44:20.077650 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.076319    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3bb0c612-bb6f-4213-a7d8-88534ba9e6ee-host-run-netns\") pod \"ovnkube-node-8nrkk\" (UID: \"3bb0c612-bb6f-4213-a7d8-88534ba9e6ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nrkk"
May 20 19:44:20.077650 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.076354    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3bb0c612-bb6f-4213-a7d8-88534ba9e6ee-etc-openvswitch\") pod \"ovnkube-node-8nrkk\" (UID: \"3bb0c612-bb6f-4213-a7d8-88534ba9e6ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nrkk"
May 20 19:44:20.077650 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.076409    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3bb0c612-bb6f-4213-a7d8-88534ba9e6ee-ovnkube-script-lib\") pod \"ovnkube-node-8nrkk\" (UID: \"3bb0c612-bb6f-4213-a7d8-88534ba9e6ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nrkk"
May 20 19:44:20.077650 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.076457    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/54a38c71-1de1-4978-9238-80cbb2312e7c-multus-cni-dir\") pod \"multus-lx5m7\" (UID: \"54a38c71-1de1-4978-9238-80cbb2312e7c\") " pod="openshift-multus/multus-lx5m7"
May 20 19:44:20.077650 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.076528    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/54a38c71-1de1-4978-9238-80cbb2312e7c-multus-cni-dir\") pod \"multus-lx5m7\" (UID: \"54a38c71-1de1-4978-9238-80cbb2312e7c\") " pod="openshift-multus/multus-lx5m7"
May 20 19:44:20.077650 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.076556    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/54a38c71-1de1-4978-9238-80cbb2312e7c-multus-daemon-config\") pod \"multus-lx5m7\" (UID: \"54a38c71-1de1-4978-9238-80cbb2312e7c\") " pod="openshift-multus/multus-lx5m7"
May 20 19:44:20.077650 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.076944    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3bb0c612-bb6f-4213-a7d8-88534ba9e6ee-node-log\") pod \"ovnkube-node-8nrkk\" (UID: \"3bb0c612-bb6f-4213-a7d8-88534ba9e6ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nrkk"
May 20 19:44:20.077650 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.076980    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cj9lt\" (UniqueName: \"kubernetes.io/projected/3bb0c612-bb6f-4213-a7d8-88534ba9e6ee-kube-api-access-cj9lt\") pod \"ovnkube-node-8nrkk\" (UID: \"3bb0c612-bb6f-4213-a7d8-88534ba9e6ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nrkk"
May 20 19:44:20.077650 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.077010    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/423625dd-477f-440c-acc3-b97d8fcdedc4-device-dir\") pod \"aws-ebs-csi-driver-node-djpd5\" (UID: \"423625dd-477f-440c-acc3-b97d8fcdedc4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-djpd5"
May 20 19:44:20.077650 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.077042    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/eb87a0e6-d519-4b67-9256-6c83f9095723-cni-binary-copy\") pod \"multus-additional-cni-plugins-jljg9\" (UID: \"eb87a0e6-d519-4b67-9256-6c83f9095723\") " pod="openshift-multus/multus-additional-cni-plugins-jljg9"
May 20 19:44:20.077650 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.077067    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3bb0c612-bb6f-4213-a7d8-88534ba9e6ee-host-cni-bin\") pod \"ovnkube-node-8nrkk\" (UID: \"3bb0c612-bb6f-4213-a7d8-88534ba9e6ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nrkk"
May 20 19:44:20.077650 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.077094    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/54a38c71-1de1-4978-9238-80cbb2312e7c-cni-binary-copy\") pod \"multus-lx5m7\" (UID: \"54a38c71-1de1-4978-9238-80cbb2312e7c\") " pod="openshift-multus/multus-lx5m7"
May 20 19:44:20.077650 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.077107    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/423625dd-477f-440c-acc3-b97d8fcdedc4-device-dir\") pod \"aws-ebs-csi-driver-node-djpd5\" (UID: \"423625dd-477f-440c-acc3-b97d8fcdedc4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-djpd5"
May 20 19:44:20.078233 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.077143    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/54a38c71-1de1-4978-9238-80cbb2312e7c-multus-conf-dir\") pod \"multus-lx5m7\" (UID: \"54a38c71-1de1-4978-9238-80cbb2312e7c\") " pod="openshift-multus/multus-lx5m7"
May 20 19:44:20.078233 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.077168    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9kzwz\" (UniqueName: \"kubernetes.io/projected/423625dd-477f-440c-acc3-b97d8fcdedc4-kube-api-access-9kzwz\") pod \"aws-ebs-csi-driver-node-djpd5\" (UID: \"423625dd-477f-440c-acc3-b97d8fcdedc4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-djpd5"
May 20 19:44:20.078233 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.077308    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tpjcq\" (UniqueName: \"kubernetes.io/projected/8adc751e-abba-4cb1-ab06-d0c915b18a28-kube-api-access-tpjcq\") pod \"network-metrics-daemon-p6zpg\" (UID: \"8adc751e-abba-4cb1-ab06-d0c915b18a28\") " pod="openshift-multus/network-metrics-daemon-p6zpg"
May 20 19:44:20.078233 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.077338    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b7fa6461-bfcd-43f2-b780-cfe899ac7f49-etc-sysconfig\") pod \"tuned-67wbm\" (UID: \"b7fa6461-bfcd-43f2-b780-cfe899ac7f49\") " pod="openshift-cluster-node-tuning-operator/tuned-67wbm"
May 20 19:44:20.078233 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.077382    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b7fa6461-bfcd-43f2-b780-cfe899ac7f49-lib-modules\") pod \"tuned-67wbm\" (UID: \"b7fa6461-bfcd-43f2-b780-cfe899ac7f49\") " pod="openshift-cluster-node-tuning-operator/tuned-67wbm"
May 20 19:44:20.078233 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.077409    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b7fa6461-bfcd-43f2-b780-cfe899ac7f49-host\") pod \"tuned-67wbm\" (UID: \"b7fa6461-bfcd-43f2-b780-cfe899ac7f49\") " pod="openshift-cluster-node-tuning-operator/tuned-67wbm"
May 20 19:44:20.078233 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.077434    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3bb0c612-bb6f-4213-a7d8-88534ba9e6ee-var-lib-openvswitch\") pod \"ovnkube-node-8nrkk\" (UID: \"3bb0c612-bb6f-4213-a7d8-88534ba9e6ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nrkk"
May 20 19:44:20.078233 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.077511    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/54a38c71-1de1-4978-9238-80cbb2312e7c-multus-conf-dir\") pod \"multus-lx5m7\" (UID: \"54a38c71-1de1-4978-9238-80cbb2312e7c\") " pod="openshift-multus/multus-lx5m7"
May 20 19:44:20.078233 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.077513    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/eb87a0e6-d519-4b67-9256-6c83f9095723-cni-binary-copy\") pod \"multus-additional-cni-plugins-jljg9\" (UID: \"eb87a0e6-d519-4b67-9256-6c83f9095723\") " pod="openshift-multus/multus-additional-cni-plugins-jljg9"
May 20 19:44:20.083777 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.083751    2578 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
May 20 19:44:20.087642 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.087605    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l6xjr\" (UniqueName: \"kubernetes.io/projected/54a38c71-1de1-4978-9238-80cbb2312e7c-kube-api-access-l6xjr\") pod \"multus-lx5m7\" (UID: \"54a38c71-1de1-4978-9238-80cbb2312e7c\") " pod="openshift-multus/multus-lx5m7"
May 20 19:44:20.087755 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.087605    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d5ptw\" (UniqueName: \"kubernetes.io/projected/cb2e0a0a-0a02-4144-8e95-2888159f5bd2-kube-api-access-d5ptw\") pod \"node-resolver-lmf6r\" (UID: \"cb2e0a0a-0a02-4144-8e95-2888159f5bd2\") " pod="openshift-dns/node-resolver-lmf6r"
May 20 19:44:20.088011 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.087982    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q5rkv\" (UniqueName: \"kubernetes.io/projected/eb87a0e6-d519-4b67-9256-6c83f9095723-kube-api-access-q5rkv\") pod \"multus-additional-cni-plugins-jljg9\" (UID: \"eb87a0e6-d519-4b67-9256-6c83f9095723\") " pod="openshift-multus/multus-additional-cni-plugins-jljg9"
May 20 19:44:20.088217 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.088193    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9kzwz\" (UniqueName: \"kubernetes.io/projected/423625dd-477f-440c-acc3-b97d8fcdedc4-kube-api-access-9kzwz\") pod \"aws-ebs-csi-driver-node-djpd5\" (UID: \"423625dd-477f-440c-acc3-b97d8fcdedc4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-djpd5"
May 20 19:44:20.088846 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.088824    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8sdst\" (UniqueName: \"kubernetes.io/projected/4639ddbd-2055-4d5f-8bda-d0cd32aca639-kube-api-access-8sdst\") pod \"node-ca-mszww\" (UID: \"4639ddbd-2055-4d5f-8bda-d0cd32aca639\") " pod="openshift-image-registry/node-ca-mszww"
May 20 19:44:20.178051 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.178016    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tpjcq\" (UniqueName: \"kubernetes.io/projected/8adc751e-abba-4cb1-ab06-d0c915b18a28-kube-api-access-tpjcq\") pod \"network-metrics-daemon-p6zpg\" (UID: \"8adc751e-abba-4cb1-ab06-d0c915b18a28\") " pod="openshift-multus/network-metrics-daemon-p6zpg"
May 20 19:44:20.178051 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.178047    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b7fa6461-bfcd-43f2-b780-cfe899ac7f49-etc-sysconfig\") pod \"tuned-67wbm\" (UID: \"b7fa6461-bfcd-43f2-b780-cfe899ac7f49\") " pod="openshift-cluster-node-tuning-operator/tuned-67wbm"
May 20 19:44:20.178351 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.178068    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b7fa6461-bfcd-43f2-b780-cfe899ac7f49-lib-modules\") pod \"tuned-67wbm\" (UID: \"b7fa6461-bfcd-43f2-b780-cfe899ac7f49\") " pod="openshift-cluster-node-tuning-operator/tuned-67wbm"
May 20 19:44:20.178351 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.178092    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b7fa6461-bfcd-43f2-b780-cfe899ac7f49-host\") pod \"tuned-67wbm\" (UID: \"b7fa6461-bfcd-43f2-b780-cfe899ac7f49\") " pod="openshift-cluster-node-tuning-operator/tuned-67wbm"
May 20 19:44:20.178351 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.178117    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3bb0c612-bb6f-4213-a7d8-88534ba9e6ee-var-lib-openvswitch\") pod \"ovnkube-node-8nrkk\" (UID: \"3bb0c612-bb6f-4213-a7d8-88534ba9e6ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nrkk"
May 20 19:44:20.178351 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.178124    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b7fa6461-bfcd-43f2-b780-cfe899ac7f49-etc-sysconfig\") pod \"tuned-67wbm\" (UID: \"b7fa6461-bfcd-43f2-b780-cfe899ac7f49\") " pod="openshift-cluster-node-tuning-operator/tuned-67wbm"
May 20 19:44:20.178351 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.178143    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3bb0c612-bb6f-4213-a7d8-88534ba9e6ee-run-openvswitch\") pod \"ovnkube-node-8nrkk\" (UID: \"3bb0c612-bb6f-4213-a7d8-88534ba9e6ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nrkk"
May 20 19:44:20.178351 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.178168    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3bb0c612-bb6f-4213-a7d8-88534ba9e6ee-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8nrkk\" (UID: \"3bb0c612-bb6f-4213-a7d8-88534ba9e6ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nrkk"
May 20 19:44:20.178351 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.178183    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3bb0c612-bb6f-4213-a7d8-88534ba9e6ee-var-lib-openvswitch\") pod \"ovnkube-node-8nrkk\" (UID: \"3bb0c612-bb6f-4213-a7d8-88534ba9e6ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nrkk"
May 20 19:44:20.178351 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.178199    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b7fa6461-bfcd-43f2-b780-cfe899ac7f49-etc-systemd\") pod \"tuned-67wbm\" (UID: \"b7fa6461-bfcd-43f2-b780-cfe899ac7f49\") " pod="openshift-cluster-node-tuning-operator/tuned-67wbm"
May 20 19:44:20.178351 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.178224    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pqrk7\" (UniqueName: \"kubernetes.io/projected/4ab5f609-836c-4e9d-907a-620d6c9d56e2-kube-api-access-pqrk7\") pod \"network-check-target-8qqbv\" (UID: \"4ab5f609-836c-4e9d-907a-620d6c9d56e2\") " pod="openshift-network-diagnostics/network-check-target-8qqbv"
May 20 19:44:20.178351 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.178225    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3bb0c612-bb6f-4213-a7d8-88534ba9e6ee-run-openvswitch\") pod \"ovnkube-node-8nrkk\" (UID: \"3bb0c612-bb6f-4213-a7d8-88534ba9e6ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nrkk"
May 20 19:44:20.178351 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.178229    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3bb0c612-bb6f-4213-a7d8-88534ba9e6ee-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8nrkk\" (UID: \"3bb0c612-bb6f-4213-a7d8-88534ba9e6ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nrkk"
May 20 19:44:20.178351 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.178253    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/32f98a02-52ac-4222-805b-97bfd60ec8dc-konnectivity-ca\") pod \"konnectivity-agent-gwj68\" (UID: \"32f98a02-52ac-4222-805b-97bfd60ec8dc\") " pod="kube-system/konnectivity-agent-gwj68"
May 20 19:44:20.178351 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.178219    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b7fa6461-bfcd-43f2-b780-cfe899ac7f49-host\") pod \"tuned-67wbm\" (UID: \"b7fa6461-bfcd-43f2-b780-cfe899ac7f49\") " pod="openshift-cluster-node-tuning-operator/tuned-67wbm"
May 20 19:44:20.178351 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.178268    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b7fa6461-bfcd-43f2-b780-cfe899ac7f49-etc-systemd\") pod \"tuned-67wbm\" (UID: \"b7fa6461-bfcd-43f2-b780-cfe899ac7f49\") " pod="openshift-cluster-node-tuning-operator/tuned-67wbm"
May 20 19:44:20.178351 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.178288    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b7fa6461-bfcd-43f2-b780-cfe899ac7f49-lib-modules\") pod \"tuned-67wbm\" (UID: \"b7fa6461-bfcd-43f2-b780-cfe899ac7f49\") " pod="openshift-cluster-node-tuning-operator/tuned-67wbm"
May 20 19:44:20.178351 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.178289    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3bb0c612-bb6f-4213-a7d8-88534ba9e6ee-host-cni-netd\") pod \"ovnkube-node-8nrkk\" (UID: \"3bb0c612-bb6f-4213-a7d8-88534ba9e6ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nrkk"
May 20 19:44:20.178351 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.178318    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3bb0c612-bb6f-4213-a7d8-88534ba9e6ee-host-cni-netd\") pod \"ovnkube-node-8nrkk\" (UID: \"3bb0c612-bb6f-4213-a7d8-88534ba9e6ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nrkk"
May 20 19:44:20.179137 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.178340    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b7fa6461-bfcd-43f2-b780-cfe899ac7f49-etc-sysctl-conf\") pod \"tuned-67wbm\" (UID: \"b7fa6461-bfcd-43f2-b780-cfe899ac7f49\") " pod="openshift-cluster-node-tuning-operator/tuned-67wbm"
May 20 19:44:20.179137 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.178365    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d768873b-b1f6-45b4-b6d3-c31b1d96e67a-iptables-alerter-script\") pod \"iptables-alerter-znlb8\" (UID: \"d768873b-b1f6-45b4-b6d3-c31b1d96e67a\") " pod="openshift-network-operator/iptables-alerter-znlb8"
May 20 19:44:20.179137 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.178381    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b7fa6461-bfcd-43f2-b780-cfe899ac7f49-etc-tuned\") pod \"tuned-67wbm\" (UID: \"b7fa6461-bfcd-43f2-b780-cfe899ac7f49\") " pod="openshift-cluster-node-tuning-operator/tuned-67wbm"
May 20 19:44:20.179137 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.178400    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8ccqc\" (UniqueName: \"kubernetes.io/projected/b7fa6461-bfcd-43f2-b780-cfe899ac7f49-kube-api-access-8ccqc\") pod \"tuned-67wbm\" (UID: \"b7fa6461-bfcd-43f2-b780-cfe899ac7f49\") " pod="openshift-cluster-node-tuning-operator/tuned-67wbm"
May 20 19:44:20.179137 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.178537    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b7fa6461-bfcd-43f2-b780-cfe899ac7f49-etc-sysctl-conf\") pod \"tuned-67wbm\" (UID: \"b7fa6461-bfcd-43f2-b780-cfe899ac7f49\") " pod="openshift-cluster-node-tuning-operator/tuned-67wbm"
May 20 19:44:20.179137 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.178618    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/32f98a02-52ac-4222-805b-97bfd60ec8dc-agent-certs\") pod \"konnectivity-agent-gwj68\" (UID: \"32f98a02-52ac-4222-805b-97bfd60ec8dc\") " pod="kube-system/konnectivity-agent-gwj68"
May 20 19:44:20.179137 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.178653    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b7fa6461-bfcd-43f2-b780-cfe899ac7f49-etc-kubernetes\") pod \"tuned-67wbm\" (UID: \"b7fa6461-bfcd-43f2-b780-cfe899ac7f49\") " pod="openshift-cluster-node-tuning-operator/tuned-67wbm"
May 20 19:44:20.179137 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.178678    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b7fa6461-bfcd-43f2-b780-cfe899ac7f49-etc-sysctl-d\") pod \"tuned-67wbm\" (UID: \"b7fa6461-bfcd-43f2-b780-cfe899ac7f49\") " pod="openshift-cluster-node-tuning-operator/tuned-67wbm"
May 20 19:44:20.179137 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.178708    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3bb0c612-bb6f-4213-a7d8-88534ba9e6ee-run-ovn\") pod \"ovnkube-node-8nrkk\" (UID: \"3bb0c612-bb6f-4213-a7d8-88534ba9e6ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nrkk"
May 20 19:44:20.179137 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.178731    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b7fa6461-bfcd-43f2-b780-cfe899ac7f49-run\") pod \"tuned-67wbm\" (UID: \"b7fa6461-bfcd-43f2-b780-cfe899ac7f49\") " pod="openshift-cluster-node-tuning-operator/tuned-67wbm"
May 20 19:44:20.179137 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.178756    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-j7qmj\" (UniqueName: \"kubernetes.io/projected/d768873b-b1f6-45b4-b6d3-c31b1d96e67a-kube-api-access-j7qmj\") pod \"iptables-alerter-znlb8\" (UID: \"d768873b-b1f6-45b4-b6d3-c31b1d96e67a\") " pod="openshift-network-operator/iptables-alerter-znlb8"
May 20 19:44:20.179137 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.178781    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3bb0c612-bb6f-4213-a7d8-88534ba9e6ee-env-overrides\") pod \"ovnkube-node-8nrkk\" (UID: \"3bb0c612-bb6f-4213-a7d8-88534ba9e6ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nrkk"
May 20 19:44:20.179137 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.178785    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b7fa6461-bfcd-43f2-b780-cfe899ac7f49-etc-kubernetes\") pod \"tuned-67wbm\" (UID: \"b7fa6461-bfcd-43f2-b780-cfe899ac7f49\") " pod="openshift-cluster-node-tuning-operator/tuned-67wbm"
May 20 19:44:20.179137 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.178804    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b7fa6461-bfcd-43f2-b780-cfe899ac7f49-tmp\") pod \"tuned-67wbm\" (UID: \"b7fa6461-bfcd-43f2-b780-cfe899ac7f49\") " pod="openshift-cluster-node-tuning-operator/tuned-67wbm"
May 20 19:44:20.179137 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.178828    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3bb0c612-bb6f-4213-a7d8-88534ba9e6ee-log-socket\") pod \"ovnkube-node-8nrkk\" (UID: \"3bb0c612-bb6f-4213-a7d8-88534ba9e6ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nrkk"
May 20 19:44:20.179137 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.178849    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3bb0c612-bb6f-4213-a7d8-88534ba9e6ee-ovnkube-config\") pod \"ovnkube-node-8nrkk\" (UID: \"3bb0c612-bb6f-4213-a7d8-88534ba9e6ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nrkk"
May 20 19:44:20.179137 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.178890    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3bb0c612-bb6f-4213-a7d8-88534ba9e6ee-ovn-node-metrics-cert\") pod \"ovnkube-node-8nrkk\" (UID: \"3bb0c612-bb6f-4213-a7d8-88534ba9e6ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nrkk"
May 20 19:44:20.180016 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.178918    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b7fa6461-bfcd-43f2-b780-cfe899ac7f49-etc-modprobe-d\") pod \"tuned-67wbm\" (UID: \"b7fa6461-bfcd-43f2-b780-cfe899ac7f49\") " pod="openshift-cluster-node-tuning-operator/tuned-67wbm"
May 20 19:44:20.180016 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.178923    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b7fa6461-bfcd-43f2-b780-cfe899ac7f49-etc-sysctl-d\") pod \"tuned-67wbm\" (UID: \"b7fa6461-bfcd-43f2-b780-cfe899ac7f49\") " pod="openshift-cluster-node-tuning-operator/tuned-67wbm"
May 20 19:44:20.180016 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.178944    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b7fa6461-bfcd-43f2-b780-cfe899ac7f49-sys\") pod \"tuned-67wbm\" (UID: \"b7fa6461-bfcd-43f2-b780-cfe899ac7f49\") " pod="openshift-cluster-node-tuning-operator/tuned-67wbm"
May 20 19:44:20.180016 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.178968    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3bb0c612-bb6f-4213-a7d8-88534ba9e6ee-run-ovn\") pod \"ovnkube-node-8nrkk\" (UID: \"3bb0c612-bb6f-4213-a7d8-88534ba9e6ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nrkk"
May 20 19:44:20.180016 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.178969    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b7fa6461-bfcd-43f2-b780-cfe899ac7f49-var-lib-kubelet\") pod \"tuned-67wbm\" (UID: \"b7fa6461-bfcd-43f2-b780-cfe899ac7f49\") " pod="openshift-cluster-node-tuning-operator/tuned-67wbm"
May 20 19:44:20.180016 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.179002    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d768873b-b1f6-45b4-b6d3-c31b1d96e67a-iptables-alerter-script\") pod \"iptables-alerter-znlb8\" (UID: \"d768873b-b1f6-45b4-b6d3-c31b1d96e67a\") " pod="openshift-network-operator/iptables-alerter-znlb8"
May 20 19:44:20.180016 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.179014    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b7fa6461-bfcd-43f2-b780-cfe899ac7f49-var-lib-kubelet\") pod \"tuned-67wbm\" (UID: \"b7fa6461-bfcd-43f2-b780-cfe899ac7f49\") " pod="openshift-cluster-node-tuning-operator/tuned-67wbm"
May 20 19:44:20.180016 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.179017    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8adc751e-abba-4cb1-ab06-d0c915b18a28-metrics-certs\") pod \"network-metrics-daemon-p6zpg\" (UID: \"8adc751e-abba-4cb1-ab06-d0c915b18a28\") " pod="openshift-multus/network-metrics-daemon-p6zpg"
May 20 19:44:20.180016 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.179064    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d768873b-b1f6-45b4-b6d3-c31b1d96e67a-host-slash\") pod \"iptables-alerter-znlb8\" (UID: \"d768873b-b1f6-45b4-b6d3-c31b1d96e67a\") " pod="openshift-network-operator/iptables-alerter-znlb8"
May 20 19:44:20.180016 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.179089    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3bb0c612-bb6f-4213-a7d8-88534ba9e6ee-host-kubelet\") pod \"ovnkube-node-8nrkk\" (UID: \"3bb0c612-bb6f-4213-a7d8-88534ba9e6ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nrkk"
May 20 19:44:20.180016 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:44:20.179099    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 20 19:44:20.180016 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.179112    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3bb0c612-bb6f-4213-a7d8-88534ba9e6ee-run-systemd\") pod \"ovnkube-node-8nrkk\" (UID: \"3bb0c612-bb6f-4213-a7d8-88534ba9e6ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nrkk"
May 20 19:44:20.180016 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.179138    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3bb0c612-bb6f-4213-a7d8-88534ba9e6ee-host-run-ovn-kubernetes\") pod \"ovnkube-node-8nrkk\" (UID: \"3bb0c612-bb6f-4213-a7d8-88534ba9e6ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nrkk"
May 20 19:44:20.180016 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.179172    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3bb0c612-bb6f-4213-a7d8-88534ba9e6ee-host-run-ovn-kubernetes\") pod \"ovnkube-node-8nrkk\" (UID: \"3bb0c612-bb6f-4213-a7d8-88534ba9e6ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nrkk"
May 20 19:44:20.180016 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.179234    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b7fa6461-bfcd-43f2-b780-cfe899ac7f49-sys\") pod \"tuned-67wbm\" (UID: \"b7fa6461-bfcd-43f2-b780-cfe899ac7f49\") " pod="openshift-cluster-node-tuning-operator/tuned-67wbm"
May 20 19:44:20.180016 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.179272    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b7fa6461-bfcd-43f2-b780-cfe899ac7f49-run\") pod \"tuned-67wbm\" (UID: \"b7fa6461-bfcd-43f2-b780-cfe899ac7f49\") " pod="openshift-cluster-node-tuning-operator/tuned-67wbm"
May 20 19:44:20.180016 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.179327    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3bb0c612-bb6f-4213-a7d8-88534ba9e6ee-host-kubelet\") pod \"ovnkube-node-8nrkk\" (UID: \"3bb0c612-bb6f-4213-a7d8-88534ba9e6ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nrkk"
May 20 19:44:20.180016 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.178780    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/32f98a02-52ac-4222-805b-97bfd60ec8dc-konnectivity-ca\") pod \"konnectivity-agent-gwj68\" (UID: \"32f98a02-52ac-4222-805b-97bfd60ec8dc\") " pod="kube-system/konnectivity-agent-gwj68"
May 20 19:44:20.180863 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.179376    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d768873b-b1f6-45b4-b6d3-c31b1d96e67a-host-slash\") pod \"iptables-alerter-znlb8\" (UID: \"d768873b-b1f6-45b4-b6d3-c31b1d96e67a\") " pod="openshift-network-operator/iptables-alerter-znlb8"
May 20 19:44:20.180863 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:44:20.179178    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8adc751e-abba-4cb1-ab06-d0c915b18a28-metrics-certs podName:8adc751e-abba-4cb1-ab06-d0c915b18a28 nodeName:}" failed. No retries permitted until 2026-05-20 19:44:20.679147601 +0000 UTC m=+3.127696457 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8adc751e-abba-4cb1-ab06-d0c915b18a28-metrics-certs") pod "network-metrics-daemon-p6zpg" (UID: "8adc751e-abba-4cb1-ab06-d0c915b18a28") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 20 19:44:20.180863 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.179609    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3bb0c612-bb6f-4213-a7d8-88534ba9e6ee-run-systemd\") pod \"ovnkube-node-8nrkk\" (UID: \"3bb0c612-bb6f-4213-a7d8-88534ba9e6ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nrkk"
May 20 19:44:20.180863 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.179686    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3bb0c612-bb6f-4213-a7d8-88534ba9e6ee-log-socket\") pod \"ovnkube-node-8nrkk\" (UID: \"3bb0c612-bb6f-4213-a7d8-88534ba9e6ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nrkk"
May 20 19:44:20.180863 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.179704    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b7fa6461-bfcd-43f2-b780-cfe899ac7f49-etc-modprobe-d\") pod \"tuned-67wbm\" (UID: \"b7fa6461-bfcd-43f2-b780-cfe899ac7f49\") " pod="openshift-cluster-node-tuning-operator/tuned-67wbm"
May 20 19:44:20.180863 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.179724    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3bb0c612-bb6f-4213-a7d8-88534ba9e6ee-env-overrides\") pod \"ovnkube-node-8nrkk\" (UID: \"3bb0c612-bb6f-4213-a7d8-88534ba9e6ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nrkk"
May 20 19:44:20.180863 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.179743    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3bb0c612-bb6f-4213-a7d8-88534ba9e6ee-systemd-units\") pod \"ovnkube-node-8nrkk\" (UID: \"3bb0c612-bb6f-4213-a7d8-88534ba9e6ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nrkk"
May 20 19:44:20.180863 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.179748    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3bb0c612-bb6f-4213-a7d8-88534ba9e6ee-ovnkube-config\") pod \"ovnkube-node-8nrkk\" (UID: \"3bb0c612-bb6f-4213-a7d8-88534ba9e6ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nrkk"
May 20 19:44:20.180863 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.179772    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3bb0c612-bb6f-4213-a7d8-88534ba9e6ee-host-slash\") pod \"ovnkube-node-8nrkk\" (UID: \"3bb0c612-bb6f-4213-a7d8-88534ba9e6ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nrkk"
May 20 19:44:20.180863 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.179798    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3bb0c612-bb6f-4213-a7d8-88534ba9e6ee-host-run-netns\") pod \"ovnkube-node-8nrkk\" (UID: \"3bb0c612-bb6f-4213-a7d8-88534ba9e6ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nrkk"
May 20 19:44:20.180863 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.179807    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3bb0c612-bb6f-4213-a7d8-88534ba9e6ee-systemd-units\") pod \"ovnkube-node-8nrkk\" (UID: \"3bb0c612-bb6f-4213-a7d8-88534ba9e6ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nrkk"
May 20 19:44:20.180863 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.179819    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3bb0c612-bb6f-4213-a7d8-88534ba9e6ee-etc-openvswitch\") pod \"ovnkube-node-8nrkk\" (UID: \"3bb0c612-bb6f-4213-a7d8-88534ba9e6ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nrkk"
May 20 19:44:20.180863 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.179829    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3bb0c612-bb6f-4213-a7d8-88534ba9e6ee-host-slash\") pod \"ovnkube-node-8nrkk\" (UID: \"3bb0c612-bb6f-4213-a7d8-88534ba9e6ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nrkk"
May 20 19:44:20.180863 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.179844    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3bb0c612-bb6f-4213-a7d8-88534ba9e6ee-ovnkube-script-lib\") pod \"ovnkube-node-8nrkk\" (UID: \"3bb0c612-bb6f-4213-a7d8-88534ba9e6ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nrkk"
May 20 19:44:20.180863 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.179869    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3bb0c612-bb6f-4213-a7d8-88534ba9e6ee-node-log\") pod \"ovnkube-node-8nrkk\" (UID: \"3bb0c612-bb6f-4213-a7d8-88534ba9e6ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nrkk"
May 20 19:44:20.180863 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.179873    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3bb0c612-bb6f-4213-a7d8-88534ba9e6ee-etc-openvswitch\") pod \"ovnkube-node-8nrkk\" (UID: \"3bb0c612-bb6f-4213-a7d8-88534ba9e6ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nrkk"
May 20 19:44:20.180863 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.179904    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cj9lt\" (UniqueName: \"kubernetes.io/projected/3bb0c612-bb6f-4213-a7d8-88534ba9e6ee-kube-api-access-cj9lt\") pod \"ovnkube-node-8nrkk\" (UID: \"3bb0c612-bb6f-4213-a7d8-88534ba9e6ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nrkk"
May 20 19:44:20.181655 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.179912    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3bb0c612-bb6f-4213-a7d8-88534ba9e6ee-node-log\") pod \"ovnkube-node-8nrkk\" (UID: \"3bb0c612-bb6f-4213-a7d8-88534ba9e6ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nrkk"
May 20 19:44:20.181655 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.179846    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3bb0c612-bb6f-4213-a7d8-88534ba9e6ee-host-run-netns\") pod \"ovnkube-node-8nrkk\" (UID: \"3bb0c612-bb6f-4213-a7d8-88534ba9e6ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nrkk"
May 20 19:44:20.181655 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.179935    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3bb0c612-bb6f-4213-a7d8-88534ba9e6ee-host-cni-bin\") pod \"ovnkube-node-8nrkk\" (UID: \"3bb0c612-bb6f-4213-a7d8-88534ba9e6ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nrkk"
May 20 19:44:20.181655 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.180000    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3bb0c612-bb6f-4213-a7d8-88534ba9e6ee-host-cni-bin\") pod \"ovnkube-node-8nrkk\" (UID: \"3bb0c612-bb6f-4213-a7d8-88534ba9e6ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nrkk"
May 20 19:44:20.181655 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.180492    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3bb0c612-bb6f-4213-a7d8-88534ba9e6ee-ovnkube-script-lib\") pod \"ovnkube-node-8nrkk\" (UID: \"3bb0c612-bb6f-4213-a7d8-88534ba9e6ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nrkk"
May 20 19:44:20.181655 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.181528    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b7fa6461-bfcd-43f2-b780-cfe899ac7f49-etc-tuned\") pod \"tuned-67wbm\" (UID: \"b7fa6461-bfcd-43f2-b780-cfe899ac7f49\") " pod="openshift-cluster-node-tuning-operator/tuned-67wbm"
May 20 19:44:20.181999 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.181716    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b7fa6461-bfcd-43f2-b780-cfe899ac7f49-tmp\") pod \"tuned-67wbm\" (UID: \"b7fa6461-bfcd-43f2-b780-cfe899ac7f49\") " pod="openshift-cluster-node-tuning-operator/tuned-67wbm"
May 20 19:44:20.181999 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.181837    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/32f98a02-52ac-4222-805b-97bfd60ec8dc-agent-certs\") pod \"konnectivity-agent-gwj68\" (UID: \"32f98a02-52ac-4222-805b-97bfd60ec8dc\") " pod="kube-system/konnectivity-agent-gwj68"
May 20 19:44:20.181999 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.181938    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3bb0c612-bb6f-4213-a7d8-88534ba9e6ee-ovn-node-metrics-cert\") pod \"ovnkube-node-8nrkk\" (UID: \"3bb0c612-bb6f-4213-a7d8-88534ba9e6ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nrkk"
May 20 19:44:20.189321 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:44:20.189301    2578 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 20 19:44:20.189321 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:44:20.189320    2578 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 20 19:44:20.189523 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:44:20.189330    2578 projected.go:194] Error preparing data for projected volume kube-api-access-pqrk7 for pod openshift-network-diagnostics/network-check-target-8qqbv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 20 19:44:20.189523 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:44:20.189389    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4ab5f609-836c-4e9d-907a-620d6c9d56e2-kube-api-access-pqrk7 podName:4ab5f609-836c-4e9d-907a-620d6c9d56e2 nodeName:}" failed. No retries permitted until 2026-05-20 19:44:20.689376066 +0000 UTC m=+3.137924898 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-pqrk7" (UniqueName: "kubernetes.io/projected/4ab5f609-836c-4e9d-907a-620d6c9d56e2-kube-api-access-pqrk7") pod "network-check-target-8qqbv" (UID: "4ab5f609-836c-4e9d-907a-620d6c9d56e2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 20 19:44:20.191470 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.191398    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tpjcq\" (UniqueName: \"kubernetes.io/projected/8adc751e-abba-4cb1-ab06-d0c915b18a28-kube-api-access-tpjcq\") pod \"network-metrics-daemon-p6zpg\" (UID: \"8adc751e-abba-4cb1-ab06-d0c915b18a28\") " pod="openshift-multus/network-metrics-daemon-p6zpg"
May 20 19:44:20.191907 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.191887    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8ccqc\" (UniqueName: \"kubernetes.io/projected/b7fa6461-bfcd-43f2-b780-cfe899ac7f49-kube-api-access-8ccqc\") pod \"tuned-67wbm\" (UID: \"b7fa6461-bfcd-43f2-b780-cfe899ac7f49\") " pod="openshift-cluster-node-tuning-operator/tuned-67wbm"
May 20 19:44:20.192374 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.192355    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j7qmj\" (UniqueName: \"kubernetes.io/projected/d768873b-b1f6-45b4-b6d3-c31b1d96e67a-kube-api-access-j7qmj\") pod \"iptables-alerter-znlb8\" (UID: \"d768873b-b1f6-45b4-b6d3-c31b1d96e67a\") " pod="openshift-network-operator/iptables-alerter-znlb8"
May 20 19:44:20.192727 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.192705    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cj9lt\" (UniqueName: \"kubernetes.io/projected/3bb0c612-bb6f-4213-a7d8-88534ba9e6ee-kube-api-access-cj9lt\") pod \"ovnkube-node-8nrkk\" (UID: \"3bb0c612-bb6f-4213-a7d8-88534ba9e6ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-8nrkk"
May 20 19:44:20.263168 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.263132    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-lx5m7"
May 20 19:44:20.273208 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.273182    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-djpd5"
May 20 19:44:20.282943 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.282920    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-lmf6r"
May 20 19:44:20.288478 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.288456    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-mszww"
May 20 19:44:20.295074 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.295055    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-jljg9"
May 20 19:44:20.301690 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.301673    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-gwj68"
May 20 19:44:20.308268 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.308243    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-67wbm"
May 20 19:44:20.315815 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.315794    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-znlb8"
May 20 19:44:20.320405 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.320386    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-8nrkk"
May 20 19:44:20.391745 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.391714    2578 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 20 19:44:20.663937 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:20.663906    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4639ddbd_2055_4d5f_8bda_d0cd32aca639.slice/crio-1c4b17aed3a45552cf6feeed0e3dfc336b28394cd0dc6ebdd39ecebeeb843b0f WatchSource:0}: Error finding container 1c4b17aed3a45552cf6feeed0e3dfc336b28394cd0dc6ebdd39ecebeeb843b0f: Status 404 returned error can't find the container with id 1c4b17aed3a45552cf6feeed0e3dfc336b28394cd0dc6ebdd39ecebeeb843b0f
May 20 19:44:20.665541 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:20.665385    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54a38c71_1de1_4978_9238_80cbb2312e7c.slice/crio-ce4de2c6e3cfe09d322ffd4af2dd3bb64b7c7ee18efc7e679cdd43d7ba920ebd WatchSource:0}: Error finding container ce4de2c6e3cfe09d322ffd4af2dd3bb64b7c7ee18efc7e679cdd43d7ba920ebd: Status 404 returned error can't find the container with id ce4de2c6e3cfe09d322ffd4af2dd3bb64b7c7ee18efc7e679cdd43d7ba920ebd
May 20 19:44:20.668140 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:20.668072    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb87a0e6_d519_4b67_9256_6c83f9095723.slice/crio-1e8e9cd9e93adcd4037397244224aa2dee1db52a349910f92470ed142800e0fd WatchSource:0}: Error finding container 1e8e9cd9e93adcd4037397244224aa2dee1db52a349910f92470ed142800e0fd: Status 404 returned error can't find the container with id 1e8e9cd9e93adcd4037397244224aa2dee1db52a349910f92470ed142800e0fd
May 20 19:44:20.668780 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:20.668756    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7fa6461_bfcd_43f2_b780_cfe899ac7f49.slice/crio-12e6a81917d6e88c526e8cc346c7ab831c4e1d4787cbd223cba8192db487812e WatchSource:0}: Error finding container 12e6a81917d6e88c526e8cc346c7ab831c4e1d4787cbd223cba8192db487812e: Status 404 returned error can't find the container with id 12e6a81917d6e88c526e8cc346c7ab831c4e1d4787cbd223cba8192db487812e
May 20 19:44:20.669654 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:20.669632    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3bb0c612_bb6f_4213_a7d8_88534ba9e6ee.slice/crio-dd3121ff00dceb53d490d546181429ed2380980a28dd40352fa1fbf4a1bc8126 WatchSource:0}: Error finding container dd3121ff00dceb53d490d546181429ed2380980a28dd40352fa1fbf4a1bc8126: Status 404 returned error can't find the container with id dd3121ff00dceb53d490d546181429ed2380980a28dd40352fa1fbf4a1bc8126
May 20 19:44:20.683792 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.683768    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8adc751e-abba-4cb1-ab06-d0c915b18a28-metrics-certs\") pod \"network-metrics-daemon-p6zpg\" (UID: \"8adc751e-abba-4cb1-ab06-d0c915b18a28\") " pod="openshift-multus/network-metrics-daemon-p6zpg"
May 20 19:44:20.683922 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:44:20.683906    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 20 19:44:20.683988 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:44:20.683965    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8adc751e-abba-4cb1-ab06-d0c915b18a28-metrics-certs podName:8adc751e-abba-4cb1-ab06-d0c915b18a28 nodeName:}" failed. No retries permitted until 2026-05-20 19:44:21.683946916 +0000 UTC m=+4.132495751 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8adc751e-abba-4cb1-ab06-d0c915b18a28-metrics-certs") pod "network-metrics-daemon-p6zpg" (UID: "8adc751e-abba-4cb1-ab06-d0c915b18a28") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 20 19:44:20.691788 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:20.691769    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32f98a02_52ac_4222_805b_97bfd60ec8dc.slice/crio-7d5a98f93e6a05c9b2c37d95601f4792b0d15eef4af4437f01f47866a3a35ebf WatchSource:0}: Error finding container 7d5a98f93e6a05c9b2c37d95601f4792b0d15eef4af4437f01f47866a3a35ebf: Status 404 returned error can't find the container with id 7d5a98f93e6a05c9b2c37d95601f4792b0d15eef4af4437f01f47866a3a35ebf
May 20 19:44:20.692898 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:20.692850    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod423625dd_477f_440c_acc3_b97d8fcdedc4.slice/crio-d550608baab77a399697b4139c5bb7f185a7b69f4e346c856f4682f236ee24e8 WatchSource:0}: Error finding container d550608baab77a399697b4139c5bb7f185a7b69f4e346c856f4682f236ee24e8: Status 404 returned error can't find the container with id d550608baab77a399697b4139c5bb7f185a7b69f4e346c856f4682f236ee24e8
May 20 19:44:20.693857 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:20.693833    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb2e0a0a_0a02_4144_8e95_2888159f5bd2.slice/crio-77b55c42617ab372201d089f456be67175304f6b4c8e2c06e3a1b754b08ccb75 WatchSource:0}: Error finding container 77b55c42617ab372201d089f456be67175304f6b4c8e2c06e3a1b754b08ccb75: Status 404 returned error can't find the container with id 77b55c42617ab372201d089f456be67175304f6b4c8e2c06e3a1b754b08ccb75
May 20 19:44:20.694655 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:44:20.694633    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd768873b_b1f6_45b4_b6d3_c31b1d96e67a.slice/crio-5a2915d2c9c193b413dc0c5512322c10b8156bee727a0e66078ccb81293dc55c WatchSource:0}: Error finding container 5a2915d2c9c193b413dc0c5512322c10b8156bee727a0e66078ccb81293dc55c: Status 404 returned error can't find the container with id 5a2915d2c9c193b413dc0c5512322c10b8156bee727a0e66078ccb81293dc55c
May 20 19:44:20.784181 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:20.784031    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pqrk7\" (UniqueName: \"kubernetes.io/projected/4ab5f609-836c-4e9d-907a-620d6c9d56e2-kube-api-access-pqrk7\") pod \"network-check-target-8qqbv\" (UID: \"4ab5f609-836c-4e9d-907a-620d6c9d56e2\") " pod="openshift-network-diagnostics/network-check-target-8qqbv"
May 20 19:44:20.784181 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:44:20.784179    2578 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 20 19:44:20.784357 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:44:20.784198    2578 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 20 19:44:20.784357 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:44:20.784209    2578 projected.go:194] Error preparing data for projected volume kube-api-access-pqrk7 for pod openshift-network-diagnostics/network-check-target-8qqbv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 20 19:44:20.784357 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:44:20.784264    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4ab5f609-836c-4e9d-907a-620d6c9d56e2-kube-api-access-pqrk7 podName:4ab5f609-836c-4e9d-907a-620d6c9d56e2 nodeName:}" failed. No retries permitted until 2026-05-20 19:44:21.784244812 +0000 UTC m=+4.232793646 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-pqrk7" (UniqueName: "kubernetes.io/projected/4ab5f609-836c-4e9d-907a-620d6c9d56e2-kube-api-access-pqrk7") pod "network-check-target-8qqbv" (UID: "4ab5f609-836c-4e9d-907a-620d6c9d56e2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 20 19:44:21.001851 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:21.001809    2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-19 19:39:18 +0000 UTC" deadline="2028-01-18 06:53:58.648300463 +0000 UTC"
May 20 19:44:21.001851 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:21.001846    2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14579h9m37.64645671s"
May 20 19:44:21.096900 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:21.096867    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p6zpg"
May 20 19:44:21.097060 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:44:21.097005    2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p6zpg" podUID="8adc751e-abba-4cb1-ab06-d0c915b18a28"
May 20 19:44:21.104075 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:21.104040    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-167.ec2.internal" event={"ID":"c154af641d973d5a0b0e558435e3a97e","Type":"ContainerStarted","Data":"ad2fa9a32e99619fa839d620abcf4dac452a9b353be1159377a63de60e174fef"}
May 20 19:44:21.109645 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:21.109617    2578 generic.go:358] "Generic (PLEG): container finished" podID="8736a515541c78203a4ba66250257011" containerID="8b2951722fe56901734edf900f62d9c947c32f5e22672a622ef68d30929d1883" exitCode=0
May 20 19:44:21.109802 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:21.109696    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-167.ec2.internal" event={"ID":"8736a515541c78203a4ba66250257011","Type":"ContainerDied","Data":"8b2951722fe56901734edf900f62d9c947c32f5e22672a622ef68d30929d1883"}
May 20 19:44:21.111876 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:21.111857    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-znlb8" event={"ID":"d768873b-b1f6-45b4-b6d3-c31b1d96e67a","Type":"ContainerStarted","Data":"5a2915d2c9c193b413dc0c5512322c10b8156bee727a0e66078ccb81293dc55c"}
May 20 19:44:21.114538 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:21.114509    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-lmf6r" event={"ID":"cb2e0a0a-0a02-4144-8e95-2888159f5bd2","Type":"ContainerStarted","Data":"77b55c42617ab372201d089f456be67175304f6b4c8e2c06e3a1b754b08ccb75"}
May 20 19:44:21.116892 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:21.116866    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-djpd5" event={"ID":"423625dd-477f-440c-acc3-b97d8fcdedc4","Type":"ContainerStarted","Data":"d550608baab77a399697b4139c5bb7f185a7b69f4e346c856f4682f236ee24e8"}
May 20 19:44:21.118256 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:21.118220    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-67wbm" event={"ID":"b7fa6461-bfcd-43f2-b780-cfe899ac7f49","Type":"ContainerStarted","Data":"12e6a81917d6e88c526e8cc346c7ab831c4e1d4787cbd223cba8192db487812e"}
May 20 19:44:21.120404 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:21.119769    2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-167.ec2.internal" podStartSLOduration=2.119753927 podStartE2EDuration="2.119753927s" podCreationTimestamp="2026-05-20 19:44:19 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-20 19:44:21.118964473 +0000 UTC m=+3.567513323" watchObservedRunningTime="2026-05-20 19:44:21.119753927 +0000 UTC m=+3.568302782"
May 20 19:44:21.120404 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:21.120348    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jljg9" event={"ID":"eb87a0e6-d519-4b67-9256-6c83f9095723","Type":"ContainerStarted","Data":"1e8e9cd9e93adcd4037397244224aa2dee1db52a349910f92470ed142800e0fd"}
May 20 19:44:21.122696 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:21.122651    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-lx5m7" event={"ID":"54a38c71-1de1-4978-9238-80cbb2312e7c","Type":"ContainerStarted","Data":"ce4de2c6e3cfe09d322ffd4af2dd3bb64b7c7ee18efc7e679cdd43d7ba920ebd"}
May 20 19:44:21.125406 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:21.125361    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-gwj68" event={"ID":"32f98a02-52ac-4222-805b-97bfd60ec8dc","Type":"ContainerStarted","Data":"7d5a98f93e6a05c9b2c37d95601f4792b0d15eef4af4437f01f47866a3a35ebf"}
May 20 19:44:21.126744 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:21.126721    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8nrkk" event={"ID":"3bb0c612-bb6f-4213-a7d8-88534ba9e6ee","Type":"ContainerStarted","Data":"dd3121ff00dceb53d490d546181429ed2380980a28dd40352fa1fbf4a1bc8126"}
May 20 19:44:21.128950 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:21.128927    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-mszww" event={"ID":"4639ddbd-2055-4d5f-8bda-d0cd32aca639","Type":"ContainerStarted","Data":"1c4b17aed3a45552cf6feeed0e3dfc336b28394cd0dc6ebdd39ecebeeb843b0f"}
May 20 19:44:21.694454 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:21.694413    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8adc751e-abba-4cb1-ab06-d0c915b18a28-metrics-certs\") pod \"network-metrics-daemon-p6zpg\" (UID: \"8adc751e-abba-4cb1-ab06-d0c915b18a28\") " pod="openshift-multus/network-metrics-daemon-p6zpg"
May 20 19:44:21.694689 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:44:21.694609    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 20 19:44:21.694755 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:44:21.694692    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8adc751e-abba-4cb1-ab06-d0c915b18a28-metrics-certs podName:8adc751e-abba-4cb1-ab06-d0c915b18a28 nodeName:}" failed. No retries permitted until 2026-05-20 19:44:23.694664757 +0000 UTC m=+6.143213590 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8adc751e-abba-4cb1-ab06-d0c915b18a28-metrics-certs") pod "network-metrics-daemon-p6zpg" (UID: "8adc751e-abba-4cb1-ab06-d0c915b18a28") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 20 19:44:21.795005 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:21.794963    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pqrk7\" (UniqueName: \"kubernetes.io/projected/4ab5f609-836c-4e9d-907a-620d6c9d56e2-kube-api-access-pqrk7\") pod \"network-check-target-8qqbv\" (UID: \"4ab5f609-836c-4e9d-907a-620d6c9d56e2\") " pod="openshift-network-diagnostics/network-check-target-8qqbv"
May 20 19:44:21.795192 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:44:21.795143    2578 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 20 19:44:21.795192 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:44:21.795160    2578 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 20 19:44:21.795192 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:44:21.795172    2578 projected.go:194] Error preparing data for projected volume kube-api-access-pqrk7 for pod openshift-network-diagnostics/network-check-target-8qqbv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 20 19:44:21.795346 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:44:21.795232    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4ab5f609-836c-4e9d-907a-620d6c9d56e2-kube-api-access-pqrk7 podName:4ab5f609-836c-4e9d-907a-620d6c9d56e2 nodeName:}" failed. No retries permitted until 2026-05-20 19:44:23.795213074 +0000 UTC m=+6.243761908 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-pqrk7" (UniqueName: "kubernetes.io/projected/4ab5f609-836c-4e9d-907a-620d6c9d56e2-kube-api-access-pqrk7") pod "network-check-target-8qqbv" (UID: "4ab5f609-836c-4e9d-907a-620d6c9d56e2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 20 19:44:22.097212 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:22.097133    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8qqbv"
May 20 19:44:22.097699 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:44:22.097262    2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8qqbv" podUID="4ab5f609-836c-4e9d-907a-620d6c9d56e2"
May 20 19:44:22.151878 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:22.151843    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-167.ec2.internal" event={"ID":"8736a515541c78203a4ba66250257011","Type":"ContainerStarted","Data":"980db491eea906ef413417af9bb832e09cc43a04b097822d2203f0a17558859c"}
May 20 19:44:23.096323 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:23.096288    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p6zpg"
May 20 19:44:23.096506 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:44:23.096403    2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p6zpg" podUID="8adc751e-abba-4cb1-ab06-d0c915b18a28"
May 20 19:44:23.711510 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:23.710867    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8adc751e-abba-4cb1-ab06-d0c915b18a28-metrics-certs\") pod \"network-metrics-daemon-p6zpg\" (UID: \"8adc751e-abba-4cb1-ab06-d0c915b18a28\") " pod="openshift-multus/network-metrics-daemon-p6zpg"
May 20 19:44:23.711510 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:44:23.711061    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 20 19:44:23.711510 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:44:23.711127    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8adc751e-abba-4cb1-ab06-d0c915b18a28-metrics-certs podName:8adc751e-abba-4cb1-ab06-d0c915b18a28 nodeName:}" failed. No retries permitted until 2026-05-20 19:44:27.711108494 +0000 UTC m=+10.159657332 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8adc751e-abba-4cb1-ab06-d0c915b18a28-metrics-certs") pod "network-metrics-daemon-p6zpg" (UID: "8adc751e-abba-4cb1-ab06-d0c915b18a28") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 20 19:44:23.812555 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:23.811951    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pqrk7\" (UniqueName: \"kubernetes.io/projected/4ab5f609-836c-4e9d-907a-620d6c9d56e2-kube-api-access-pqrk7\") pod \"network-check-target-8qqbv\" (UID: \"4ab5f609-836c-4e9d-907a-620d6c9d56e2\") " pod="openshift-network-diagnostics/network-check-target-8qqbv"
May 20 19:44:23.812555 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:44:23.812156    2578 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 20 19:44:23.812555 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:44:23.812171    2578 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 20 19:44:23.812555 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:44:23.812180    2578 projected.go:194] Error preparing data for projected volume kube-api-access-pqrk7 for pod openshift-network-diagnostics/network-check-target-8qqbv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 20 19:44:23.812555 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:44:23.812239    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4ab5f609-836c-4e9d-907a-620d6c9d56e2-kube-api-access-pqrk7 podName:4ab5f609-836c-4e9d-907a-620d6c9d56e2 nodeName:}" failed. No retries permitted until 2026-05-20 19:44:27.812222845 +0000 UTC m=+10.260771676 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-pqrk7" (UniqueName: "kubernetes.io/projected/4ab5f609-836c-4e9d-907a-620d6c9d56e2-kube-api-access-pqrk7") pod "network-check-target-8qqbv" (UID: "4ab5f609-836c-4e9d-907a-620d6c9d56e2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 20 19:44:24.099158 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:24.098672    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8qqbv"
May 20 19:44:24.099158 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:44:24.098763    2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8qqbv" podUID="4ab5f609-836c-4e9d-907a-620d6c9d56e2"
May 20 19:44:25.096482 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:25.096448    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p6zpg"
May 20 19:44:25.096974 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:44:25.096610    2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p6zpg" podUID="8adc751e-abba-4cb1-ab06-d0c915b18a28"
May 20 19:44:26.099384 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:26.098792    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8qqbv"
May 20 19:44:26.099384 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:44:26.098915    2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8qqbv" podUID="4ab5f609-836c-4e9d-907a-620d6c9d56e2"
May 20 19:44:27.096779 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:27.096734    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p6zpg"
May 20 19:44:27.096960 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:44:27.096911    2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p6zpg" podUID="8adc751e-abba-4cb1-ab06-d0c915b18a28"
May 20 19:44:27.743559 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:27.743523    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8adc751e-abba-4cb1-ab06-d0c915b18a28-metrics-certs\") pod \"network-metrics-daemon-p6zpg\" (UID: \"8adc751e-abba-4cb1-ab06-d0c915b18a28\") " pod="openshift-multus/network-metrics-daemon-p6zpg"
May 20 19:44:27.744014 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:44:27.743719    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 20 19:44:27.744014 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:44:27.743781    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8adc751e-abba-4cb1-ab06-d0c915b18a28-metrics-certs podName:8adc751e-abba-4cb1-ab06-d0c915b18a28 nodeName:}" failed. No retries permitted until 2026-05-20 19:44:35.743762764 +0000 UTC m=+18.192311595 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8adc751e-abba-4cb1-ab06-d0c915b18a28-metrics-certs") pod "network-metrics-daemon-p6zpg" (UID: "8adc751e-abba-4cb1-ab06-d0c915b18a28") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 20 19:44:27.845184 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:27.844604    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pqrk7\" (UniqueName: \"kubernetes.io/projected/4ab5f609-836c-4e9d-907a-620d6c9d56e2-kube-api-access-pqrk7\") pod \"network-check-target-8qqbv\" (UID: \"4ab5f609-836c-4e9d-907a-620d6c9d56e2\") " pod="openshift-network-diagnostics/network-check-target-8qqbv"
May 20 19:44:27.845184 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:44:27.844774    2578 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 20 19:44:27.845184 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:44:27.844796    2578 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 20 19:44:27.845184 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:44:27.844808    2578 projected.go:194] Error preparing data for projected volume kube-api-access-pqrk7 for pod openshift-network-diagnostics/network-check-target-8qqbv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 20 19:44:27.845184 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:44:27.844860    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4ab5f609-836c-4e9d-907a-620d6c9d56e2-kube-api-access-pqrk7 podName:4ab5f609-836c-4e9d-907a-620d6c9d56e2 nodeName:}" failed. No retries permitted until 2026-05-20 19:44:35.844842451 +0000 UTC m=+18.293391290 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-pqrk7" (UniqueName: "kubernetes.io/projected/4ab5f609-836c-4e9d-907a-620d6c9d56e2-kube-api-access-pqrk7") pod "network-check-target-8qqbv" (UID: "4ab5f609-836c-4e9d-907a-620d6c9d56e2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 20 19:44:28.098924 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:28.098791    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8qqbv"
May 20 19:44:28.099088 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:44:28.098930    2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8qqbv" podUID="4ab5f609-836c-4e9d-907a-620d6c9d56e2"
May 20 19:44:29.096777 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:29.096738    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p6zpg"
May 20 19:44:29.097199 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:44:29.096863    2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p6zpg" podUID="8adc751e-abba-4cb1-ab06-d0c915b18a28"
May 20 19:44:30.098517 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:30.098481    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8qqbv"
May 20 19:44:30.099021 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:44:30.098616    2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8qqbv" podUID="4ab5f609-836c-4e9d-907a-620d6c9d56e2"
May 20 19:44:31.096033 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:31.095999    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p6zpg"
May 20 19:44:31.096183 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:44:31.096120    2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p6zpg" podUID="8adc751e-abba-4cb1-ab06-d0c915b18a28"
May 20 19:44:32.096357 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:32.096313    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8qqbv"
May 20 19:44:32.096800 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:44:32.096433    2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8qqbv" podUID="4ab5f609-836c-4e9d-907a-620d6c9d56e2"
May 20 19:44:33.096375 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:33.096335    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p6zpg"
May 20 19:44:33.096986 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:44:33.096490    2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p6zpg" podUID="8adc751e-abba-4cb1-ab06-d0c915b18a28"
May 20 19:44:34.096916 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:34.096874    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8qqbv"
May 20 19:44:34.097296 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:44:34.097009    2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8qqbv" podUID="4ab5f609-836c-4e9d-907a-620d6c9d56e2"
May 20 19:44:35.096955 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:35.096917    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p6zpg"
May 20 19:44:35.097376 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:44:35.097037    2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p6zpg" podUID="8adc751e-abba-4cb1-ab06-d0c915b18a28"
May 20 19:44:35.808440 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:35.808397    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8adc751e-abba-4cb1-ab06-d0c915b18a28-metrics-certs\") pod \"network-metrics-daemon-p6zpg\" (UID: \"8adc751e-abba-4cb1-ab06-d0c915b18a28\") " pod="openshift-multus/network-metrics-daemon-p6zpg"
May 20 19:44:35.808632 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:44:35.808568    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 20 19:44:35.808703 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:44:35.808654    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8adc751e-abba-4cb1-ab06-d0c915b18a28-metrics-certs podName:8adc751e-abba-4cb1-ab06-d0c915b18a28 nodeName:}" failed. No retries permitted until 2026-05-20 19:44:51.808639053 +0000 UTC m=+34.257187886 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8adc751e-abba-4cb1-ab06-d0c915b18a28-metrics-certs") pod "network-metrics-daemon-p6zpg" (UID: "8adc751e-abba-4cb1-ab06-d0c915b18a28") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 20 19:44:35.909566 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:35.909525    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pqrk7\" (UniqueName: \"kubernetes.io/projected/4ab5f609-836c-4e9d-907a-620d6c9d56e2-kube-api-access-pqrk7\") pod \"network-check-target-8qqbv\" (UID: \"4ab5f609-836c-4e9d-907a-620d6c9d56e2\") " pod="openshift-network-diagnostics/network-check-target-8qqbv"
May 20 19:44:35.909756 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:44:35.909732    2578 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 20 19:44:35.909821 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:44:35.909765    2578 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 20 19:44:35.909821 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:44:35.909778    2578 projected.go:194] Error preparing data for projected volume kube-api-access-pqrk7 for pod openshift-network-diagnostics/network-check-target-8qqbv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 20 19:44:35.909897 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:44:35.909847    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4ab5f609-836c-4e9d-907a-620d6c9d56e2-kube-api-access-pqrk7 podName:4ab5f609-836c-4e9d-907a-620d6c9d56e2 nodeName:}" failed. No retries permitted until 2026-05-20 19:44:51.909825262 +0000 UTC m=+34.358374097 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-pqrk7" (UniqueName: "kubernetes.io/projected/4ab5f609-836c-4e9d-907a-620d6c9d56e2-kube-api-access-pqrk7") pod "network-check-target-8qqbv" (UID: "4ab5f609-836c-4e9d-907a-620d6c9d56e2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 20 19:44:36.097097 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:36.097016    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8qqbv"
May 20 19:44:36.097515 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:44:36.097184    2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8qqbv" podUID="4ab5f609-836c-4e9d-907a-620d6c9d56e2"
May 20 19:44:37.096027 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:37.095987    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p6zpg"
May 20 19:44:37.096217 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:44:37.096102    2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p6zpg" podUID="8adc751e-abba-4cb1-ab06-d0c915b18a28"
May 20 19:44:38.097522 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:38.097483    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8qqbv"
May 20 19:44:38.098016 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:44:38.097606    2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8qqbv" podUID="4ab5f609-836c-4e9d-907a-620d6c9d56e2"
May 20 19:44:39.096297 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:39.096261    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p6zpg"
May 20 19:44:39.096458 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:44:39.096375    2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p6zpg" podUID="8adc751e-abba-4cb1-ab06-d0c915b18a28"
May 20 19:44:40.097128 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:40.096873    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8qqbv"
May 20 19:44:40.097930 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:44:40.097191    2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8qqbv" podUID="4ab5f609-836c-4e9d-907a-620d6c9d56e2"
May 20 19:44:40.191310 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:40.191270    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-lmf6r" event={"ID":"cb2e0a0a-0a02-4144-8e95-2888159f5bd2","Type":"ContainerStarted","Data":"83256f86f83f2fd7ac3efdaaf62f594b7c91c57311b33c5a8bcef8013d6ca3f4"}
May 20 19:44:40.193127 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:40.193095    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-djpd5" event={"ID":"423625dd-477f-440c-acc3-b97d8fcdedc4","Type":"ContainerStarted","Data":"4eea632df26a96f18db9f2a6ee0d185caf5663d4b8a940ddc5211927efa02da3"}
May 20 19:44:40.195259 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:40.194928    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-67wbm" event={"ID":"b7fa6461-bfcd-43f2-b780-cfe899ac7f49","Type":"ContainerStarted","Data":"e4d5e9a8686c062cabed93ad64970804427aab987371f20c51e9f557ac39bba8"}
May 20 19:44:40.196492 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:40.196471    2578 generic.go:358] "Generic (PLEG): container finished" podID="eb87a0e6-d519-4b67-9256-6c83f9095723" containerID="b03edd5cbfddda4061c4a50e1bf9c135fbba61c8c4f815cd342f78d83d6c062f" exitCode=0
May 20 19:44:40.196634 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:40.196531    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jljg9" event={"ID":"eb87a0e6-d519-4b67-9256-6c83f9095723","Type":"ContainerDied","Data":"b03edd5cbfddda4061c4a50e1bf9c135fbba61c8c4f815cd342f78d83d6c062f"}
May 20 19:44:40.198057 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:40.197945    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-lx5m7" event={"ID":"54a38c71-1de1-4978-9238-80cbb2312e7c","Type":"ContainerStarted","Data":"acf4faceea01de7700e46d4e94ef35d424340232f2b06b419a431a91f8bf10dc"}
May 20 19:44:40.199722 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:40.199698    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-gwj68" event={"ID":"32f98a02-52ac-4222-805b-97bfd60ec8dc","Type":"ContainerStarted","Data":"4015e79446e4e860a712858b14f207db34e153370536be5eeaf89e99581b0e7d"}
May 20 19:44:40.202606 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:40.202566    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8nrkk_3bb0c612-bb6f-4213-a7d8-88534ba9e6ee/ovn-acl-logging/0.log"
May 20 19:44:40.202896 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:40.202878    2578 generic.go:358] "Generic (PLEG): container finished" podID="3bb0c612-bb6f-4213-a7d8-88534ba9e6ee" containerID="400e307c2ea2209e7afb5483177f3d17ca68453466b8f14ffd41b015fa1120d4" exitCode=1
May 20 19:44:40.202999 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:40.202943    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8nrkk" event={"ID":"3bb0c612-bb6f-4213-a7d8-88534ba9e6ee","Type":"ContainerStarted","Data":"f4679b8172e12299fd0f0c2508c697f303a26197eebb84c47a8108943d091c80"}
May 20 19:44:40.202999 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:40.202983    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8nrkk" event={"ID":"3bb0c612-bb6f-4213-a7d8-88534ba9e6ee","Type":"ContainerStarted","Data":"da6cbc28e0c0c79d554e8e661d653857ceb067f1095a50862780e90421e2f94f"}
May 20 19:44:40.202999 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:40.202996    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8nrkk" event={"ID":"3bb0c612-bb6f-4213-a7d8-88534ba9e6ee","Type":"ContainerStarted","Data":"367f204fe6d11c5ace27b3a0eccf0d8110cf45e81cdaf55dfb7178fa7a2f8036"}
May 20 19:44:40.203128 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:40.203008    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8nrkk" event={"ID":"3bb0c612-bb6f-4213-a7d8-88534ba9e6ee","Type":"ContainerStarted","Data":"6f1b5d31ae03ba1e734f3911c1bf3804be1f2bab5a91a612754425147ddcba23"}
May 20 19:44:40.203128 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:40.203021    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8nrkk" event={"ID":"3bb0c612-bb6f-4213-a7d8-88534ba9e6ee","Type":"ContainerDied","Data":"400e307c2ea2209e7afb5483177f3d17ca68453466b8f14ffd41b015fa1120d4"}
May 20 19:44:40.203128 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:40.203037    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8nrkk" event={"ID":"3bb0c612-bb6f-4213-a7d8-88534ba9e6ee","Type":"ContainerStarted","Data":"a6e8a8d3a81239c0c1782f20267fea9de5bcd38b8affb4c5c45f4ec143083bec"}
May 20 19:44:40.204250 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:40.204232    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-mszww" event={"ID":"4639ddbd-2055-4d5f-8bda-d0cd32aca639","Type":"ContainerStarted","Data":"6460ddc75edad38d66dc1ae1d3f26edb5a99143135380ea4fa06740018f1d84c"}
May 20 19:44:40.206162 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:40.206119    2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-lmf6r" podStartSLOduration=3.713008471 podStartE2EDuration="22.206104345s" podCreationTimestamp="2026-05-20 19:44:18 +0000 UTC" firstStartedPulling="2026-05-20 19:44:20.698405469 +0000 UTC m=+3.146954303" lastFinishedPulling="2026-05-20 19:44:39.191501325 +0000 UTC m=+21.640050177" observedRunningTime="2026-05-20 19:44:40.205234997 +0000 UTC m=+22.653783851" watchObservedRunningTime="2026-05-20 19:44:40.206104345 +0000 UTC m=+22.654653200"
May 20 19:44:40.206288 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:40.206257    2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-167.ec2.internal" podStartSLOduration=21.206248243 podStartE2EDuration="21.206248243s" podCreationTimestamp="2026-05-20 19:44:19 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-20 19:44:22.16755588 +0000 UTC m=+4.616104735" watchObservedRunningTime="2026-05-20 19:44:40.206248243 +0000 UTC m=+22.654797097"
May 20 19:44:40.219519 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:40.219483    2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-mszww" podStartSLOduration=7.674919497 podStartE2EDuration="22.219473574s" podCreationTimestamp="2026-05-20 19:44:18 +0000 UTC" firstStartedPulling="2026-05-20 19:44:20.666520968 +0000 UTC m=+3.115069800" lastFinishedPulling="2026-05-20 19:44:35.211075037 +0000 UTC m=+17.659623877" observedRunningTime="2026-05-20 19:44:40.219342698 +0000 UTC m=+22.667891694" watchObservedRunningTime="2026-05-20 19:44:40.219473574 +0000 UTC m=+22.668022428"
May 20 19:44:40.234257 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:40.234222    2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-67wbm" podStartSLOduration=3.7074850120000002 podStartE2EDuration="22.234209645s" podCreationTimestamp="2026-05-20 19:44:18 +0000 UTC" firstStartedPulling="2026-05-20 19:44:20.690824836 +0000 UTC m=+3.139373673" lastFinishedPulling="2026-05-20 19:44:39.217549466 +0000 UTC m=+21.666098306" observedRunningTime="2026-05-20 19:44:40.233900248 +0000 UTC m=+22.682449107" watchObservedRunningTime="2026-05-20 19:44:40.234209645 +0000 UTC m=+22.682758549"
May 20 19:44:40.277605 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:40.277548    2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-lx5m7" podStartSLOduration=3.677411068 podStartE2EDuration="22.277534176s" podCreationTimestamp="2026-05-20 19:44:18 +0000 UTC" firstStartedPulling="2026-05-20 19:44:20.667747615 +0000 UTC m=+3.116296447" lastFinishedPulling="2026-05-20 19:44:39.267870707 +0000 UTC m=+21.716419555" observedRunningTime="2026-05-20 19:44:40.252364753 +0000 UTC m=+22.700913606" watchObservedRunningTime="2026-05-20 19:44:40.277534176 +0000 UTC m=+22.726083029"
May 20 19:44:40.292207 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:40.292169    2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-gwj68" podStartSLOduration=3.770085549 podStartE2EDuration="22.292154821s" podCreationTimestamp="2026-05-20 19:44:18 +0000 UTC" firstStartedPulling="2026-05-20 19:44:20.693348783 +0000 UTC m=+3.141897615" lastFinishedPulling="2026-05-20 19:44:39.215418056 +0000 UTC m=+21.663966887" observedRunningTime="2026-05-20 19:44:40.291973651 +0000 UTC m=+22.740522505" watchObservedRunningTime="2026-05-20 19:44:40.292154821 +0000 UTC m=+22.740703668"
May 20 19:44:40.934791 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:40.934755    2578 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
May 20 19:44:41.041025 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:41.040915    2578 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-20T19:44:40.934786016Z","UUID":"ea76d48a-bf14-4295-925f-ebfcf85a8dec","Handler":null,"Name":"","Endpoint":""}
May 20 19:44:41.043365 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:41.043336    2578 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
May 20 19:44:41.043365 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:41.043364    2578 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
May 20 19:44:41.096463 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:41.096380    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p6zpg"
May 20 19:44:41.096649 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:44:41.096505    2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p6zpg" podUID="8adc751e-abba-4cb1-ab06-d0c915b18a28"
May 20 19:44:41.208157 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:41.208122    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-djpd5" event={"ID":"423625dd-477f-440c-acc3-b97d8fcdedc4","Type":"ContainerStarted","Data":"cab3ff740391d3e4021b48e3ff601f2f548b357a96ebd12733d0957baeb220b1"}
May 20 19:44:41.209569 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:41.209533    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-znlb8" event={"ID":"d768873b-b1f6-45b4-b6d3-c31b1d96e67a","Type":"ContainerStarted","Data":"c75e91f73e059150bffbf852222c929370e7e38b3923d33a396240160b08ec26"}
May 20 19:44:41.225371 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:41.225327    2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-znlb8" podStartSLOduration=4.705526987 podStartE2EDuration="23.225315014s" podCreationTimestamp="2026-05-20 19:44:18 +0000 UTC" firstStartedPulling="2026-05-20 19:44:20.69817912 +0000 UTC m=+3.146727954" lastFinishedPulling="2026-05-20 19:44:39.217967148 +0000 UTC m=+21.666515981" observedRunningTime="2026-05-20 19:44:41.225190109 +0000 UTC m=+23.673738966" watchObservedRunningTime="2026-05-20 19:44:41.225315014 +0000 UTC m=+23.673863870"
May 20 19:44:42.096508 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:42.096478    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8qqbv"
May 20 19:44:42.096705 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:44:42.096602    2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8qqbv" podUID="4ab5f609-836c-4e9d-907a-620d6c9d56e2"
May 20 19:44:43.096815 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:43.096572    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p6zpg"
May 20 19:44:43.097236 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:44:43.096908    2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p6zpg" podUID="8adc751e-abba-4cb1-ab06-d0c915b18a28"
May 20 19:44:43.216220 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:43.216193    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8nrkk_3bb0c612-bb6f-4213-a7d8-88534ba9e6ee/ovn-acl-logging/0.log"
May 20 19:44:43.216670 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:43.216501    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8nrkk" event={"ID":"3bb0c612-bb6f-4213-a7d8-88534ba9e6ee","Type":"ContainerStarted","Data":"e8e67ace25a89a5acd1801eeb17284b8c47722b42a3afa48970c024c9adced4e"}
May 20 19:44:43.218428 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:43.218404    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-djpd5" event={"ID":"423625dd-477f-440c-acc3-b97d8fcdedc4","Type":"ContainerStarted","Data":"6b18403b90c9df618101f4df5fb9b7e3bceea7b2d2b6927e8d08ad5571126dcb"}
May 20 19:44:43.237283 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:43.237227    2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-djpd5" podStartSLOduration=3.7631015899999998 podStartE2EDuration="25.237214027s" podCreationTimestamp="2026-05-20 19:44:18 +0000 UTC" firstStartedPulling="2026-05-20 19:44:20.698523398 +0000 UTC m=+3.147072234" lastFinishedPulling="2026-05-20 19:44:42.172635825 +0000 UTC m=+24.621184671" observedRunningTime="2026-05-20 19:44:43.235876648 +0000 UTC m=+25.684425504" watchObservedRunningTime="2026-05-20 19:44:43.237214027 +0000 UTC m=+25.685762881"
May 20 19:44:44.096617 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:44.096561    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8qqbv"
May 20 19:44:44.096810 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:44:44.096701    2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8qqbv" podUID="4ab5f609-836c-4e9d-907a-620d6c9d56e2"
May 20 19:44:44.281566 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:44.281531    2578 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-gwj68"
May 20 19:44:44.282238 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:44.282214    2578 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-gwj68"
May 20 19:44:45.096906 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:45.096727    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p6zpg"
May 20 19:44:45.097063 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:44:45.097008    2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p6zpg" podUID="8adc751e-abba-4cb1-ab06-d0c915b18a28"
May 20 19:44:45.222518 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:45.222488    2578 generic.go:358] "Generic (PLEG): container finished" podID="eb87a0e6-d519-4b67-9256-6c83f9095723" containerID="6ec5e3ce2d29eb5e773cf4032b442a166ef855bb92ab5a9d3cc5d6f62b9f440a" exitCode=0
May 20 19:44:45.222728 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:45.222562    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jljg9" event={"ID":"eb87a0e6-d519-4b67-9256-6c83f9095723","Type":"ContainerDied","Data":"6ec5e3ce2d29eb5e773cf4032b442a166ef855bb92ab5a9d3cc5d6f62b9f440a"}
May 20 19:44:45.225489 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:45.225430    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8nrkk_3bb0c612-bb6f-4213-a7d8-88534ba9e6ee/ovn-acl-logging/0.log"
May 20 19:44:45.225847 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:45.225821    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8nrkk" event={"ID":"3bb0c612-bb6f-4213-a7d8-88534ba9e6ee","Type":"ContainerStarted","Data":"6da43b973ae6e86ac9cc82d95459ef2e7d4bf40faea6a67f0d301f3064705d2c"}
May 20 19:44:45.226053 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:45.226031    2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-gwj68"
May 20 19:44:45.226186 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:45.226139    2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8nrkk"
May 20 19:44:45.226377 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:45.226290    2578 scope.go:117] "RemoveContainer" containerID="400e307c2ea2209e7afb5483177f3d17ca68453466b8f14ffd41b015fa1120d4"
May 20 19:44:45.226717 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:45.226698    2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-gwj68"
May 20 19:44:45.242445 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:45.242423    2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8nrkk"
May 20 19:44:46.096159 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:46.096119    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8qqbv"
May 20 19:44:46.096624 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:44:46.096225    2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8qqbv" podUID="4ab5f609-836c-4e9d-907a-620d6c9d56e2"
May 20 19:44:46.229808 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:46.229774    2578 generic.go:358] "Generic (PLEG): container finished" podID="eb87a0e6-d519-4b67-9256-6c83f9095723" containerID="eddedcf7df664f7a68927305d26508dc87a2daf16bf3c9e426b64590b411e09c" exitCode=0
May 20 19:44:46.229976 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:46.229865    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jljg9" event={"ID":"eb87a0e6-d519-4b67-9256-6c83f9095723","Type":"ContainerDied","Data":"eddedcf7df664f7a68927305d26508dc87a2daf16bf3c9e426b64590b411e09c"}
May 20 19:44:46.233843 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:46.233814    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8nrkk_3bb0c612-bb6f-4213-a7d8-88534ba9e6ee/ovn-acl-logging/0.log"
May 20 19:44:46.234220 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:46.234195    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8nrkk" event={"ID":"3bb0c612-bb6f-4213-a7d8-88534ba9e6ee","Type":"ContainerStarted","Data":"f28f22a695f0204aa4c24f04f0abc4fb2f1d40bfb97ece56cf489d6d3a1e9172"}
May 20 19:44:46.234697 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:46.234677    2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8nrkk"
May 20 19:44:46.234762 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:46.234707    2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8nrkk"
May 20 19:44:46.251123 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:46.251086    2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8nrkk"
May 20 19:44:46.706131 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:46.706072    2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-8nrkk" podStartSLOduration=10.155344985 podStartE2EDuration="28.70604951s" podCreationTimestamp="2026-05-20 19:44:18 +0000 UTC" firstStartedPulling="2026-05-20 19:44:20.690828897 +0000 UTC m=+3.139377730" lastFinishedPulling="2026-05-20 19:44:39.241533407 +0000 UTC m=+21.690082255" observedRunningTime="2026-05-20 19:44:46.314730381 +0000 UTC m=+28.763279237" watchObservedRunningTime="2026-05-20 19:44:46.70604951 +0000 UTC m=+29.154598364"
May 20 19:44:46.707768 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:46.707151    2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-p6zpg"]
May 20 19:44:46.707768 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:46.707290    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p6zpg"
May 20 19:44:46.707768 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:44:46.707405    2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p6zpg" podUID="8adc751e-abba-4cb1-ab06-d0c915b18a28"
May 20 19:44:46.710731 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:46.710709    2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-8qqbv"]
May 20 19:44:46.710846 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:46.710808    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8qqbv"
May 20 19:44:46.710925 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:44:46.710904    2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8qqbv" podUID="4ab5f609-836c-4e9d-907a-620d6c9d56e2"
May 20 19:44:47.238152 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:47.238114    2578 generic.go:358] "Generic (PLEG): container finished" podID="eb87a0e6-d519-4b67-9256-6c83f9095723" containerID="19b7d254b76dedba31e396223f7a32cb77b327fc5e2cd744c1e34132d21643ad" exitCode=0
May 20 19:44:47.238635 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:47.238200    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jljg9" event={"ID":"eb87a0e6-d519-4b67-9256-6c83f9095723","Type":"ContainerDied","Data":"19b7d254b76dedba31e396223f7a32cb77b327fc5e2cd744c1e34132d21643ad"}
May 20 19:44:48.097330 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:48.097294    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8qqbv"
May 20 19:44:48.097497 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:44:48.097397    2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8qqbv" podUID="4ab5f609-836c-4e9d-907a-620d6c9d56e2"
May 20 19:44:49.096373 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:49.096294    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p6zpg"
May 20 19:44:49.097028 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:44:49.096420    2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p6zpg" podUID="8adc751e-abba-4cb1-ab06-d0c915b18a28"
May 20 19:44:50.096625 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:50.096572    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8qqbv"
May 20 19:44:50.097079 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:44:50.096705    2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8qqbv" podUID="4ab5f609-836c-4e9d-907a-620d6c9d56e2"
May 20 19:44:51.096126 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:51.096087    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p6zpg"
May 20 19:44:51.096359 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:44:51.096242    2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p6zpg" podUID="8adc751e-abba-4cb1-ab06-d0c915b18a28"
May 20 19:44:51.825492 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:51.825455    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8adc751e-abba-4cb1-ab06-d0c915b18a28-metrics-certs\") pod \"network-metrics-daemon-p6zpg\" (UID: \"8adc751e-abba-4cb1-ab06-d0c915b18a28\") " pod="openshift-multus/network-metrics-daemon-p6zpg"
May 20 19:44:51.826133 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:44:51.825562    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 20 19:44:51.826133 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:44:51.825644    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8adc751e-abba-4cb1-ab06-d0c915b18a28-metrics-certs podName:8adc751e-abba-4cb1-ab06-d0c915b18a28 nodeName:}" failed. No retries permitted until 2026-05-20 19:45:23.825625593 +0000 UTC m=+66.274174432 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8adc751e-abba-4cb1-ab06-d0c915b18a28-metrics-certs") pod "network-metrics-daemon-p6zpg" (UID: "8adc751e-abba-4cb1-ab06-d0c915b18a28") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 20 19:44:51.926661 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:51.926630    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pqrk7\" (UniqueName: \"kubernetes.io/projected/4ab5f609-836c-4e9d-907a-620d6c9d56e2-kube-api-access-pqrk7\") pod \"network-check-target-8qqbv\" (UID: \"4ab5f609-836c-4e9d-907a-620d6c9d56e2\") " pod="openshift-network-diagnostics/network-check-target-8qqbv"
May 20 19:44:51.926833 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:44:51.926776    2578 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 20 19:44:51.926833 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:44:51.926805    2578 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 20 19:44:51.926833 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:44:51.926819    2578 projected.go:194] Error preparing data for projected volume kube-api-access-pqrk7 for pod openshift-network-diagnostics/network-check-target-8qqbv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 20 19:44:51.926952 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:44:51.926883    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4ab5f609-836c-4e9d-907a-620d6c9d56e2-kube-api-access-pqrk7 podName:4ab5f609-836c-4e9d-907a-620d6c9d56e2 nodeName:}" failed. No retries permitted until 2026-05-20 19:45:23.926863373 +0000 UTC m=+66.375412212 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-pqrk7" (UniqueName: "kubernetes.io/projected/4ab5f609-836c-4e9d-907a-620d6c9d56e2-kube-api-access-pqrk7") pod "network-check-target-8qqbv" (UID: "4ab5f609-836c-4e9d-907a-620d6c9d56e2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 20 19:44:52.096846 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:52.096747    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8qqbv"
May 20 19:44:52.096992 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:44:52.096884    2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8qqbv" podUID="4ab5f609-836c-4e9d-907a-620d6c9d56e2"
May 20 19:44:52.330654 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:52.330618    2578 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-167.ec2.internal" event="NodeReady"
May 20 19:44:52.330817 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:52.330762    2578 kubelet_node_status.go:550] "Fast updating node status as it just became ready"
May 20 19:44:52.380190 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:52.380151    2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-t8kn6"]
May 20 19:44:52.414462 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:52.414416    2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-rj5rw"]
May 20 19:44:52.414629 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:52.414604    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-t8kn6"
May 20 19:44:52.416953 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:52.416927    2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
May 20 19:44:52.417212 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:52.417195    2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-2fqs2\""
May 20 19:44:52.417400 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:52.417384    2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
May 20 19:44:52.424764 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:52.424737    2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-t8kn6"]
May 20 19:44:52.424857 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:52.424769    2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-rj5rw"]
May 20 19:44:52.424857 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:52.424854    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-rj5rw"
May 20 19:44:52.427693 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:52.427316    2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
May 20 19:44:52.427693 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:52.427398    2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
May 20 19:44:52.427693 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:52.427466    2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-s4ppg\""
May 20 19:44:52.427693 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:52.427518    2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
May 20 19:44:52.530340 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:52.530304    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wr754\" (UniqueName: \"kubernetes.io/projected/b63a00ba-256d-476a-9f16-f0ae99f6e73b-kube-api-access-wr754\") pod \"ingress-canary-rj5rw\" (UID: \"b63a00ba-256d-476a-9f16-f0ae99f6e73b\") " pod="openshift-ingress-canary/ingress-canary-rj5rw"
May 20 19:44:52.530532 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:52.530363    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3e5d41c3-bec4-4344-a58c-e52112542af8-tmp-dir\") pod \"dns-default-t8kn6\" (UID: \"3e5d41c3-bec4-4344-a58c-e52112542af8\") " pod="openshift-dns/dns-default-t8kn6"
May 20 19:44:52.530532 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:52.530437    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3e5d41c3-bec4-4344-a58c-e52112542af8-metrics-tls\") pod \"dns-default-t8kn6\" (UID: \"3e5d41c3-bec4-4344-a58c-e52112542af8\") " pod="openshift-dns/dns-default-t8kn6"
May 20 19:44:52.530532 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:52.530477    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b63a00ba-256d-476a-9f16-f0ae99f6e73b-cert\") pod \"ingress-canary-rj5rw\" (UID: \"b63a00ba-256d-476a-9f16-f0ae99f6e73b\") " pod="openshift-ingress-canary/ingress-canary-rj5rw"
May 20 19:44:52.530532 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:52.530507    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3e5d41c3-bec4-4344-a58c-e52112542af8-config-volume\") pod \"dns-default-t8kn6\" (UID: \"3e5d41c3-bec4-4344-a58c-e52112542af8\") " pod="openshift-dns/dns-default-t8kn6"
May 20 19:44:52.530725 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:52.530556    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zcx52\" (UniqueName: \"kubernetes.io/projected/3e5d41c3-bec4-4344-a58c-e52112542af8-kube-api-access-zcx52\") pod \"dns-default-t8kn6\" (UID: \"3e5d41c3-bec4-4344-a58c-e52112542af8\") " pod="openshift-dns/dns-default-t8kn6"
May 20 19:44:52.631835 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:52.631751    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wr754\" (UniqueName: \"kubernetes.io/projected/b63a00ba-256d-476a-9f16-f0ae99f6e73b-kube-api-access-wr754\") pod \"ingress-canary-rj5rw\" (UID: \"b63a00ba-256d-476a-9f16-f0ae99f6e73b\") " pod="openshift-ingress-canary/ingress-canary-rj5rw"
May 20 19:44:52.631835 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:52.631794    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3e5d41c3-bec4-4344-a58c-e52112542af8-tmp-dir\") pod \"dns-default-t8kn6\" (UID: \"3e5d41c3-bec4-4344-a58c-e52112542af8\") " pod="openshift-dns/dns-default-t8kn6"
May 20 19:44:52.632019 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:52.631848    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3e5d41c3-bec4-4344-a58c-e52112542af8-metrics-tls\") pod \"dns-default-t8kn6\" (UID: \"3e5d41c3-bec4-4344-a58c-e52112542af8\") " pod="openshift-dns/dns-default-t8kn6"
May 20 19:44:52.632019 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:52.631871    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b63a00ba-256d-476a-9f16-f0ae99f6e73b-cert\") pod \"ingress-canary-rj5rw\" (UID: \"b63a00ba-256d-476a-9f16-f0ae99f6e73b\") " pod="openshift-ingress-canary/ingress-canary-rj5rw"
May 20 19:44:52.632019 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:52.631899    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3e5d41c3-bec4-4344-a58c-e52112542af8-config-volume\") pod \"dns-default-t8kn6\" (UID: \"3e5d41c3-bec4-4344-a58c-e52112542af8\") " pod="openshift-dns/dns-default-t8kn6"
May 20 19:44:52.632019 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:52.631949    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zcx52\" (UniqueName: \"kubernetes.io/projected/3e5d41c3-bec4-4344-a58c-e52112542af8-kube-api-access-zcx52\") pod \"dns-default-t8kn6\" (UID: \"3e5d41c3-bec4-4344-a58c-e52112542af8\") " pod="openshift-dns/dns-default-t8kn6"
May 20 19:44:52.632019 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:44:52.631982    2578 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 20 19:44:52.632210 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:44:52.632060    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b63a00ba-256d-476a-9f16-f0ae99f6e73b-cert podName:b63a00ba-256d-476a-9f16-f0ae99f6e73b nodeName:}" failed. No retries permitted until 2026-05-20 19:44:53.132040576 +0000 UTC m=+35.580589411 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/b63a00ba-256d-476a-9f16-f0ae99f6e73b-cert") pod "ingress-canary-rj5rw" (UID: "b63a00ba-256d-476a-9f16-f0ae99f6e73b") : secret "canary-serving-cert" not found
May 20 19:44:52.632210 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:44:52.631982    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 20 19:44:52.632210 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:44:52.632174    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e5d41c3-bec4-4344-a58c-e52112542af8-metrics-tls podName:3e5d41c3-bec4-4344-a58c-e52112542af8 nodeName:}" failed. No retries permitted until 2026-05-20 19:44:53.132157966 +0000 UTC m=+35.580706798 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3e5d41c3-bec4-4344-a58c-e52112542af8-metrics-tls") pod "dns-default-t8kn6" (UID: "3e5d41c3-bec4-4344-a58c-e52112542af8") : secret "dns-default-metrics-tls" not found
May 20 19:44:52.632340 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:52.632259    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3e5d41c3-bec4-4344-a58c-e52112542af8-tmp-dir\") pod \"dns-default-t8kn6\" (UID: \"3e5d41c3-bec4-4344-a58c-e52112542af8\") " pod="openshift-dns/dns-default-t8kn6"
May 20 19:44:52.632552 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:52.632526    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3e5d41c3-bec4-4344-a58c-e52112542af8-config-volume\") pod \"dns-default-t8kn6\" (UID: \"3e5d41c3-bec4-4344-a58c-e52112542af8\") " pod="openshift-dns/dns-default-t8kn6"
May 20 19:44:52.642992 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:52.642954    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zcx52\" (UniqueName: \"kubernetes.io/projected/3e5d41c3-bec4-4344-a58c-e52112542af8-kube-api-access-zcx52\") pod \"dns-default-t8kn6\" (UID: \"3e5d41c3-bec4-4344-a58c-e52112542af8\") " pod="openshift-dns/dns-default-t8kn6"
May 20 19:44:52.643116 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:52.642998    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wr754\" (UniqueName: \"kubernetes.io/projected/b63a00ba-256d-476a-9f16-f0ae99f6e73b-kube-api-access-wr754\") pod \"ingress-canary-rj5rw\" (UID: \"b63a00ba-256d-476a-9f16-f0ae99f6e73b\") " pod="openshift-ingress-canary/ingress-canary-rj5rw"
May 20 19:44:53.096961 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:53.096872    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p6zpg"
May 20 19:44:53.099892 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:53.099872    2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 20 19:44:53.100015 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:53.099894    2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-f2b4p\""
May 20 19:44:53.135645 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:53.135616    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3e5d41c3-bec4-4344-a58c-e52112542af8-metrics-tls\") pod \"dns-default-t8kn6\" (UID: \"3e5d41c3-bec4-4344-a58c-e52112542af8\") " pod="openshift-dns/dns-default-t8kn6"
May 20 19:44:53.135783 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:53.135656    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b63a00ba-256d-476a-9f16-f0ae99f6e73b-cert\") pod \"ingress-canary-rj5rw\" (UID: \"b63a00ba-256d-476a-9f16-f0ae99f6e73b\") " pod="openshift-ingress-canary/ingress-canary-rj5rw"
May 20 19:44:53.135783 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:44:53.135763    2578 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 20 19:44:53.135783 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:44:53.135765    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 20 19:44:53.135894 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:44:53.135820    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b63a00ba-256d-476a-9f16-f0ae99f6e73b-cert podName:b63a00ba-256d-476a-9f16-f0ae99f6e73b nodeName:}" failed. No retries permitted until 2026-05-20 19:44:54.135806163 +0000 UTC m=+36.584354995 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/b63a00ba-256d-476a-9f16-f0ae99f6e73b-cert") pod "ingress-canary-rj5rw" (UID: "b63a00ba-256d-476a-9f16-f0ae99f6e73b") : secret "canary-serving-cert" not found
May 20 19:44:53.135894 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:44:53.135833    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e5d41c3-bec4-4344-a58c-e52112542af8-metrics-tls podName:3e5d41c3-bec4-4344-a58c-e52112542af8 nodeName:}" failed. No retries permitted until 2026-05-20 19:44:54.135827265 +0000 UTC m=+36.584376096 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3e5d41c3-bec4-4344-a58c-e52112542af8-metrics-tls") pod "dns-default-t8kn6" (UID: "3e5d41c3-bec4-4344-a58c-e52112542af8") : secret "dns-default-metrics-tls" not found
May 20 19:44:54.096569 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:54.096324    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8qqbv"
May 20 19:44:54.099441 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:54.099417    2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 20 19:44:54.099818 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:54.099424    2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 20 19:44:54.099818 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:54.099484    2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-zlkxb\""
May 20 19:44:54.144600 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:54.144546    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b63a00ba-256d-476a-9f16-f0ae99f6e73b-cert\") pod \"ingress-canary-rj5rw\" (UID: \"b63a00ba-256d-476a-9f16-f0ae99f6e73b\") " pod="openshift-ingress-canary/ingress-canary-rj5rw"
May 20 19:44:54.144768 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:54.144642    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3e5d41c3-bec4-4344-a58c-e52112542af8-metrics-tls\") pod \"dns-default-t8kn6\" (UID: \"3e5d41c3-bec4-4344-a58c-e52112542af8\") " pod="openshift-dns/dns-default-t8kn6"
May 20 19:44:54.144768 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:44:54.144711    2578 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 20 19:44:54.144768 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:44:54.144721    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 20 19:44:54.144858 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:44:54.144774    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e5d41c3-bec4-4344-a58c-e52112542af8-metrics-tls podName:3e5d41c3-bec4-4344-a58c-e52112542af8 nodeName:}" failed. No retries permitted until 2026-05-20 19:44:56.144761814 +0000 UTC m=+38.593310646 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3e5d41c3-bec4-4344-a58c-e52112542af8-metrics-tls") pod "dns-default-t8kn6" (UID: "3e5d41c3-bec4-4344-a58c-e52112542af8") : secret "dns-default-metrics-tls" not found
May 20 19:44:54.144858 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:44:54.144788    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b63a00ba-256d-476a-9f16-f0ae99f6e73b-cert podName:b63a00ba-256d-476a-9f16-f0ae99f6e73b nodeName:}" failed. No retries permitted until 2026-05-20 19:44:56.144782232 +0000 UTC m=+38.593331064 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/b63a00ba-256d-476a-9f16-f0ae99f6e73b-cert") pod "ingress-canary-rj5rw" (UID: "b63a00ba-256d-476a-9f16-f0ae99f6e73b") : secret "canary-serving-cert" not found
May 20 19:44:54.253738 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:54.253704    2578 generic.go:358] "Generic (PLEG): container finished" podID="eb87a0e6-d519-4b67-9256-6c83f9095723" containerID="ac2079c22fb05e2b39998faa76171806346da227a8a5278d9f32bd64e7171261" exitCode=0
May 20 19:44:54.253888 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:54.253762    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jljg9" event={"ID":"eb87a0e6-d519-4b67-9256-6c83f9095723","Type":"ContainerDied","Data":"ac2079c22fb05e2b39998faa76171806346da227a8a5278d9f32bd64e7171261"}
May 20 19:44:55.257775 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:55.257742    2578 generic.go:358] "Generic (PLEG): container finished" podID="eb87a0e6-d519-4b67-9256-6c83f9095723" containerID="4f532fd602fe8724a86488fb62b8b4ed48acae460c45611b8a47ed81a4d73047" exitCode=0
May 20 19:44:55.258179 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:55.257805    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jljg9" event={"ID":"eb87a0e6-d519-4b67-9256-6c83f9095723","Type":"ContainerDied","Data":"4f532fd602fe8724a86488fb62b8b4ed48acae460c45611b8a47ed81a4d73047"}
May 20 19:44:56.160281 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:56.160248    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3e5d41c3-bec4-4344-a58c-e52112542af8-metrics-tls\") pod \"dns-default-t8kn6\" (UID: \"3e5d41c3-bec4-4344-a58c-e52112542af8\") " pod="openshift-dns/dns-default-t8kn6"
May 20 19:44:56.160281 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:56.160287    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b63a00ba-256d-476a-9f16-f0ae99f6e73b-cert\") pod \"ingress-canary-rj5rw\" (UID: \"b63a00ba-256d-476a-9f16-f0ae99f6e73b\") " pod="openshift-ingress-canary/ingress-canary-rj5rw"
May 20 19:44:56.160488 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:44:56.160396    2578 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 20 19:44:56.160488 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:44:56.160397    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 20 19:44:56.160488 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:44:56.160445    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b63a00ba-256d-476a-9f16-f0ae99f6e73b-cert podName:b63a00ba-256d-476a-9f16-f0ae99f6e73b nodeName:}" failed. No retries permitted until 2026-05-20 19:45:00.160432092 +0000 UTC m=+42.608980924 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/b63a00ba-256d-476a-9f16-f0ae99f6e73b-cert") pod "ingress-canary-rj5rw" (UID: "b63a00ba-256d-476a-9f16-f0ae99f6e73b") : secret "canary-serving-cert" not found
May 20 19:44:56.160488 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:44:56.160458    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e5d41c3-bec4-4344-a58c-e52112542af8-metrics-tls podName:3e5d41c3-bec4-4344-a58c-e52112542af8 nodeName:}" failed. No retries permitted until 2026-05-20 19:45:00.160452723 +0000 UTC m=+42.609001555 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3e5d41c3-bec4-4344-a58c-e52112542af8-metrics-tls") pod "dns-default-t8kn6" (UID: "3e5d41c3-bec4-4344-a58c-e52112542af8") : secret "dns-default-metrics-tls" not found
May 20 19:44:56.262475 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:56.262444    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jljg9" event={"ID":"eb87a0e6-d519-4b67-9256-6c83f9095723","Type":"ContainerStarted","Data":"38659a40a65312944bc889d4327e5b2139f3304a5fc14d91c10f52155477f5b5"}
May 20 19:44:56.287311 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:44:56.287269    2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-jljg9" podStartSLOduration=5.587873558 podStartE2EDuration="38.287253972s" podCreationTimestamp="2026-05-20 19:44:18 +0000 UTC" firstStartedPulling="2026-05-20 19:44:20.690726948 +0000 UTC m=+3.139275785" lastFinishedPulling="2026-05-20 19:44:53.390107358 +0000 UTC m=+35.838656199" observedRunningTime="2026-05-20 19:44:56.285353758 +0000 UTC m=+38.733902625" watchObservedRunningTime="2026-05-20 19:44:56.287253972 +0000 UTC m=+38.735802826"
May 20 19:45:00.191245 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:45:00.191202    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3e5d41c3-bec4-4344-a58c-e52112542af8-metrics-tls\") pod \"dns-default-t8kn6\" (UID: \"3e5d41c3-bec4-4344-a58c-e52112542af8\") " pod="openshift-dns/dns-default-t8kn6"
May 20 19:45:00.191245 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:45:00.191250    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b63a00ba-256d-476a-9f16-f0ae99f6e73b-cert\") pod \"ingress-canary-rj5rw\" (UID: \"b63a00ba-256d-476a-9f16-f0ae99f6e73b\") " pod="openshift-ingress-canary/ingress-canary-rj5rw"
May 20 19:45:00.191698 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:45:00.191346    2578 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 20 19:45:00.191698 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:45:00.191349    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 20 19:45:00.191698 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:45:00.191401    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b63a00ba-256d-476a-9f16-f0ae99f6e73b-cert podName:b63a00ba-256d-476a-9f16-f0ae99f6e73b nodeName:}" failed. No retries permitted until 2026-05-20 19:45:08.19138606 +0000 UTC m=+50.639934892 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/b63a00ba-256d-476a-9f16-f0ae99f6e73b-cert") pod "ingress-canary-rj5rw" (UID: "b63a00ba-256d-476a-9f16-f0ae99f6e73b") : secret "canary-serving-cert" not found
May 20 19:45:00.191698 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:45:00.191414    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e5d41c3-bec4-4344-a58c-e52112542af8-metrics-tls podName:3e5d41c3-bec4-4344-a58c-e52112542af8 nodeName:}" failed. No retries permitted until 2026-05-20 19:45:08.191407481 +0000 UTC m=+50.639956313 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3e5d41c3-bec4-4344-a58c-e52112542af8-metrics-tls") pod "dns-default-t8kn6" (UID: "3e5d41c3-bec4-4344-a58c-e52112542af8") : secret "dns-default-metrics-tls" not found
May 20 19:45:08.242408 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:45:08.242359    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3e5d41c3-bec4-4344-a58c-e52112542af8-metrics-tls\") pod \"dns-default-t8kn6\" (UID: \"3e5d41c3-bec4-4344-a58c-e52112542af8\") " pod="openshift-dns/dns-default-t8kn6"
May 20 19:45:08.242408 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:45:08.242405    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b63a00ba-256d-476a-9f16-f0ae99f6e73b-cert\") pod \"ingress-canary-rj5rw\" (UID: \"b63a00ba-256d-476a-9f16-f0ae99f6e73b\") " pod="openshift-ingress-canary/ingress-canary-rj5rw"
May 20 19:45:08.243001 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:45:08.242514    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 20 19:45:08.243001 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:45:08.242528    2578 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 20 19:45:08.243001 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:45:08.242599    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e5d41c3-bec4-4344-a58c-e52112542af8-metrics-tls podName:3e5d41c3-bec4-4344-a58c-e52112542af8 nodeName:}" failed. No retries permitted until 2026-05-20 19:45:24.242563651 +0000 UTC m=+66.691112483 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3e5d41c3-bec4-4344-a58c-e52112542af8-metrics-tls") pod "dns-default-t8kn6" (UID: "3e5d41c3-bec4-4344-a58c-e52112542af8") : secret "dns-default-metrics-tls" not found
May 20 19:45:08.243001 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:45:08.242655    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b63a00ba-256d-476a-9f16-f0ae99f6e73b-cert podName:b63a00ba-256d-476a-9f16-f0ae99f6e73b nodeName:}" failed. No retries permitted until 2026-05-20 19:45:24.242637188 +0000 UTC m=+66.691186020 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/b63a00ba-256d-476a-9f16-f0ae99f6e73b-cert") pod "ingress-canary-rj5rw" (UID: "b63a00ba-256d-476a-9f16-f0ae99f6e73b") : secret "canary-serving-cert" not found
May 20 19:45:18.250723 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:45:18.250696    2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8nrkk"
May 20 19:45:23.852103 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:45:23.852055    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8adc751e-abba-4cb1-ab06-d0c915b18a28-metrics-certs\") pod \"network-metrics-daemon-p6zpg\" (UID: \"8adc751e-abba-4cb1-ab06-d0c915b18a28\") " pod="openshift-multus/network-metrics-daemon-p6zpg"
May 20 19:45:23.854947 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:45:23.854925    2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 20 19:45:23.863033 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:45:23.863002    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
May 20 19:45:23.863116 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:45:23.863091    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8adc751e-abba-4cb1-ab06-d0c915b18a28-metrics-certs podName:8adc751e-abba-4cb1-ab06-d0c915b18a28 nodeName:}" failed. No retries permitted until 2026-05-20 19:46:27.863067998 +0000 UTC m=+130.311616836 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8adc751e-abba-4cb1-ab06-d0c915b18a28-metrics-certs") pod "network-metrics-daemon-p6zpg" (UID: "8adc751e-abba-4cb1-ab06-d0c915b18a28") : secret "metrics-daemon-secret" not found
May 20 19:45:23.953214 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:45:23.953173    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pqrk7\" (UniqueName: \"kubernetes.io/projected/4ab5f609-836c-4e9d-907a-620d6c9d56e2-kube-api-access-pqrk7\") pod \"network-check-target-8qqbv\" (UID: \"4ab5f609-836c-4e9d-907a-620d6c9d56e2\") " pod="openshift-network-diagnostics/network-check-target-8qqbv"
May 20 19:45:23.955829 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:45:23.955808    2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 20 19:45:23.966006 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:45:23.965981    2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 20 19:45:23.977528 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:45:23.977501    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pqrk7\" (UniqueName: \"kubernetes.io/projected/4ab5f609-836c-4e9d-907a-620d6c9d56e2-kube-api-access-pqrk7\") pod \"network-check-target-8qqbv\" (UID: \"4ab5f609-836c-4e9d-907a-620d6c9d56e2\") " pod="openshift-network-diagnostics/network-check-target-8qqbv"
May 20 19:45:24.107395 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:45:24.107311    2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-zlkxb\""
May 20 19:45:24.115268 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:45:24.115252    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8qqbv"
May 20 19:45:24.255002 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:45:24.254973    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3e5d41c3-bec4-4344-a58c-e52112542af8-metrics-tls\") pod \"dns-default-t8kn6\" (UID: \"3e5d41c3-bec4-4344-a58c-e52112542af8\") " pod="openshift-dns/dns-default-t8kn6"
May 20 19:45:24.255144 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:45:24.255011    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b63a00ba-256d-476a-9f16-f0ae99f6e73b-cert\") pod \"ingress-canary-rj5rw\" (UID: \"b63a00ba-256d-476a-9f16-f0ae99f6e73b\") " pod="openshift-ingress-canary/ingress-canary-rj5rw"
May 20 19:45:24.255202 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:45:24.255165    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 20 19:45:24.255255 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:45:24.255222    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e5d41c3-bec4-4344-a58c-e52112542af8-metrics-tls podName:3e5d41c3-bec4-4344-a58c-e52112542af8 nodeName:}" failed. No retries permitted until 2026-05-20 19:45:56.255207355 +0000 UTC m=+98.703756191 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3e5d41c3-bec4-4344-a58c-e52112542af8-metrics-tls") pod "dns-default-t8kn6" (UID: "3e5d41c3-bec4-4344-a58c-e52112542af8") : secret "dns-default-metrics-tls" not found
May 20 19:45:24.255255 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:45:24.255165    2578 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 20 19:45:24.255369 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:45:24.255277    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b63a00ba-256d-476a-9f16-f0ae99f6e73b-cert podName:b63a00ba-256d-476a-9f16-f0ae99f6e73b nodeName:}" failed. No retries permitted until 2026-05-20 19:45:56.255266186 +0000 UTC m=+98.703815017 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/b63a00ba-256d-476a-9f16-f0ae99f6e73b-cert") pod "ingress-canary-rj5rw" (UID: "b63a00ba-256d-476a-9f16-f0ae99f6e73b") : secret "canary-serving-cert" not found
May 20 19:45:24.317202 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:45:24.317174    2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-8qqbv"]
May 20 19:45:24.320734 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:45:24.320703    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ab5f609_836c_4e9d_907a_620d6c9d56e2.slice/crio-39e0c2d4de9d48c2105f06e88f1014266d8c8e6abe9982d082c8342097cbcfe1 WatchSource:0}: Error finding container 39e0c2d4de9d48c2105f06e88f1014266d8c8e6abe9982d082c8342097cbcfe1: Status 404 returned error can't find the container with id 39e0c2d4de9d48c2105f06e88f1014266d8c8e6abe9982d082c8342097cbcfe1
May 20 19:45:25.320152 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:45:25.320111    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-8qqbv" event={"ID":"4ab5f609-836c-4e9d-907a-620d6c9d56e2","Type":"ContainerStarted","Data":"39e0c2d4de9d48c2105f06e88f1014266d8c8e6abe9982d082c8342097cbcfe1"}
May 20 19:45:28.326545 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:45:28.326508    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-8qqbv" event={"ID":"4ab5f609-836c-4e9d-907a-620d6c9d56e2","Type":"ContainerStarted","Data":"7ad5a3e3676e5b795d9de3a58f5b3a532279952be9f8d7a561699002cd9386d4"}
May 20 19:45:28.326949 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:45:28.326655    2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-8qqbv"
May 20 19:45:28.342145 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:45:28.342105    2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-8qqbv" podStartSLOduration=67.402585189 podStartE2EDuration="1m10.342092966s" podCreationTimestamp="2026-05-20 19:44:18 +0000 UTC" firstStartedPulling="2026-05-20 19:45:24.322516822 +0000 UTC m=+66.771065656" lastFinishedPulling="2026-05-20 19:45:27.262024601 +0000 UTC m=+69.710573433" observedRunningTime="2026-05-20 19:45:28.341192137 +0000 UTC m=+70.789740988" watchObservedRunningTime="2026-05-20 19:45:28.342092966 +0000 UTC m=+70.790641819"
May 20 19:45:56.277535 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:45:56.277497    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b63a00ba-256d-476a-9f16-f0ae99f6e73b-cert\") pod \"ingress-canary-rj5rw\" (UID: \"b63a00ba-256d-476a-9f16-f0ae99f6e73b\") " pod="openshift-ingress-canary/ingress-canary-rj5rw"
May 20 19:45:56.277991 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:45:56.277571    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3e5d41c3-bec4-4344-a58c-e52112542af8-metrics-tls\") pod \"dns-default-t8kn6\" (UID: \"3e5d41c3-bec4-4344-a58c-e52112542af8\") " pod="openshift-dns/dns-default-t8kn6"
May 20 19:45:56.278059 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:45:56.278028    2578 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 20 19:45:56.280506 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:45:56.278100    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 20 19:45:56.280506 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:45:56.278153    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b63a00ba-256d-476a-9f16-f0ae99f6e73b-cert podName:b63a00ba-256d-476a-9f16-f0ae99f6e73b nodeName:}" failed. No retries permitted until 2026-05-20 19:47:00.278128586 +0000 UTC m=+162.726677437 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/b63a00ba-256d-476a-9f16-f0ae99f6e73b-cert") pod "ingress-canary-rj5rw" (UID: "b63a00ba-256d-476a-9f16-f0ae99f6e73b") : secret "canary-serving-cert" not found
May 20 19:45:56.280506 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:45:56.278719    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e5d41c3-bec4-4344-a58c-e52112542af8-metrics-tls podName:3e5d41c3-bec4-4344-a58c-e52112542af8 nodeName:}" failed. No retries permitted until 2026-05-20 19:47:00.278696105 +0000 UTC m=+162.727244947 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3e5d41c3-bec4-4344-a58c-e52112542af8-metrics-tls") pod "dns-default-t8kn6" (UID: "3e5d41c3-bec4-4344-a58c-e52112542af8") : secret "dns-default-metrics-tls" not found
May 20 19:45:59.330999 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:45:59.330969    2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-8qqbv"
May 20 19:46:26.969888 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:26.969846    2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-qg49z"]
May 20 19:46:26.972717 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:26.972699    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-qg49z"
May 20 19:46:26.975402 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:26.975379    2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-mcc7w\""
May 20 19:46:26.975402 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:26.975396    2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
May 20 19:46:26.975598 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:26.975440    2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
May 20 19:46:26.976503 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:26.976488    2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
May 20 19:46:26.976552 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:26.976512    2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
May 20 19:46:26.980088 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:26.980068    2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-qg49z"]
May 20 19:46:27.070640 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:27.070574    2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-fd6t5"]
May 20 19:46:27.073438 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:27.073420    2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-m2crt"]
May 20 19:46:27.073614 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:27.073576    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-fd6t5"
May 20 19:46:27.076107 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:27.076079    2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-vqxgv\""
May 20 19:46:27.076234 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:27.076174    2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-xpb4t"]
May 20 19:46:27.076415 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:27.076370    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-m2crt"
May 20 19:46:27.076625 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:27.076509    2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
May 20 19:46:27.076726 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:27.076377    2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
May 20 19:46:27.078855 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:27.078838    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-xpb4t"
May 20 19:46:27.079081 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:27.078998    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4pmzm\" (UniqueName: \"kubernetes.io/projected/0edc95e5-a20c-4a03-a91a-03dfa7730b2a-kube-api-access-4pmzm\") pod \"kube-storage-version-migrator-operator-565644f49-qg49z\" (UID: \"0edc95e5-a20c-4a03-a91a-03dfa7730b2a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-qg49z"
May 20 19:46:27.079081 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:27.079049    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0edc95e5-a20c-4a03-a91a-03dfa7730b2a-config\") pod \"kube-storage-version-migrator-operator-565644f49-qg49z\" (UID: \"0edc95e5-a20c-4a03-a91a-03dfa7730b2a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-qg49z"
May 20 19:46:27.079212 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:27.079081    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0edc95e5-a20c-4a03-a91a-03dfa7730b2a-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-qg49z\" (UID: \"0edc95e5-a20c-4a03-a91a-03dfa7730b2a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-qg49z"
May 20 19:46:27.079296 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:27.079273    2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
May 20 19:46:27.079801 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:27.079788    2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-cqhfl\""
May 20 19:46:27.080080 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:27.080063    2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
May 20 19:46:27.080503 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:27.080489    2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
May 20 19:46:27.081172 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:27.081155    2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
May 20 19:46:27.081597 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:27.081552    2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
May 20 19:46:27.081712 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:27.081652    2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
May 20 19:46:27.081817 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:27.081780    2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-9m84c\""
May 20 19:46:27.081892 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:27.081869    2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
May 20 19:46:27.082664 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:27.082642    2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-fd6t5"]
May 20 19:46:27.086395 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:27.086370    2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-m2crt"]
May 20 19:46:27.088253 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:27.088230    2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-xpb4t"]
May 20 19:46:27.169321 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:27.169286    2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-2jjjl"]
May 20 19:46:27.172274 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:27.172251    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-2jjjl"
May 20 19:46:27.174971 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:27.174948    2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
May 20 19:46:27.175093 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:27.174973    2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-sgpck\""
May 20 19:46:27.175093 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:27.174973    2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
May 20 19:46:27.177503 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:27.177481    2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-w7grq"]
May 20 19:46:27.179427 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:27.179408    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4pmzm\" (UniqueName: \"kubernetes.io/projected/0edc95e5-a20c-4a03-a91a-03dfa7730b2a-kube-api-access-4pmzm\") pod \"kube-storage-version-migrator-operator-565644f49-qg49z\" (UID: \"0edc95e5-a20c-4a03-a91a-03dfa7730b2a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-qg49z"
May 20 19:46:27.179502 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:27.179441    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hff22\" (UniqueName: \"kubernetes.io/projected/dbcb72b7-120b-4be2-836c-7981af7baa1e-kube-api-access-hff22\") pod \"volume-data-source-validator-5cf8c89d64-fd6t5\" (UID: \"dbcb72b7-120b-4be2-836c-7981af7baa1e\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-fd6t5"
May 20 19:46:27.179502 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:27.179469    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7e48cbbf-eaf2-44ad-bf70-cda2a6670a42-samples-operator-tls\") pod \"cluster-samples-operator-697587599-m2crt\" (UID: \"7e48cbbf-eaf2-44ad-bf70-cda2a6670a42\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-m2crt"
May 20 19:46:27.179611 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:27.179526    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x4bfl\" (UniqueName: \"kubernetes.io/projected/7e48cbbf-eaf2-44ad-bf70-cda2a6670a42-kube-api-access-x4bfl\") pod \"cluster-samples-operator-697587599-m2crt\" (UID: \"7e48cbbf-eaf2-44ad-bf70-cda2a6670a42\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-m2crt"
May 20 19:46:27.179687 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:27.179667    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0edc95e5-a20c-4a03-a91a-03dfa7730b2a-config\") pod \"kube-storage-version-migrator-operator-565644f49-qg49z\" (UID: \"0edc95e5-a20c-4a03-a91a-03dfa7730b2a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-qg49z"
May 20 19:46:27.179740 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:27.179706    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0f7be3ab-2755-40b3-ab14-2353ad0ebecd-config\") pod \"service-ca-operator-57b5b68b8-xpb4t\" (UID: \"0f7be3ab-2755-40b3-ab14-2353ad0ebecd\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-xpb4t"
May 20 19:46:27.179794 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:27.179742    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0edc95e5-a20c-4a03-a91a-03dfa7730b2a-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-qg49z\" (UID: \"0edc95e5-a20c-4a03-a91a-03dfa7730b2a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-qg49z"
May 20 19:46:27.179794 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:27.179768    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sz8s4\" (UniqueName: \"kubernetes.io/projected/0f7be3ab-2755-40b3-ab14-2353ad0ebecd-kube-api-access-sz8s4\") pod \"service-ca-operator-57b5b68b8-xpb4t\" (UID: \"0f7be3ab-2755-40b3-ab14-2353ad0ebecd\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-xpb4t"
May 20 19:46:27.179896 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:27.179842    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0f7be3ab-2755-40b3-ab14-2353ad0ebecd-serving-cert\") pod \"service-ca-operator-57b5b68b8-xpb4t\" (UID: \"0f7be3ab-2755-40b3-ab14-2353ad0ebecd\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-xpb4t"
May 20 19:46:27.180270 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:27.180216    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0edc95e5-a20c-4a03-a91a-03dfa7730b2a-config\") pod \"kube-storage-version-migrator-operator-565644f49-qg49z\" (UID: \"0edc95e5-a20c-4a03-a91a-03dfa7730b2a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-qg49z"
May 20 19:46:27.180422 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:27.180408    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-w7grq"
May 20 19:46:27.182280 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:27.182257    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0edc95e5-a20c-4a03-a91a-03dfa7730b2a-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-qg49z\" (UID: \"0edc95e5-a20c-4a03-a91a-03dfa7730b2a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-qg49z"
May 20 19:46:27.182892 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:27.182872    2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-wbfg8\""
May 20 19:46:27.182980 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:27.182926    2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
May 20 19:46:27.183212 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:27.183197    2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
May 20 19:46:27.184247 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:27.184223    2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
May 20 19:46:27.185171 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:27.185151    2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
May 20 19:46:27.185506 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:27.185489    2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-2jjjl"]
May 20 19:46:27.193423 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:27.193401    2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-w7grq"]
May 20 19:46:27.200778 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:27.200754    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4pmzm\" (UniqueName: \"kubernetes.io/projected/0edc95e5-a20c-4a03-a91a-03dfa7730b2a-kube-api-access-4pmzm\") pod \"kube-storage-version-migrator-operator-565644f49-qg49z\" (UID: \"0edc95e5-a20c-4a03-a91a-03dfa7730b2a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-qg49z"
May 20 19:46:27.280646 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:27.280540    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6c107f5d-7dac-4b0c-8b34-e52b84ab2075-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-2jjjl\" (UID: \"6c107f5d-7dac-4b0c-8b34-e52b84ab2075\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-2jjjl"
May 20 19:46:27.280646 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:27.280597    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wxlqs\" (UniqueName: \"kubernetes.io/projected/9438ccc5-f4ae-4304-815d-ef1af9cdd459-kube-api-access-wxlqs\") pod \"cluster-monitoring-operator-6c75959455-w7grq\" (UID: \"9438ccc5-f4ae-4304-815d-ef1af9cdd459\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-w7grq"
May 20 19:46:27.280646 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:27.280621    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/6c107f5d-7dac-4b0c-8b34-e52b84ab2075-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-2jjjl\" (UID: \"6c107f5d-7dac-4b0c-8b34-e52b84ab2075\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-2jjjl"
May 20 19:46:27.280646 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:27.280643    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0f7be3ab-2755-40b3-ab14-2353ad0ebecd-serving-cert\") pod \"service-ca-operator-57b5b68b8-xpb4t\" (UID: \"0f7be3ab-2755-40b3-ab14-2353ad0ebecd\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-xpb4t"
May 20 19:46:27.280918 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:27.280697    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hff22\" (UniqueName: \"kubernetes.io/projected/dbcb72b7-120b-4be2-836c-7981af7baa1e-kube-api-access-hff22\") pod \"volume-data-source-validator-5cf8c89d64-fd6t5\" (UID: \"dbcb72b7-120b-4be2-836c-7981af7baa1e\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-fd6t5"
May 20 19:46:27.280918 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:27.280731    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7e48cbbf-eaf2-44ad-bf70-cda2a6670a42-samples-operator-tls\") pod \"cluster-samples-operator-697587599-m2crt\" (UID: \"7e48cbbf-eaf2-44ad-bf70-cda2a6670a42\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-m2crt"
May 20 19:46:27.280918 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:27.280752    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-x4bfl\" (UniqueName: \"kubernetes.io/projected/7e48cbbf-eaf2-44ad-bf70-cda2a6670a42-kube-api-access-x4bfl\") pod \"cluster-samples-operator-697587599-m2crt\" (UID: \"7e48cbbf-eaf2-44ad-bf70-cda2a6670a42\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-m2crt"
May 20 19:46:27.280918 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:46:27.280825    2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
May 20 19:46:27.280918 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:27.280884    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0f7be3ab-2755-40b3-ab14-2353ad0ebecd-config\") pod \"service-ca-operator-57b5b68b8-xpb4t\" (UID: \"0f7be3ab-2755-40b3-ab14-2353ad0ebecd\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-xpb4t"
May 20 19:46:27.280918 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:46:27.280895    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e48cbbf-eaf2-44ad-bf70-cda2a6670a42-samples-operator-tls podName:7e48cbbf-eaf2-44ad-bf70-cda2a6670a42 nodeName:}" failed. No retries permitted until 2026-05-20 19:46:27.780876554 +0000 UTC m=+130.229425387 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/7e48cbbf-eaf2-44ad-bf70-cda2a6670a42-samples-operator-tls") pod "cluster-samples-operator-697587599-m2crt" (UID: "7e48cbbf-eaf2-44ad-bf70-cda2a6670a42") : secret "samples-operator-tls" not found
May 20 19:46:27.281160 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:27.280935    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sz8s4\" (UniqueName: \"kubernetes.io/projected/0f7be3ab-2755-40b3-ab14-2353ad0ebecd-kube-api-access-sz8s4\") pod \"service-ca-operator-57b5b68b8-xpb4t\" (UID: \"0f7be3ab-2755-40b3-ab14-2353ad0ebecd\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-xpb4t"
May 20 19:46:27.281160 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:27.280971    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/9438ccc5-f4ae-4304-815d-ef1af9cdd459-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-w7grq\" (UID: \"9438ccc5-f4ae-4304-815d-ef1af9cdd459\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-w7grq"
May 20 19:46:27.281160 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:27.281001    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9438ccc5-f4ae-4304-815d-ef1af9cdd459-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-w7grq\" (UID: \"9438ccc5-f4ae-4304-815d-ef1af9cdd459\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-w7grq"
May 20 19:46:27.281352 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:27.281336    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0f7be3ab-2755-40b3-ab14-2353ad0ebecd-config\") pod \"service-ca-operator-57b5b68b8-xpb4t\" (UID: \"0f7be3ab-2755-40b3-ab14-2353ad0ebecd\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-xpb4t"
May 20 19:46:27.281419 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:27.281408    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-qg49z"
May 20 19:46:27.283392 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:27.283362    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0f7be3ab-2755-40b3-ab14-2353ad0ebecd-serving-cert\") pod \"service-ca-operator-57b5b68b8-xpb4t\" (UID: \"0f7be3ab-2755-40b3-ab14-2353ad0ebecd\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-xpb4t"
May 20 19:46:27.294272 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:27.294247    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x4bfl\" (UniqueName: \"kubernetes.io/projected/7e48cbbf-eaf2-44ad-bf70-cda2a6670a42-kube-api-access-x4bfl\") pod \"cluster-samples-operator-697587599-m2crt\" (UID: \"7e48cbbf-eaf2-44ad-bf70-cda2a6670a42\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-m2crt"
May 20 19:46:27.294558 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:27.294534    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sz8s4\" (UniqueName: \"kubernetes.io/projected/0f7be3ab-2755-40b3-ab14-2353ad0ebecd-kube-api-access-sz8s4\") pod \"service-ca-operator-57b5b68b8-xpb4t\" (UID: \"0f7be3ab-2755-40b3-ab14-2353ad0ebecd\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-xpb4t"
May 20 19:46:27.294755 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:27.294739    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hff22\" (UniqueName: \"kubernetes.io/projected/dbcb72b7-120b-4be2-836c-7981af7baa1e-kube-api-access-hff22\") pod \"volume-data-source-validator-5cf8c89d64-fd6t5\" (UID: \"dbcb72b7-120b-4be2-836c-7981af7baa1e\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-fd6t5"
May 20 19:46:27.381376 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:27.381345    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/6c107f5d-7dac-4b0c-8b34-e52b84ab2075-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-2jjjl\" (UID: \"6c107f5d-7dac-4b0c-8b34-e52b84ab2075\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-2jjjl"
May 20 19:46:27.381541 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:27.381433    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/9438ccc5-f4ae-4304-815d-ef1af9cdd459-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-w7grq\" (UID: \"9438ccc5-f4ae-4304-815d-ef1af9cdd459\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-w7grq"
May 20 19:46:27.381541 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:27.381462    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9438ccc5-f4ae-4304-815d-ef1af9cdd459-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-w7grq\" (UID: \"9438ccc5-f4ae-4304-815d-ef1af9cdd459\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-w7grq"
May 20 19:46:27.381541 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:27.381528    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6c107f5d-7dac-4b0c-8b34-e52b84ab2075-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-2jjjl\" (UID: \"6c107f5d-7dac-4b0c-8b34-e52b84ab2075\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-2jjjl"
May 20 19:46:27.381704 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:27.381554    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wxlqs\" (UniqueName: \"kubernetes.io/projected/9438ccc5-f4ae-4304-815d-ef1af9cdd459-kube-api-access-wxlqs\") pod \"cluster-monitoring-operator-6c75959455-w7grq\" (UID: \"9438ccc5-f4ae-4304-815d-ef1af9cdd459\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-w7grq"
May 20 19:46:27.381704 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:46:27.381675    2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 20 19:46:27.381704 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:46:27.381690    2578 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
May 20 19:46:27.381827 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:46:27.381744    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9438ccc5-f4ae-4304-815d-ef1af9cdd459-cluster-monitoring-operator-tls podName:9438ccc5-f4ae-4304-815d-ef1af9cdd459 nodeName:}" failed. No retries permitted until 2026-05-20 19:46:27.881723487 +0000 UTC m=+130.330272319 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/9438ccc5-f4ae-4304-815d-ef1af9cdd459-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-w7grq" (UID: "9438ccc5-f4ae-4304-815d-ef1af9cdd459") : secret "cluster-monitoring-operator-tls" not found
May 20 19:46:27.381827 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:46:27.381759    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c107f5d-7dac-4b0c-8b34-e52b84ab2075-networking-console-plugin-cert podName:6c107f5d-7dac-4b0c-8b34-e52b84ab2075 nodeName:}" failed. No retries permitted until 2026-05-20 19:46:27.881753333 +0000 UTC m=+130.330302165 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/6c107f5d-7dac-4b0c-8b34-e52b84ab2075-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-2jjjl" (UID: "6c107f5d-7dac-4b0c-8b34-e52b84ab2075") : secret "networking-console-plugin-cert" not found
May 20 19:46:27.382153 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:27.382134    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/6c107f5d-7dac-4b0c-8b34-e52b84ab2075-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-2jjjl\" (UID: \"6c107f5d-7dac-4b0c-8b34-e52b84ab2075\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-2jjjl"
May 20 19:46:27.382153 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:27.382143    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/9438ccc5-f4ae-4304-815d-ef1af9cdd459-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-w7grq\" (UID: \"9438ccc5-f4ae-4304-815d-ef1af9cdd459\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-w7grq"
May 20 19:46:27.385296 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:27.385278    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-fd6t5"
May 20 19:46:27.390998 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:27.390975    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wxlqs\" (UniqueName: \"kubernetes.io/projected/9438ccc5-f4ae-4304-815d-ef1af9cdd459-kube-api-access-wxlqs\") pod \"cluster-monitoring-operator-6c75959455-w7grq\" (UID: \"9438ccc5-f4ae-4304-815d-ef1af9cdd459\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-w7grq"
May 20 19:46:27.398848 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:27.398754    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-xpb4t"
May 20 19:46:27.400034 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:27.400015    2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-qg49z"]
May 20 19:46:27.405002 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:46:27.404977    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0edc95e5_a20c_4a03_a91a_03dfa7730b2a.slice/crio-777be4f3f21329833ba66980ef29ba7f97fc614178c9860e1c02cddba1547b76 WatchSource:0}: Error finding container 777be4f3f21329833ba66980ef29ba7f97fc614178c9860e1c02cddba1547b76: Status 404 returned error can't find the container with id 777be4f3f21329833ba66980ef29ba7f97fc614178c9860e1c02cddba1547b76
May 20 19:46:27.447224 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:27.447188    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-qg49z" event={"ID":"0edc95e5-a20c-4a03-a91a-03dfa7730b2a","Type":"ContainerStarted","Data":"777be4f3f21329833ba66980ef29ba7f97fc614178c9860e1c02cddba1547b76"}
May 20 19:46:27.476182 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:27.476149    2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5757cb6fbf-g5qgx"]
May 20 19:46:27.488026 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:27.488001    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5757cb6fbf-g5qgx"
May 20 19:46:27.491241 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:27.490898    2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5757cb6fbf-g5qgx"]
May 20 19:46:27.491241 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:27.490905    2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
May 20 19:46:27.491241 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:27.490973    2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
May 20 19:46:27.491241 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:27.490986    2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-qknn6\""
May 20 19:46:27.491635 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:27.491254    2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
May 20 19:46:27.508550 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:27.508498    2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
May 20 19:46:27.521898 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:27.521871    2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-fd6t5"]
May 20 19:46:27.525228 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:46:27.525190    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddbcb72b7_120b_4be2_836c_7981af7baa1e.slice/crio-8c384e8e184b1fcd269f65dfc8b9f44bab112f7cdeddb9ef3073d872ced9c5de WatchSource:0}: Error finding container 8c384e8e184b1fcd269f65dfc8b9f44bab112f7cdeddb9ef3073d872ced9c5de: Status 404 returned error can't find the container with id 8c384e8e184b1fcd269f65dfc8b9f44bab112f7cdeddb9ef3073d872ced9c5de
May 20 19:46:27.542267 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:27.542202    2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-xpb4t"]
May 20 19:46:27.546459 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:46:27.546434    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f7be3ab_2755_40b3_ab14_2353ad0ebecd.slice/crio-eba2ea8c54ac111c25445a82ddb742975cdb839cd777c8db7952b6bb494e201a WatchSource:0}: Error finding container eba2ea8c54ac111c25445a82ddb742975cdb839cd777c8db7952b6bb494e201a: Status 404 returned error can't find the container with id eba2ea8c54ac111c25445a82ddb742975cdb839cd777c8db7952b6bb494e201a
May 20 19:46:27.582899 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:27.582861    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/169436b4-0a1d-4a7b-a7e1-b9868db43921-image-registry-private-configuration\") pod \"image-registry-5757cb6fbf-g5qgx\" (UID: \"169436b4-0a1d-4a7b-a7e1-b9868db43921\") " pod="openshift-image-registry/image-registry-5757cb6fbf-g5qgx"
May 20 19:46:27.582899 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:27.582901    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/169436b4-0a1d-4a7b-a7e1-b9868db43921-registry-certificates\") pod \"image-registry-5757cb6fbf-g5qgx\" (UID: \"169436b4-0a1d-4a7b-a7e1-b9868db43921\") " pod="openshift-image-registry/image-registry-5757cb6fbf-g5qgx"
May 20 19:46:27.583121 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:27.582926    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/169436b4-0a1d-4a7b-a7e1-b9868db43921-installation-pull-secrets\") pod \"image-registry-5757cb6fbf-g5qgx\" (UID: \"169436b4-0a1d-4a7b-a7e1-b9868db43921\") " pod="openshift-image-registry/image-registry-5757cb6fbf-g5qgx"
May 20 19:46:27.583121 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:27.582963    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/169436b4-0a1d-4a7b-a7e1-b9868db43921-trusted-ca\") pod \"image-registry-5757cb6fbf-g5qgx\" (UID: \"169436b4-0a1d-4a7b-a7e1-b9868db43921\") " pod="openshift-image-registry/image-registry-5757cb6fbf-g5qgx"
May 20 19:46:27.583121 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:27.583081    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/169436b4-0a1d-4a7b-a7e1-b9868db43921-bound-sa-token\") pod \"image-registry-5757cb6fbf-g5qgx\" (UID: \"169436b4-0a1d-4a7b-a7e1-b9868db43921\") " pod="openshift-image-registry/image-registry-5757cb6fbf-g5qgx"
May 20 19:46:27.583238 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:27.583157    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/169436b4-0a1d-4a7b-a7e1-b9868db43921-ca-trust-extracted\") pod \"image-registry-5757cb6fbf-g5qgx\" (UID: \"169436b4-0a1d-4a7b-a7e1-b9868db43921\") " pod="openshift-image-registry/image-registry-5757cb6fbf-g5qgx"
May 20 19:46:27.583238 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:27.583177    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-khkqf\" (UniqueName: \"kubernetes.io/projected/169436b4-0a1d-4a7b-a7e1-b9868db43921-kube-api-access-khkqf\") pod \"image-registry-5757cb6fbf-g5qgx\" (UID: \"169436b4-0a1d-4a7b-a7e1-b9868db43921\") " pod="openshift-image-registry/image-registry-5757cb6fbf-g5qgx"
May 20 19:46:27.583238 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:27.583200    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/169436b4-0a1d-4a7b-a7e1-b9868db43921-registry-tls\") pod \"image-registry-5757cb6fbf-g5qgx\" (UID: \"169436b4-0a1d-4a7b-a7e1-b9868db43921\") " pod="openshift-image-registry/image-registry-5757cb6fbf-g5qgx"
May 20 19:46:27.684017 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:27.683977    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-khkqf\" (UniqueName: \"kubernetes.io/projected/169436b4-0a1d-4a7b-a7e1-b9868db43921-kube-api-access-khkqf\") pod \"image-registry-5757cb6fbf-g5qgx\" (UID: \"169436b4-0a1d-4a7b-a7e1-b9868db43921\") " pod="openshift-image-registry/image-registry-5757cb6fbf-g5qgx"
May 20 19:46:27.684205 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:27.684027    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/169436b4-0a1d-4a7b-a7e1-b9868db43921-registry-tls\") pod \"image-registry-5757cb6fbf-g5qgx\" (UID: \"169436b4-0a1d-4a7b-a7e1-b9868db43921\") " pod="openshift-image-registry/image-registry-5757cb6fbf-g5qgx"
May 20 19:46:27.684205 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:27.684094    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/169436b4-0a1d-4a7b-a7e1-b9868db43921-image-registry-private-configuration\") pod \"image-registry-5757cb6fbf-g5qgx\" (UID: \"169436b4-0a1d-4a7b-a7e1-b9868db43921\") " pod="openshift-image-registry/image-registry-5757cb6fbf-g5qgx"
May 20 19:46:27.684205 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:27.684118    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/169436b4-0a1d-4a7b-a7e1-b9868db43921-registry-certificates\") pod \"image-registry-5757cb6fbf-g5qgx\" (UID: \"169436b4-0a1d-4a7b-a7e1-b9868db43921\") " pod="openshift-image-registry/image-registry-5757cb6fbf-g5qgx"
May 20 19:46:27.684205 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:27.684143    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/169436b4-0a1d-4a7b-a7e1-b9868db43921-installation-pull-secrets\") pod \"image-registry-5757cb6fbf-g5qgx\" (UID: \"169436b4-0a1d-4a7b-a7e1-b9868db43921\") " pod="openshift-image-registry/image-registry-5757cb6fbf-g5qgx"
May 20 19:46:27.684205 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:27.684174    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/169436b4-0a1d-4a7b-a7e1-b9868db43921-trusted-ca\") pod \"image-registry-5757cb6fbf-g5qgx\" (UID: \"169436b4-0a1d-4a7b-a7e1-b9868db43921\") " pod="openshift-image-registry/image-registry-5757cb6fbf-g5qgx"
May 20 19:46:27.684496 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:46:27.684206    2578 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 20 19:46:27.684496 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:27.684216    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/169436b4-0a1d-4a7b-a7e1-b9868db43921-bound-sa-token\") pod \"image-registry-5757cb6fbf-g5qgx\" (UID: \"169436b4-0a1d-4a7b-a7e1-b9868db43921\") " pod="openshift-image-registry/image-registry-5757cb6fbf-g5qgx"
May 20 19:46:27.684496 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:46:27.684228    2578 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5757cb6fbf-g5qgx: secret "image-registry-tls" not found
May 20 19:46:27.684496 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:46:27.684288    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/169436b4-0a1d-4a7b-a7e1-b9868db43921-registry-tls podName:169436b4-0a1d-4a7b-a7e1-b9868db43921 nodeName:}" failed. No retries permitted until 2026-05-20 19:46:28.184265501 +0000 UTC m=+130.632814346 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/169436b4-0a1d-4a7b-a7e1-b9868db43921-registry-tls") pod "image-registry-5757cb6fbf-g5qgx" (UID: "169436b4-0a1d-4a7b-a7e1-b9868db43921") : secret "image-registry-tls" not found
May 20 19:46:27.684496 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:27.684412    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/169436b4-0a1d-4a7b-a7e1-b9868db43921-ca-trust-extracted\") pod \"image-registry-5757cb6fbf-g5qgx\" (UID: \"169436b4-0a1d-4a7b-a7e1-b9868db43921\") " pod="openshift-image-registry/image-registry-5757cb6fbf-g5qgx"
May 20 19:46:27.684755 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:27.684744    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/169436b4-0a1d-4a7b-a7e1-b9868db43921-ca-trust-extracted\") pod \"image-registry-5757cb6fbf-g5qgx\" (UID: \"169436b4-0a1d-4a7b-a7e1-b9868db43921\") " pod="openshift-image-registry/image-registry-5757cb6fbf-g5qgx"
May 20 19:46:27.684838 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:27.684814    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/169436b4-0a1d-4a7b-a7e1-b9868db43921-registry-certificates\") pod \"image-registry-5757cb6fbf-g5qgx\" (UID: \"169436b4-0a1d-4a7b-a7e1-b9868db43921\") " pod="openshift-image-registry/image-registry-5757cb6fbf-g5qgx"
May 20 19:46:27.685060 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:27.685030    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/169436b4-0a1d-4a7b-a7e1-b9868db43921-trusted-ca\") pod \"image-registry-5757cb6fbf-g5qgx\" (UID: \"169436b4-0a1d-4a7b-a7e1-b9868db43921\") " pod="openshift-image-registry/image-registry-5757cb6fbf-g5qgx"
May 20 19:46:27.686647 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:27.686627    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/169436b4-0a1d-4a7b-a7e1-b9868db43921-installation-pull-secrets\") pod \"image-registry-5757cb6fbf-g5qgx\" (UID: \"169436b4-0a1d-4a7b-a7e1-b9868db43921\") " pod="openshift-image-registry/image-registry-5757cb6fbf-g5qgx"
May 20 19:46:27.686743 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:27.686658    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/169436b4-0a1d-4a7b-a7e1-b9868db43921-image-registry-private-configuration\") pod \"image-registry-5757cb6fbf-g5qgx\" (UID: \"169436b4-0a1d-4a7b-a7e1-b9868db43921\") " pod="openshift-image-registry/image-registry-5757cb6fbf-g5qgx"
May 20 19:46:27.692507 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:27.692482    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/169436b4-0a1d-4a7b-a7e1-b9868db43921-bound-sa-token\") pod \"image-registry-5757cb6fbf-g5qgx\" (UID: \"169436b4-0a1d-4a7b-a7e1-b9868db43921\") " pod="openshift-image-registry/image-registry-5757cb6fbf-g5qgx"
May 20 19:46:27.692692 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:27.692676    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-khkqf\" (UniqueName: \"kubernetes.io/projected/169436b4-0a1d-4a7b-a7e1-b9868db43921-kube-api-access-khkqf\") pod \"image-registry-5757cb6fbf-g5qgx\" (UID: \"169436b4-0a1d-4a7b-a7e1-b9868db43921\") " pod="openshift-image-registry/image-registry-5757cb6fbf-g5qgx"
May 20 19:46:27.785044 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:27.785008    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7e48cbbf-eaf2-44ad-bf70-cda2a6670a42-samples-operator-tls\") pod \"cluster-samples-operator-697587599-m2crt\" (UID: \"7e48cbbf-eaf2-44ad-bf70-cda2a6670a42\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-m2crt"
May 20 19:46:27.785160 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:46:27.785115    2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
May 20 19:46:27.785214 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:46:27.785175    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e48cbbf-eaf2-44ad-bf70-cda2a6670a42-samples-operator-tls podName:7e48cbbf-eaf2-44ad-bf70-cda2a6670a42 nodeName:}" failed. No retries permitted until 2026-05-20 19:46:28.785160913 +0000 UTC m=+131.233709746 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/7e48cbbf-eaf2-44ad-bf70-cda2a6670a42-samples-operator-tls") pod "cluster-samples-operator-697587599-m2crt" (UID: "7e48cbbf-eaf2-44ad-bf70-cda2a6670a42") : secret "samples-operator-tls" not found
May 20 19:46:27.886012 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:27.885983    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9438ccc5-f4ae-4304-815d-ef1af9cdd459-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-w7grq\" (UID: \"9438ccc5-f4ae-4304-815d-ef1af9cdd459\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-w7grq"
May 20 19:46:27.886163 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:27.886021    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8adc751e-abba-4cb1-ab06-d0c915b18a28-metrics-certs\") pod \"network-metrics-daemon-p6zpg\" (UID: \"8adc751e-abba-4cb1-ab06-d0c915b18a28\") " pod="openshift-multus/network-metrics-daemon-p6zpg"
May 20 19:46:27.886163 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:27.886054    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6c107f5d-7dac-4b0c-8b34-e52b84ab2075-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-2jjjl\" (UID: \"6c107f5d-7dac-4b0c-8b34-e52b84ab2075\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-2jjjl"
May 20 19:46:27.886238 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:46:27.886162    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
May 20 19:46:27.886238 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:46:27.886226    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8adc751e-abba-4cb1-ab06-d0c915b18a28-metrics-certs podName:8adc751e-abba-4cb1-ab06-d0c915b18a28 nodeName:}" failed. No retries permitted until 2026-05-20 19:48:29.886211114 +0000 UTC m=+252.334759947 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8adc751e-abba-4cb1-ab06-d0c915b18a28-metrics-certs") pod "network-metrics-daemon-p6zpg" (UID: "8adc751e-abba-4cb1-ab06-d0c915b18a28") : secret "metrics-daemon-secret" not found
May 20 19:46:27.886306 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:46:27.886162    2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 20 19:46:27.886338 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:46:27.886310    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9438ccc5-f4ae-4304-815d-ef1af9cdd459-cluster-monitoring-operator-tls podName:9438ccc5-f4ae-4304-815d-ef1af9cdd459 nodeName:}" failed. No retries permitted until 2026-05-20 19:46:28.886298711 +0000 UTC m=+131.334847543 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/9438ccc5-f4ae-4304-815d-ef1af9cdd459-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-w7grq" (UID: "9438ccc5-f4ae-4304-815d-ef1af9cdd459") : secret "cluster-monitoring-operator-tls" not found
May 20 19:46:27.886338 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:46:27.886167    2578 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
May 20 19:46:27.886400 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:46:27.886342    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c107f5d-7dac-4b0c-8b34-e52b84ab2075-networking-console-plugin-cert podName:6c107f5d-7dac-4b0c-8b34-e52b84ab2075 nodeName:}" failed. No retries permitted until 2026-05-20 19:46:28.886332826 +0000 UTC m=+131.334881658 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/6c107f5d-7dac-4b0c-8b34-e52b84ab2075-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-2jjjl" (UID: "6c107f5d-7dac-4b0c-8b34-e52b84ab2075") : secret "networking-console-plugin-cert" not found
May 20 19:46:28.188397 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:28.188305    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/169436b4-0a1d-4a7b-a7e1-b9868db43921-registry-tls\") pod \"image-registry-5757cb6fbf-g5qgx\" (UID: \"169436b4-0a1d-4a7b-a7e1-b9868db43921\") " pod="openshift-image-registry/image-registry-5757cb6fbf-g5qgx"
May 20 19:46:28.188964 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:46:28.188941    2578 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 20 19:46:28.189053 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:46:28.188966    2578 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5757cb6fbf-g5qgx: secret "image-registry-tls" not found
May 20 19:46:28.189053 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:46:28.189019    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/169436b4-0a1d-4a7b-a7e1-b9868db43921-registry-tls podName:169436b4-0a1d-4a7b-a7e1-b9868db43921 nodeName:}" failed. No retries permitted until 2026-05-20 19:46:29.189000091 +0000 UTC m=+131.637548928 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/169436b4-0a1d-4a7b-a7e1-b9868db43921-registry-tls") pod "image-registry-5757cb6fbf-g5qgx" (UID: "169436b4-0a1d-4a7b-a7e1-b9868db43921") : secret "image-registry-tls" not found
May 20 19:46:28.452208 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:28.452078    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-fd6t5" event={"ID":"dbcb72b7-120b-4be2-836c-7981af7baa1e","Type":"ContainerStarted","Data":"8c384e8e184b1fcd269f65dfc8b9f44bab112f7cdeddb9ef3073d872ced9c5de"}
May 20 19:46:28.453471 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:28.453434    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-xpb4t" event={"ID":"0f7be3ab-2755-40b3-ab14-2353ad0ebecd","Type":"ContainerStarted","Data":"eba2ea8c54ac111c25445a82ddb742975cdb839cd777c8db7952b6bb494e201a"}
May 20 19:46:28.794260 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:28.794177    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7e48cbbf-eaf2-44ad-bf70-cda2a6670a42-samples-operator-tls\") pod \"cluster-samples-operator-697587599-m2crt\" (UID: \"7e48cbbf-eaf2-44ad-bf70-cda2a6670a42\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-m2crt"
May 20 19:46:28.794431 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:46:28.794335    2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
May 20 19:46:28.794431 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:46:28.794416    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e48cbbf-eaf2-44ad-bf70-cda2a6670a42-samples-operator-tls podName:7e48cbbf-eaf2-44ad-bf70-cda2a6670a42 nodeName:}" failed. No retries permitted until 2026-05-20 19:46:30.794391126 +0000 UTC m=+133.242939961 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/7e48cbbf-eaf2-44ad-bf70-cda2a6670a42-samples-operator-tls") pod "cluster-samples-operator-697587599-m2crt" (UID: "7e48cbbf-eaf2-44ad-bf70-cda2a6670a42") : secret "samples-operator-tls" not found
May 20 19:46:28.895035 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:28.894993    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9438ccc5-f4ae-4304-815d-ef1af9cdd459-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-w7grq\" (UID: \"9438ccc5-f4ae-4304-815d-ef1af9cdd459\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-w7grq"
May 20 19:46:28.895201 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:28.895082    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6c107f5d-7dac-4b0c-8b34-e52b84ab2075-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-2jjjl\" (UID: \"6c107f5d-7dac-4b0c-8b34-e52b84ab2075\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-2jjjl"
May 20 19:46:28.895201 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:46:28.895175    2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 20 19:46:28.895331 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:46:28.895256    2578 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
May 20 19:46:28.895331 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:46:28.895264    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9438ccc5-f4ae-4304-815d-ef1af9cdd459-cluster-monitoring-operator-tls podName:9438ccc5-f4ae-4304-815d-ef1af9cdd459 nodeName:}" failed. No retries permitted until 2026-05-20 19:46:30.895239564 +0000 UTC m=+133.343788405 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/9438ccc5-f4ae-4304-815d-ef1af9cdd459-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-w7grq" (UID: "9438ccc5-f4ae-4304-815d-ef1af9cdd459") : secret "cluster-monitoring-operator-tls" not found
May 20 19:46:28.895331 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:46:28.895317    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c107f5d-7dac-4b0c-8b34-e52b84ab2075-networking-console-plugin-cert podName:6c107f5d-7dac-4b0c-8b34-e52b84ab2075 nodeName:}" failed. No retries permitted until 2026-05-20 19:46:30.89529976 +0000 UTC m=+133.343848609 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/6c107f5d-7dac-4b0c-8b34-e52b84ab2075-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-2jjjl" (UID: "6c107f5d-7dac-4b0c-8b34-e52b84ab2075") : secret "networking-console-plugin-cert" not found
May 20 19:46:29.197992 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:29.197951    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/169436b4-0a1d-4a7b-a7e1-b9868db43921-registry-tls\") pod \"image-registry-5757cb6fbf-g5qgx\" (UID: \"169436b4-0a1d-4a7b-a7e1-b9868db43921\") " pod="openshift-image-registry/image-registry-5757cb6fbf-g5qgx"
May 20 19:46:29.198392 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:46:29.198137    2578 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 20 19:46:29.198392 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:46:29.198162    2578 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5757cb6fbf-g5qgx: secret "image-registry-tls" not found
May 20 19:46:29.198392 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:46:29.198234    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/169436b4-0a1d-4a7b-a7e1-b9868db43921-registry-tls podName:169436b4-0a1d-4a7b-a7e1-b9868db43921 nodeName:}" failed. No retries permitted until 2026-05-20 19:46:31.198211504 +0000 UTC m=+133.646760350 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/169436b4-0a1d-4a7b-a7e1-b9868db43921-registry-tls") pod "image-registry-5757cb6fbf-g5qgx" (UID: "169436b4-0a1d-4a7b-a7e1-b9868db43921") : secret "image-registry-tls" not found
May 20 19:46:29.457545 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:29.457457    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-fd6t5" event={"ID":"dbcb72b7-120b-4be2-836c-7981af7baa1e","Type":"ContainerStarted","Data":"252edf07919806477ae411c7170bc1bcae6779728568e8597317c88d1dc5cb39"}
May 20 19:46:29.475573 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:29.475514    2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-fd6t5" podStartSLOduration=1.09038288 podStartE2EDuration="2.47549572s" podCreationTimestamp="2026-05-20 19:46:27 +0000 UTC" firstStartedPulling="2026-05-20 19:46:27.52713237 +0000 UTC m=+129.975681202" lastFinishedPulling="2026-05-20 19:46:28.912245208 +0000 UTC m=+131.360794042" observedRunningTime="2026-05-20 19:46:29.474643445 +0000 UTC m=+131.923192300" watchObservedRunningTime="2026-05-20 19:46:29.47549572 +0000 UTC m=+131.924044575"
May 20 19:46:30.461136 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:30.461043    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-xpb4t" event={"ID":"0f7be3ab-2755-40b3-ab14-2353ad0ebecd","Type":"ContainerStarted","Data":"6527d6783ab5c82c35481c3f38c9040327ac307efef191f0e71e7e54b5cd1412"}
May 20 19:46:30.462500 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:30.462470    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-qg49z" event={"ID":"0edc95e5-a20c-4a03-a91a-03dfa7730b2a","Type":"ContainerStarted","Data":"b59bf9b4877b7351e9096a80cedbd2f9f510da216c1d806f7d30735090932c14"}
May 20 19:46:30.477150 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:30.477095    2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-xpb4t" podStartSLOduration=0.87930327 podStartE2EDuration="3.477079901s" podCreationTimestamp="2026-05-20 19:46:27 +0000 UTC" firstStartedPulling="2026-05-20 19:46:27.548103146 +0000 UTC m=+129.996651981" lastFinishedPulling="2026-05-20 19:46:30.145879762 +0000 UTC m=+132.594428612" observedRunningTime="2026-05-20 19:46:30.47596372 +0000 UTC m=+132.924512573" watchObservedRunningTime="2026-05-20 19:46:30.477079901 +0000 UTC m=+132.925628754"
May 20 19:46:30.492003 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:30.491940    2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-qg49z" podStartSLOduration=1.756754569 podStartE2EDuration="4.49192144s" podCreationTimestamp="2026-05-20 19:46:26 +0000 UTC" firstStartedPulling="2026-05-20 19:46:27.407637062 +0000 UTC m=+129.856185898" lastFinishedPulling="2026-05-20 19:46:30.142803925 +0000 UTC m=+132.591352769" observedRunningTime="2026-05-20 19:46:30.491671445 +0000 UTC m=+132.940220302" watchObservedRunningTime="2026-05-20 19:46:30.49192144 +0000 UTC m=+132.940470297"
May 20 19:46:30.811969 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:30.811866    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7e48cbbf-eaf2-44ad-bf70-cda2a6670a42-samples-operator-tls\") pod \"cluster-samples-operator-697587599-m2crt\" (UID: \"7e48cbbf-eaf2-44ad-bf70-cda2a6670a42\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-m2crt"
May 20 19:46:30.812140 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:46:30.812043    2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
May 20 19:46:30.812140 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:46:30.812117    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e48cbbf-eaf2-44ad-bf70-cda2a6670a42-samples-operator-tls podName:7e48cbbf-eaf2-44ad-bf70-cda2a6670a42 nodeName:}" failed. No retries permitted until 2026-05-20 19:46:34.812099066 +0000 UTC m=+137.260647899 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/7e48cbbf-eaf2-44ad-bf70-cda2a6670a42-samples-operator-tls") pod "cluster-samples-operator-697587599-m2crt" (UID: "7e48cbbf-eaf2-44ad-bf70-cda2a6670a42") : secret "samples-operator-tls" not found
May 20 19:46:30.912985 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:30.912942    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9438ccc5-f4ae-4304-815d-ef1af9cdd459-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-w7grq\" (UID: \"9438ccc5-f4ae-4304-815d-ef1af9cdd459\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-w7grq"
May 20 19:46:30.913127 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:30.913009    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6c107f5d-7dac-4b0c-8b34-e52b84ab2075-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-2jjjl\" (UID: \"6c107f5d-7dac-4b0c-8b34-e52b84ab2075\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-2jjjl"
May 20 19:46:30.913127 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:46:30.913094    2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 20 19:46:30.913127 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:46:30.913118    2578 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
May 20 19:46:30.913293 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:46:30.913162    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c107f5d-7dac-4b0c-8b34-e52b84ab2075-networking-console-plugin-cert podName:6c107f5d-7dac-4b0c-8b34-e52b84ab2075 nodeName:}" failed. No retries permitted until 2026-05-20 19:46:34.913147442 +0000 UTC m=+137.361696274 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/6c107f5d-7dac-4b0c-8b34-e52b84ab2075-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-2jjjl" (UID: "6c107f5d-7dac-4b0c-8b34-e52b84ab2075") : secret "networking-console-plugin-cert" not found
May 20 19:46:30.913293 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:46:30.913174    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9438ccc5-f4ae-4304-815d-ef1af9cdd459-cluster-monitoring-operator-tls podName:9438ccc5-f4ae-4304-815d-ef1af9cdd459 nodeName:}" failed. No retries permitted until 2026-05-20 19:46:34.913169039 +0000 UTC m=+137.361717871 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/9438ccc5-f4ae-4304-815d-ef1af9cdd459-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-w7grq" (UID: "9438ccc5-f4ae-4304-815d-ef1af9cdd459") : secret "cluster-monitoring-operator-tls" not found
May 20 19:46:31.215381 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:31.215348    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/169436b4-0a1d-4a7b-a7e1-b9868db43921-registry-tls\") pod \"image-registry-5757cb6fbf-g5qgx\" (UID: \"169436b4-0a1d-4a7b-a7e1-b9868db43921\") " pod="openshift-image-registry/image-registry-5757cb6fbf-g5qgx"
May 20 19:46:31.215541 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:46:31.215448    2578 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 20 19:46:31.215541 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:46:31.215459    2578 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5757cb6fbf-g5qgx: secret "image-registry-tls" not found
May 20 19:46:31.215541 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:46:31.215517    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/169436b4-0a1d-4a7b-a7e1-b9868db43921-registry-tls podName:169436b4-0a1d-4a7b-a7e1-b9868db43921 nodeName:}" failed. No retries permitted until 2026-05-20 19:46:35.215501396 +0000 UTC m=+137.664050228 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/169436b4-0a1d-4a7b-a7e1-b9868db43921-registry-tls") pod "image-registry-5757cb6fbf-g5qgx" (UID: "169436b4-0a1d-4a7b-a7e1-b9868db43921") : secret "image-registry-tls" not found
May 20 19:46:33.492397 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:33.492368    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-lmf6r_cb2e0a0a-0a02-4144-8e95-2888159f5bd2/dns-node-resolver/0.log"
May 20 19:46:34.495746 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:34.495710    2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-snlb6"]
May 20 19:46:34.496846 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:34.496825    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-mszww_4639ddbd-2055-4d5f-8bda-d0cd32aca639/node-ca/0.log"
May 20 19:46:34.500095 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:34.500078    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-67d667c7d-snlb6"
May 20 19:46:34.502749 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:34.502686    2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
May 20 19:46:34.502749 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:34.502739    2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-gj6sp\""
May 20 19:46:34.502749 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:34.502720    2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
May 20 19:46:34.503929 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:34.503911    2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
May 20 19:46:34.504003 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:34.503948    2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
May 20 19:46:34.507011 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:34.506989    2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-snlb6"]
May 20 19:46:34.642345 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:34.642311    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/937c2767-2805-42c6-bfde-7bd0cf92d947-signing-key\") pod \"service-ca-67d667c7d-snlb6\" (UID: \"937c2767-2805-42c6-bfde-7bd0cf92d947\") " pod="openshift-service-ca/service-ca-67d667c7d-snlb6"
May 20 19:46:34.642345 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:34.642350    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/937c2767-2805-42c6-bfde-7bd0cf92d947-signing-cabundle\") pod \"service-ca-67d667c7d-snlb6\" (UID: \"937c2767-2805-42c6-bfde-7bd0cf92d947\") " pod="openshift-service-ca/service-ca-67d667c7d-snlb6"
May 20 19:46:34.642547 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:34.642430    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lcmp8\" (UniqueName: \"kubernetes.io/projected/937c2767-2805-42c6-bfde-7bd0cf92d947-kube-api-access-lcmp8\") pod \"service-ca-67d667c7d-snlb6\" (UID: \"937c2767-2805-42c6-bfde-7bd0cf92d947\") " pod="openshift-service-ca/service-ca-67d667c7d-snlb6"
May 20 19:46:34.743283 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:34.743243    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/937c2767-2805-42c6-bfde-7bd0cf92d947-signing-cabundle\") pod \"service-ca-67d667c7d-snlb6\" (UID: \"937c2767-2805-42c6-bfde-7bd0cf92d947\") " pod="openshift-service-ca/service-ca-67d667c7d-snlb6"
May 20 19:46:34.743472 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:34.743344    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lcmp8\" (UniqueName: \"kubernetes.io/projected/937c2767-2805-42c6-bfde-7bd0cf92d947-kube-api-access-lcmp8\") pod \"service-ca-67d667c7d-snlb6\" (UID: \"937c2767-2805-42c6-bfde-7bd0cf92d947\") " pod="openshift-service-ca/service-ca-67d667c7d-snlb6"
May 20 19:46:34.743472 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:34.743435    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/937c2767-2805-42c6-bfde-7bd0cf92d947-signing-key\") pod \"service-ca-67d667c7d-snlb6\" (UID: \"937c2767-2805-42c6-bfde-7bd0cf92d947\") " pod="openshift-service-ca/service-ca-67d667c7d-snlb6"
May 20 19:46:34.743980 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:34.743959    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/937c2767-2805-42c6-bfde-7bd0cf92d947-signing-cabundle\") pod \"service-ca-67d667c7d-snlb6\" (UID: \"937c2767-2805-42c6-bfde-7bd0cf92d947\") " pod="openshift-service-ca/service-ca-67d667c7d-snlb6"
May 20 19:46:34.745905 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:34.745853    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/937c2767-2805-42c6-bfde-7bd0cf92d947-signing-key\") pod \"service-ca-67d667c7d-snlb6\" (UID: \"937c2767-2805-42c6-bfde-7bd0cf92d947\") " pod="openshift-service-ca/service-ca-67d667c7d-snlb6"
May 20 19:46:34.753467 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:34.753447    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lcmp8\" (UniqueName: \"kubernetes.io/projected/937c2767-2805-42c6-bfde-7bd0cf92d947-kube-api-access-lcmp8\") pod \"service-ca-67d667c7d-snlb6\" (UID: \"937c2767-2805-42c6-bfde-7bd0cf92d947\") " pod="openshift-service-ca/service-ca-67d667c7d-snlb6"
May 20 19:46:34.809634 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:34.809570    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-67d667c7d-snlb6"
May 20 19:46:34.844750 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:34.844702    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7e48cbbf-eaf2-44ad-bf70-cda2a6670a42-samples-operator-tls\") pod \"cluster-samples-operator-697587599-m2crt\" (UID: \"7e48cbbf-eaf2-44ad-bf70-cda2a6670a42\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-m2crt"
May 20 19:46:34.844926 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:46:34.844842    2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
May 20 19:46:34.844926 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:46:34.844911    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e48cbbf-eaf2-44ad-bf70-cda2a6670a42-samples-operator-tls podName:7e48cbbf-eaf2-44ad-bf70-cda2a6670a42 nodeName:}" failed. No retries permitted until 2026-05-20 19:46:42.844892336 +0000 UTC m=+145.293441171 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/7e48cbbf-eaf2-44ad-bf70-cda2a6670a42-samples-operator-tls") pod "cluster-samples-operator-697587599-m2crt" (UID: "7e48cbbf-eaf2-44ad-bf70-cda2a6670a42") : secret "samples-operator-tls" not found
May 20 19:46:34.936686 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:34.936653    2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-snlb6"]
May 20 19:46:34.940369 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:46:34.940339    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod937c2767_2805_42c6_bfde_7bd0cf92d947.slice/crio-1470f18ecf036189cb9e9fb723b7ea798d0e1fb038abd16c6e6c52d652b9ec4d WatchSource:0}: Error finding container 1470f18ecf036189cb9e9fb723b7ea798d0e1fb038abd16c6e6c52d652b9ec4d: Status 404 returned error can't find the container with id 1470f18ecf036189cb9e9fb723b7ea798d0e1fb038abd16c6e6c52d652b9ec4d
May 20 19:46:34.945233 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:34.945200    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9438ccc5-f4ae-4304-815d-ef1af9cdd459-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-w7grq\" (UID: \"9438ccc5-f4ae-4304-815d-ef1af9cdd459\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-w7grq"
May 20 19:46:34.945351 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:34.945315    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6c107f5d-7dac-4b0c-8b34-e52b84ab2075-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-2jjjl\" (UID: \"6c107f5d-7dac-4b0c-8b34-e52b84ab2075\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-2jjjl"
May 20 19:46:34.945351 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:46:34.945332    2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 20 19:46:34.945471 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:46:34.945399    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9438ccc5-f4ae-4304-815d-ef1af9cdd459-cluster-monitoring-operator-tls podName:9438ccc5-f4ae-4304-815d-ef1af9cdd459 nodeName:}" failed. No retries permitted until 2026-05-20 19:46:42.945376932 +0000 UTC m=+145.393925783 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/9438ccc5-f4ae-4304-815d-ef1af9cdd459-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-w7grq" (UID: "9438ccc5-f4ae-4304-815d-ef1af9cdd459") : secret "cluster-monitoring-operator-tls" not found
May 20 19:46:34.945471 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:46:34.945429    2578 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
May 20 19:46:34.945606 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:46:34.945479    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c107f5d-7dac-4b0c-8b34-e52b84ab2075-networking-console-plugin-cert podName:6c107f5d-7dac-4b0c-8b34-e52b84ab2075 nodeName:}" failed. No retries permitted until 2026-05-20 19:46:42.945462298 +0000 UTC m=+145.394011132 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/6c107f5d-7dac-4b0c-8b34-e52b84ab2075-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-2jjjl" (UID: "6c107f5d-7dac-4b0c-8b34-e52b84ab2075") : secret "networking-console-plugin-cert" not found
May 20 19:46:35.247368 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:35.247339    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/169436b4-0a1d-4a7b-a7e1-b9868db43921-registry-tls\") pod \"image-registry-5757cb6fbf-g5qgx\" (UID: \"169436b4-0a1d-4a7b-a7e1-b9868db43921\") " pod="openshift-image-registry/image-registry-5757cb6fbf-g5qgx"
May 20 19:46:35.247530 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:46:35.247484    2578 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 20 19:46:35.247530 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:46:35.247500    2578 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5757cb6fbf-g5qgx: secret "image-registry-tls" not found
May 20 19:46:35.247637 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:46:35.247551    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/169436b4-0a1d-4a7b-a7e1-b9868db43921-registry-tls podName:169436b4-0a1d-4a7b-a7e1-b9868db43921 nodeName:}" failed. No retries permitted until 2026-05-20 19:46:43.247536471 +0000 UTC m=+145.696085304 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/169436b4-0a1d-4a7b-a7e1-b9868db43921-registry-tls") pod "image-registry-5757cb6fbf-g5qgx" (UID: "169436b4-0a1d-4a7b-a7e1-b9868db43921") : secret "image-registry-tls" not found
May 20 19:46:35.474784 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:35.474748    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-67d667c7d-snlb6" event={"ID":"937c2767-2805-42c6-bfde-7bd0cf92d947","Type":"ContainerStarted","Data":"11f89735aa19a692089c1619ab1e319e67afca83f57bf9baead705e1d2afb851"}
May 20 19:46:35.474784 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:35.474784    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-67d667c7d-snlb6" event={"ID":"937c2767-2805-42c6-bfde-7bd0cf92d947","Type":"ContainerStarted","Data":"1470f18ecf036189cb9e9fb723b7ea798d0e1fb038abd16c6e6c52d652b9ec4d"}
May 20 19:46:35.498186 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:35.498125    2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca/service-ca-67d667c7d-snlb6" podStartSLOduration=1.4981084089999999 podStartE2EDuration="1.498108409s" podCreationTimestamp="2026-05-20 19:46:34 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-20 19:46:35.497758153 +0000 UTC m=+137.946307014" watchObservedRunningTime="2026-05-20 19:46:35.498108409 +0000 UTC m=+137.946657264"
May 20 19:46:42.909125 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:42.909085    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7e48cbbf-eaf2-44ad-bf70-cda2a6670a42-samples-operator-tls\") pod \"cluster-samples-operator-697587599-m2crt\" (UID: \"7e48cbbf-eaf2-44ad-bf70-cda2a6670a42\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-m2crt"
May 20 19:46:42.911656 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:42.911626    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7e48cbbf-eaf2-44ad-bf70-cda2a6670a42-samples-operator-tls\") pod \"cluster-samples-operator-697587599-m2crt\" (UID: \"7e48cbbf-eaf2-44ad-bf70-cda2a6670a42\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-m2crt"
May 20 19:46:42.992845 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:42.992799    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-m2crt"
May 20 19:46:43.009831 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:43.009796    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9438ccc5-f4ae-4304-815d-ef1af9cdd459-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-w7grq\" (UID: \"9438ccc5-f4ae-4304-815d-ef1af9cdd459\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-w7grq"
May 20 19:46:43.009969 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:43.009915    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6c107f5d-7dac-4b0c-8b34-e52b84ab2075-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-2jjjl\" (UID: \"6c107f5d-7dac-4b0c-8b34-e52b84ab2075\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-2jjjl"
May 20 19:46:43.009969 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:46:43.009957    2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 20 19:46:43.010073 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:46:43.010021    2578 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
May 20 19:46:43.010073 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:46:43.010056    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9438ccc5-f4ae-4304-815d-ef1af9cdd459-cluster-monitoring-operator-tls podName:9438ccc5-f4ae-4304-815d-ef1af9cdd459 nodeName:}" failed. No retries permitted until 2026-05-20 19:46:59.010032442 +0000 UTC m=+161.458581290 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/9438ccc5-f4ae-4304-815d-ef1af9cdd459-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-w7grq" (UID: "9438ccc5-f4ae-4304-815d-ef1af9cdd459") : secret "cluster-monitoring-operator-tls" not found
May 20 19:46:43.010165 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:46:43.010077    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c107f5d-7dac-4b0c-8b34-e52b84ab2075-networking-console-plugin-cert podName:6c107f5d-7dac-4b0c-8b34-e52b84ab2075 nodeName:}" failed. No retries permitted until 2026-05-20 19:46:59.01006714 +0000 UTC m=+161.458615989 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/6c107f5d-7dac-4b0c-8b34-e52b84ab2075-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-2jjjl" (UID: "6c107f5d-7dac-4b0c-8b34-e52b84ab2075") : secret "networking-console-plugin-cert" not found
May 20 19:46:43.128404 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:43.128348    2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-m2crt"]
May 20 19:46:43.312496 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:43.312457    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/169436b4-0a1d-4a7b-a7e1-b9868db43921-registry-tls\") pod \"image-registry-5757cb6fbf-g5qgx\" (UID: \"169436b4-0a1d-4a7b-a7e1-b9868db43921\") " pod="openshift-image-registry/image-registry-5757cb6fbf-g5qgx"
May 20 19:46:43.315001 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:43.314977    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/169436b4-0a1d-4a7b-a7e1-b9868db43921-registry-tls\") pod \"image-registry-5757cb6fbf-g5qgx\" (UID: \"169436b4-0a1d-4a7b-a7e1-b9868db43921\") " pod="openshift-image-registry/image-registry-5757cb6fbf-g5qgx"
May 20 19:46:43.401718 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:43.401676    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5757cb6fbf-g5qgx"
May 20 19:46:43.495374 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:43.495337    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-m2crt" event={"ID":"7e48cbbf-eaf2-44ad-bf70-cda2a6670a42","Type":"ContainerStarted","Data":"45cf29e1aedb5b3b26dca8a4c9d72da1e93e114515b9d08eb7169ce85771f819"}
May 20 19:46:43.531434 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:43.531401    2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5757cb6fbf-g5qgx"]
May 20 19:46:43.534388 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:46:43.534357    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod169436b4_0a1d_4a7b_a7e1_b9868db43921.slice/crio-19bc063e7ec56f0cbfadbbfc9a8492cd201e4b28f7fa70f9791a7969389bf196 WatchSource:0}: Error finding container 19bc063e7ec56f0cbfadbbfc9a8492cd201e4b28f7fa70f9791a7969389bf196: Status 404 returned error can't find the container with id 19bc063e7ec56f0cbfadbbfc9a8492cd201e4b28f7fa70f9791a7969389bf196
May 20 19:46:44.500069 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:44.500034    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5757cb6fbf-g5qgx" event={"ID":"169436b4-0a1d-4a7b-a7e1-b9868db43921","Type":"ContainerStarted","Data":"0b2c1a5c357422e3baa140cf7b25034ad12bbaea78a3adc0d54d99513ac898a9"}
May 20 19:46:44.500653 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:44.500079    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5757cb6fbf-g5qgx" event={"ID":"169436b4-0a1d-4a7b-a7e1-b9868db43921","Type":"ContainerStarted","Data":"19bc063e7ec56f0cbfadbbfc9a8492cd201e4b28f7fa70f9791a7969389bf196"}
May 20 19:46:44.500653 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:44.500318    2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5757cb6fbf-g5qgx"
May 20 19:46:44.519703 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:44.519615    2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5757cb6fbf-g5qgx" podStartSLOduration=17.519571102 podStartE2EDuration="17.519571102s" podCreationTimestamp="2026-05-20 19:46:27 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-20 19:46:44.519083344 +0000 UTC m=+146.967632200" watchObservedRunningTime="2026-05-20 19:46:44.519571102 +0000 UTC m=+146.968119956"
May 20 19:46:45.504687 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:45.504647    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-m2crt" event={"ID":"7e48cbbf-eaf2-44ad-bf70-cda2a6670a42","Type":"ContainerStarted","Data":"8a8fd8e42201b7b39c3e80579b3734db3ec5f05ee5e96c351479f11568c8c415"}
May 20 19:46:45.504687 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:45.504686    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-m2crt" event={"ID":"7e48cbbf-eaf2-44ad-bf70-cda2a6670a42","Type":"ContainerStarted","Data":"a0b61be7f9aefa9f47b775f1b12f43931f3f869491f853d0f4730f6dd5c986d6"}
May 20 19:46:45.522990 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:45.522933    2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-m2crt" podStartSLOduration=16.756506615 podStartE2EDuration="18.522919575s" podCreationTimestamp="2026-05-20 19:46:27 +0000 UTC" firstStartedPulling="2026-05-20 19:46:43.187013994 +0000 UTC m=+145.635562825" lastFinishedPulling="2026-05-20 19:46:44.95342695 +0000 UTC m=+147.401975785" observedRunningTime="2026-05-20 19:46:45.521851034 +0000 UTC m=+147.970399888" watchObservedRunningTime="2026-05-20 19:46:45.522919575 +0000 UTC m=+147.971468428"
May 20 19:46:53.811684 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:53.811648    2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-57bd96b888-nnjln"]
May 20 19:46:53.817511 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:53.817487    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-57bd96b888-nnjln"
May 20 19:46:53.818756 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:53.818727    2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-mqvzm"]
May 20 19:46:53.820917 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:53.820890    2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
May 20 19:46:53.822804 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:53.822782    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-mqvzm"
May 20 19:46:53.823544 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:53.823520    2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-cfqk2\""
May 20 19:46:53.824983 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:53.824961    2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
May 20 19:46:53.825964 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:53.825944    2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-44nrp\""
May 20 19:46:53.826342 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:53.826326    2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
May 20 19:46:53.826524 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:53.826509    2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
May 20 19:46:53.826607 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:53.826528    2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
May 20 19:46:53.826689 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:53.826672    2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-57bd96b888-nnjln"]
May 20 19:46:53.826762 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:53.826748    2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
May 20 19:46:53.834919 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:53.834899    2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-mqvzm"]
May 20 19:46:53.839337 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:53.839318    2578 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5757cb6fbf-g5qgx"]
May 20 19:46:53.871135 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:53.871108    2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7dcd5658f9-9lmdq"]
May 20 19:46:53.875136 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:53.875120    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7dcd5658f9-9lmdq"
May 20 19:46:53.885808 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:53.885781    2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7dcd5658f9-9lmdq"]
May 20 19:46:53.896367 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:53.896342    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bz87j\" (UniqueName: \"kubernetes.io/projected/60de8576-f74a-44a5-b5de-bfa3597b2c85-kube-api-access-bz87j\") pod \"downloads-57bd96b888-nnjln\" (UID: \"60de8576-f74a-44a5-b5de-bfa3597b2c85\") " pod="openshift-console/downloads-57bd96b888-nnjln"
May 20 19:46:53.996970 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:53.996939    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k5s6s\" (UniqueName: \"kubernetes.io/projected/9e0c6bfa-4fd1-4fbd-b1f2-b0796e7ff69c-kube-api-access-k5s6s\") pod \"insights-runtime-extractor-mqvzm\" (UID: \"9e0c6bfa-4fd1-4fbd-b1f2-b0796e7ff69c\") " pod="openshift-insights/insights-runtime-extractor-mqvzm"
May 20 19:46:53.997159 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:53.996978    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bz87j\" (UniqueName: \"kubernetes.io/projected/60de8576-f74a-44a5-b5de-bfa3597b2c85-kube-api-access-bz87j\") pod \"downloads-57bd96b888-nnjln\" (UID: \"60de8576-f74a-44a5-b5de-bfa3597b2c85\") " pod="openshift-console/downloads-57bd96b888-nnjln"
May 20 19:46:53.997159 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:53.996998    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nktj2\" (UniqueName: \"kubernetes.io/projected/e676d7d6-3fc2-4c85-b627-e65515c5d6ce-kube-api-access-nktj2\") pod \"image-registry-7dcd5658f9-9lmdq\" (UID: \"e676d7d6-3fc2-4c85-b627-e65515c5d6ce\") " pod="openshift-image-registry/image-registry-7dcd5658f9-9lmdq"
May 20 19:46:53.997159 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:53.997027    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e676d7d6-3fc2-4c85-b627-e65515c5d6ce-ca-trust-extracted\") pod \"image-registry-7dcd5658f9-9lmdq\" (UID: \"e676d7d6-3fc2-4c85-b627-e65515c5d6ce\") " pod="openshift-image-registry/image-registry-7dcd5658f9-9lmdq"
May 20 19:46:53.997159 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:53.997067    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9e0c6bfa-4fd1-4fbd-b1f2-b0796e7ff69c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mqvzm\" (UID: \"9e0c6bfa-4fd1-4fbd-b1f2-b0796e7ff69c\") " pod="openshift-insights/insights-runtime-extractor-mqvzm"
May 20 19:46:53.997159 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:53.997104    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e676d7d6-3fc2-4c85-b627-e65515c5d6ce-image-registry-private-configuration\") pod \"image-registry-7dcd5658f9-9lmdq\" (UID: \"e676d7d6-3fc2-4c85-b627-e65515c5d6ce\") " pod="openshift-image-registry/image-registry-7dcd5658f9-9lmdq"
May 20 19:46:53.997159 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:53.997148    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e676d7d6-3fc2-4c85-b627-e65515c5d6ce-installation-pull-secrets\") pod \"image-registry-7dcd5658f9-9lmdq\" (UID: \"e676d7d6-3fc2-4c85-b627-e65515c5d6ce\") " pod="openshift-image-registry/image-registry-7dcd5658f9-9lmdq"
May 20 19:46:53.997434 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:53.997192    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e676d7d6-3fc2-4c85-b627-e65515c5d6ce-bound-sa-token\") pod \"image-registry-7dcd5658f9-9lmdq\" (UID: \"e676d7d6-3fc2-4c85-b627-e65515c5d6ce\") " pod="openshift-image-registry/image-registry-7dcd5658f9-9lmdq"
May 20 19:46:53.997434 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:53.997217    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e676d7d6-3fc2-4c85-b627-e65515c5d6ce-registry-tls\") pod \"image-registry-7dcd5658f9-9lmdq\" (UID: \"e676d7d6-3fc2-4c85-b627-e65515c5d6ce\") " pod="openshift-image-registry/image-registry-7dcd5658f9-9lmdq"
May 20 19:46:53.997434 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:53.997235    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9e0c6bfa-4fd1-4fbd-b1f2-b0796e7ff69c-data-volume\") pod \"insights-runtime-extractor-mqvzm\" (UID: \"9e0c6bfa-4fd1-4fbd-b1f2-b0796e7ff69c\") " pod="openshift-insights/insights-runtime-extractor-mqvzm"
May 20 19:46:53.997434 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:53.997252    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e676d7d6-3fc2-4c85-b627-e65515c5d6ce-trusted-ca\") pod \"image-registry-7dcd5658f9-9lmdq\" (UID: \"e676d7d6-3fc2-4c85-b627-e65515c5d6ce\") " pod="openshift-image-registry/image-registry-7dcd5658f9-9lmdq"
May 20 19:46:53.997434 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:53.997273    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9e0c6bfa-4fd1-4fbd-b1f2-b0796e7ff69c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mqvzm\" (UID: \"9e0c6bfa-4fd1-4fbd-b1f2-b0796e7ff69c\") " pod="openshift-insights/insights-runtime-extractor-mqvzm"
May 20 19:46:53.997434 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:53.997343    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9e0c6bfa-4fd1-4fbd-b1f2-b0796e7ff69c-crio-socket\") pod \"insights-runtime-extractor-mqvzm\" (UID: \"9e0c6bfa-4fd1-4fbd-b1f2-b0796e7ff69c\") " pod="openshift-insights/insights-runtime-extractor-mqvzm"
May 20 19:46:53.997434 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:53.997434    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e676d7d6-3fc2-4c85-b627-e65515c5d6ce-registry-certificates\") pod \"image-registry-7dcd5658f9-9lmdq\" (UID: \"e676d7d6-3fc2-4c85-b627-e65515c5d6ce\") " pod="openshift-image-registry/image-registry-7dcd5658f9-9lmdq"
May 20 19:46:54.008663 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:54.008633    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bz87j\" (UniqueName: \"kubernetes.io/projected/60de8576-f74a-44a5-b5de-bfa3597b2c85-kube-api-access-bz87j\") pod \"downloads-57bd96b888-nnjln\" (UID: \"60de8576-f74a-44a5-b5de-bfa3597b2c85\") " pod="openshift-console/downloads-57bd96b888-nnjln"
May 20 19:46:54.097954 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:54.097861    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e676d7d6-3fc2-4c85-b627-e65515c5d6ce-registry-certificates\") pod \"image-registry-7dcd5658f9-9lmdq\" (UID: \"e676d7d6-3fc2-4c85-b627-e65515c5d6ce\") " pod="openshift-image-registry/image-registry-7dcd5658f9-9lmdq"
May 20 19:46:54.097954 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:54.097912    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k5s6s\" (UniqueName: \"kubernetes.io/projected/9e0c6bfa-4fd1-4fbd-b1f2-b0796e7ff69c-kube-api-access-k5s6s\") pod \"insights-runtime-extractor-mqvzm\" (UID: \"9e0c6bfa-4fd1-4fbd-b1f2-b0796e7ff69c\") " pod="openshift-insights/insights-runtime-extractor-mqvzm"
May 20 19:46:54.098186 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:54.098042    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nktj2\" (UniqueName: \"kubernetes.io/projected/e676d7d6-3fc2-4c85-b627-e65515c5d6ce-kube-api-access-nktj2\") pod \"image-registry-7dcd5658f9-9lmdq\" (UID: \"e676d7d6-3fc2-4c85-b627-e65515c5d6ce\") " pod="openshift-image-registry/image-registry-7dcd5658f9-9lmdq"
May 20 19:46:54.098186 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:54.098095    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e676d7d6-3fc2-4c85-b627-e65515c5d6ce-ca-trust-extracted\") pod \"image-registry-7dcd5658f9-9lmdq\" (UID: \"e676d7d6-3fc2-4c85-b627-e65515c5d6ce\") " pod="openshift-image-registry/image-registry-7dcd5658f9-9lmdq"
May 20 19:46:54.098186 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:54.098130    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9e0c6bfa-4fd1-4fbd-b1f2-b0796e7ff69c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mqvzm\" (UID: \"9e0c6bfa-4fd1-4fbd-b1f2-b0796e7ff69c\") " pod="openshift-insights/insights-runtime-extractor-mqvzm"
May 20 19:46:54.098186 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:54.098166    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e676d7d6-3fc2-4c85-b627-e65515c5d6ce-image-registry-private-configuration\") pod \"image-registry-7dcd5658f9-9lmdq\" (UID: \"e676d7d6-3fc2-4c85-b627-e65515c5d6ce\") " pod="openshift-image-registry/image-registry-7dcd5658f9-9lmdq"
May 20 19:46:54.098396 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:54.098199    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e676d7d6-3fc2-4c85-b627-e65515c5d6ce-installation-pull-secrets\") pod \"image-registry-7dcd5658f9-9lmdq\" (UID: \"e676d7d6-3fc2-4c85-b627-e65515c5d6ce\") " pod="openshift-image-registry/image-registry-7dcd5658f9-9lmdq"
May 20 19:46:54.098396 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:54.098248    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e676d7d6-3fc2-4c85-b627-e65515c5d6ce-bound-sa-token\") pod \"image-registry-7dcd5658f9-9lmdq\" (UID: \"e676d7d6-3fc2-4c85-b627-e65515c5d6ce\") " pod="openshift-image-registry/image-registry-7dcd5658f9-9lmdq"
May 20 19:46:54.098396 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:54.098287    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e676d7d6-3fc2-4c85-b627-e65515c5d6ce-registry-tls\") pod \"image-registry-7dcd5658f9-9lmdq\" (UID: \"e676d7d6-3fc2-4c85-b627-e65515c5d6ce\") " pod="openshift-image-registry/image-registry-7dcd5658f9-9lmdq"
May 20 19:46:54.098396 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:54.098317    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9e0c6bfa-4fd1-4fbd-b1f2-b0796e7ff69c-data-volume\") pod \"insights-runtime-extractor-mqvzm\" (UID: \"9e0c6bfa-4fd1-4fbd-b1f2-b0796e7ff69c\") " pod="openshift-insights/insights-runtime-extractor-mqvzm"
May 20 19:46:54.098396 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:54.098347    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e676d7d6-3fc2-4c85-b627-e65515c5d6ce-trusted-ca\") pod \"image-registry-7dcd5658f9-9lmdq\" (UID: \"e676d7d6-3fc2-4c85-b627-e65515c5d6ce\") " pod="openshift-image-registry/image-registry-7dcd5658f9-9lmdq"
May 20 19:46:54.098396 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:54.098372    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9e0c6bfa-4fd1-4fbd-b1f2-b0796e7ff69c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mqvzm\" (UID: \"9e0c6bfa-4fd1-4fbd-b1f2-b0796e7ff69c\") " pod="openshift-insights/insights-runtime-extractor-mqvzm"
May 20 19:46:54.098707 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:54.098403    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9e0c6bfa-4fd1-4fbd-b1f2-b0796e7ff69c-crio-socket\") pod \"insights-runtime-extractor-mqvzm\" (UID: \"9e0c6bfa-4fd1-4fbd-b1f2-b0796e7ff69c\") " pod="openshift-insights/insights-runtime-extractor-mqvzm"
May 20 19:46:54.098707 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:54.098445    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e676d7d6-3fc2-4c85-b627-e65515c5d6ce-ca-trust-extracted\") pod \"image-registry-7dcd5658f9-9lmdq\" (UID: \"e676d7d6-3fc2-4c85-b627-e65515c5d6ce\") " pod="openshift-image-registry/image-registry-7dcd5658f9-9lmdq"
May 20 19:46:54.098707 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:54.098523    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9e0c6bfa-4fd1-4fbd-b1f2-b0796e7ff69c-crio-socket\") pod \"insights-runtime-extractor-mqvzm\" (UID: \"9e0c6bfa-4fd1-4fbd-b1f2-b0796e7ff69c\") " pod="openshift-insights/insights-runtime-extractor-mqvzm"
May 20 19:46:54.098859 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:54.098725    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9e0c6bfa-4fd1-4fbd-b1f2-b0796e7ff69c-data-volume\") pod \"insights-runtime-extractor-mqvzm\" (UID: \"9e0c6bfa-4fd1-4fbd-b1f2-b0796e7ff69c\") " pod="openshift-insights/insights-runtime-extractor-mqvzm"
May 20 19:46:54.098859 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:54.098788    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9e0c6bfa-4fd1-4fbd-b1f2-b0796e7ff69c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mqvzm\" (UID: \"9e0c6bfa-4fd1-4fbd-b1f2-b0796e7ff69c\") " pod="openshift-insights/insights-runtime-extractor-mqvzm"
May 20 19:46:54.098964 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:54.098867    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e676d7d6-3fc2-4c85-b627-e65515c5d6ce-registry-certificates\") pod \"image-registry-7dcd5658f9-9lmdq\" (UID: \"e676d7d6-3fc2-4c85-b627-e65515c5d6ce\") " pod="openshift-image-registry/image-registry-7dcd5658f9-9lmdq"
May 20 19:46:54.099616 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:54.099552    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e676d7d6-3fc2-4c85-b627-e65515c5d6ce-trusted-ca\") pod \"image-registry-7dcd5658f9-9lmdq\" (UID: \"e676d7d6-3fc2-4c85-b627-e65515c5d6ce\") " pod="openshift-image-registry/image-registry-7dcd5658f9-9lmdq"
May 20 19:46:54.101519 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:54.101497    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e676d7d6-3fc2-4c85-b627-e65515c5d6ce-image-registry-private-configuration\") pod \"image-registry-7dcd5658f9-9lmdq\" (UID: \"e676d7d6-3fc2-4c85-b627-e65515c5d6ce\") " pod="openshift-image-registry/image-registry-7dcd5658f9-9lmdq"
May 20 19:46:54.101643 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:54.101547    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e676d7d6-3fc2-4c85-b627-e65515c5d6ce-registry-tls\") pod \"image-registry-7dcd5658f9-9lmdq\" (UID: \"e676d7d6-3fc2-4c85-b627-e65515c5d6ce\") " pod="openshift-image-registry/image-registry-7dcd5658f9-9lmdq"
May 20 19:46:54.101643 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:54.101624    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9e0c6bfa-4fd1-4fbd-b1f2-b0796e7ff69c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mqvzm\" (UID: \"9e0c6bfa-4fd1-4fbd-b1f2-b0796e7ff69c\") " pod="openshift-insights/insights-runtime-extractor-mqvzm"
May 20 19:46:54.101731 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:54.101649    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e676d7d6-3fc2-4c85-b627-e65515c5d6ce-installation-pull-secrets\") pod \"image-registry-7dcd5658f9-9lmdq\" (UID: \"e676d7d6-3fc2-4c85-b627-e65515c5d6ce\") " pod="openshift-image-registry/image-registry-7dcd5658f9-9lmdq"
May 20 19:46:54.123335 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:54.123304    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k5s6s\" (UniqueName: \"kubernetes.io/projected/9e0c6bfa-4fd1-4fbd-b1f2-b0796e7ff69c-kube-api-access-k5s6s\") pod \"insights-runtime-extractor-mqvzm\" (UID: \"9e0c6bfa-4fd1-4fbd-b1f2-b0796e7ff69c\") " pod="openshift-insights/insights-runtime-extractor-mqvzm"
May 20 19:46:54.123455 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:54.123337    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nktj2\" (UniqueName: \"kubernetes.io/projected/e676d7d6-3fc2-4c85-b627-e65515c5d6ce-kube-api-access-nktj2\") pod \"image-registry-7dcd5658f9-9lmdq\" (UID: \"e676d7d6-3fc2-4c85-b627-e65515c5d6ce\") " pod="openshift-image-registry/image-registry-7dcd5658f9-9lmdq"
May 20 19:46:54.124120 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:54.124094    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e676d7d6-3fc2-4c85-b627-e65515c5d6ce-bound-sa-token\") pod \"image-registry-7dcd5658f9-9lmdq\" (UID: \"e676d7d6-3fc2-4c85-b627-e65515c5d6ce\") " pod="openshift-image-registry/image-registry-7dcd5658f9-9lmdq"
May 20 19:46:54.128130 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:54.128104    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-57bd96b888-nnjln"
May 20 19:46:54.135940 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:54.135918    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-mqvzm"
May 20 19:46:54.183598 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:54.183451    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7dcd5658f9-9lmdq"
May 20 19:46:54.304041 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:54.303988    2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-57bd96b888-nnjln"]
May 20 19:46:54.307615 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:46:54.307568    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60de8576_f74a_44a5_b5de_bfa3597b2c85.slice/crio-d1dea606f206a38776d8f93eef1078acd575b156e03359f77b6eed3cf3365107 WatchSource:0}: Error finding container d1dea606f206a38776d8f93eef1078acd575b156e03359f77b6eed3cf3365107: Status 404 returned error can't find the container with id d1dea606f206a38776d8f93eef1078acd575b156e03359f77b6eed3cf3365107
May 20 19:46:54.315903 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:54.314517    2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-mqvzm"]
May 20 19:46:54.360733 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:54.360701    2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7dcd5658f9-9lmdq"]
May 20 19:46:54.363370 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:46:54.363347    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode676d7d6_3fc2_4c85_b627_e65515c5d6ce.slice/crio-efbaf700e6bb038a9c7b25d663f1811044a4d11c98f9380c41886428703f2ee2 WatchSource:0}: Error finding container efbaf700e6bb038a9c7b25d663f1811044a4d11c98f9380c41886428703f2ee2: Status 404 returned error can't find the container with id efbaf700e6bb038a9c7b25d663f1811044a4d11c98f9380c41886428703f2ee2
May 20 19:46:54.526483 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:54.526418    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7dcd5658f9-9lmdq" event={"ID":"e676d7d6-3fc2-4c85-b627-e65515c5d6ce","Type":"ContainerStarted","Data":"7893d164129d2df36b8e58c0b306972e8837cf6c4c93f3746e93cf7942143be3"}
May 20 19:46:54.526483 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:54.526472    2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7dcd5658f9-9lmdq"
May 20 19:46:54.526483 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:54.526487    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7dcd5658f9-9lmdq" event={"ID":"e676d7d6-3fc2-4c85-b627-e65515c5d6ce","Type":"ContainerStarted","Data":"efbaf700e6bb038a9c7b25d663f1811044a4d11c98f9380c41886428703f2ee2"}
May 20 19:46:54.527744 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:54.527703    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mqvzm" event={"ID":"9e0c6bfa-4fd1-4fbd-b1f2-b0796e7ff69c","Type":"ContainerStarted","Data":"526913071cbdac659ed0b487a398062f6b7be71c5df93057bc2b9d9e8d21563c"}
May 20 19:46:54.527885 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:54.527752    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mqvzm" event={"ID":"9e0c6bfa-4fd1-4fbd-b1f2-b0796e7ff69c","Type":"ContainerStarted","Data":"f1e15185b16e67f93690336179f6648fa3f873a04e32a6d752bfd01e9487d7c5"}
May 20 19:46:54.528670 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:54.528648    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-57bd96b888-nnjln" event={"ID":"60de8576-f74a-44a5-b5de-bfa3597b2c85","Type":"ContainerStarted","Data":"d1dea606f206a38776d8f93eef1078acd575b156e03359f77b6eed3cf3365107"}
May 20 19:46:54.546171 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:54.546132    2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7dcd5658f9-9lmdq" podStartSLOduration=1.5461177529999999 podStartE2EDuration="1.546117753s" podCreationTimestamp="2026-05-20 19:46:53 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-20 19:46:54.545171093 +0000 UTC m=+156.993719946" watchObservedRunningTime="2026-05-20 19:46:54.546117753 +0000 UTC m=+156.994666608"
May 20 19:46:55.426410 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:46:55.426367    2578 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-t8kn6" podUID="3e5d41c3-bec4-4344-a58c-e52112542af8"
May 20 19:46:55.434484 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:46:55.434451    2578 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-rj5rw" podUID="b63a00ba-256d-476a-9f16-f0ae99f6e73b"
May 20 19:46:55.532878 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:55.532673    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mqvzm" event={"ID":"9e0c6bfa-4fd1-4fbd-b1f2-b0796e7ff69c","Type":"ContainerStarted","Data":"4650d9fb0be64aacbea3ea2f1bc3faee7546411effce7ce6d657c505348cff7a"}
May 20 19:46:55.532878 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:55.532724    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-t8kn6"
May 20 19:46:56.106022 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:46:56.105982    2578 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-p6zpg" podUID="8adc751e-abba-4cb1-ab06-d0c915b18a28"
May 20 19:46:57.541444 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:57.541407    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mqvzm" event={"ID":"9e0c6bfa-4fd1-4fbd-b1f2-b0796e7ff69c","Type":"ContainerStarted","Data":"df0032b286663c22b434302d2a0bd7ae123e4b07ab3305318a14eb025c7a0513"}
May 20 19:46:57.562034 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:57.561789    2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-mqvzm" podStartSLOduration=2.3657428830000002 podStartE2EDuration="4.561767966s" podCreationTimestamp="2026-05-20 19:46:53 +0000 UTC" firstStartedPulling="2026-05-20 19:46:54.383225513 +0000 UTC m=+156.831774352" lastFinishedPulling="2026-05-20 19:46:56.579250601 +0000 UTC m=+159.027799435" observedRunningTime="2026-05-20 19:46:57.561715227 +0000 UTC m=+160.010264081" watchObservedRunningTime="2026-05-20 19:46:57.561767966 +0000 UTC m=+160.010316823"
May 20 19:46:59.044747 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:59.044704    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9438ccc5-f4ae-4304-815d-ef1af9cdd459-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-w7grq\" (UID: \"9438ccc5-f4ae-4304-815d-ef1af9cdd459\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-w7grq"
May 20 19:46:59.045162 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:59.044837    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6c107f5d-7dac-4b0c-8b34-e52b84ab2075-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-2jjjl\" (UID: \"6c107f5d-7dac-4b0c-8b34-e52b84ab2075\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-2jjjl"
May 20 19:46:59.047601 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:59.047548    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9438ccc5-f4ae-4304-815d-ef1af9cdd459-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-w7grq\" (UID: \"9438ccc5-f4ae-4304-815d-ef1af9cdd459\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-w7grq"
May 20 19:46:59.047732 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:59.047674    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6c107f5d-7dac-4b0c-8b34-e52b84ab2075-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-2jjjl\" (UID: \"6c107f5d-7dac-4b0c-8b34-e52b84ab2075\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-2jjjl"
May 20 19:46:59.281751 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:59.281712    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-2jjjl"
May 20 19:46:59.293565 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:59.293535    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-w7grq"
May 20 19:46:59.440347 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:59.440315    2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-2jjjl"]
May 20 19:46:59.443558 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:46:59.443519    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c107f5d_7dac_4b0c_8b34_e52b84ab2075.slice/crio-47fb33d4183884d44f68f85df5a75f79e344456264f8cb942dc3bbeecd0c464f WatchSource:0}: Error finding container 47fb33d4183884d44f68f85df5a75f79e344456264f8cb942dc3bbeecd0c464f: Status 404 returned error can't find the container with id 47fb33d4183884d44f68f85df5a75f79e344456264f8cb942dc3bbeecd0c464f
May 20 19:46:59.456427 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:59.456401    2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-w7grq"]
May 20 19:46:59.460362 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:46:59.460333    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9438ccc5_f4ae_4304_815d_ef1af9cdd459.slice/crio-fd051fa3ef706a373518b4e204c721a94c8b4aa0d8ea2a25f71946f3afe4dd28 WatchSource:0}: Error finding container fd051fa3ef706a373518b4e204c721a94c8b4aa0d8ea2a25f71946f3afe4dd28: Status 404 returned error can't find the container with id fd051fa3ef706a373518b4e204c721a94c8b4aa0d8ea2a25f71946f3afe4dd28
May 20 19:46:59.548416 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:59.548378    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-w7grq" event={"ID":"9438ccc5-f4ae-4304-815d-ef1af9cdd459","Type":"ContainerStarted","Data":"fd051fa3ef706a373518b4e204c721a94c8b4aa0d8ea2a25f71946f3afe4dd28"}
May 20 19:46:59.549468 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:46:59.549437    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-2jjjl" event={"ID":"6c107f5d-7dac-4b0c-8b34-e52b84ab2075","Type":"ContainerStarted","Data":"47fb33d4183884d44f68f85df5a75f79e344456264f8cb942dc3bbeecd0c464f"}
May 20 19:47:00.360939 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:00.359562    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3e5d41c3-bec4-4344-a58c-e52112542af8-metrics-tls\") pod \"dns-default-t8kn6\" (UID: \"3e5d41c3-bec4-4344-a58c-e52112542af8\") " pod="openshift-dns/dns-default-t8kn6"
May 20 19:47:00.360939 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:00.359702    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b63a00ba-256d-476a-9f16-f0ae99f6e73b-cert\") pod \"ingress-canary-rj5rw\" (UID: \"b63a00ba-256d-476a-9f16-f0ae99f6e73b\") " pod="openshift-ingress-canary/ingress-canary-rj5rw"
May 20 19:47:00.361981 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:00.361801    2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-b4686f895-dsfk8"]
May 20 19:47:00.364965 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:00.364939    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3e5d41c3-bec4-4344-a58c-e52112542af8-metrics-tls\") pod \"dns-default-t8kn6\" (UID: \"3e5d41c3-bec4-4344-a58c-e52112542af8\") " pod="openshift-dns/dns-default-t8kn6"
May 20 19:47:00.365490 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:00.365468    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b4686f895-dsfk8"
May 20 19:47:00.366640 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:00.366596    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b63a00ba-256d-476a-9f16-f0ae99f6e73b-cert\") pod \"ingress-canary-rj5rw\" (UID: \"b63a00ba-256d-476a-9f16-f0ae99f6e73b\") " pod="openshift-ingress-canary/ingress-canary-rj5rw"
May 20 19:47:00.368923 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:00.368897    2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
May 20 19:47:00.369176 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:00.369160    2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
May 20 19:47:00.369235 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:00.369201    2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-69fvn\""
May 20 19:47:00.369388 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:00.369374    2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
May 20 19:47:00.369442 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:00.369418    2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
May 20 19:47:00.369537 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:00.369524    2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
May 20 19:47:00.374294 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:00.374274    2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-b4686f895-dsfk8"]
May 20 19:47:00.460431 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:00.460379    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3aa65265-bdd9-4d27-9b43-5b4de9961d45-console-config\") pod \"console-b4686f895-dsfk8\" (UID: \"3aa65265-bdd9-4d27-9b43-5b4de9961d45\") " pod="openshift-console/console-b4686f895-dsfk8"
May 20 19:47:00.460713 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:00.460454    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3aa65265-bdd9-4d27-9b43-5b4de9961d45-console-oauth-config\") pod \"console-b4686f895-dsfk8\" (UID: \"3aa65265-bdd9-4d27-9b43-5b4de9961d45\") " pod="openshift-console/console-b4686f895-dsfk8"
May 20 19:47:00.460713 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:00.460488    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3aa65265-bdd9-4d27-9b43-5b4de9961d45-console-serving-cert\") pod \"console-b4686f895-dsfk8\" (UID: \"3aa65265-bdd9-4d27-9b43-5b4de9961d45\") " pod="openshift-console/console-b4686f895-dsfk8"
May 20 19:47:00.460713 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:00.460521    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3aa65265-bdd9-4d27-9b43-5b4de9961d45-oauth-serving-cert\") pod \"console-b4686f895-dsfk8\" (UID: \"3aa65265-bdd9-4d27-9b43-5b4de9961d45\") " pod="openshift-console/console-b4686f895-dsfk8"
May 20 19:47:00.460713 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:00.460545    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-srlmd\" (UniqueName: \"kubernetes.io/projected/3aa65265-bdd9-4d27-9b43-5b4de9961d45-kube-api-access-srlmd\") pod \"console-b4686f895-dsfk8\" (UID: \"3aa65265-bdd9-4d27-9b43-5b4de9961d45\") " pod="openshift-console/console-b4686f895-dsfk8"
May 20 19:47:00.460713 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:00.460618    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3aa65265-bdd9-4d27-9b43-5b4de9961d45-service-ca\") pod \"console-b4686f895-dsfk8\" (UID: \"3aa65265-bdd9-4d27-9b43-5b4de9961d45\") " pod="openshift-console/console-b4686f895-dsfk8"
May 20 19:47:00.561436 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:00.561068    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3aa65265-bdd9-4d27-9b43-5b4de9961d45-console-oauth-config\") pod \"console-b4686f895-dsfk8\" (UID: \"3aa65265-bdd9-4d27-9b43-5b4de9961d45\") " pod="openshift-console/console-b4686f895-dsfk8"
May 20 19:47:00.561436 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:00.561117    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3aa65265-bdd9-4d27-9b43-5b4de9961d45-console-serving-cert\") pod \"console-b4686f895-dsfk8\" (UID: \"3aa65265-bdd9-4d27-9b43-5b4de9961d45\") " pod="openshift-console/console-b4686f895-dsfk8"
May 20 19:47:00.561436 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:00.561155    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3aa65265-bdd9-4d27-9b43-5b4de9961d45-oauth-serving-cert\") pod \"console-b4686f895-dsfk8\" (UID: \"3aa65265-bdd9-4d27-9b43-5b4de9961d45\") " pod="openshift-console/console-b4686f895-dsfk8"
May 20 19:47:00.561436 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:00.561180    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-srlmd\" (UniqueName: \"kubernetes.io/projected/3aa65265-bdd9-4d27-9b43-5b4de9961d45-kube-api-access-srlmd\") pod \"console-b4686f895-dsfk8\" (UID: \"3aa65265-bdd9-4d27-9b43-5b4de9961d45\") " pod="openshift-console/console-b4686f895-dsfk8"
May 20 19:47:00.561436 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:00.561223    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3aa65265-bdd9-4d27-9b43-5b4de9961d45-service-ca\") pod \"console-b4686f895-dsfk8\" (UID: \"3aa65265-bdd9-4d27-9b43-5b4de9961d45\") " pod="openshift-console/console-b4686f895-dsfk8"
May 20 19:47:00.561436 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:00.561289    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3aa65265-bdd9-4d27-9b43-5b4de9961d45-console-config\") pod \"console-b4686f895-dsfk8\" (UID: \"3aa65265-bdd9-4d27-9b43-5b4de9961d45\") " pod="openshift-console/console-b4686f895-dsfk8"
May 20 19:47:00.562468 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:00.562358    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3aa65265-bdd9-4d27-9b43-5b4de9961d45-oauth-serving-cert\") pod \"console-b4686f895-dsfk8\" (UID: \"3aa65265-bdd9-4d27-9b43-5b4de9961d45\") " pod="openshift-console/console-b4686f895-dsfk8"
May 20 19:47:00.562468 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:00.562387    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3aa65265-bdd9-4d27-9b43-5b4de9961d45-service-ca\") pod \"console-b4686f895-dsfk8\" (UID: \"3aa65265-bdd9-4d27-9b43-5b4de9961d45\") " pod="openshift-console/console-b4686f895-dsfk8"
May 20 19:47:00.563060 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:00.563038    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3aa65265-bdd9-4d27-9b43-5b4de9961d45-console-config\") pod \"console-b4686f895-dsfk8\" (UID: \"3aa65265-bdd9-4d27-9b43-5b4de9961d45\") " pod="openshift-console/console-b4686f895-dsfk8"
May 20 19:47:00.565425 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:00.565382    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3aa65265-bdd9-4d27-9b43-5b4de9961d45-console-serving-cert\") pod \"console-b4686f895-dsfk8\" (UID: \"3aa65265-bdd9-4d27-9b43-5b4de9961d45\") " pod="openshift-console/console-b4686f895-dsfk8"
May 20 19:47:00.565633 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:00.565609    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3aa65265-bdd9-4d27-9b43-5b4de9961d45-console-oauth-config\") pod \"console-b4686f895-dsfk8\" (UID: \"3aa65265-bdd9-4d27-9b43-5b4de9961d45\") " pod="openshift-console/console-b4686f895-dsfk8"
May 20 19:47:00.573216 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:00.573189    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-srlmd\" (UniqueName: \"kubernetes.io/projected/3aa65265-bdd9-4d27-9b43-5b4de9961d45-kube-api-access-srlmd\") pod \"console-b4686f895-dsfk8\" (UID: \"3aa65265-bdd9-4d27-9b43-5b4de9961d45\") " pod="openshift-console/console-b4686f895-dsfk8"
May 20 19:47:00.635852 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:00.635824    2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-2fqs2\""
May 20 19:47:00.644382 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:00.643965    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-t8kn6"
May 20 19:47:00.691893 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:00.691859    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b4686f895-dsfk8"
May 20 19:47:00.955231 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:00.955191    2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-b4686f895-dsfk8"]
May 20 19:47:00.978473 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:00.978416    2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-t8kn6"]
May 20 19:47:01.453053 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:47:01.453016    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3aa65265_bdd9_4d27_9b43_5b4de9961d45.slice/crio-2c8747f022951d31fa86483f425bc79209cf1ed43229a18c572edaeed667d6b7 WatchSource:0}: Error finding container 2c8747f022951d31fa86483f425bc79209cf1ed43229a18c572edaeed667d6b7: Status 404 returned error can't find the container with id 2c8747f022951d31fa86483f425bc79209cf1ed43229a18c572edaeed667d6b7
May 20 19:47:01.453698 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:47:01.453665    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e5d41c3_bec4_4344_a58c_e52112542af8.slice/crio-0130f5628178fb7a442be0936861110cb06ef2e6395523cfb5c41dbcc9b4637a WatchSource:0}: Error finding container 0130f5628178fb7a442be0936861110cb06ef2e6395523cfb5c41dbcc9b4637a: Status 404 returned error can't find the container with id 0130f5628178fb7a442be0936861110cb06ef2e6395523cfb5c41dbcc9b4637a
May 20 19:47:01.557484 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:01.557453    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b4686f895-dsfk8" event={"ID":"3aa65265-bdd9-4d27-9b43-5b4de9961d45","Type":"ContainerStarted","Data":"2c8747f022951d31fa86483f425bc79209cf1ed43229a18c572edaeed667d6b7"}
May 20 19:47:01.559274 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:01.559227    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-2jjjl" event={"ID":"6c107f5d-7dac-4b0c-8b34-e52b84ab2075","Type":"ContainerStarted","Data":"d627dc03f6d3d25e3dd308788715cf99f5888e7983b22851d77ce5da960749b7"}
May 20 19:47:01.560683 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:01.560662    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-t8kn6" event={"ID":"3e5d41c3-bec4-4344-a58c-e52112542af8","Type":"ContainerStarted","Data":"0130f5628178fb7a442be0936861110cb06ef2e6395523cfb5c41dbcc9b4637a"}
May 20 19:47:02.065011 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:02.062681    2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-2jjjl" podStartSLOduration=33.668603016 podStartE2EDuration="35.062660931s" podCreationTimestamp="2026-05-20 19:46:27 +0000 UTC" firstStartedPulling="2026-05-20 19:46:59.445975017 +0000 UTC m=+161.894523852" lastFinishedPulling="2026-05-20 19:47:00.840032935 +0000 UTC m=+163.288581767" observedRunningTime="2026-05-20 19:47:01.576047605 +0000 UTC m=+164.024596460" watchObservedRunningTime="2026-05-20 19:47:02.062660931 +0000 UTC m=+164.511209791"
May 20 19:47:02.073110 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:02.070339    2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-z4x5h"]
May 20 19:47:02.075329 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:02.075006    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-z4x5h"
May 20 19:47:02.079999 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:02.079973    2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
May 20 19:47:02.080107 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:02.080069    2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-6x84m\""
May 20 19:47:02.081957 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:02.081880    2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-z4x5h"]
May 20 19:47:02.174722 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:02.174675    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/7a1d3bad-a626-46c1-b512-2e4c4681cfb4-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-z4x5h\" (UID: \"7a1d3bad-a626-46c1-b512-2e4c4681cfb4\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-z4x5h"
May 20 19:47:02.275904 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:02.275864    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/7a1d3bad-a626-46c1-b512-2e4c4681cfb4-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-z4x5h\" (UID: \"7a1d3bad-a626-46c1-b512-2e4c4681cfb4\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-z4x5h"
May 20 19:47:02.277036 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:47:02.276704    2578 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found
May 20 19:47:02.277036 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:47:02.276781    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a1d3bad-a626-46c1-b512-2e4c4681cfb4-tls-certificates podName:7a1d3bad-a626-46c1-b512-2e4c4681cfb4 nodeName:}" failed. No retries permitted until 2026-05-20 19:47:02.776760103 +0000 UTC m=+165.225308944 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/7a1d3bad-a626-46c1-b512-2e4c4681cfb4-tls-certificates") pod "prometheus-operator-admission-webhook-6c4bbc67b7-z4x5h" (UID: "7a1d3bad-a626-46c1-b512-2e4c4681cfb4") : secret "prometheus-operator-admission-webhook-tls" not found
May 20 19:47:02.565692 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:02.565630    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-w7grq" event={"ID":"9438ccc5-f4ae-4304-815d-ef1af9cdd459","Type":"ContainerStarted","Data":"7e3437a3a85ed62b8d851cd814c6b585350fe834b067b58456dfa700d529931b"}
May 20 19:47:02.582628 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:02.582540    2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-w7grq" podStartSLOduration=33.543306628 podStartE2EDuration="35.582524459s" podCreationTimestamp="2026-05-20 19:46:27 +0000 UTC" firstStartedPulling="2026-05-20 19:46:59.462936951 +0000 UTC m=+161.911485789" lastFinishedPulling="2026-05-20 19:47:01.502154783 +0000 UTC m=+163.950703620" observedRunningTime="2026-05-20 19:47:02.582230546 +0000 UTC m=+165.030779402" watchObservedRunningTime="2026-05-20 19:47:02.582524459 +0000 UTC m=+165.031073313"
May 20 19:47:02.780117 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:02.780023    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/7a1d3bad-a626-46c1-b512-2e4c4681cfb4-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-z4x5h\" (UID: \"7a1d3bad-a626-46c1-b512-2e4c4681cfb4\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-z4x5h"
May 20 19:47:02.783672 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:02.783618    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/7a1d3bad-a626-46c1-b512-2e4c4681cfb4-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-z4x5h\" (UID: \"7a1d3bad-a626-46c1-b512-2e4c4681cfb4\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-z4x5h"
May 20 19:47:02.995605 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:02.995194    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-z4x5h"
May 20 19:47:03.247761 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:03.247652    2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-z4x5h"]
May 20 19:47:03.250930 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:47:03.250100    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a1d3bad_a626_46c1_b512_2e4c4681cfb4.slice/crio-c85731bb816055f45c29c312255d1848f173ad11919a9196fc5e8a88205af906 WatchSource:0}: Error finding container c85731bb816055f45c29c312255d1848f173ad11919a9196fc5e8a88205af906: Status 404 returned error can't find the container with id c85731bb816055f45c29c312255d1848f173ad11919a9196fc5e8a88205af906
May 20 19:47:03.574002 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:03.573718    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-t8kn6" event={"ID":"3e5d41c3-bec4-4344-a58c-e52112542af8","Type":"ContainerStarted","Data":"d7a447f42942fa7279834a2e7d9454ff02b485e336977a971f62e5b2426e4319"}
May 20 19:47:03.574002 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:03.573761    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-t8kn6" event={"ID":"3e5d41c3-bec4-4344-a58c-e52112542af8","Type":"ContainerStarted","Data":"0fb57f471f93b2a81d4a228fac0b2d6549fea42d06ed969bedc36de00aa00ea0"}
May 20 19:47:03.574494 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:03.574079    2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-t8kn6"
May 20 19:47:03.575362 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:03.575323    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-z4x5h" event={"ID":"7a1d3bad-a626-46c1-b512-2e4c4681cfb4","Type":"ContainerStarted","Data":"c85731bb816055f45c29c312255d1848f173ad11919a9196fc5e8a88205af906"}
May 20 19:47:03.591279 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:03.591231    2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-t8kn6" podStartSLOduration=129.914485144 podStartE2EDuration="2m11.591217838s" podCreationTimestamp="2026-05-20 19:44:52 +0000 UTC" firstStartedPulling="2026-05-20 19:47:01.455827918 +0000 UTC m=+163.904376750" lastFinishedPulling="2026-05-20 19:47:03.132560598 +0000 UTC m=+165.581109444" observedRunningTime="2026-05-20 19:47:03.590538646 +0000 UTC m=+166.039087495" watchObservedRunningTime="2026-05-20 19:47:03.591217838 +0000 UTC m=+166.039766689"
May 20 19:47:03.846148 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:03.845875    2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5757cb6fbf-g5qgx"
May 20 19:47:07.096443 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:07.096407    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p6zpg"
May 20 19:47:10.096711 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:10.096677    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-rj5rw"
May 20 19:47:10.099493 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:10.099463    2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-s4ppg\""
May 20 19:47:10.107502 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:10.107471    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-rj5rw"
May 20 19:47:12.182473 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:12.182423    2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-rj5rw"]
May 20 19:47:12.185409 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:47:12.185378    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb63a00ba_256d_476a_9f16_f0ae99f6e73b.slice/crio-d806644e46e538e806b0ea67f3180475bae80af00244f2b62fa3d362a0dac9a9 WatchSource:0}: Error finding container d806644e46e538e806b0ea67f3180475bae80af00244f2b62fa3d362a0dac9a9: Status 404 returned error can't find the container with id d806644e46e538e806b0ea67f3180475bae80af00244f2b62fa3d362a0dac9a9
May 20 19:47:12.605139 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:12.605097    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-57bd96b888-nnjln" event={"ID":"60de8576-f74a-44a5-b5de-bfa3597b2c85","Type":"ContainerStarted","Data":"d19f13862fbe1a8dc329b3e129b58e1974a4e21d31dd7fd7e0352c7139269eff"}
May 20 19:47:12.605668 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:12.605641    2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-57bd96b888-nnjln"
May 20 19:47:12.607699 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:12.607668    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-z4x5h" event={"ID":"7a1d3bad-a626-46c1-b512-2e4c4681cfb4","Type":"ContainerStarted","Data":"1a72ccd062374938f28a5b19508f366eb1992b31e1e616634d2e44a27b06d3a7"}
May 20 19:47:12.607921 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:12.607899    2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-z4x5h"
May 20 19:47:12.609411 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:12.609371    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b4686f895-dsfk8" event={"ID":"3aa65265-bdd9-4d27-9b43-5b4de9961d45","Type":"ContainerStarted","Data":"9250a7d4d01a13f6f5cda8528cf00d7319465087cc583cb1deb20fdf4e89de99"}
May 20 19:47:12.616692 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:12.614650    2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-z4x5h"
May 20 19:47:12.621350 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:12.621314    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-rj5rw" event={"ID":"b63a00ba-256d-476a-9f16-f0ae99f6e73b","Type":"ContainerStarted","Data":"d806644e46e538e806b0ea67f3180475bae80af00244f2b62fa3d362a0dac9a9"}
May 20 19:47:12.622126 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:12.622087    2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-57bd96b888-nnjln"
May 20 19:47:12.653334 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:12.652615    2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/downloads-57bd96b888-nnjln" podStartSLOduration=1.885353721 podStartE2EDuration="19.652597097s" podCreationTimestamp="2026-05-20 19:46:53 +0000 UTC" firstStartedPulling="2026-05-20 19:46:54.309532105 +0000 UTC m=+156.758080937" lastFinishedPulling="2026-05-20 19:47:12.076775467 +0000 UTC m=+174.525324313" observedRunningTime="2026-05-20 19:47:12.631025055 +0000 UTC m=+175.079573913" watchObservedRunningTime="2026-05-20 19:47:12.652597097 +0000 UTC m=+175.101145950"
May 20 19:47:12.673224 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:12.672175    2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-b4686f895-dsfk8" podStartSLOduration=2.108541316 podStartE2EDuration="12.672157942s" podCreationTimestamp="2026-05-20 19:47:00 +0000 UTC" firstStartedPulling="2026-05-20 19:47:01.455669663 +0000 UTC m=+163.904218501" lastFinishedPulling="2026-05-20 19:47:12.019286284 +0000 UTC m=+174.467835127" observedRunningTime="2026-05-20 19:47:12.671624913 +0000 UTC m=+175.120173769" watchObservedRunningTime="2026-05-20 19:47:12.672157942 +0000 UTC m=+175.120706798"
May 20 19:47:12.692166 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:12.692105    2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-z4x5h" podStartSLOduration=1.9256300240000002 podStartE2EDuration="10.692089592s" podCreationTimestamp="2026-05-20 19:47:02 +0000 UTC" firstStartedPulling="2026-05-20 19:47:03.252842396 +0000 UTC m=+165.701391234" lastFinishedPulling="2026-05-20 19:47:12.019301962 +0000 UTC m=+174.467850802" observedRunningTime="2026-05-20 19:47:12.692009314 +0000 UTC m=+175.140558169" watchObservedRunningTime="2026-05-20 19:47:12.692089592 +0000 UTC m=+175.140638449"
May 20 19:47:13.584894 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:13.584777    2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-t8kn6"
May 20 19:47:14.630318 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:14.630277    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-rj5rw" event={"ID":"b63a00ba-256d-476a-9f16-f0ae99f6e73b","Type":"ContainerStarted","Data":"00f0cb08114ae0a4b493ec1ae14d3d5b5ac30a99bd38e0995140ca0989ff7d63"}
May 20 19:47:14.646147 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:14.646079    2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-rj5rw" podStartSLOduration=140.410159362 podStartE2EDuration="2m22.646056682s" podCreationTimestamp="2026-05-20 19:44:52 +0000 UTC" firstStartedPulling="2026-05-20 19:47:12.187256943 +0000 UTC m=+174.635805775" lastFinishedPulling="2026-05-20 19:47:14.423154258 +0000 UTC m=+176.871703095" observedRunningTime="2026-05-20 19:47:14.645038152 +0000 UTC m=+177.093587007" watchObservedRunningTime="2026-05-20 19:47:14.646056682 +0000 UTC m=+177.094605549"
May 20 19:47:15.538131 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:15.538094    2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7dcd5658f9-9lmdq"
May 20 19:47:18.547828 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:18.547788    2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-wmqdr"]
May 20 19:47:18.618648 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:18.618613    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-wmqdr"
May 20 19:47:18.623731 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:18.623704    2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
May 20 19:47:18.623925 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:18.623777    2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
May 20 19:47:18.624392 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:18.624369    2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-l5xb4\""
May 20 19:47:18.625673 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:18.625644    2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
May 20 19:47:18.632359 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:18.632340    2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
May 20 19:47:18.725493 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:18.725448    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8f2fd804-794d-414a-bec8-2f486409098a-metrics-client-ca\") pod \"node-exporter-wmqdr\" (UID: \"8f2fd804-794d-414a-bec8-2f486409098a\") " pod="openshift-monitoring/node-exporter-wmqdr"
May 20 19:47:18.725819 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:18.725777    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8f2fd804-794d-414a-bec8-2f486409098a-sys\") pod \"node-exporter-wmqdr\" (UID: \"8f2fd804-794d-414a-bec8-2f486409098a\") " pod="openshift-monitoring/node-exporter-wmqdr"
May 20 19:47:18.725980 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:18.725963    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8f2fd804-794d-414a-bec8-2f486409098a-root\") pod \"node-exporter-wmqdr\" (UID: \"8f2fd804-794d-414a-bec8-2f486409098a\") " pod="openshift-monitoring/node-exporter-wmqdr"
May 20 19:47:18.726126 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:18.726102    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8f2fd804-794d-414a-bec8-2f486409098a-node-exporter-tls\") pod \"node-exporter-wmqdr\" (UID: \"8f2fd804-794d-414a-bec8-2f486409098a\") " pod="openshift-monitoring/node-exporter-wmqdr"
May 20 19:47:18.726309 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:18.726268    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8f2fd804-794d-414a-bec8-2f486409098a-node-exporter-wtmp\") pod \"node-exporter-wmqdr\" (UID: \"8f2fd804-794d-414a-bec8-2f486409098a\") " pod="openshift-monitoring/node-exporter-wmqdr"
May 20 19:47:18.726383 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:18.726324    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8f2fd804-794d-414a-bec8-2f486409098a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-wmqdr\" (UID: \"8f2fd804-794d-414a-bec8-2f486409098a\") " pod="openshift-monitoring/node-exporter-wmqdr"
May 20 19:47:18.726446 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:18.726386    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tnx9g\" (UniqueName: \"kubernetes.io/projected/8f2fd804-794d-414a-bec8-2f486409098a-kube-api-access-tnx9g\") pod \"node-exporter-wmqdr\" (UID: \"8f2fd804-794d-414a-bec8-2f486409098a\") " pod="openshift-monitoring/node-exporter-wmqdr"
May 20 19:47:18.726446 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:18.726417    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8f2fd804-794d-414a-bec8-2f486409098a-node-exporter-textfile\") pod \"node-exporter-wmqdr\" (UID: \"8f2fd804-794d-414a-bec8-2f486409098a\") " pod="openshift-monitoring/node-exporter-wmqdr"
May 20 19:47:18.726543 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:18.726459    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8f2fd804-794d-414a-bec8-2f486409098a-node-exporter-accelerators-collector-config\") pod \"node-exporter-wmqdr\" (UID: \"8f2fd804-794d-414a-bec8-2f486409098a\") " pod="openshift-monitoring/node-exporter-wmqdr"
May 20 19:47:18.827851 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:18.827766    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8f2fd804-794d-414a-bec8-2f486409098a-metrics-client-ca\") pod \"node-exporter-wmqdr\" (UID: \"8f2fd804-794d-414a-bec8-2f486409098a\") " pod="openshift-monitoring/node-exporter-wmqdr"
May 20 19:47:18.828083 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:18.828065    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8f2fd804-794d-414a-bec8-2f486409098a-sys\") pod \"node-exporter-wmqdr\" (UID: \"8f2fd804-794d-414a-bec8-2f486409098a\") " pod="openshift-monitoring/node-exporter-wmqdr"
May 20 19:47:18.828192 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:18.828178    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8f2fd804-794d-414a-bec8-2f486409098a-root\") pod \"node-exporter-wmqdr\" (UID: \"8f2fd804-794d-414a-bec8-2f486409098a\") " pod="openshift-monitoring/node-exporter-wmqdr"
May 20 19:47:18.828318 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:18.828299    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8f2fd804-794d-414a-bec8-2f486409098a-node-exporter-tls\") pod \"node-exporter-wmqdr\" (UID: \"8f2fd804-794d-414a-bec8-2f486409098a\") " pod="openshift-monitoring/node-exporter-wmqdr"
May 20 19:47:18.828459 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:18.828439    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8f2fd804-794d-414a-bec8-2f486409098a-metrics-client-ca\") pod \"node-exporter-wmqdr\" (UID: \"8f2fd804-794d-414a-bec8-2f486409098a\") " pod="openshift-monitoring/node-exporter-wmqdr"
May 20 19:47:18.828535 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:18.828512    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8f2fd804-794d-414a-bec8-2f486409098a-sys\") pod \"node-exporter-wmqdr\" (UID: \"8f2fd804-794d-414a-bec8-2f486409098a\") " pod="openshift-monitoring/node-exporter-wmqdr"
May 20 19:47:18.828535 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:18.828526    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8f2fd804-794d-414a-bec8-2f486409098a-node-exporter-wtmp\") pod \"node-exporter-wmqdr\" (UID: \"8f2fd804-794d-414a-bec8-2f486409098a\") " pod="openshift-monitoring/node-exporter-wmqdr"
May 20 19:47:18.828677 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:18.828552    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8f2fd804-794d-414a-bec8-2f486409098a-root\") pod \"node-exporter-wmqdr\" (UID: \"8f2fd804-794d-414a-bec8-2f486409098a\") " pod="openshift-monitoring/node-exporter-wmqdr"
May 20 19:47:18.828677 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:18.828565    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8f2fd804-794d-414a-bec8-2f486409098a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-wmqdr\" (UID: \"8f2fd804-794d-414a-bec8-2f486409098a\") " pod="openshift-monitoring/node-exporter-wmqdr"
May 20 19:47:18.828677 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:18.828630    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tnx9g\" (UniqueName: \"kubernetes.io/projected/8f2fd804-794d-414a-bec8-2f486409098a-kube-api-access-tnx9g\") pod \"node-exporter-wmqdr\" (UID: \"8f2fd804-794d-414a-bec8-2f486409098a\") " pod="openshift-monitoring/node-exporter-wmqdr"
May 20 19:47:18.828677 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:18.828660    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8f2fd804-794d-414a-bec8-2f486409098a-node-exporter-textfile\") pod \"node-exporter-wmqdr\" (UID: \"8f2fd804-794d-414a-bec8-2f486409098a\") " pod="openshift-monitoring/node-exporter-wmqdr"
May 20 19:47:18.828859 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:18.828687    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8f2fd804-794d-414a-bec8-2f486409098a-node-exporter-accelerators-collector-config\") pod \"node-exporter-wmqdr\" (UID: \"8f2fd804-794d-414a-bec8-2f486409098a\") " pod="openshift-monitoring/node-exporter-wmqdr"
May 20 19:47:18.829241 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:18.829216    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8f2fd804-794d-414a-bec8-2f486409098a-node-exporter-accelerators-collector-config\") pod \"node-exporter-wmqdr\" (UID: \"8f2fd804-794d-414a-bec8-2f486409098a\") " pod="openshift-monitoring/node-exporter-wmqdr"
May 20 19:47:18.829540 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:18.829429    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8f2fd804-794d-414a-bec8-2f486409098a-node-exporter-textfile\") pod \"node-exporter-wmqdr\" (UID: \"8f2fd804-794d-414a-bec8-2f486409098a\") " pod="openshift-monitoring/node-exporter-wmqdr"
May 20 19:47:18.829649 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:18.829626    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8f2fd804-794d-414a-bec8-2f486409098a-node-exporter-wtmp\") pod \"node-exporter-wmqdr\" (UID: \"8f2fd804-794d-414a-bec8-2f486409098a\") " pod="openshift-monitoring/node-exporter-wmqdr"
May 20 19:47:18.831536 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:18.831516    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8f2fd804-794d-414a-bec8-2f486409098a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-wmqdr\" (UID: \"8f2fd804-794d-414a-bec8-2f486409098a\") " pod="openshift-monitoring/node-exporter-wmqdr"
May 20 19:47:18.831906 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:18.831884    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8f2fd804-794d-414a-bec8-2f486409098a-node-exporter-tls\") pod \"node-exporter-wmqdr\" (UID: \"8f2fd804-794d-414a-bec8-2f486409098a\") " pod="openshift-monitoring/node-exporter-wmqdr"
May 20 19:47:18.840192 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:18.840167    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tnx9g\" (UniqueName: \"kubernetes.io/projected/8f2fd804-794d-414a-bec8-2f486409098a-kube-api-access-tnx9g\") pod \"node-exporter-wmqdr\" (UID: \"8f2fd804-794d-414a-bec8-2f486409098a\") " pod="openshift-monitoring/node-exporter-wmqdr"
May 20 19:47:18.859262 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:18.859222    2578 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5757cb6fbf-g5qgx" podUID="169436b4-0a1d-4a7b-a7e1-b9868db43921" containerName="registry" containerID="cri-o://0b2c1a5c357422e3baa140cf7b25034ad12bbaea78a3adc0d54d99513ac898a9" gracePeriod=30
May 20 19:47:18.930628 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:18.929893    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-wmqdr"
May 20 19:47:19.168432 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:19.168139    2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5757cb6fbf-g5qgx"
May 20 19:47:19.231857 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:19.231814    2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/169436b4-0a1d-4a7b-a7e1-b9868db43921-registry-certificates\") pod \"169436b4-0a1d-4a7b-a7e1-b9868db43921\" (UID: \"169436b4-0a1d-4a7b-a7e1-b9868db43921\") "
May 20 19:47:19.232034 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:19.231880    2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/169436b4-0a1d-4a7b-a7e1-b9868db43921-registry-tls\") pod \"169436b4-0a1d-4a7b-a7e1-b9868db43921\" (UID: \"169436b4-0a1d-4a7b-a7e1-b9868db43921\") "
May 20 19:47:19.232034 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:19.231913    2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/169436b4-0a1d-4a7b-a7e1-b9868db43921-trusted-ca\") pod \"169436b4-0a1d-4a7b-a7e1-b9868db43921\" (UID: \"169436b4-0a1d-4a7b-a7e1-b9868db43921\") "
May 20 19:47:19.232034 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:19.231963    2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/169436b4-0a1d-4a7b-a7e1-b9868db43921-image-registry-private-configuration\") pod \"169436b4-0a1d-4a7b-a7e1-b9868db43921\" (UID: \"169436b4-0a1d-4a7b-a7e1-b9868db43921\") "
May 20 19:47:19.232034 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:19.232011    2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/169436b4-0a1d-4a7b-a7e1-b9868db43921-ca-trust-extracted\") pod \"169436b4-0a1d-4a7b-a7e1-b9868db43921\" (UID: \"169436b4-0a1d-4a7b-a7e1-b9868db43921\") "
May 20 19:47:19.232260 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:19.232059    2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-khkqf\" (UniqueName: \"kubernetes.io/projected/169436b4-0a1d-4a7b-a7e1-b9868db43921-kube-api-access-khkqf\") pod \"169436b4-0a1d-4a7b-a7e1-b9868db43921\" (UID: \"169436b4-0a1d-4a7b-a7e1-b9868db43921\") "
May 20 19:47:19.232260 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:19.232100    2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/169436b4-0a1d-4a7b-a7e1-b9868db43921-installation-pull-secrets\") pod \"169436b4-0a1d-4a7b-a7e1-b9868db43921\" (UID: \"169436b4-0a1d-4a7b-a7e1-b9868db43921\") "
May 20 19:47:19.232260 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:19.232129    2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/169436b4-0a1d-4a7b-a7e1-b9868db43921-bound-sa-token\") pod \"169436b4-0a1d-4a7b-a7e1-b9868db43921\" (UID: \"169436b4-0a1d-4a7b-a7e1-b9868db43921\") "
May 20 19:47:19.232260 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:19.232214    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/169436b4-0a1d-4a7b-a7e1-b9868db43921-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "169436b4-0a1d-4a7b-a7e1-b9868db43921" (UID: "169436b4-0a1d-4a7b-a7e1-b9868db43921"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 20 19:47:19.232457 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:19.232410    2578 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/169436b4-0a1d-4a7b-a7e1-b9868db43921-registry-certificates\") on node \"ip-10-0-134-167.ec2.internal\" DevicePath \"\""
May 20 19:47:19.232773 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:19.232744    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/169436b4-0a1d-4a7b-a7e1-b9868db43921-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "169436b4-0a1d-4a7b-a7e1-b9868db43921" (UID: "169436b4-0a1d-4a7b-a7e1-b9868db43921"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 20 19:47:19.235407 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:19.235361    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/169436b4-0a1d-4a7b-a7e1-b9868db43921-kube-api-access-khkqf" (OuterVolumeSpecName: "kube-api-access-khkqf") pod "169436b4-0a1d-4a7b-a7e1-b9868db43921" (UID: "169436b4-0a1d-4a7b-a7e1-b9868db43921"). InnerVolumeSpecName "kube-api-access-khkqf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 20 19:47:19.235407 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:19.235380    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/169436b4-0a1d-4a7b-a7e1-b9868db43921-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "169436b4-0a1d-4a7b-a7e1-b9868db43921" (UID: "169436b4-0a1d-4a7b-a7e1-b9868db43921"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 20 19:47:19.235609 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:19.235432    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/169436b4-0a1d-4a7b-a7e1-b9868db43921-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "169436b4-0a1d-4a7b-a7e1-b9868db43921" (UID: "169436b4-0a1d-4a7b-a7e1-b9868db43921"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 20 19:47:19.237558 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:19.237533    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/169436b4-0a1d-4a7b-a7e1-b9868db43921-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "169436b4-0a1d-4a7b-a7e1-b9868db43921" (UID: "169436b4-0a1d-4a7b-a7e1-b9868db43921"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 20 19:47:19.237700 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:19.237551    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/169436b4-0a1d-4a7b-a7e1-b9868db43921-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "169436b4-0a1d-4a7b-a7e1-b9868db43921" (UID: "169436b4-0a1d-4a7b-a7e1-b9868db43921"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 20 19:47:19.242862 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:19.242830    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/169436b4-0a1d-4a7b-a7e1-b9868db43921-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "169436b4-0a1d-4a7b-a7e1-b9868db43921" (UID: "169436b4-0a1d-4a7b-a7e1-b9868db43921"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 20 19:47:19.333219 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:19.333182    2578 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/169436b4-0a1d-4a7b-a7e1-b9868db43921-registry-tls\") on node \"ip-10-0-134-167.ec2.internal\" DevicePath \"\""
May 20 19:47:19.333219 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:19.333213    2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/169436b4-0a1d-4a7b-a7e1-b9868db43921-trusted-ca\") on node \"ip-10-0-134-167.ec2.internal\" DevicePath \"\""
May 20 19:47:19.333439 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:19.333227    2578 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/169436b4-0a1d-4a7b-a7e1-b9868db43921-image-registry-private-configuration\") on node \"ip-10-0-134-167.ec2.internal\" DevicePath \"\""
May 20 19:47:19.333439 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:19.333274    2578 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/169436b4-0a1d-4a7b-a7e1-b9868db43921-ca-trust-extracted\") on node \"ip-10-0-134-167.ec2.internal\" DevicePath \"\""
May 20 19:47:19.333439 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:19.333288    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-khkqf\" (UniqueName: \"kubernetes.io/projected/169436b4-0a1d-4a7b-a7e1-b9868db43921-kube-api-access-khkqf\") on node \"ip-10-0-134-167.ec2.internal\" DevicePath \"\""
May 20 19:47:19.333439 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:19.333303    2578 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/169436b4-0a1d-4a7b-a7e1-b9868db43921-installation-pull-secrets\") on node \"ip-10-0-134-167.ec2.internal\" DevicePath \"\""
May 20 19:47:19.333439 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:19.333317    2578 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/169436b4-0a1d-4a7b-a7e1-b9868db43921-bound-sa-token\") on node \"ip-10-0-134-167.ec2.internal\" DevicePath \"\""
May 20 19:47:19.668045 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:19.667053    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5757cb6fbf-g5qgx" event={"ID":"169436b4-0a1d-4a7b-a7e1-b9868db43921","Type":"ContainerDied","Data":"0b2c1a5c357422e3baa140cf7b25034ad12bbaea78a3adc0d54d99513ac898a9"}
May 20 19:47:19.668045 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:19.667109    2578 scope.go:117] "RemoveContainer" containerID="0b2c1a5c357422e3baa140cf7b25034ad12bbaea78a3adc0d54d99513ac898a9"
May 20 19:47:19.668045 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:19.667095    2578 generic.go:358] "Generic (PLEG): container finished" podID="169436b4-0a1d-4a7b-a7e1-b9868db43921" containerID="0b2c1a5c357422e3baa140cf7b25034ad12bbaea78a3adc0d54d99513ac898a9" exitCode=0
May 20 19:47:19.668045 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:19.667140    2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5757cb6fbf-g5qgx"
May 20 19:47:19.668045 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:19.667193    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5757cb6fbf-g5qgx" event={"ID":"169436b4-0a1d-4a7b-a7e1-b9868db43921","Type":"ContainerDied","Data":"19bc063e7ec56f0cbfadbbfc9a8492cd201e4b28f7fa70f9791a7969389bf196"}
May 20 19:47:19.673644 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:19.672957    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wmqdr" event={"ID":"8f2fd804-794d-414a-bec8-2f486409098a","Type":"ContainerStarted","Data":"5d1d96c23092bf1fe84164cbfde0708f87863973d80c4eeb79d04c71a253fe88"}
May 20 19:47:19.693647 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:19.691875    2578 scope.go:117] "RemoveContainer" containerID="0b2c1a5c357422e3baa140cf7b25034ad12bbaea78a3adc0d54d99513ac898a9"
May 20 19:47:19.694781 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:19.694690    2578 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5757cb6fbf-g5qgx"]
May 20 19:47:19.695119 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:47:19.695031    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0b2c1a5c357422e3baa140cf7b25034ad12bbaea78a3adc0d54d99513ac898a9\": container with ID starting with 0b2c1a5c357422e3baa140cf7b25034ad12bbaea78a3adc0d54d99513ac898a9 not found: ID does not exist" containerID="0b2c1a5c357422e3baa140cf7b25034ad12bbaea78a3adc0d54d99513ac898a9"
May 20 19:47:19.695119 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:19.695067    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b2c1a5c357422e3baa140cf7b25034ad12bbaea78a3adc0d54d99513ac898a9"} err="failed to get container status \"0b2c1a5c357422e3baa140cf7b25034ad12bbaea78a3adc0d54d99513ac898a9\": rpc error: code = NotFound desc = could not find container \"0b2c1a5c357422e3baa140cf7b25034ad12bbaea78a3adc0d54d99513ac898a9\": container with ID starting with 0b2c1a5c357422e3baa140cf7b25034ad12bbaea78a3adc0d54d99513ac898a9 not found: ID does not exist"
May 20 19:47:19.704365 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:19.704341    2578 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5757cb6fbf-g5qgx"]
May 20 19:47:20.102693 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:20.102608    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="169436b4-0a1d-4a7b-a7e1-b9868db43921" path="/var/lib/kubelet/pods/169436b4-0a1d-4a7b-a7e1-b9868db43921/volumes"
May 20 19:47:20.560481 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:20.560445    2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-7dbb8667fb-zfh2w"]
May 20 19:47:20.560755 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:20.560742    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="169436b4-0a1d-4a7b-a7e1-b9868db43921" containerName="registry"
May 20 19:47:20.560755 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:20.560757    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="169436b4-0a1d-4a7b-a7e1-b9868db43921" containerName="registry"
May 20 19:47:20.560875 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:20.560805    2578 memory_manager.go:356] "RemoveStaleState removing state" podUID="169436b4-0a1d-4a7b-a7e1-b9868db43921" containerName="registry"
May 20 19:47:20.581981 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:20.581948    2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7dbb8667fb-zfh2w"]
May 20 19:47:20.582128 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:20.582106    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7dbb8667fb-zfh2w"
May 20 19:47:20.584971 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:20.584777    2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
May 20 19:47:20.584971 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:20.584828    2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
May 20 19:47:20.584971 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:20.584839    2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-1g2st2vg2c8ei\""
May 20 19:47:20.584971 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:20.584777    2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
May 20 19:47:20.585409 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:20.585392    2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
May 20 19:47:20.585504 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:20.585432    2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
May 20 19:47:20.585504 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:20.585462    2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-n9r9d\""
May 20 19:47:20.648355 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:20.648317    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/93a0230d-77d3-474e-b324-450c719b7ed1-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7dbb8667fb-zfh2w\" (UID: \"93a0230d-77d3-474e-b324-450c719b7ed1\") " pod="openshift-monitoring/thanos-querier-7dbb8667fb-zfh2w"
May 20 19:47:20.648532 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:20.648382    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/93a0230d-77d3-474e-b324-450c719b7ed1-metrics-client-ca\") pod \"thanos-querier-7dbb8667fb-zfh2w\" (UID: \"93a0230d-77d3-474e-b324-450c719b7ed1\") " pod="openshift-monitoring/thanos-querier-7dbb8667fb-zfh2w"
May 20 19:47:20.648532 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:20.648445    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/93a0230d-77d3-474e-b324-450c719b7ed1-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7dbb8667fb-zfh2w\" (UID: \"93a0230d-77d3-474e-b324-450c719b7ed1\") " pod="openshift-monitoring/thanos-querier-7dbb8667fb-zfh2w"
May 20 19:47:20.648532 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:20.648495    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/93a0230d-77d3-474e-b324-450c719b7ed1-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7dbb8667fb-zfh2w\" (UID: \"93a0230d-77d3-474e-b324-450c719b7ed1\") " pod="openshift-monitoring/thanos-querier-7dbb8667fb-zfh2w"
May 20 19:47:20.648731 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:20.648535    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/93a0230d-77d3-474e-b324-450c719b7ed1-secret-grpc-tls\") pod \"thanos-querier-7dbb8667fb-zfh2w\" (UID: \"93a0230d-77d3-474e-b324-450c719b7ed1\") " pod="openshift-monitoring/thanos-querier-7dbb8667fb-zfh2w"
May 20 19:47:20.648731 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:20.648565    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/93a0230d-77d3-474e-b324-450c719b7ed1-secret-thanos-querier-tls\") pod \"thanos-querier-7dbb8667fb-zfh2w\" (UID: \"93a0230d-77d3-474e-b324-450c719b7ed1\") " pod="openshift-monitoring/thanos-querier-7dbb8667fb-zfh2w"
May 20 19:47:20.648731 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:20.648639    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7dsnt\" (UniqueName: \"kubernetes.io/projected/93a0230d-77d3-474e-b324-450c719b7ed1-kube-api-access-7dsnt\") pod \"thanos-querier-7dbb8667fb-zfh2w\" (UID: \"93a0230d-77d3-474e-b324-450c719b7ed1\") " pod="openshift-monitoring/thanos-querier-7dbb8667fb-zfh2w"
May 20 19:47:20.648731 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:20.648674    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/93a0230d-77d3-474e-b324-450c719b7ed1-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7dbb8667fb-zfh2w\" (UID: \"93a0230d-77d3-474e-b324-450c719b7ed1\") " pod="openshift-monitoring/thanos-querier-7dbb8667fb-zfh2w"
May 20 19:47:20.692639 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:20.692605    2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-b4686f895-dsfk8"
May 20 19:47:20.692639 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:20.692647    2578 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-b4686f895-dsfk8"
May 20 19:47:20.698408 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:20.698381    2578 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-b4686f895-dsfk8"
May 20 19:47:20.749256 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:20.749222    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/93a0230d-77d3-474e-b324-450c719b7ed1-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7dbb8667fb-zfh2w\" (UID: \"93a0230d-77d3-474e-b324-450c719b7ed1\") " pod="openshift-monitoring/thanos-querier-7dbb8667fb-zfh2w"
May 20 19:47:20.749383 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:20.749271    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/93a0230d-77d3-474e-b324-450c719b7ed1-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7dbb8667fb-zfh2w\" (UID: \"93a0230d-77d3-474e-b324-450c719b7ed1\") " pod="openshift-monitoring/thanos-querier-7dbb8667fb-zfh2w"
May 20 19:47:20.749383 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:20.749312    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/93a0230d-77d3-474e-b324-450c719b7ed1-secret-grpc-tls\") pod \"thanos-querier-7dbb8667fb-zfh2w\" (UID: \"93a0230d-77d3-474e-b324-450c719b7ed1\") " pod="openshift-monitoring/thanos-querier-7dbb8667fb-zfh2w"
May 20 19:47:20.749383 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:20.749351    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/93a0230d-77d3-474e-b324-450c719b7ed1-secret-thanos-querier-tls\") pod \"thanos-querier-7dbb8667fb-zfh2w\" (UID: \"93a0230d-77d3-474e-b324-450c719b7ed1\") " pod="openshift-monitoring/thanos-querier-7dbb8667fb-zfh2w"
May 20 19:47:20.749612 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:20.749575    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7dsnt\" (UniqueName: \"kubernetes.io/projected/93a0230d-77d3-474e-b324-450c719b7ed1-kube-api-access-7dsnt\") pod \"thanos-querier-7dbb8667fb-zfh2w\" (UID: \"93a0230d-77d3-474e-b324-450c719b7ed1\") " pod="openshift-monitoring/thanos-querier-7dbb8667fb-zfh2w"
May 20 19:47:20.749678 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:20.749644    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/93a0230d-77d3-474e-b324-450c719b7ed1-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7dbb8667fb-zfh2w\" (UID: \"93a0230d-77d3-474e-b324-450c719b7ed1\") " pod="openshift-monitoring/thanos-querier-7dbb8667fb-zfh2w"
May 20 19:47:20.749759 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:20.749738    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/93a0230d-77d3-474e-b324-450c719b7ed1-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7dbb8667fb-zfh2w\" (UID: \"93a0230d-77d3-474e-b324-450c719b7ed1\") " pod="openshift-monitoring/thanos-querier-7dbb8667fb-zfh2w"
May 20 19:47:20.749864 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:20.749849    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/93a0230d-77d3-474e-b324-450c719b7ed1-metrics-client-ca\") pod \"thanos-querier-7dbb8667fb-zfh2w\" (UID: \"93a0230d-77d3-474e-b324-450c719b7ed1\") " pod="openshift-monitoring/thanos-querier-7dbb8667fb-zfh2w"
May 20 19:47:20.750621 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:20.750574    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/93a0230d-77d3-474e-b324-450c719b7ed1-metrics-client-ca\") pod \"thanos-querier-7dbb8667fb-zfh2w\" (UID: \"93a0230d-77d3-474e-b324-450c719b7ed1\") " pod="openshift-monitoring/thanos-querier-7dbb8667fb-zfh2w"
May 20 19:47:20.753290 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:20.753243    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/93a0230d-77d3-474e-b324-450c719b7ed1-secret-grpc-tls\") pod \"thanos-querier-7dbb8667fb-zfh2w\" (UID: \"93a0230d-77d3-474e-b324-450c719b7ed1\") " pod="openshift-monitoring/thanos-querier-7dbb8667fb-zfh2w"
May 20 19:47:20.753520 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:20.753494    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/93a0230d-77d3-474e-b324-450c719b7ed1-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7dbb8667fb-zfh2w\" (UID: \"93a0230d-77d3-474e-b324-450c719b7ed1\") " pod="openshift-monitoring/thanos-querier-7dbb8667fb-zfh2w"
May 20 19:47:20.753654 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:20.753494    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/93a0230d-77d3-474e-b324-450c719b7ed1-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7dbb8667fb-zfh2w\" (UID: \"93a0230d-77d3-474e-b324-450c719b7ed1\") " pod="openshift-monitoring/thanos-querier-7dbb8667fb-zfh2w"
May 20 19:47:20.753961 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:20.753926    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/93a0230d-77d3-474e-b324-450c719b7ed1-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7dbb8667fb-zfh2w\" (UID: \"93a0230d-77d3-474e-b324-450c719b7ed1\") " pod="openshift-monitoring/thanos-querier-7dbb8667fb-zfh2w"
May 20 19:47:20.754059 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:20.753933    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/93a0230d-77d3-474e-b324-450c719b7ed1-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7dbb8667fb-zfh2w\" (UID: \"93a0230d-77d3-474e-b324-450c719b7ed1\") " pod="openshift-monitoring/thanos-querier-7dbb8667fb-zfh2w"
May 20 19:47:20.754383 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:20.754360    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/93a0230d-77d3-474e-b324-450c719b7ed1-secret-thanos-querier-tls\") pod \"thanos-querier-7dbb8667fb-zfh2w\" (UID: \"93a0230d-77d3-474e-b324-450c719b7ed1\") " pod="openshift-monitoring/thanos-querier-7dbb8667fb-zfh2w"
May 20 19:47:20.757272 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:20.757249    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7dsnt\" (UniqueName: \"kubernetes.io/projected/93a0230d-77d3-474e-b324-450c719b7ed1-kube-api-access-7dsnt\") pod \"thanos-querier-7dbb8667fb-zfh2w\" (UID: \"93a0230d-77d3-474e-b324-450c719b7ed1\") " pod="openshift-monitoring/thanos-querier-7dbb8667fb-zfh2w"
May 20 19:47:20.895042 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:20.895015    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7dbb8667fb-zfh2w"
May 20 19:47:21.087965 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:21.087880    2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7dbb8667fb-zfh2w"]
May 20 19:47:21.094524 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:47:21.094496    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93a0230d_77d3_474e_b324_450c719b7ed1.slice/crio-07eb4bab825aa9575226bc45b9e63a2f5fa5e655b63e1ff1a25c8ba9b9a04328 WatchSource:0}: Error finding container 07eb4bab825aa9575226bc45b9e63a2f5fa5e655b63e1ff1a25c8ba9b9a04328: Status 404 returned error can't find the container with id 07eb4bab825aa9575226bc45b9e63a2f5fa5e655b63e1ff1a25c8ba9b9a04328
May 20 19:47:21.467033 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:21.466996    2578 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-b4686f895-dsfk8"]
May 20 19:47:21.681259 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:21.681223    2578 generic.go:358] "Generic (PLEG): container finished" podID="8f2fd804-794d-414a-bec8-2f486409098a" containerID="cfa8456e59c96426e5a9955c5e9713dd8707b4b2683d33ac32198d2542802c5b" exitCode=0
May 20 19:47:21.681417 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:21.681305    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wmqdr" event={"ID":"8f2fd804-794d-414a-bec8-2f486409098a","Type":"ContainerDied","Data":"cfa8456e59c96426e5a9955c5e9713dd8707b4b2683d33ac32198d2542802c5b"}
May 20 19:47:21.682519 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:21.682498    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7dbb8667fb-zfh2w" event={"ID":"93a0230d-77d3-474e-b324-450c719b7ed1","Type":"ContainerStarted","Data":"07eb4bab825aa9575226bc45b9e63a2f5fa5e655b63e1ff1a25c8ba9b9a04328"}
May 20 19:47:21.686967 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:21.686946    2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-b4686f895-dsfk8"
May 20 19:47:22.687989 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:22.687955    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wmqdr" event={"ID":"8f2fd804-794d-414a-bec8-2f486409098a","Type":"ContainerStarted","Data":"3c3ef5d32015d17cf28ef394a5afb0a417b0405e1a83e3180a874f62d1d15e00"}
May 20 19:47:22.687989 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:22.687998    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wmqdr" event={"ID":"8f2fd804-794d-414a-bec8-2f486409098a","Type":"ContainerStarted","Data":"56f4af93ffa1fdcc8853fcc48b8dc8609cf083f3d3780f93be6566be786ea542"}
May 20 19:47:22.714047 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:22.713990    2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-wmqdr" podStartSLOduration=2.933552223 podStartE2EDuration="4.713972082s" podCreationTimestamp="2026-05-20 19:47:18 +0000 UTC" firstStartedPulling="2026-05-20 19:47:18.966792541 +0000 UTC m=+181.415341376" lastFinishedPulling="2026-05-20 19:47:20.747212398 +0000 UTC m=+183.195761235" observedRunningTime="2026-05-20 19:47:22.713163901 +0000 UTC m=+185.161712754" watchObservedRunningTime="2026-05-20 19:47:22.713972082 +0000 UTC m=+185.162520941"
May 20 19:47:23.692500 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:23.692467    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7dbb8667fb-zfh2w" event={"ID":"93a0230d-77d3-474e-b324-450c719b7ed1","Type":"ContainerStarted","Data":"83629183cdd66d362b0fcc6656559b874c611fc45ba2bfd896fded5c37f7a6e7"}
May 20 19:47:24.560766 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:24.560731    2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-7c7c48fd9b-qh7hw"]
May 20 19:47:24.580099 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:24.580065    2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7c7c48fd9b-qh7hw"]
May 20 19:47:24.580251 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:24.580190    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c7c48fd9b-qh7hw"
May 20 19:47:24.587787 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:24.587764    2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
May 20 19:47:24.684857 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:24.684820    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d16eed6a-d0cf-4d65-b8e6-9348d91ab413-oauth-serving-cert\") pod \"console-7c7c48fd9b-qh7hw\" (UID: \"d16eed6a-d0cf-4d65-b8e6-9348d91ab413\") " pod="openshift-console/console-7c7c48fd9b-qh7hw"
May 20 19:47:24.685043 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:24.684918    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d16eed6a-d0cf-4d65-b8e6-9348d91ab413-trusted-ca-bundle\") pod \"console-7c7c48fd9b-qh7hw\" (UID: \"d16eed6a-d0cf-4d65-b8e6-9348d91ab413\") " pod="openshift-console/console-7c7c48fd9b-qh7hw"
May 20 19:47:24.685043 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:24.684955    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d16eed6a-d0cf-4d65-b8e6-9348d91ab413-service-ca\") pod \"console-7c7c48fd9b-qh7hw\" (UID: \"d16eed6a-d0cf-4d65-b8e6-9348d91ab413\") " pod="openshift-console/console-7c7c48fd9b-qh7hw"
May 20 19:47:24.685043 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:24.684992    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fsm5g\" (UniqueName: \"kubernetes.io/projected/d16eed6a-d0cf-4d65-b8e6-9348d91ab413-kube-api-access-fsm5g\") pod \"console-7c7c48fd9b-qh7hw\" (UID: \"d16eed6a-d0cf-4d65-b8e6-9348d91ab413\") " pod="openshift-console/console-7c7c48fd9b-qh7hw"
May 20 19:47:24.685186 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:24.685049    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d16eed6a-d0cf-4d65-b8e6-9348d91ab413-console-config\") pod \"console-7c7c48fd9b-qh7hw\" (UID: \"d16eed6a-d0cf-4d65-b8e6-9348d91ab413\") " pod="openshift-console/console-7c7c48fd9b-qh7hw"
May 20 19:47:24.685186 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:24.685098    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d16eed6a-d0cf-4d65-b8e6-9348d91ab413-console-serving-cert\") pod \"console-7c7c48fd9b-qh7hw\" (UID: \"d16eed6a-d0cf-4d65-b8e6-9348d91ab413\") " pod="openshift-console/console-7c7c48fd9b-qh7hw"
May 20 19:47:24.685186 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:24.685124    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d16eed6a-d0cf-4d65-b8e6-9348d91ab413-console-oauth-config\") pod \"console-7c7c48fd9b-qh7hw\" (UID: \"d16eed6a-d0cf-4d65-b8e6-9348d91ab413\") " pod="openshift-console/console-7c7c48fd9b-qh7hw"
May 20 19:47:24.697478 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:24.697409    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7dbb8667fb-zfh2w" event={"ID":"93a0230d-77d3-474e-b324-450c719b7ed1","Type":"ContainerStarted","Data":"9ab3f1296d53162ad6d38e91628bee0823196584a7e66a48cba56a4513200471"}
May 20 19:47:24.697478 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:24.697449    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7dbb8667fb-zfh2w" event={"ID":"93a0230d-77d3-474e-b324-450c719b7ed1","Type":"ContainerStarted","Data":"1404ff562378c9bfbd7e2051cb7277adf6c1446eecf3c5f6320c623767ba6ff0"}
May 20 19:47:24.786164 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:24.786131    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d16eed6a-d0cf-4d65-b8e6-9348d91ab413-trusted-ca-bundle\") pod \"console-7c7c48fd9b-qh7hw\" (UID: \"d16eed6a-d0cf-4d65-b8e6-9348d91ab413\") " pod="openshift-console/console-7c7c48fd9b-qh7hw"
May 20 19:47:24.786316 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:24.786186    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d16eed6a-d0cf-4d65-b8e6-9348d91ab413-service-ca\") pod \"console-7c7c48fd9b-qh7hw\" (UID: \"d16eed6a-d0cf-4d65-b8e6-9348d91ab413\") " pod="openshift-console/console-7c7c48fd9b-qh7hw"
May 20 19:47:24.786316 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:24.786219    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fsm5g\" (UniqueName: \"kubernetes.io/projected/d16eed6a-d0cf-4d65-b8e6-9348d91ab413-kube-api-access-fsm5g\") pod \"console-7c7c48fd9b-qh7hw\" (UID: \"d16eed6a-d0cf-4d65-b8e6-9348d91ab413\") " pod="openshift-console/console-7c7c48fd9b-qh7hw"
May 20 19:47:24.786316 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:24.786254    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d16eed6a-d0cf-4d65-b8e6-9348d91ab413-console-config\") pod \"console-7c7c48fd9b-qh7hw\" (UID: \"d16eed6a-d0cf-4d65-b8e6-9348d91ab413\") " pod="openshift-console/console-7c7c48fd9b-qh7hw"
May 20 19:47:24.786316 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:24.786289    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d16eed6a-d0cf-4d65-b8e6-9348d91ab413-console-serving-cert\") pod \"console-7c7c48fd9b-qh7hw\" (UID: \"d16eed6a-d0cf-4d65-b8e6-9348d91ab413\") " pod="openshift-console/console-7c7c48fd9b-qh7hw"
May 20 19:47:24.786505 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:24.786315    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d16eed6a-d0cf-4d65-b8e6-9348d91ab413-console-oauth-config\") pod \"console-7c7c48fd9b-qh7hw\" (UID: \"d16eed6a-d0cf-4d65-b8e6-9348d91ab413\") " pod="openshift-console/console-7c7c48fd9b-qh7hw"
May 20 19:47:24.786505 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:24.786379    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d16eed6a-d0cf-4d65-b8e6-9348d91ab413-oauth-serving-cert\") pod \"console-7c7c48fd9b-qh7hw\" (UID: \"d16eed6a-d0cf-4d65-b8e6-9348d91ab413\") " pod="openshift-console/console-7c7c48fd9b-qh7hw"
May 20 19:47:24.787057 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:24.787007    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d16eed6a-d0cf-4d65-b8e6-9348d91ab413-trusted-ca-bundle\") pod \"console-7c7c48fd9b-qh7hw\" (UID: \"d16eed6a-d0cf-4d65-b8e6-9348d91ab413\") " pod="openshift-console/console-7c7c48fd9b-qh7hw"
May 20 19:47:24.787170 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:24.787097    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d16eed6a-d0cf-4d65-b8e6-9348d91ab413-oauth-serving-cert\") pod \"console-7c7c48fd9b-qh7hw\" (UID: \"d16eed6a-d0cf-4d65-b8e6-9348d91ab413\") " pod="openshift-console/console-7c7c48fd9b-qh7hw"
May 20 19:47:24.787170 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:24.787160    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d16eed6a-d0cf-4d65-b8e6-9348d91ab413-console-config\") pod \"console-7c7c48fd9b-qh7hw\" (UID: \"d16eed6a-d0cf-4d65-b8e6-9348d91ab413\") " pod="openshift-console/console-7c7c48fd9b-qh7hw"
May 20 19:47:24.787261 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:24.787241    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d16eed6a-d0cf-4d65-b8e6-9348d91ab413-service-ca\") pod \"console-7c7c48fd9b-qh7hw\" (UID: \"d16eed6a-d0cf-4d65-b8e6-9348d91ab413\") " pod="openshift-console/console-7c7c48fd9b-qh7hw"
May 20 19:47:24.789501 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:24.789481    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d16eed6a-d0cf-4d65-b8e6-9348d91ab413-console-serving-cert\") pod \"console-7c7c48fd9b-qh7hw\" (UID: \"d16eed6a-d0cf-4d65-b8e6-9348d91ab413\") " pod="openshift-console/console-7c7c48fd9b-qh7hw"
May 20 19:47:24.789621 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:24.789599    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d16eed6a-d0cf-4d65-b8e6-9348d91ab413-console-oauth-config\") pod \"console-7c7c48fd9b-qh7hw\" (UID: \"d16eed6a-d0cf-4d65-b8e6-9348d91ab413\") " pod="openshift-console/console-7c7c48fd9b-qh7hw"
May 20 19:47:24.794132 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:24.794106    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fsm5g\" (UniqueName: \"kubernetes.io/projected/d16eed6a-d0cf-4d65-b8e6-9348d91ab413-kube-api-access-fsm5g\") pod \"console-7c7c48fd9b-qh7hw\" (UID: \"d16eed6a-d0cf-4d65-b8e6-9348d91ab413\") " pod="openshift-console/console-7c7c48fd9b-qh7hw"
May 20 19:47:24.890150 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:24.890099    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c7c48fd9b-qh7hw"
May 20 19:47:25.146870 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:25.146788    2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7c7c48fd9b-qh7hw"]
May 20 19:47:25.149632 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:47:25.149606    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd16eed6a_d0cf_4d65_b8e6_9348d91ab413.slice/crio-fdb5761bcb15a14e7cd2aed7215217bea428d668e130166d1e48910c20e76309 WatchSource:0}: Error finding container fdb5761bcb15a14e7cd2aed7215217bea428d668e130166d1e48910c20e76309: Status 404 returned error can't find the container with id fdb5761bcb15a14e7cd2aed7215217bea428d668e130166d1e48910c20e76309
May 20 19:47:25.703250 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:25.703221    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7dbb8667fb-zfh2w" event={"ID":"93a0230d-77d3-474e-b324-450c719b7ed1","Type":"ContainerStarted","Data":"eb1ab4c793560e0038279903c0f42be3611a3eec8f3bc4380304747049337d9f"}
May 20 19:47:25.703733 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:25.703254    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7dbb8667fb-zfh2w" event={"ID":"93a0230d-77d3-474e-b324-450c719b7ed1","Type":"ContainerStarted","Data":"49acd2f3035491095fb03274eb629d7f29be944dd4200e20b430299a837e1c71"}
May 20 19:47:25.703733 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:25.703286    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7dbb8667fb-zfh2w" event={"ID":"93a0230d-77d3-474e-b324-450c719b7ed1","Type":"ContainerStarted","Data":"fe6c0ccd91465d91d9182a610b8cd6d3e4131094288cb46112bf605f523641f0"}
May 20 19:47:25.704707 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:25.704680    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c7c48fd9b-qh7hw" event={"ID":"d16eed6a-d0cf-4d65-b8e6-9348d91ab413","Type":"ContainerStarted","Data":"4bc7a93a5a2ea26e6c3144650062d704712726ddb5095404077bde1c2ab937f4"}
May 20 19:47:25.704780 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:25.704718    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c7c48fd9b-qh7hw" event={"ID":"d16eed6a-d0cf-4d65-b8e6-9348d91ab413","Type":"ContainerStarted","Data":"fdb5761bcb15a14e7cd2aed7215217bea428d668e130166d1e48910c20e76309"}
May 20 19:47:25.721364 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:25.721318    2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-7c7c48fd9b-qh7hw" podStartSLOduration=1.7213034729999999 podStartE2EDuration="1.721303473s" podCreationTimestamp="2026-05-20 19:47:24 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-20 19:47:25.720489999 +0000 UTC m=+188.169038854" watchObservedRunningTime="2026-05-20 19:47:25.721303473 +0000 UTC m=+188.169852327"
May 20 19:47:26.733048 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:26.732997    2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-7dbb8667fb-zfh2w" podStartSLOduration=2.437549244 podStartE2EDuration="6.732982406s" podCreationTimestamp="2026-05-20 19:47:20 +0000 UTC" firstStartedPulling="2026-05-20 19:47:21.096668504 +0000 UTC m=+183.545217521" lastFinishedPulling="2026-05-20 19:47:25.392101852 +0000 UTC m=+187.840650683" observedRunningTime="2026-05-20 19:47:26.731988327 +0000 UTC m=+189.180537181" watchObservedRunningTime="2026-05-20 19:47:26.732982406 +0000 UTC m=+189.181531259"
May 20 19:47:27.711121 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:27.711082    2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-7dbb8667fb-zfh2w"
May 20 19:47:28.222046 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:28.222005    2578 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7c7c48fd9b-qh7hw"]
May 20 19:47:28.274492 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:28.274452    2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-b6cf879cc-jqnn9"]
May 20 19:47:28.298331 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:28.298305    2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-b6cf879cc-jqnn9"]
May 20 19:47:28.298477 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:28.298414    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b6cf879cc-jqnn9"
May 20 19:47:28.419916 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:28.419881    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w7826\" (UniqueName: \"kubernetes.io/projected/26ef8d4e-e0e9-4bba-82dd-419cbd131f56-kube-api-access-w7826\") pod \"console-b6cf879cc-jqnn9\" (UID: \"26ef8d4e-e0e9-4bba-82dd-419cbd131f56\") " pod="openshift-console/console-b6cf879cc-jqnn9"
May 20 19:47:28.420100 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:28.419929    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/26ef8d4e-e0e9-4bba-82dd-419cbd131f56-oauth-serving-cert\") pod \"console-b6cf879cc-jqnn9\" (UID: \"26ef8d4e-e0e9-4bba-82dd-419cbd131f56\") " pod="openshift-console/console-b6cf879cc-jqnn9"
May 20 19:47:28.420100 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:28.420004    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/26ef8d4e-e0e9-4bba-82dd-419cbd131f56-console-oauth-config\") pod \"console-b6cf879cc-jqnn9\" (UID: \"26ef8d4e-e0e9-4bba-82dd-419cbd131f56\") " pod="openshift-console/console-b6cf879cc-jqnn9"
May 20 19:47:28.420100 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:28.420049    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/26ef8d4e-e0e9-4bba-82dd-419cbd131f56-console-serving-cert\") pod \"console-b6cf879cc-jqnn9\" (UID: \"26ef8d4e-e0e9-4bba-82dd-419cbd131f56\") " pod="openshift-console/console-b6cf879cc-jqnn9"
May 20 19:47:28.420100 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:28.420078    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/26ef8d4e-e0e9-4bba-82dd-419cbd131f56-service-ca\") pod \"console-b6cf879cc-jqnn9\" (UID: \"26ef8d4e-e0e9-4bba-82dd-419cbd131f56\") " pod="openshift-console/console-b6cf879cc-jqnn9"
May 20 19:47:28.420267 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:28.420149    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/26ef8d4e-e0e9-4bba-82dd-419cbd131f56-console-config\") pod \"console-b6cf879cc-jqnn9\" (UID: \"26ef8d4e-e0e9-4bba-82dd-419cbd131f56\") " pod="openshift-console/console-b6cf879cc-jqnn9"
May 20 19:47:28.420267 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:28.420189    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/26ef8d4e-e0e9-4bba-82dd-419cbd131f56-trusted-ca-bundle\") pod \"console-b6cf879cc-jqnn9\" (UID: \"26ef8d4e-e0e9-4bba-82dd-419cbd131f56\") " pod="openshift-console/console-b6cf879cc-jqnn9"
May 20 19:47:28.521399 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:28.521314    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/26ef8d4e-e0e9-4bba-82dd-419cbd131f56-console-config\") pod \"console-b6cf879cc-jqnn9\" (UID: \"26ef8d4e-e0e9-4bba-82dd-419cbd131f56\") " pod="openshift-console/console-b6cf879cc-jqnn9"
May 20 19:47:28.521399 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:28.521358    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/26ef8d4e-e0e9-4bba-82dd-419cbd131f56-trusted-ca-bundle\") pod \"console-b6cf879cc-jqnn9\" (UID: \"26ef8d4e-e0e9-4bba-82dd-419cbd131f56\") " pod="openshift-console/console-b6cf879cc-jqnn9"
May 20 19:47:28.521678 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:28.521404    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-w7826\" (UniqueName: \"kubernetes.io/projected/26ef8d4e-e0e9-4bba-82dd-419cbd131f56-kube-api-access-w7826\") pod \"console-b6cf879cc-jqnn9\" (UID: \"26ef8d4e-e0e9-4bba-82dd-419cbd131f56\") " pod="openshift-console/console-b6cf879cc-jqnn9"
May 20 19:47:28.521678 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:28.521426    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/26ef8d4e-e0e9-4bba-82dd-419cbd131f56-oauth-serving-cert\") pod \"console-b6cf879cc-jqnn9\" (UID: \"26ef8d4e-e0e9-4bba-82dd-419cbd131f56\") " pod="openshift-console/console-b6cf879cc-jqnn9"
May 20 19:47:28.521678 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:28.521449    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/26ef8d4e-e0e9-4bba-82dd-419cbd131f56-console-oauth-config\") pod \"console-b6cf879cc-jqnn9\" (UID: \"26ef8d4e-e0e9-4bba-82dd-419cbd131f56\") " pod="openshift-console/console-b6cf879cc-jqnn9"
May 20 19:47:28.521678 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:28.521633    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/26ef8d4e-e0e9-4bba-82dd-419cbd131f56-console-serving-cert\") pod \"console-b6cf879cc-jqnn9\" (UID: \"26ef8d4e-e0e9-4bba-82dd-419cbd131f56\") " pod="openshift-console/console-b6cf879cc-jqnn9"
May 20 19:47:28.521678 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:28.521671    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/26ef8d4e-e0e9-4bba-82dd-419cbd131f56-service-ca\") pod \"console-b6cf879cc-jqnn9\" (UID: \"26ef8d4e-e0e9-4bba-82dd-419cbd131f56\") " pod="openshift-console/console-b6cf879cc-jqnn9"
May 20 19:47:28.522121 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:28.522094    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/26ef8d4e-e0e9-4bba-82dd-419cbd131f56-oauth-serving-cert\") pod \"console-b6cf879cc-jqnn9\" (UID: \"26ef8d4e-e0e9-4bba-82dd-419cbd131f56\") " pod="openshift-console/console-b6cf879cc-jqnn9"
May 20 19:47:28.522220 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:28.522118    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/26ef8d4e-e0e9-4bba-82dd-419cbd131f56-console-config\") pod \"console-b6cf879cc-jqnn9\" (UID: \"26ef8d4e-e0e9-4bba-82dd-419cbd131f56\") " pod="openshift-console/console-b6cf879cc-jqnn9"
May 20 19:47:28.522386 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:28.522367    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/26ef8d4e-e0e9-4bba-82dd-419cbd131f56-trusted-ca-bundle\") pod \"console-b6cf879cc-jqnn9\" (UID: \"26ef8d4e-e0e9-4bba-82dd-419cbd131f56\") " pod="openshift-console/console-b6cf879cc-jqnn9"
May 20 19:47:28.522539 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:28.522517    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/26ef8d4e-e0e9-4bba-82dd-419cbd131f56-service-ca\") pod \"console-b6cf879cc-jqnn9\" (UID: \"26ef8d4e-e0e9-4bba-82dd-419cbd131f56\") " pod="openshift-console/console-b6cf879cc-jqnn9"
May 20 19:47:28.524019 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:28.523999    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/26ef8d4e-e0e9-4bba-82dd-419cbd131f56-console-oauth-config\") pod \"console-b6cf879cc-jqnn9\" (UID: \"26ef8d4e-e0e9-4bba-82dd-419cbd131f56\") " pod="openshift-console/console-b6cf879cc-jqnn9"
May 20 19:47:28.524257 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:28.524241    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/26ef8d4e-e0e9-4bba-82dd-419cbd131f56-console-serving-cert\") pod \"console-b6cf879cc-jqnn9\" (UID: \"26ef8d4e-e0e9-4bba-82dd-419cbd131f56\") " pod="openshift-console/console-b6cf879cc-jqnn9"
May 20 19:47:28.530552 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:28.530523    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w7826\" (UniqueName: \"kubernetes.io/projected/26ef8d4e-e0e9-4bba-82dd-419cbd131f56-kube-api-access-w7826\") pod \"console-b6cf879cc-jqnn9\" (UID: \"26ef8d4e-e0e9-4bba-82dd-419cbd131f56\") " pod="openshift-console/console-b6cf879cc-jqnn9"
May 20 19:47:28.608339 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:28.608296    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b6cf879cc-jqnn9"
May 20 19:47:28.719365 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:28.719339    2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-7dbb8667fb-zfh2w"
May 20 19:47:28.737838 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:28.737801    2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-b6cf879cc-jqnn9"]
May 20 19:47:28.741184 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:47:28.741153    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26ef8d4e_e0e9_4bba_82dd_419cbd131f56.slice/crio-12c022bb434f6fa97c2ed387e23ca2bd1d738eefa265c242900c332a3edeb5ae WatchSource:0}: Error finding container 12c022bb434f6fa97c2ed387e23ca2bd1d738eefa265c242900c332a3edeb5ae: Status 404 returned error can't find the container with id 12c022bb434f6fa97c2ed387e23ca2bd1d738eefa265c242900c332a3edeb5ae
May 20 19:47:29.718289 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:29.718245    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b6cf879cc-jqnn9" event={"ID":"26ef8d4e-e0e9-4bba-82dd-419cbd131f56","Type":"ContainerStarted","Data":"e62eb29141267ba8214900295c04c8504441f88fc6011ef3f31af49155cf13b0"}
May 20 19:47:29.718289 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:29.718287    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b6cf879cc-jqnn9" event={"ID":"26ef8d4e-e0e9-4bba-82dd-419cbd131f56","Type":"ContainerStarted","Data":"12c022bb434f6fa97c2ed387e23ca2bd1d738eefa265c242900c332a3edeb5ae"}
May 20 19:47:29.735095 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:29.735049    2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-b6cf879cc-jqnn9" podStartSLOduration=1.735034975 podStartE2EDuration="1.735034975s" podCreationTimestamp="2026-05-20 19:47:28 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-20 19:47:29.734055787 +0000 UTC m=+192.182604642" watchObservedRunningTime="2026-05-20 19:47:29.735034975 +0000 UTC m=+192.183583826"
May 20 19:47:34.890656 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:34.890608    2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7c7c48fd9b-qh7hw"
May 20 19:47:36.128336 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:36.128309    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-rj5rw_b63a00ba-256d-476a-9f16-f0ae99f6e73b/serve-healthcheck-canary/0.log"
May 20 19:47:38.608553 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:38.608503    2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-b6cf879cc-jqnn9"
May 20 19:47:38.608553 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:38.608552    2578 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-b6cf879cc-jqnn9"
May 20 19:47:38.613311 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:38.613292    2578 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-b6cf879cc-jqnn9"
May 20 19:47:38.745828 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:38.745801    2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-b6cf879cc-jqnn9"
May 20 19:47:47.709467 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:47.709422    2578 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-b4686f895-dsfk8" podUID="3aa65265-bdd9-4d27-9b43-5b4de9961d45" containerName="console" containerID="cri-o://9250a7d4d01a13f6f5cda8528cf00d7319465087cc583cb1deb20fdf4e89de99" gracePeriod=15
May 20 19:47:48.016451 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:48.016425    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-b4686f895-dsfk8_3aa65265-bdd9-4d27-9b43-5b4de9961d45/console/0.log"
May 20 19:47:48.016667 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:48.016486    2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b4686f895-dsfk8"
May 20 19:47:48.124190 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:48.124146    2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3aa65265-bdd9-4d27-9b43-5b4de9961d45-service-ca\") pod \"3aa65265-bdd9-4d27-9b43-5b4de9961d45\" (UID: \"3aa65265-bdd9-4d27-9b43-5b4de9961d45\") "
May 20 19:47:48.124394 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:48.124267    2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3aa65265-bdd9-4d27-9b43-5b4de9961d45-console-oauth-config\") pod \"3aa65265-bdd9-4d27-9b43-5b4de9961d45\" (UID: \"3aa65265-bdd9-4d27-9b43-5b4de9961d45\") "
May 20 19:47:48.124394 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:48.124295    2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3aa65265-bdd9-4d27-9b43-5b4de9961d45-console-config\") pod \"3aa65265-bdd9-4d27-9b43-5b4de9961d45\" (UID: \"3aa65265-bdd9-4d27-9b43-5b4de9961d45\") "
May 20 19:47:48.124394 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:48.124327    2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3aa65265-bdd9-4d27-9b43-5b4de9961d45-console-serving-cert\") pod \"3aa65265-bdd9-4d27-9b43-5b4de9961d45\" (UID: \"3aa65265-bdd9-4d27-9b43-5b4de9961d45\") "
May 20 19:47:48.124394 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:48.124351    2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-srlmd\" (UniqueName: \"kubernetes.io/projected/3aa65265-bdd9-4d27-9b43-5b4de9961d45-kube-api-access-srlmd\") pod \"3aa65265-bdd9-4d27-9b43-5b4de9961d45\" (UID: \"3aa65265-bdd9-4d27-9b43-5b4de9961d45\") "
May 20 19:47:48.124621 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:48.124399    2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3aa65265-bdd9-4d27-9b43-5b4de9961d45-oauth-serving-cert\") pod \"3aa65265-bdd9-4d27-9b43-5b4de9961d45\" (UID: \"3aa65265-bdd9-4d27-9b43-5b4de9961d45\") "
May 20 19:47:48.124621 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:48.124612    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3aa65265-bdd9-4d27-9b43-5b4de9961d45-service-ca" (OuterVolumeSpecName: "service-ca") pod "3aa65265-bdd9-4d27-9b43-5b4de9961d45" (UID: "3aa65265-bdd9-4d27-9b43-5b4de9961d45"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 20 19:47:48.124769 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:48.124739    2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3aa65265-bdd9-4d27-9b43-5b4de9961d45-service-ca\") on node \"ip-10-0-134-167.ec2.internal\" DevicePath \"\""
May 20 19:47:48.124903 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:48.124880    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3aa65265-bdd9-4d27-9b43-5b4de9961d45-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "3aa65265-bdd9-4d27-9b43-5b4de9961d45" (UID: "3aa65265-bdd9-4d27-9b43-5b4de9961d45"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 20 19:47:48.124973 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:48.124912    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3aa65265-bdd9-4d27-9b43-5b4de9961d45-console-config" (OuterVolumeSpecName: "console-config") pod "3aa65265-bdd9-4d27-9b43-5b4de9961d45" (UID: "3aa65265-bdd9-4d27-9b43-5b4de9961d45"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 20 19:47:48.127118 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:48.127072    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3aa65265-bdd9-4d27-9b43-5b4de9961d45-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "3aa65265-bdd9-4d27-9b43-5b4de9961d45" (UID: "3aa65265-bdd9-4d27-9b43-5b4de9961d45"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 20 19:47:48.127272 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:48.127117    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3aa65265-bdd9-4d27-9b43-5b4de9961d45-kube-api-access-srlmd" (OuterVolumeSpecName: "kube-api-access-srlmd") pod "3aa65265-bdd9-4d27-9b43-5b4de9961d45" (UID: "3aa65265-bdd9-4d27-9b43-5b4de9961d45"). InnerVolumeSpecName "kube-api-access-srlmd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 20 19:47:48.127272 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:48.127201    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3aa65265-bdd9-4d27-9b43-5b4de9961d45-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "3aa65265-bdd9-4d27-9b43-5b4de9961d45" (UID: "3aa65265-bdd9-4d27-9b43-5b4de9961d45"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 20 19:47:48.225868 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:48.225833    2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3aa65265-bdd9-4d27-9b43-5b4de9961d45-console-oauth-config\") on node \"ip-10-0-134-167.ec2.internal\" DevicePath \"\""
May 20 19:47:48.225868 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:48.225865    2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3aa65265-bdd9-4d27-9b43-5b4de9961d45-console-config\") on node \"ip-10-0-134-167.ec2.internal\" DevicePath \"\""
May 20 19:47:48.225868 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:48.225875    2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3aa65265-bdd9-4d27-9b43-5b4de9961d45-console-serving-cert\") on node \"ip-10-0-134-167.ec2.internal\" DevicePath \"\""
May 20 19:47:48.226122 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:48.225884    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-srlmd\" (UniqueName: \"kubernetes.io/projected/3aa65265-bdd9-4d27-9b43-5b4de9961d45-kube-api-access-srlmd\") on node \"ip-10-0-134-167.ec2.internal\" DevicePath \"\""
May 20 19:47:48.226122 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:48.225894    2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3aa65265-bdd9-4d27-9b43-5b4de9961d45-oauth-serving-cert\") on node \"ip-10-0-134-167.ec2.internal\" DevicePath \"\""
May 20 19:47:48.772080 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:48.772056    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-b4686f895-dsfk8_3aa65265-bdd9-4d27-9b43-5b4de9961d45/console/0.log"
May 20 19:47:48.772457 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:48.772093    2578 generic.go:358] "Generic (PLEG): container finished" podID="3aa65265-bdd9-4d27-9b43-5b4de9961d45" containerID="9250a7d4d01a13f6f5cda8528cf00d7319465087cc583cb1deb20fdf4e89de99" exitCode=2
May 20 19:47:48.772457 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:48.772168    2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b4686f895-dsfk8"
May 20 19:47:48.772457 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:48.772172    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b4686f895-dsfk8" event={"ID":"3aa65265-bdd9-4d27-9b43-5b4de9961d45","Type":"ContainerDied","Data":"9250a7d4d01a13f6f5cda8528cf00d7319465087cc583cb1deb20fdf4e89de99"}
May 20 19:47:48.772457 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:48.772261    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b4686f895-dsfk8" event={"ID":"3aa65265-bdd9-4d27-9b43-5b4de9961d45","Type":"ContainerDied","Data":"2c8747f022951d31fa86483f425bc79209cf1ed43229a18c572edaeed667d6b7"}
May 20 19:47:48.772457 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:48.772276    2578 scope.go:117] "RemoveContainer" containerID="9250a7d4d01a13f6f5cda8528cf00d7319465087cc583cb1deb20fdf4e89de99"
May 20 19:47:48.781653 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:48.781624    2578 scope.go:117] "RemoveContainer" containerID="9250a7d4d01a13f6f5cda8528cf00d7319465087cc583cb1deb20fdf4e89de99"
May 20 19:47:48.781950 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:47:48.781928    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9250a7d4d01a13f6f5cda8528cf00d7319465087cc583cb1deb20fdf4e89de99\": container with ID starting with 9250a7d4d01a13f6f5cda8528cf00d7319465087cc583cb1deb20fdf4e89de99 not found: ID does not exist" containerID="9250a7d4d01a13f6f5cda8528cf00d7319465087cc583cb1deb20fdf4e89de99"
May 20 19:47:48.782021 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:48.781959    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9250a7d4d01a13f6f5cda8528cf00d7319465087cc583cb1deb20fdf4e89de99"} err="failed to get container status \"9250a7d4d01a13f6f5cda8528cf00d7319465087cc583cb1deb20fdf4e89de99\": rpc error: code = NotFound desc = could not find container \"9250a7d4d01a13f6f5cda8528cf00d7319465087cc583cb1deb20fdf4e89de99\": container with ID starting with 9250a7d4d01a13f6f5cda8528cf00d7319465087cc583cb1deb20fdf4e89de99 not found: ID does not exist"
May 20 19:47:48.795118 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:48.795088    2578 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-b4686f895-dsfk8"]
May 20 19:47:48.799783 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:48.799729    2578 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-b4686f895-dsfk8"]
May 20 19:47:50.099984 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:50.099948    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3aa65265-bdd9-4d27-9b43-5b4de9961d45" path="/var/lib/kubelet/pods/3aa65265-bdd9-4d27-9b43-5b4de9961d45/volumes"
May 20 19:47:51.783553 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:51.783516    2578 generic.go:358] "Generic (PLEG): container finished" podID="0f7be3ab-2755-40b3-ab14-2353ad0ebecd" containerID="6527d6783ab5c82c35481c3f38c9040327ac307efef191f0e71e7e54b5cd1412" exitCode=0
May 20 19:47:51.783966 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:51.783611    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-xpb4t" event={"ID":"0f7be3ab-2755-40b3-ab14-2353ad0ebecd","Type":"ContainerDied","Data":"6527d6783ab5c82c35481c3f38c9040327ac307efef191f0e71e7e54b5cd1412"}
May 20 19:47:51.783966 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:51.783932    2578 scope.go:117] "RemoveContainer" containerID="6527d6783ab5c82c35481c3f38c9040327ac307efef191f0e71e7e54b5cd1412"
May 20 19:47:52.788232 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:52.788199    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-xpb4t" event={"ID":"0f7be3ab-2755-40b3-ab14-2353ad0ebecd","Type":"ContainerStarted","Data":"a75b55bf1b5d508c01e30f29110090ce25a0b6f753962c604d2ee4e64a25a164"}
May 20 19:47:53.241667 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:53.241629    2578 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-7c7c48fd9b-qh7hw" podUID="d16eed6a-d0cf-4d65-b8e6-9348d91ab413" containerName="console" containerID="cri-o://4bc7a93a5a2ea26e6c3144650062d704712726ddb5095404077bde1c2ab937f4" gracePeriod=15
May 20 19:47:53.491746 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:53.491692    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7c7c48fd9b-qh7hw_d16eed6a-d0cf-4d65-b8e6-9348d91ab413/console/0.log"
May 20 19:47:53.491849 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:53.491750    2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c7c48fd9b-qh7hw"
May 20 19:47:53.575156 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:53.575123    2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d16eed6a-d0cf-4d65-b8e6-9348d91ab413-console-config\") pod \"d16eed6a-d0cf-4d65-b8e6-9348d91ab413\" (UID: \"d16eed6a-d0cf-4d65-b8e6-9348d91ab413\") "
May 20 19:47:53.575156 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:53.575161    2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fsm5g\" (UniqueName: \"kubernetes.io/projected/d16eed6a-d0cf-4d65-b8e6-9348d91ab413-kube-api-access-fsm5g\") pod \"d16eed6a-d0cf-4d65-b8e6-9348d91ab413\" (UID: \"d16eed6a-d0cf-4d65-b8e6-9348d91ab413\") "
May 20 19:47:53.575403 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:53.575183    2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d16eed6a-d0cf-4d65-b8e6-9348d91ab413-service-ca\") pod \"d16eed6a-d0cf-4d65-b8e6-9348d91ab413\" (UID: \"d16eed6a-d0cf-4d65-b8e6-9348d91ab413\") "
May 20 19:47:53.575403 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:53.575227    2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d16eed6a-d0cf-4d65-b8e6-9348d91ab413-trusted-ca-bundle\") pod \"d16eed6a-d0cf-4d65-b8e6-9348d91ab413\" (UID: \"d16eed6a-d0cf-4d65-b8e6-9348d91ab413\") "
May 20 19:47:53.575403 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:53.575270    2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d16eed6a-d0cf-4d65-b8e6-9348d91ab413-oauth-serving-cert\") pod \"d16eed6a-d0cf-4d65-b8e6-9348d91ab413\" (UID: \"d16eed6a-d0cf-4d65-b8e6-9348d91ab413\") "
May 20 19:47:53.575403 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:53.575298    2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d16eed6a-d0cf-4d65-b8e6-9348d91ab413-console-serving-cert\") pod \"d16eed6a-d0cf-4d65-b8e6-9348d91ab413\" (UID: \"d16eed6a-d0cf-4d65-b8e6-9348d91ab413\") "
May 20 19:47:53.575403 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:53.575325    2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d16eed6a-d0cf-4d65-b8e6-9348d91ab413-console-oauth-config\") pod \"d16eed6a-d0cf-4d65-b8e6-9348d91ab413\" (UID: \"d16eed6a-d0cf-4d65-b8e6-9348d91ab413\") "
May 20 19:47:53.575725 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:53.575695    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d16eed6a-d0cf-4d65-b8e6-9348d91ab413-console-config" (OuterVolumeSpecName: "console-config") pod "d16eed6a-d0cf-4d65-b8e6-9348d91ab413" (UID: "d16eed6a-d0cf-4d65-b8e6-9348d91ab413"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 20 19:47:53.575856 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:53.575724    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d16eed6a-d0cf-4d65-b8e6-9348d91ab413-service-ca" (OuterVolumeSpecName: "service-ca") pod "d16eed6a-d0cf-4d65-b8e6-9348d91ab413" (UID: "d16eed6a-d0cf-4d65-b8e6-9348d91ab413"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 20 19:47:53.575856 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:53.575735    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d16eed6a-d0cf-4d65-b8e6-9348d91ab413-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "d16eed6a-d0cf-4d65-b8e6-9348d91ab413" (UID: "d16eed6a-d0cf-4d65-b8e6-9348d91ab413"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 20 19:47:53.575856 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:53.575747    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d16eed6a-d0cf-4d65-b8e6-9348d91ab413-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "d16eed6a-d0cf-4d65-b8e6-9348d91ab413" (UID: "d16eed6a-d0cf-4d65-b8e6-9348d91ab413"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 20 19:47:53.577594 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:53.577554    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d16eed6a-d0cf-4d65-b8e6-9348d91ab413-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "d16eed6a-d0cf-4d65-b8e6-9348d91ab413" (UID: "d16eed6a-d0cf-4d65-b8e6-9348d91ab413"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 20 19:47:53.577594 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:53.577565    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d16eed6a-d0cf-4d65-b8e6-9348d91ab413-kube-api-access-fsm5g" (OuterVolumeSpecName: "kube-api-access-fsm5g") pod "d16eed6a-d0cf-4d65-b8e6-9348d91ab413" (UID: "d16eed6a-d0cf-4d65-b8e6-9348d91ab413"). InnerVolumeSpecName "kube-api-access-fsm5g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 20 19:47:53.577729 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:53.577652    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d16eed6a-d0cf-4d65-b8e6-9348d91ab413-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "d16eed6a-d0cf-4d65-b8e6-9348d91ab413" (UID: "d16eed6a-d0cf-4d65-b8e6-9348d91ab413"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 20 19:47:53.676384 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:53.676351    2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d16eed6a-d0cf-4d65-b8e6-9348d91ab413-oauth-serving-cert\") on node \"ip-10-0-134-167.ec2.internal\" DevicePath \"\""
May 20 19:47:53.676384 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:53.676379    2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d16eed6a-d0cf-4d65-b8e6-9348d91ab413-console-serving-cert\") on node \"ip-10-0-134-167.ec2.internal\" DevicePath \"\""
May 20 19:47:53.676384 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:53.676389    2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d16eed6a-d0cf-4d65-b8e6-9348d91ab413-console-oauth-config\") on node \"ip-10-0-134-167.ec2.internal\" DevicePath \"\""
May 20 19:47:53.676634 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:53.676398    2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d16eed6a-d0cf-4d65-b8e6-9348d91ab413-console-config\") on node \"ip-10-0-134-167.ec2.internal\" DevicePath \"\""
May 20 19:47:53.676634 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:53.676407    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fsm5g\" (UniqueName: \"kubernetes.io/projected/d16eed6a-d0cf-4d65-b8e6-9348d91ab413-kube-api-access-fsm5g\") on node \"ip-10-0-134-167.ec2.internal\" DevicePath \"\""
May 20 19:47:53.676634 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:53.676417    2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d16eed6a-d0cf-4d65-b8e6-9348d91ab413-service-ca\") on node \"ip-10-0-134-167.ec2.internal\" DevicePath \"\""
May 20 19:47:53.676634 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:53.676427    2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d16eed6a-d0cf-4d65-b8e6-9348d91ab413-trusted-ca-bundle\") on node \"ip-10-0-134-167.ec2.internal\" DevicePath \"\""
May 20 19:47:53.792705 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:53.792628    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7c7c48fd9b-qh7hw_d16eed6a-d0cf-4d65-b8e6-9348d91ab413/console/0.log"
May 20 19:47:53.792705 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:53.792668    2578 generic.go:358] "Generic (PLEG): container finished" podID="d16eed6a-d0cf-4d65-b8e6-9348d91ab413" containerID="4bc7a93a5a2ea26e6c3144650062d704712726ddb5095404077bde1c2ab937f4" exitCode=2
May 20 19:47:53.793111 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:53.792733    2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c7c48fd9b-qh7hw"
May 20 19:47:53.793111 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:53.792762    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c7c48fd9b-qh7hw" event={"ID":"d16eed6a-d0cf-4d65-b8e6-9348d91ab413","Type":"ContainerDied","Data":"4bc7a93a5a2ea26e6c3144650062d704712726ddb5095404077bde1c2ab937f4"}
May 20 19:47:53.793111 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:53.792808    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c7c48fd9b-qh7hw" event={"ID":"d16eed6a-d0cf-4d65-b8e6-9348d91ab413","Type":"ContainerDied","Data":"fdb5761bcb15a14e7cd2aed7215217bea428d668e130166d1e48910c20e76309"}
May 20 19:47:53.793111 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:53.792826    2578 scope.go:117] "RemoveContainer" containerID="4bc7a93a5a2ea26e6c3144650062d704712726ddb5095404077bde1c2ab937f4"
May 20 19:47:53.801518 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:53.801503    2578 scope.go:117] "RemoveContainer" containerID="4bc7a93a5a2ea26e6c3144650062d704712726ddb5095404077bde1c2ab937f4"
May 20 19:47:53.801791 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:47:53.801774    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4bc7a93a5a2ea26e6c3144650062d704712726ddb5095404077bde1c2ab937f4\": container with ID starting with 4bc7a93a5a2ea26e6c3144650062d704712726ddb5095404077bde1c2ab937f4 not found: ID does not exist" containerID="4bc7a93a5a2ea26e6c3144650062d704712726ddb5095404077bde1c2ab937f4"
May 20 19:47:53.801839 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:53.801801    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4bc7a93a5a2ea26e6c3144650062d704712726ddb5095404077bde1c2ab937f4"} err="failed to get container status \"4bc7a93a5a2ea26e6c3144650062d704712726ddb5095404077bde1c2ab937f4\": rpc error: code = NotFound desc = could not find container \"4bc7a93a5a2ea26e6c3144650062d704712726ddb5095404077bde1c2ab937f4\": container with ID starting with 4bc7a93a5a2ea26e6c3144650062d704712726ddb5095404077bde1c2ab937f4 not found: ID does not exist"
May 20 19:47:53.815053 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:53.815028    2578 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7c7c48fd9b-qh7hw"]
May 20 19:47:53.818951 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:53.818925    2578 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7c7c48fd9b-qh7hw"]
May 20 19:47:54.101015 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:47:54.100936    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d16eed6a-d0cf-4d65-b8e6-9348d91ab413" path="/var/lib/kubelet/pods/d16eed6a-d0cf-4d65-b8e6-9348d91ab413/volumes"
May 20 19:48:01.822970 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:48:01.822935    2578 generic.go:358] "Generic (PLEG): container finished" podID="0edc95e5-a20c-4a03-a91a-03dfa7730b2a" containerID="b59bf9b4877b7351e9096a80cedbd2f9f510da216c1d806f7d30735090932c14" exitCode=0
May 20 19:48:01.823416 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:48:01.822987    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-qg49z" event={"ID":"0edc95e5-a20c-4a03-a91a-03dfa7730b2a","Type":"ContainerDied","Data":"b59bf9b4877b7351e9096a80cedbd2f9f510da216c1d806f7d30735090932c14"}
May 20 19:48:01.823416 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:48:01.823312    2578 scope.go:117] "RemoveContainer" containerID="b59bf9b4877b7351e9096a80cedbd2f9f510da216c1d806f7d30735090932c14"
May 20 19:48:02.827463 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:48:02.827427    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-qg49z" event={"ID":"0edc95e5-a20c-4a03-a91a-03dfa7730b2a","Type":"ContainerStarted","Data":"31e1e7aafaa60a4518a6f948dd905bfbfcae452be757fb304497dce2215b551e"}
May 20 19:48:29.973644 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:48:29.973603    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8adc751e-abba-4cb1-ab06-d0c915b18a28-metrics-certs\") pod \"network-metrics-daemon-p6zpg\" (UID: \"8adc751e-abba-4cb1-ab06-d0c915b18a28\") " pod="openshift-multus/network-metrics-daemon-p6zpg"
May 20 19:48:29.976075 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:48:29.976048    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8adc751e-abba-4cb1-ab06-d0c915b18a28-metrics-certs\") pod \"network-metrics-daemon-p6zpg\" (UID: \"8adc751e-abba-4cb1-ab06-d0c915b18a28\") " pod="openshift-multus/network-metrics-daemon-p6zpg"
May 20 19:48:30.200649 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:48:30.200612    2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-f2b4p\""
May 20 19:48:30.207960 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:48:30.207934    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p6zpg"
May 20 19:48:30.337635 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:48:30.337598    2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-p6zpg"]
May 20 19:48:30.342151 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:48:30.342126    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8adc751e_abba_4cb1_ab06_d0c915b18a28.slice/crio-7da05273c26ae790781077beea2c5294cdfda465d4294213703202b87713a1bf WatchSource:0}: Error finding container 7da05273c26ae790781077beea2c5294cdfda465d4294213703202b87713a1bf: Status 404 returned error can't find the container with id 7da05273c26ae790781077beea2c5294cdfda465d4294213703202b87713a1bf
May 20 19:48:30.906904 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:48:30.906816    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-p6zpg" event={"ID":"8adc751e-abba-4cb1-ab06-d0c915b18a28","Type":"ContainerStarted","Data":"7da05273c26ae790781077beea2c5294cdfda465d4294213703202b87713a1bf"}
May 20 19:48:31.911884 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:48:31.911844    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-p6zpg" event={"ID":"8adc751e-abba-4cb1-ab06-d0c915b18a28","Type":"ContainerStarted","Data":"902e05346dc9fa19c2e3a58ad8a2dd54ebfc3fed769cee6d85d47761efed9ae8"}
May 20 19:48:31.911884 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:48:31.911890    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-p6zpg" event={"ID":"8adc751e-abba-4cb1-ab06-d0c915b18a28","Type":"ContainerStarted","Data":"e647193a7cbda677d0b937bc6686e561676b63af4a23d81ee2c55105c1d295a7"}
May 20 19:48:31.928746 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:48:31.928688    2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-p6zpg" podStartSLOduration=252.975808377 podStartE2EDuration="4m13.928672698s" podCreationTimestamp="2026-05-20 19:44:18 +0000 UTC" firstStartedPulling="2026-05-20 19:48:30.343883856 +0000 UTC m=+252.792432688" lastFinishedPulling="2026-05-20 19:48:31.296748164 +0000 UTC m=+253.745297009" observedRunningTime="2026-05-20 19:48:31.92746834 +0000 UTC m=+254.376017195" watchObservedRunningTime="2026-05-20 19:48:31.928672698 +0000 UTC m=+254.377221573"
May 20 19:48:49.645270 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:48:49.645225    2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-9854f5658-dkbbm"]
May 20 19:48:49.645866 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:48:49.645659    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d16eed6a-d0cf-4d65-b8e6-9348d91ab413" containerName="console"
May 20 19:48:49.645866 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:48:49.645676    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="d16eed6a-d0cf-4d65-b8e6-9348d91ab413" containerName="console"
May 20 19:48:49.645866 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:48:49.645702    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3aa65265-bdd9-4d27-9b43-5b4de9961d45" containerName="console"
May 20 19:48:49.645866 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:48:49.645712    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="3aa65265-bdd9-4d27-9b43-5b4de9961d45" containerName="console"
May 20 19:48:49.645866 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:48:49.645801    2578 memory_manager.go:356] "RemoveStaleState removing state" podUID="d16eed6a-d0cf-4d65-b8e6-9348d91ab413" containerName="console"
May 20 19:48:49.645866 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:48:49.645813    2578 memory_manager.go:356] "RemoveStaleState removing state" podUID="3aa65265-bdd9-4d27-9b43-5b4de9961d45" containerName="console"
May 20 19:48:49.647852 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:48:49.647832    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9854f5658-dkbbm"
May 20 19:48:49.658181 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:48:49.658149    2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-9854f5658-dkbbm"]
May 20 19:48:49.732967 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:48:49.732927    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lcfv7\" (UniqueName: \"kubernetes.io/projected/db7699a5-a474-4a1e-a8af-ca5cb13f67b0-kube-api-access-lcfv7\") pod \"console-9854f5658-dkbbm\" (UID: \"db7699a5-a474-4a1e-a8af-ca5cb13f67b0\") " pod="openshift-console/console-9854f5658-dkbbm"
May 20 19:48:49.733158 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:48:49.732977    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/db7699a5-a474-4a1e-a8af-ca5cb13f67b0-console-serving-cert\") pod \"console-9854f5658-dkbbm\" (UID: \"db7699a5-a474-4a1e-a8af-ca5cb13f67b0\") " pod="openshift-console/console-9854f5658-dkbbm"
May 20 19:48:49.733158 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:48:49.732998    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/db7699a5-a474-4a1e-a8af-ca5cb13f67b0-console-oauth-config\") pod \"console-9854f5658-dkbbm\" (UID: \"db7699a5-a474-4a1e-a8af-ca5cb13f67b0\") " pod="openshift-console/console-9854f5658-dkbbm"
May 20 19:48:49.733158 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:48:49.733031    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/db7699a5-a474-4a1e-a8af-ca5cb13f67b0-console-config\") pod \"console-9854f5658-dkbbm\" (UID: \"db7699a5-a474-4a1e-a8af-ca5cb13f67b0\") " pod="openshift-console/console-9854f5658-dkbbm"
May 20 19:48:49.733158 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:48:49.733071    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/db7699a5-a474-4a1e-a8af-ca5cb13f67b0-service-ca\") pod \"console-9854f5658-dkbbm\" (UID: \"db7699a5-a474-4a1e-a8af-ca5cb13f67b0\") " pod="openshift-console/console-9854f5658-dkbbm"
May 20 19:48:49.733158 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:48:49.733100    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/db7699a5-a474-4a1e-a8af-ca5cb13f67b0-trusted-ca-bundle\") pod \"console-9854f5658-dkbbm\" (UID: \"db7699a5-a474-4a1e-a8af-ca5cb13f67b0\") " pod="openshift-console/console-9854f5658-dkbbm"
May 20 19:48:49.733158 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:48:49.733123    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/db7699a5-a474-4a1e-a8af-ca5cb13f67b0-oauth-serving-cert\") pod \"console-9854f5658-dkbbm\" (UID: \"db7699a5-a474-4a1e-a8af-ca5cb13f67b0\") " pod="openshift-console/console-9854f5658-dkbbm"
May 20 19:48:49.834278 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:48:49.834236    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/db7699a5-a474-4a1e-a8af-ca5cb13f67b0-service-ca\") pod \"console-9854f5658-dkbbm\" (UID: \"db7699a5-a474-4a1e-a8af-ca5cb13f67b0\") " pod="openshift-console/console-9854f5658-dkbbm"
May 20 19:48:49.834453 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:48:49.834288    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/db7699a5-a474-4a1e-a8af-ca5cb13f67b0-trusted-ca-bundle\") pod \"console-9854f5658-dkbbm\" (UID: \"db7699a5-a474-4a1e-a8af-ca5cb13f67b0\") " pod="openshift-console/console-9854f5658-dkbbm"
May 20 19:48:49.834453 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:48:49.834410    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/db7699a5-a474-4a1e-a8af-ca5cb13f67b0-oauth-serving-cert\") pod \"console-9854f5658-dkbbm\" (UID: \"db7699a5-a474-4a1e-a8af-ca5cb13f67b0\") " pod="openshift-console/console-9854f5658-dkbbm"
May 20 19:48:49.834537 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:48:49.834513    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lcfv7\" (UniqueName: \"kubernetes.io/projected/db7699a5-a474-4a1e-a8af-ca5cb13f67b0-kube-api-access-lcfv7\") pod \"console-9854f5658-dkbbm\" (UID: \"db7699a5-a474-4a1e-a8af-ca5cb13f67b0\") " pod="openshift-console/console-9854f5658-dkbbm"
May 20 19:48:49.834613 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:48:49.834546    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/db7699a5-a474-4a1e-a8af-ca5cb13f67b0-console-serving-cert\") pod \"console-9854f5658-dkbbm\" (UID: \"db7699a5-a474-4a1e-a8af-ca5cb13f67b0\") " pod="openshift-console/console-9854f5658-dkbbm"
May 20 19:48:49.834613 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:48:49.834576    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/db7699a5-a474-4a1e-a8af-ca5cb13f67b0-console-oauth-config\") pod \"console-9854f5658-dkbbm\" (UID: \"db7699a5-a474-4a1e-a8af-ca5cb13f67b0\") " pod="openshift-console/console-9854f5658-dkbbm"
May 20 19:48:49.834957 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:48:49.834926    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/db7699a5-a474-4a1e-a8af-ca5cb13f67b0-console-config\") pod \"console-9854f5658-dkbbm\" (UID: \"db7699a5-a474-4a1e-a8af-ca5cb13f67b0\") " pod="openshift-console/console-9854f5658-dkbbm"
May 20 19:48:49.835147 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:48:49.835125    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/db7699a5-a474-4a1e-a8af-ca5cb13f67b0-service-ca\") pod \"console-9854f5658-dkbbm\" (UID: \"db7699a5-a474-4a1e-a8af-ca5cb13f67b0\") " pod="openshift-console/console-9854f5658-dkbbm"
May 20 19:48:49.835207 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:48:49.835150    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/db7699a5-a474-4a1e-a8af-ca5cb13f67b0-oauth-serving-cert\") pod \"console-9854f5658-dkbbm\" (UID: \"db7699a5-a474-4a1e-a8af-ca5cb13f67b0\") " pod="openshift-console/console-9854f5658-dkbbm"
May 20 19:48:49.835207 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:48:49.835159    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/db7699a5-a474-4a1e-a8af-ca5cb13f67b0-trusted-ca-bundle\") pod \"console-9854f5658-dkbbm\" (UID: \"db7699a5-a474-4a1e-a8af-ca5cb13f67b0\") " pod="openshift-console/console-9854f5658-dkbbm"
May 20 19:48:49.835529 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:48:49.835471    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/db7699a5-a474-4a1e-a8af-ca5cb13f67b0-console-config\") pod \"console-9854f5658-dkbbm\" (UID: \"db7699a5-a474-4a1e-a8af-ca5cb13f67b0\") " pod="openshift-console/console-9854f5658-dkbbm"
May 20 19:48:49.837229 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:48:49.837211    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/db7699a5-a474-4a1e-a8af-ca5cb13f67b0-console-serving-cert\") pod \"console-9854f5658-dkbbm\" (UID: \"db7699a5-a474-4a1e-a8af-ca5cb13f67b0\") " pod="openshift-console/console-9854f5658-dkbbm"
May 20 19:48:49.837323 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:48:49.837310    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/db7699a5-a474-4a1e-a8af-ca5cb13f67b0-console-oauth-config\") pod \"console-9854f5658-dkbbm\" (UID: \"db7699a5-a474-4a1e-a8af-ca5cb13f67b0\") " pod="openshift-console/console-9854f5658-dkbbm"
May 20 19:48:49.843223 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:48:49.843191    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lcfv7\" (UniqueName: \"kubernetes.io/projected/db7699a5-a474-4a1e-a8af-ca5cb13f67b0-kube-api-access-lcfv7\") pod \"console-9854f5658-dkbbm\" (UID: \"db7699a5-a474-4a1e-a8af-ca5cb13f67b0\") " pod="openshift-console/console-9854f5658-dkbbm"
May 20 19:48:49.958285 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:48:49.958206    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9854f5658-dkbbm"
May 20 19:48:50.112715 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:48:50.112691    2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-9854f5658-dkbbm"]
May 20 19:48:50.115292 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:48:50.115254    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb7699a5_a474_4a1e_a8af_ca5cb13f67b0.slice/crio-fff763fe29ad389dfa32dcdb9e7e8b9a55c21b94763f3ae98c9230f52644cf67 WatchSource:0}: Error finding container fff763fe29ad389dfa32dcdb9e7e8b9a55c21b94763f3ae98c9230f52644cf67: Status 404 returned error can't find the container with id fff763fe29ad389dfa32dcdb9e7e8b9a55c21b94763f3ae98c9230f52644cf67
May 20 19:48:50.967920 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:48:50.967881    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9854f5658-dkbbm" event={"ID":"db7699a5-a474-4a1e-a8af-ca5cb13f67b0","Type":"ContainerStarted","Data":"16dde8293ae09d2380fe1647d0c4ce1bac410e75bf93b785d40fcbd196a86339"}
May 20 19:48:50.967920 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:48:50.967917    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9854f5658-dkbbm" event={"ID":"db7699a5-a474-4a1e-a8af-ca5cb13f67b0","Type":"ContainerStarted","Data":"fff763fe29ad389dfa32dcdb9e7e8b9a55c21b94763f3ae98c9230f52644cf67"}
May 20 19:48:50.983955 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:48:50.983899    2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-9854f5658-dkbbm" podStartSLOduration=1.98388557 podStartE2EDuration="1.98388557s" podCreationTimestamp="2026-05-20 19:48:49 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-20 19:48:50.983173826 +0000 UTC m=+273.431722680" watchObservedRunningTime="2026-05-20 19:48:50.98388557 +0000 UTC m=+273.432434424"
May 20 19:48:59.958652 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:48:59.958577    2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-9854f5658-dkbbm"
May 20 19:48:59.958652 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:48:59.958659    2578 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-9854f5658-dkbbm"
May 20 19:48:59.964406 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:48:59.964375    2578 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-9854f5658-dkbbm"
May 20 19:48:59.998262 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:48:59.998235    2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-9854f5658-dkbbm"
May 20 19:49:00.043110 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:49:00.043076    2578 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-b6cf879cc-jqnn9"]
May 20 19:49:17.989171 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:49:17.989141    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8nrkk_3bb0c612-bb6f-4213-a7d8-88534ba9e6ee/ovn-acl-logging/0.log"
May 20 19:49:17.989675 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:49:17.989405    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8nrkk_3bb0c612-bb6f-4213-a7d8-88534ba9e6ee/ovn-acl-logging/0.log"
May 20 19:49:21.332779 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:49:21.332741    2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-sjvdr"]
May 20 19:49:21.334637 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:49:21.334621    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sjvdr"
May 20 19:49:21.336722 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:49:21.336696    2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
May 20 19:49:21.342477 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:49:21.342445    2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-sjvdr"]
May 20 19:49:21.497856 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:49:21.497813    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/16af1a4f-77e8-4350-a543-635b06eec283-dbus\") pod \"global-pull-secret-syncer-sjvdr\" (UID: \"16af1a4f-77e8-4350-a543-635b06eec283\") " pod="kube-system/global-pull-secret-syncer-sjvdr"
May 20 19:49:21.498060 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:49:21.497863    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/16af1a4f-77e8-4350-a543-635b06eec283-original-pull-secret\") pod \"global-pull-secret-syncer-sjvdr\" (UID: \"16af1a4f-77e8-4350-a543-635b06eec283\") " pod="kube-system/global-pull-secret-syncer-sjvdr"
May 20 19:49:21.498060 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:49:21.497955    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/16af1a4f-77e8-4350-a543-635b06eec283-kubelet-config\") pod \"global-pull-secret-syncer-sjvdr\" (UID: \"16af1a4f-77e8-4350-a543-635b06eec283\") " pod="kube-system/global-pull-secret-syncer-sjvdr"
May 20 19:49:21.599020 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:49:21.598917    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/16af1a4f-77e8-4350-a543-635b06eec283-kubelet-config\") pod \"global-pull-secret-syncer-sjvdr\" (UID: \"16af1a4f-77e8-4350-a543-635b06eec283\") " pod="kube-system/global-pull-secret-syncer-sjvdr"
May 20 19:49:21.599204 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:49:21.599025    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/16af1a4f-77e8-4350-a543-635b06eec283-dbus\") pod \"global-pull-secret-syncer-sjvdr\" (UID: \"16af1a4f-77e8-4350-a543-635b06eec283\") " pod="kube-system/global-pull-secret-syncer-sjvdr"
May 20 19:49:21.599204 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:49:21.599048    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/16af1a4f-77e8-4350-a543-635b06eec283-kubelet-config\") pod \"global-pull-secret-syncer-sjvdr\" (UID: \"16af1a4f-77e8-4350-a543-635b06eec283\") " pod="kube-system/global-pull-secret-syncer-sjvdr"
May 20 19:49:21.599204 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:49:21.599055    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/16af1a4f-77e8-4350-a543-635b06eec283-original-pull-secret\") pod \"global-pull-secret-syncer-sjvdr\" (UID: \"16af1a4f-77e8-4350-a543-635b06eec283\") " pod="kube-system/global-pull-secret-syncer-sjvdr"
May 20 19:49:21.599363 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:49:21.599213    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/16af1a4f-77e8-4350-a543-635b06eec283-dbus\") pod \"global-pull-secret-syncer-sjvdr\" (UID: \"16af1a4f-77e8-4350-a543-635b06eec283\") " pod="kube-system/global-pull-secret-syncer-sjvdr"
May 20 19:49:21.601465 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:49:21.601445    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/16af1a4f-77e8-4350-a543-635b06eec283-original-pull-secret\") pod \"global-pull-secret-syncer-sjvdr\" (UID: \"16af1a4f-77e8-4350-a543-635b06eec283\") " pod="kube-system/global-pull-secret-syncer-sjvdr"
May 20 19:49:21.643606 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:49:21.643534    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sjvdr"
May 20 19:49:21.770449 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:49:21.770417    2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-sjvdr"]
May 20 19:49:21.773458 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:49:21.773433    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16af1a4f_77e8_4350_a543_635b06eec283.slice/crio-bcc3ecef55b9e8f8492a7414c3f01ec932456aa263534c7e2a82b4700a96eb8d WatchSource:0}: Error finding container bcc3ecef55b9e8f8492a7414c3f01ec932456aa263534c7e2a82b4700a96eb8d: Status 404 returned error can't find the container with id bcc3ecef55b9e8f8492a7414c3f01ec932456aa263534c7e2a82b4700a96eb8d
May 20 19:49:21.775010 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:49:21.774993    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 20 19:49:22.051553 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:49:22.051520    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-sjvdr" event={"ID":"16af1a4f-77e8-4350-a543-635b06eec283","Type":"ContainerStarted","Data":"bcc3ecef55b9e8f8492a7414c3f01ec932456aa263534c7e2a82b4700a96eb8d"}
May 20 19:49:25.068494 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:49:25.068423    2578 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-b6cf879cc-jqnn9" podUID="26ef8d4e-e0e9-4bba-82dd-419cbd131f56" containerName="console" containerID="cri-o://e62eb29141267ba8214900295c04c8504441f88fc6011ef3f31af49155cf13b0" gracePeriod=15
May 20 19:49:26.285601 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:49:26.285557    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-b6cf879cc-jqnn9_26ef8d4e-e0e9-4bba-82dd-419cbd131f56/console/0.log"
May 20 19:49:26.285900 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:49:26.285667    2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b6cf879cc-jqnn9"
May 20 19:49:26.440298 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:49:26.440195    2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/26ef8d4e-e0e9-4bba-82dd-419cbd131f56-console-oauth-config\") pod \"26ef8d4e-e0e9-4bba-82dd-419cbd131f56\" (UID: \"26ef8d4e-e0e9-4bba-82dd-419cbd131f56\") "
May 20 19:49:26.440298 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:49:26.440248    2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/26ef8d4e-e0e9-4bba-82dd-419cbd131f56-service-ca\") pod \"26ef8d4e-e0e9-4bba-82dd-419cbd131f56\" (UID: \"26ef8d4e-e0e9-4bba-82dd-419cbd131f56\") "
May 20 19:49:26.440298 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:49:26.440275    2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/26ef8d4e-e0e9-4bba-82dd-419cbd131f56-console-serving-cert\") pod \"26ef8d4e-e0e9-4bba-82dd-419cbd131f56\" (UID: \"26ef8d4e-e0e9-4bba-82dd-419cbd131f56\") "
May 20 19:49:26.440298 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:49:26.440297    2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/26ef8d4e-e0e9-4bba-82dd-419cbd131f56-console-config\") pod \"26ef8d4e-e0e9-4bba-82dd-419cbd131f56\" (UID: \"26ef8d4e-e0e9-4bba-82dd-419cbd131f56\") "
May 20 19:49:26.440666 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:49:26.440336    2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/26ef8d4e-e0e9-4bba-82dd-419cbd131f56-trusted-ca-bundle\") pod \"26ef8d4e-e0e9-4bba-82dd-419cbd131f56\" (UID: \"26ef8d4e-e0e9-4bba-82dd-419cbd131f56\") "
May 20 19:49:26.440666 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:49:26.440391    2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/26ef8d4e-e0e9-4bba-82dd-419cbd131f56-oauth-serving-cert\") pod \"26ef8d4e-e0e9-4bba-82dd-419cbd131f56\" (UID: \"26ef8d4e-e0e9-4bba-82dd-419cbd131f56\") "
May 20 19:49:26.440666 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:49:26.440424    2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w7826\" (UniqueName: \"kubernetes.io/projected/26ef8d4e-e0e9-4bba-82dd-419cbd131f56-kube-api-access-w7826\") pod \"26ef8d4e-e0e9-4bba-82dd-419cbd131f56\" (UID: \"26ef8d4e-e0e9-4bba-82dd-419cbd131f56\") "
May 20 19:49:26.440813 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:49:26.440705    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/26ef8d4e-e0e9-4bba-82dd-419cbd131f56-service-ca" (OuterVolumeSpecName: "service-ca") pod "26ef8d4e-e0e9-4bba-82dd-419cbd131f56" (UID: "26ef8d4e-e0e9-4bba-82dd-419cbd131f56"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 20 19:49:26.440813 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:49:26.440719    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/26ef8d4e-e0e9-4bba-82dd-419cbd131f56-console-config" (OuterVolumeSpecName: "console-config") pod "26ef8d4e-e0e9-4bba-82dd-419cbd131f56" (UID: "26ef8d4e-e0e9-4bba-82dd-419cbd131f56"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 20 19:49:26.440813 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:49:26.440743    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/26ef8d4e-e0e9-4bba-82dd-419cbd131f56-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "26ef8d4e-e0e9-4bba-82dd-419cbd131f56" (UID: "26ef8d4e-e0e9-4bba-82dd-419cbd131f56"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 20 19:49:26.441003 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:49:26.440969    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/26ef8d4e-e0e9-4bba-82dd-419cbd131f56-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "26ef8d4e-e0e9-4bba-82dd-419cbd131f56" (UID: "26ef8d4e-e0e9-4bba-82dd-419cbd131f56"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 20 19:49:26.442731 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:49:26.442709    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/26ef8d4e-e0e9-4bba-82dd-419cbd131f56-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "26ef8d4e-e0e9-4bba-82dd-419cbd131f56" (UID: "26ef8d4e-e0e9-4bba-82dd-419cbd131f56"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 20 19:49:26.442890 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:49:26.442823    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/26ef8d4e-e0e9-4bba-82dd-419cbd131f56-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "26ef8d4e-e0e9-4bba-82dd-419cbd131f56" (UID: "26ef8d4e-e0e9-4bba-82dd-419cbd131f56"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 20 19:49:26.443052 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:49:26.443033    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/26ef8d4e-e0e9-4bba-82dd-419cbd131f56-kube-api-access-w7826" (OuterVolumeSpecName: "kube-api-access-w7826") pod "26ef8d4e-e0e9-4bba-82dd-419cbd131f56" (UID: "26ef8d4e-e0e9-4bba-82dd-419cbd131f56"). InnerVolumeSpecName "kube-api-access-w7826". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 20 19:49:26.541429 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:49:26.541395    2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/26ef8d4e-e0e9-4bba-82dd-419cbd131f56-console-oauth-config\") on node \"ip-10-0-134-167.ec2.internal\" DevicePath \"\""
May 20 19:49:26.541429 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:49:26.541423    2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/26ef8d4e-e0e9-4bba-82dd-419cbd131f56-service-ca\") on node \"ip-10-0-134-167.ec2.internal\" DevicePath \"\""
May 20 19:49:26.541429 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:49:26.541433    2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/26ef8d4e-e0e9-4bba-82dd-419cbd131f56-console-serving-cert\") on node \"ip-10-0-134-167.ec2.internal\" DevicePath \"\""
May 20 19:49:26.541679 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:49:26.541442    2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/26ef8d4e-e0e9-4bba-82dd-419cbd131f56-console-config\") on node \"ip-10-0-134-167.ec2.internal\" DevicePath \"\""
May 20 19:49:26.541679 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:49:26.541452    2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/26ef8d4e-e0e9-4bba-82dd-419cbd131f56-trusted-ca-bundle\") on node \"ip-10-0-134-167.ec2.internal\" DevicePath \"\""
May 20 19:49:26.541679 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:49:26.541461    2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/26ef8d4e-e0e9-4bba-82dd-419cbd131f56-oauth-serving-cert\") on node \"ip-10-0-134-167.ec2.internal\" DevicePath \"\""
May 20 19:49:26.541679 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:49:26.541469    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w7826\" (UniqueName: \"kubernetes.io/projected/26ef8d4e-e0e9-4bba-82dd-419cbd131f56-kube-api-access-w7826\") on node \"ip-10-0-134-167.ec2.internal\" DevicePath \"\""
May 20 19:49:27.067080 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:49:27.067053    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-b6cf879cc-jqnn9_26ef8d4e-e0e9-4bba-82dd-419cbd131f56/console/0.log"
May 20 19:49:27.067262 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:49:27.067092    2578 generic.go:358] "Generic (PLEG): container finished" podID="26ef8d4e-e0e9-4bba-82dd-419cbd131f56" containerID="e62eb29141267ba8214900295c04c8504441f88fc6011ef3f31af49155cf13b0" exitCode=2
May 20 19:49:27.067262 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:49:27.067127    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b6cf879cc-jqnn9" event={"ID":"26ef8d4e-e0e9-4bba-82dd-419cbd131f56","Type":"ContainerDied","Data":"e62eb29141267ba8214900295c04c8504441f88fc6011ef3f31af49155cf13b0"}
May 20 19:49:27.067262 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:49:27.067159    2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b6cf879cc-jqnn9"
May 20 19:49:27.067262 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:49:27.067177    2578 scope.go:117] "RemoveContainer" containerID="e62eb29141267ba8214900295c04c8504441f88fc6011ef3f31af49155cf13b0"
May 20 19:49:27.067262 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:49:27.067164    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b6cf879cc-jqnn9" event={"ID":"26ef8d4e-e0e9-4bba-82dd-419cbd131f56","Type":"ContainerDied","Data":"12c022bb434f6fa97c2ed387e23ca2bd1d738eefa265c242900c332a3edeb5ae"}
May 20 19:49:27.068540 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:49:27.068511    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-sjvdr" event={"ID":"16af1a4f-77e8-4350-a543-635b06eec283","Type":"ContainerStarted","Data":"12841cd61bdb915aec5ddb9bc1b9de42c2d8a3c9570dbe111730f9d4af7e4327"}
May 20 19:49:27.076014 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:49:27.075994    2578 scope.go:117] "RemoveContainer" containerID="e62eb29141267ba8214900295c04c8504441f88fc6011ef3f31af49155cf13b0"
May 20 19:49:27.076260 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:49:27.076242    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e62eb29141267ba8214900295c04c8504441f88fc6011ef3f31af49155cf13b0\": container with ID starting with e62eb29141267ba8214900295c04c8504441f88fc6011ef3f31af49155cf13b0 not found: ID does not exist" containerID="e62eb29141267ba8214900295c04c8504441f88fc6011ef3f31af49155cf13b0"
May 20 19:49:27.076310 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:49:27.076267    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e62eb29141267ba8214900295c04c8504441f88fc6011ef3f31af49155cf13b0"} err="failed to get container status \"e62eb29141267ba8214900295c04c8504441f88fc6011ef3f31af49155cf13b0\": rpc error: code = NotFound desc = could not find container \"e62eb29141267ba8214900295c04c8504441f88fc6011ef3f31af49155cf13b0\": container with ID starting with e62eb29141267ba8214900295c04c8504441f88fc6011ef3f31af49155cf13b0 not found: ID does not exist"
May 20 19:49:27.086301 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:49:27.086258    2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-sjvdr" podStartSLOduration=1.687481834 podStartE2EDuration="6.086247099s" podCreationTimestamp="2026-05-20 19:49:21 +0000 UTC" firstStartedPulling="2026-05-20 19:49:21.775146894 +0000 UTC m=+304.223695726" lastFinishedPulling="2026-05-20 19:49:26.173912155 +0000 UTC m=+308.622460991" observedRunningTime="2026-05-20 19:49:27.08465896 +0000 UTC m=+309.533207814" watchObservedRunningTime="2026-05-20 19:49:27.086247099 +0000 UTC m=+309.534795952"
May 20 19:49:27.097681 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:49:27.097662    2578 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-b6cf879cc-jqnn9"]
May 20 19:49:27.100859 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:49:27.100827    2578 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-b6cf879cc-jqnn9"]
May 20 19:49:28.099738 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:49:28.099705    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="26ef8d4e-e0e9-4bba-82dd-419cbd131f56" path="/var/lib/kubelet/pods/26ef8d4e-e0e9-4bba-82dd-419cbd131f56/volumes"
May 20 19:51:41.180668 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:51:41.180567    2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dtdgd4"]
May 20 19:51:41.181103 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:51:41.180901    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26ef8d4e-e0e9-4bba-82dd-419cbd131f56" containerName="console"
May 20 19:51:41.181103 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:51:41.180913    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="26ef8d4e-e0e9-4bba-82dd-419cbd131f56" containerName="console"
May 20 19:51:41.181103 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:51:41.180973    2578 memory_manager.go:356] "RemoveStaleState removing state" podUID="26ef8d4e-e0e9-4bba-82dd-419cbd131f56" containerName="console"
May 20 19:51:41.183984 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:51:41.183968    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dtdgd4"
May 20 19:51:41.186460 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:51:41.186441    2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-5p7qv\""
May 20 19:51:41.186460 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:51:41.186453    2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
May 20 19:51:41.187469 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:51:41.187445    2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
May 20 19:51:41.202805 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:51:41.202781    2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dtdgd4"]
May 20 19:51:41.301080 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:51:41.301045    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f8769127-c183-47bb-9117-b0ea31df8089-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dtdgd4\" (UID: \"f8769127-c183-47bb-9117-b0ea31df8089\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dtdgd4"
May 20 19:51:41.301080 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:51:41.301085    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hhmql\" (UniqueName: \"kubernetes.io/projected/f8769127-c183-47bb-9117-b0ea31df8089-kube-api-access-hhmql\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dtdgd4\" (UID: \"f8769127-c183-47bb-9117-b0ea31df8089\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dtdgd4"
May 20 19:51:41.301301 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:51:41.301167    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f8769127-c183-47bb-9117-b0ea31df8089-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dtdgd4\" (UID: \"f8769127-c183-47bb-9117-b0ea31df8089\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dtdgd4"
May 20 19:51:41.402518 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:51:41.402477    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f8769127-c183-47bb-9117-b0ea31df8089-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dtdgd4\" (UID: \"f8769127-c183-47bb-9117-b0ea31df8089\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dtdgd4"
May 20 19:51:41.402735 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:51:41.402567    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f8769127-c183-47bb-9117-b0ea31df8089-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dtdgd4\" (UID: \"f8769127-c183-47bb-9117-b0ea31df8089\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dtdgd4"
May 20 19:51:41.402735 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:51:41.402621    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hhmql\" (UniqueName: \"kubernetes.io/projected/f8769127-c183-47bb-9117-b0ea31df8089-kube-api-access-hhmql\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dtdgd4\" (UID: \"f8769127-c183-47bb-9117-b0ea31df8089\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dtdgd4"
May 20 19:51:41.402973 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:51:41.402944    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f8769127-c183-47bb-9117-b0ea31df8089-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dtdgd4\" (UID: \"f8769127-c183-47bb-9117-b0ea31df8089\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dtdgd4"
May 20 19:51:41.403044 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:51:41.402956    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f8769127-c183-47bb-9117-b0ea31df8089-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dtdgd4\" (UID: \"f8769127-c183-47bb-9117-b0ea31df8089\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dtdgd4"
May 20 19:51:41.411623 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:51:41.411572    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hhmql\" (UniqueName: \"kubernetes.io/projected/f8769127-c183-47bb-9117-b0ea31df8089-kube-api-access-hhmql\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dtdgd4\" (UID: \"f8769127-c183-47bb-9117-b0ea31df8089\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dtdgd4"
May 20 19:51:41.493357 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:51:41.493262    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dtdgd4"
May 20 19:51:41.620005 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:51:41.619977    2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dtdgd4"]
May 20 19:51:41.624280 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:51:41.624252    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8769127_c183_47bb_9117_b0ea31df8089.slice/crio-b63e1b033d54dc983f2530651edce035079f47cf6a5feb493031eebb681345a9 WatchSource:0}: Error finding container b63e1b033d54dc983f2530651edce035079f47cf6a5feb493031eebb681345a9: Status 404 returned error can't find the container with id b63e1b033d54dc983f2530651edce035079f47cf6a5feb493031eebb681345a9
May 20 19:51:42.447049 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:51:42.447010    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dtdgd4" event={"ID":"f8769127-c183-47bb-9117-b0ea31df8089","Type":"ContainerStarted","Data":"b63e1b033d54dc983f2530651edce035079f47cf6a5feb493031eebb681345a9"}
May 20 19:51:48.466044 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:51:48.466006    2578 generic.go:358] "Generic (PLEG): container finished" podID="f8769127-c183-47bb-9117-b0ea31df8089" containerID="59ba91fb84f90ded23a03d7e8efe159120a6258210cb4eaec9c54ec882e7597d" exitCode=0
May 20 19:51:48.466436 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:51:48.466093    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dtdgd4" event={"ID":"f8769127-c183-47bb-9117-b0ea31df8089","Type":"ContainerDied","Data":"59ba91fb84f90ded23a03d7e8efe159120a6258210cb4eaec9c54ec882e7597d"}
May 20 19:51:51.477080 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:51:51.477040    2578 generic.go:358] "Generic (PLEG): container finished" podID="f8769127-c183-47bb-9117-b0ea31df8089" containerID="195805613c73ee7f5a1d9916dac708c0ef0006b316e9746850a613c03251d29d" exitCode=0
May 20 19:51:51.477477 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:51:51.477131    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dtdgd4" event={"ID":"f8769127-c183-47bb-9117-b0ea31df8089","Type":"ContainerDied","Data":"195805613c73ee7f5a1d9916dac708c0ef0006b316e9746850a613c03251d29d"}
May 20 19:51:58.499538 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:51:58.499458    2578 generic.go:358] "Generic (PLEG): container finished" podID="f8769127-c183-47bb-9117-b0ea31df8089" containerID="169512da17f927ffd8f5dfdf298a860c4c8080f9a1bc6cb5bee8577c48561d19" exitCode=0
May 20 19:51:58.499538 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:51:58.499502    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dtdgd4" event={"ID":"f8769127-c183-47bb-9117-b0ea31df8089","Type":"ContainerDied","Data":"169512da17f927ffd8f5dfdf298a860c4c8080f9a1bc6cb5bee8577c48561d19"}
May 20 19:51:59.630221 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:51:59.630191    2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dtdgd4"
May 20 19:51:59.649605 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:51:59.649565    2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hhmql\" (UniqueName: \"kubernetes.io/projected/f8769127-c183-47bb-9117-b0ea31df8089-kube-api-access-hhmql\") pod \"f8769127-c183-47bb-9117-b0ea31df8089\" (UID: \"f8769127-c183-47bb-9117-b0ea31df8089\") "
May 20 19:51:59.649733 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:51:59.649628    2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f8769127-c183-47bb-9117-b0ea31df8089-util\") pod \"f8769127-c183-47bb-9117-b0ea31df8089\" (UID: \"f8769127-c183-47bb-9117-b0ea31df8089\") "
May 20 19:51:59.649733 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:51:59.649659    2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f8769127-c183-47bb-9117-b0ea31df8089-bundle\") pod \"f8769127-c183-47bb-9117-b0ea31df8089\" (UID: \"f8769127-c183-47bb-9117-b0ea31df8089\") "
May 20 19:51:59.650366 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:51:59.650339    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f8769127-c183-47bb-9117-b0ea31df8089-bundle" (OuterVolumeSpecName: "bundle") pod "f8769127-c183-47bb-9117-b0ea31df8089" (UID: "f8769127-c183-47bb-9117-b0ea31df8089"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 20 19:51:59.651966 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:51:59.651942    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f8769127-c183-47bb-9117-b0ea31df8089-kube-api-access-hhmql" (OuterVolumeSpecName: "kube-api-access-hhmql") pod "f8769127-c183-47bb-9117-b0ea31df8089" (UID: "f8769127-c183-47bb-9117-b0ea31df8089"). InnerVolumeSpecName "kube-api-access-hhmql". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 20 19:51:59.654684 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:51:59.654659    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f8769127-c183-47bb-9117-b0ea31df8089-util" (OuterVolumeSpecName: "util") pod "f8769127-c183-47bb-9117-b0ea31df8089" (UID: "f8769127-c183-47bb-9117-b0ea31df8089"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 20 19:51:59.750506 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:51:59.750470    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hhmql\" (UniqueName: \"kubernetes.io/projected/f8769127-c183-47bb-9117-b0ea31df8089-kube-api-access-hhmql\") on node \"ip-10-0-134-167.ec2.internal\" DevicePath \"\""
May 20 19:51:59.750506 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:51:59.750498    2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f8769127-c183-47bb-9117-b0ea31df8089-util\") on node \"ip-10-0-134-167.ec2.internal\" DevicePath \"\""
May 20 19:51:59.750506 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:51:59.750508    2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f8769127-c183-47bb-9117-b0ea31df8089-bundle\") on node \"ip-10-0-134-167.ec2.internal\" DevicePath \"\""
May 20 19:52:00.507142 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:00.507106    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dtdgd4" event={"ID":"f8769127-c183-47bb-9117-b0ea31df8089","Type":"ContainerDied","Data":"b63e1b033d54dc983f2530651edce035079f47cf6a5feb493031eebb681345a9"}
May 20 19:52:00.507142 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:00.507138    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b63e1b033d54dc983f2530651edce035079f47cf6a5feb493031eebb681345a9"
May 20 19:52:00.507142 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:00.507136    2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dtdgd4"
May 20 19:52:04.150725 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:04.150694    2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-tdzlp"]
May 20 19:52:04.151063 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:04.150980    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f8769127-c183-47bb-9117-b0ea31df8089" containerName="extract"
May 20 19:52:04.151063 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:04.150991    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8769127-c183-47bb-9117-b0ea31df8089" containerName="extract"
May 20 19:52:04.151063 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:04.151009    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f8769127-c183-47bb-9117-b0ea31df8089" containerName="pull"
May 20 19:52:04.151063 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:04.151014    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8769127-c183-47bb-9117-b0ea31df8089" containerName="pull"
May 20 19:52:04.151063 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:04.151024    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f8769127-c183-47bb-9117-b0ea31df8089" containerName="util"
May 20 19:52:04.151063 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:04.151029    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8769127-c183-47bb-9117-b0ea31df8089" containerName="util"
May 20 19:52:04.151235 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:04.151084    2578 memory_manager.go:356] "RemoveStaleState removing state" podUID="f8769127-c183-47bb-9117-b0ea31df8089" containerName="extract"
May 20 19:52:04.202811 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:04.202777    2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-tdzlp"]
May 20 19:52:04.202811 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:04.202798    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-tdzlp"
May 20 19:52:04.206623 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:04.206574    2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
May 20 19:52:04.206623 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:04.206616    2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
May 20 19:52:04.206804 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:04.206697    2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-c6rsb\""
May 20 19:52:04.286072 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:04.286038    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pdrw9\" (UniqueName: \"kubernetes.io/projected/aa1db248-058c-4c03-b226-2e22d7238d2f-kube-api-access-pdrw9\") pod \"cert-manager-operator-controller-manager-54b9655956-tdzlp\" (UID: \"aa1db248-058c-4c03-b226-2e22d7238d2f\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-tdzlp"
May 20 19:52:04.286223 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:04.286100    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/aa1db248-058c-4c03-b226-2e22d7238d2f-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-tdzlp\" (UID: \"aa1db248-058c-4c03-b226-2e22d7238d2f\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-tdzlp"
May 20 19:52:04.386558 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:04.386525    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/aa1db248-058c-4c03-b226-2e22d7238d2f-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-tdzlp\" (UID: \"aa1db248-058c-4c03-b226-2e22d7238d2f\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-tdzlp"
May 20 19:52:04.386730 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:04.386631    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pdrw9\" (UniqueName: \"kubernetes.io/projected/aa1db248-058c-4c03-b226-2e22d7238d2f-kube-api-access-pdrw9\") pod \"cert-manager-operator-controller-manager-54b9655956-tdzlp\" (UID: \"aa1db248-058c-4c03-b226-2e22d7238d2f\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-tdzlp"
May 20 19:52:04.386954 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:04.386932    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/aa1db248-058c-4c03-b226-2e22d7238d2f-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-tdzlp\" (UID: \"aa1db248-058c-4c03-b226-2e22d7238d2f\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-tdzlp"
May 20 19:52:04.395400 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:04.395374    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pdrw9\" (UniqueName: \"kubernetes.io/projected/aa1db248-058c-4c03-b226-2e22d7238d2f-kube-api-access-pdrw9\") pod \"cert-manager-operator-controller-manager-54b9655956-tdzlp\" (UID: \"aa1db248-058c-4c03-b226-2e22d7238d2f\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-tdzlp"
May 20 19:52:04.512397 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:04.512308    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-tdzlp"
May 20 19:52:04.645193 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:04.645161    2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-tdzlp"]
May 20 19:52:04.649209 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:52:04.649185    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa1db248_058c_4c03_b226_2e22d7238d2f.slice/crio-0a4b1f58aba28a226d6dc413997f8b28b10ce40f148d2a9d7ba00e46c6f4c211 WatchSource:0}: Error finding container 0a4b1f58aba28a226d6dc413997f8b28b10ce40f148d2a9d7ba00e46c6f4c211: Status 404 returned error can't find the container with id 0a4b1f58aba28a226d6dc413997f8b28b10ce40f148d2a9d7ba00e46c6f4c211
May 20 19:52:05.524339 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:05.524304    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-tdzlp" event={"ID":"aa1db248-058c-4c03-b226-2e22d7238d2f","Type":"ContainerStarted","Data":"0a4b1f58aba28a226d6dc413997f8b28b10ce40f148d2a9d7ba00e46c6f4c211"}
May 20 19:52:07.533336 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:07.533296    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-tdzlp" event={"ID":"aa1db248-058c-4c03-b226-2e22d7238d2f","Type":"ContainerStarted","Data":"160b4d2362405a5cb8b64e4e3ac974035ea8a7ebe0af07ab75b367191db99693"}
May 20 19:52:07.555699 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:07.555637    2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-tdzlp" podStartSLOduration=1.160038455 podStartE2EDuration="3.555618887s" podCreationTimestamp="2026-05-20 19:52:04 +0000 UTC" firstStartedPulling="2026-05-20 19:52:04.651750831 +0000 UTC m=+467.100299662" lastFinishedPulling="2026-05-20 19:52:07.047331259 +0000 UTC m=+469.495880094" observedRunningTime="2026-05-20 19:52:07.55424516 +0000 UTC m=+470.002794015" watchObservedRunningTime="2026-05-20 19:52:07.555618887 +0000 UTC m=+470.004167743"
May 20 19:52:08.500774 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:08.500738    2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6czvq"]
May 20 19:52:08.519798 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:08.519771    2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6czvq"]
May 20 19:52:08.519924 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:08.519885    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6czvq"
May 20 19:52:08.523551 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:08.523528    2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-5p7qv\""
May 20 19:52:08.523920 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:08.523898    2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
May 20 19:52:08.524361 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:08.524338    2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
May 20 19:52:08.622726 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:08.622690    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/567c191c-142a-403f-bacb-1153472b2c6f-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6czvq\" (UID: \"567c191c-142a-403f-bacb-1153472b2c6f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6czvq"
May 20 19:52:08.623137 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:08.622791    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-64sqs\" (UniqueName: \"kubernetes.io/projected/567c191c-142a-403f-bacb-1153472b2c6f-kube-api-access-64sqs\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6czvq\" (UID: \"567c191c-142a-403f-bacb-1153472b2c6f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6czvq"
May 20 19:52:08.623137 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:08.622824    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/567c191c-142a-403f-bacb-1153472b2c6f-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6czvq\" (UID: \"567c191c-142a-403f-bacb-1153472b2c6f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6czvq"
May 20 19:52:08.723873 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:08.723838    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/567c191c-142a-403f-bacb-1153472b2c6f-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6czvq\" (UID: \"567c191c-142a-403f-bacb-1153472b2c6f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6czvq"
May 20 19:52:08.724069 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:08.723881    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-64sqs\" (UniqueName: \"kubernetes.io/projected/567c191c-142a-403f-bacb-1153472b2c6f-kube-api-access-64sqs\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6czvq\" (UID: \"567c191c-142a-403f-bacb-1153472b2c6f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6czvq"
May 20 19:52:08.724069 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:08.723901    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/567c191c-142a-403f-bacb-1153472b2c6f-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6czvq\" (UID: \"567c191c-142a-403f-bacb-1153472b2c6f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6czvq"
May 20 19:52:08.724285 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:08.724261    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/567c191c-142a-403f-bacb-1153472b2c6f-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6czvq\" (UID: \"567c191c-142a-403f-bacb-1153472b2c6f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6czvq"
May 20 19:52:08.724348 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:08.724273    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/567c191c-142a-403f-bacb-1153472b2c6f-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6czvq\" (UID: \"567c191c-142a-403f-bacb-1153472b2c6f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6czvq"
May 20 19:52:08.735315 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:08.735289    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-64sqs\" (UniqueName: \"kubernetes.io/projected/567c191c-142a-403f-bacb-1153472b2c6f-kube-api-access-64sqs\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6czvq\" (UID: \"567c191c-142a-403f-bacb-1153472b2c6f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6czvq"
May 20 19:52:08.830023 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:08.829926    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6czvq"
May 20 19:52:08.962079 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:08.962057    2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6czvq"]
May 20 19:52:08.964628 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:52:08.964598    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod567c191c_142a_403f_bacb_1153472b2c6f.slice/crio-b7c2a277d2bd92c25e521720978ae0cdcd7ef0aa4eef5036de501f2fe65779a5 WatchSource:0}: Error finding container b7c2a277d2bd92c25e521720978ae0cdcd7ef0aa4eef5036de501f2fe65779a5: Status 404 returned error can't find the container with id b7c2a277d2bd92c25e521720978ae0cdcd7ef0aa4eef5036de501f2fe65779a5
May 20 19:52:09.541081 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:09.541049    2578 generic.go:358] "Generic (PLEG): container finished" podID="567c191c-142a-403f-bacb-1153472b2c6f" containerID="163ce58d1bd8ea338e246f1ec9d57ed7b246c2539302c5d8f94bbd818d82fc22" exitCode=0
May 20 19:52:09.541247 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:09.541124    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6czvq" event={"ID":"567c191c-142a-403f-bacb-1153472b2c6f","Type":"ContainerDied","Data":"163ce58d1bd8ea338e246f1ec9d57ed7b246c2539302c5d8f94bbd818d82fc22"}
May 20 19:52:09.541247 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:09.541145    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6czvq" event={"ID":"567c191c-142a-403f-bacb-1153472b2c6f","Type":"ContainerStarted","Data":"b7c2a277d2bd92c25e521720978ae0cdcd7ef0aa4eef5036de501f2fe65779a5"}
May 20 19:52:10.621751 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:10.621717    2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-4zt2h"]
May 20 19:52:10.623711 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:10.623695    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-587ccfb98-4zt2h"
May 20 19:52:10.626185 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:10.626154    2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
May 20 19:52:10.627270 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:10.627253    2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
May 20 19:52:10.627368 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:10.627332    2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-mrvvz\""
May 20 19:52:10.632007 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:10.631982    2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-4zt2h"]
May 20 19:52:10.740023 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:10.739986    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b5e73c4f-7b22-4fb6-99c8-c4bde3323540-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-4zt2h\" (UID: \"b5e73c4f-7b22-4fb6-99c8-c4bde3323540\") " pod="cert-manager/cert-manager-webhook-587ccfb98-4zt2h"
May 20 19:52:10.740197 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:10.740042    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jfmcm\" (UniqueName: \"kubernetes.io/projected/b5e73c4f-7b22-4fb6-99c8-c4bde3323540-kube-api-access-jfmcm\") pod \"cert-manager-webhook-587ccfb98-4zt2h\" (UID: \"b5e73c4f-7b22-4fb6-99c8-c4bde3323540\") " pod="cert-manager/cert-manager-webhook-587ccfb98-4zt2h"
May 20 19:52:10.840890 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:10.840856    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b5e73c4f-7b22-4fb6-99c8-c4bde3323540-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-4zt2h\" (UID: \"b5e73c4f-7b22-4fb6-99c8-c4bde3323540\") " pod="cert-manager/cert-manager-webhook-587ccfb98-4zt2h"
May 20 19:52:10.841054 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:10.840911    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jfmcm\" (UniqueName: \"kubernetes.io/projected/b5e73c4f-7b22-4fb6-99c8-c4bde3323540-kube-api-access-jfmcm\") pod \"cert-manager-webhook-587ccfb98-4zt2h\" (UID: \"b5e73c4f-7b22-4fb6-99c8-c4bde3323540\") " pod="cert-manager/cert-manager-webhook-587ccfb98-4zt2h"
May 20 19:52:10.849429 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:10.849398    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b5e73c4f-7b22-4fb6-99c8-c4bde3323540-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-4zt2h\" (UID: \"b5e73c4f-7b22-4fb6-99c8-c4bde3323540\") " pod="cert-manager/cert-manager-webhook-587ccfb98-4zt2h"
May 20 19:52:10.849553 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:10.849450    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jfmcm\" (UniqueName: \"kubernetes.io/projected/b5e73c4f-7b22-4fb6-99c8-c4bde3323540-kube-api-access-jfmcm\") pod \"cert-manager-webhook-587ccfb98-4zt2h\" (UID: \"b5e73c4f-7b22-4fb6-99c8-c4bde3323540\") " pod="cert-manager/cert-manager-webhook-587ccfb98-4zt2h"
May 20 19:52:10.941872 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:10.941839    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-587ccfb98-4zt2h"
May 20 19:52:11.074595 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:11.074558    2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-4zt2h"]
May 20 19:52:11.077128 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:52:11.077103    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb5e73c4f_7b22_4fb6_99c8_c4bde3323540.slice/crio-1f0dfd5e64915c68dcefe37601cc214631df1905a90139e5e7bf8f4782778ca3 WatchSource:0}: Error finding container 1f0dfd5e64915c68dcefe37601cc214631df1905a90139e5e7bf8f4782778ca3: Status 404 returned error can't find the container with id 1f0dfd5e64915c68dcefe37601cc214631df1905a90139e5e7bf8f4782778ca3
May 20 19:52:11.549575 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:11.549538    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-587ccfb98-4zt2h" event={"ID":"b5e73c4f-7b22-4fb6-99c8-c4bde3323540","Type":"ContainerStarted","Data":"1f0dfd5e64915c68dcefe37601cc214631df1905a90139e5e7bf8f4782778ca3"}
May 20 19:52:11.590271 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:11.590238    2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-857sj"]
May 20 19:52:11.592448 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:11.592429    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-68b757865b-857sj"
May 20 19:52:11.595015 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:11.594991    2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-qlsjt\""
May 20 19:52:11.602461 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:11.602440    2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-857sj"]
May 20 19:52:11.649481 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:11.649437    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rxsnt\" (UniqueName: \"kubernetes.io/projected/32392628-e46d-4074-be92-3be4180c0556-kube-api-access-rxsnt\") pod \"cert-manager-cainjector-68b757865b-857sj\" (UID: \"32392628-e46d-4074-be92-3be4180c0556\") " pod="cert-manager/cert-manager-cainjector-68b757865b-857sj"
May 20 19:52:11.649945 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:11.649685    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/32392628-e46d-4074-be92-3be4180c0556-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-857sj\" (UID: \"32392628-e46d-4074-be92-3be4180c0556\") " pod="cert-manager/cert-manager-cainjector-68b757865b-857sj"
May 20 19:52:11.750477 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:11.750439    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/32392628-e46d-4074-be92-3be4180c0556-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-857sj\" (UID: \"32392628-e46d-4074-be92-3be4180c0556\") " pod="cert-manager/cert-manager-cainjector-68b757865b-857sj"
May 20 19:52:11.750726 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:11.750496    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rxsnt\" (UniqueName: \"kubernetes.io/projected/32392628-e46d-4074-be92-3be4180c0556-kube-api-access-rxsnt\") pod \"cert-manager-cainjector-68b757865b-857sj\" (UID: \"32392628-e46d-4074-be92-3be4180c0556\") " pod="cert-manager/cert-manager-cainjector-68b757865b-857sj"
May 20 19:52:11.760219 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:11.760192    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/32392628-e46d-4074-be92-3be4180c0556-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-857sj\" (UID: \"32392628-e46d-4074-be92-3be4180c0556\") " pod="cert-manager/cert-manager-cainjector-68b757865b-857sj"
May 20 19:52:11.760380 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:11.760355    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rxsnt\" (UniqueName: \"kubernetes.io/projected/32392628-e46d-4074-be92-3be4180c0556-kube-api-access-rxsnt\") pod \"cert-manager-cainjector-68b757865b-857sj\" (UID: \"32392628-e46d-4074-be92-3be4180c0556\") " pod="cert-manager/cert-manager-cainjector-68b757865b-857sj"
May 20 19:52:11.904601 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:11.904549    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-68b757865b-857sj"
May 20 19:52:12.047637 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:12.047556    2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-857sj"]
May 20 19:52:12.052031 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:52:12.052001    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod32392628_e46d_4074_be92_3be4180c0556.slice/crio-5956df2c89faa74f24eaa33f4d9935310f4d7430362e077e3b1cf2767150bfca WatchSource:0}: Error finding container 5956df2c89faa74f24eaa33f4d9935310f4d7430362e077e3b1cf2767150bfca: Status 404 returned error can't find the container with id 5956df2c89faa74f24eaa33f4d9935310f4d7430362e077e3b1cf2767150bfca
May 20 19:52:12.555513 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:12.555475    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-68b757865b-857sj" event={"ID":"32392628-e46d-4074-be92-3be4180c0556","Type":"ContainerStarted","Data":"5956df2c89faa74f24eaa33f4d9935310f4d7430362e077e3b1cf2767150bfca"}
May 20 19:52:13.562110 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:13.562068    2578 generic.go:358] "Generic (PLEG): container finished" podID="567c191c-142a-403f-bacb-1153472b2c6f" containerID="a78afdbaec03a6fb931fe3f78312ae2b0b58cafda71d43fe8f654495752c973b" exitCode=0
May 20 19:52:13.562557 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:13.562134    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6czvq" event={"ID":"567c191c-142a-403f-bacb-1153472b2c6f","Type":"ContainerDied","Data":"a78afdbaec03a6fb931fe3f78312ae2b0b58cafda71d43fe8f654495752c973b"}
May 20 19:52:14.567030 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:14.566994    2578 generic.go:358] "Generic (PLEG): container finished" podID="567c191c-142a-403f-bacb-1153472b2c6f" containerID="d587368fcb3a40f764fab88189d0e5aeb829fa1bb3772757568ca76825cca555" exitCode=0
May 20 19:52:14.567422 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:14.567038    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6czvq" event={"ID":"567c191c-142a-403f-bacb-1153472b2c6f","Type":"ContainerDied","Data":"d587368fcb3a40f764fab88189d0e5aeb829fa1bb3772757568ca76825cca555"}
May 20 19:52:15.701133 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:15.701111    2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6czvq"
May 20 19:52:15.787749 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:15.787715    2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-64sqs\" (UniqueName: \"kubernetes.io/projected/567c191c-142a-403f-bacb-1153472b2c6f-kube-api-access-64sqs\") pod \"567c191c-142a-403f-bacb-1153472b2c6f\" (UID: \"567c191c-142a-403f-bacb-1153472b2c6f\") "
May 20 19:52:15.787749 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:15.787750    2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/567c191c-142a-403f-bacb-1153472b2c6f-bundle\") pod \"567c191c-142a-403f-bacb-1153472b2c6f\" (UID: \"567c191c-142a-403f-bacb-1153472b2c6f\") "
May 20 19:52:15.788004 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:15.787776    2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/567c191c-142a-403f-bacb-1153472b2c6f-util\") pod \"567c191c-142a-403f-bacb-1153472b2c6f\" (UID: \"567c191c-142a-403f-bacb-1153472b2c6f\") "
May 20 19:52:15.788162 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:15.788122    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/567c191c-142a-403f-bacb-1153472b2c6f-bundle" (OuterVolumeSpecName: "bundle") pod "567c191c-142a-403f-bacb-1153472b2c6f" (UID: "567c191c-142a-403f-bacb-1153472b2c6f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 20 19:52:15.790352 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:15.790316    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/567c191c-142a-403f-bacb-1153472b2c6f-kube-api-access-64sqs" (OuterVolumeSpecName: "kube-api-access-64sqs") pod "567c191c-142a-403f-bacb-1153472b2c6f" (UID: "567c191c-142a-403f-bacb-1153472b2c6f"). InnerVolumeSpecName "kube-api-access-64sqs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 20 19:52:15.791848 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:15.791824    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/567c191c-142a-403f-bacb-1153472b2c6f-util" (OuterVolumeSpecName: "util") pod "567c191c-142a-403f-bacb-1153472b2c6f" (UID: "567c191c-142a-403f-bacb-1153472b2c6f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 20 19:52:15.889027 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:15.888987    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-64sqs\" (UniqueName: \"kubernetes.io/projected/567c191c-142a-403f-bacb-1153472b2c6f-kube-api-access-64sqs\") on node \"ip-10-0-134-167.ec2.internal\" DevicePath \"\""
May 20 19:52:15.889027 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:15.889028    2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/567c191c-142a-403f-bacb-1153472b2c6f-bundle\") on node \"ip-10-0-134-167.ec2.internal\" DevicePath \"\""
May 20 19:52:15.889223 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:15.889044    2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/567c191c-142a-403f-bacb-1153472b2c6f-util\") on node \"ip-10-0-134-167.ec2.internal\" DevicePath \"\""
May 20 19:52:16.574084 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:16.574048    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6czvq" event={"ID":"567c191c-142a-403f-bacb-1153472b2c6f","Type":"ContainerDied","Data":"b7c2a277d2bd92c25e521720978ae0cdcd7ef0aa4eef5036de501f2fe65779a5"}
May 20 19:52:16.574084 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:16.574078    2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6czvq"
May 20 19:52:16.574084 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:16.574087    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b7c2a277d2bd92c25e521720978ae0cdcd7ef0aa4eef5036de501f2fe65779a5"
May 20 19:52:16.575567 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:16.575541    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-68b757865b-857sj" event={"ID":"32392628-e46d-4074-be92-3be4180c0556","Type":"ContainerStarted","Data":"82e6ade4aa1f2ca2250118ad88d9a20ac69f0ba7143724ac4d91ccbd30a0ed20"}
May 20 19:52:16.592078 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:16.592030    2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-68b757865b-857sj" podStartSLOduration=2.082110808 podStartE2EDuration="5.592017135s" podCreationTimestamp="2026-05-20 19:52:11 +0000 UTC" firstStartedPulling="2026-05-20 19:52:12.053794468 +0000 UTC m=+474.502343300" lastFinishedPulling="2026-05-20 19:52:15.563700791 +0000 UTC m=+478.012249627" observedRunningTime="2026-05-20 19:52:16.59098494 +0000 UTC m=+479.039533794" watchObservedRunningTime="2026-05-20 19:52:16.592017135 +0000 UTC m=+479.040565989"
May 20 19:52:17.580211 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:17.580172    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-587ccfb98-4zt2h" event={"ID":"b5e73c4f-7b22-4fb6-99c8-c4bde3323540","Type":"ContainerStarted","Data":"3a2fb4211bc8b7611fa04a1b5628ff6445af8ca0abbc588db44e51386e1b03bd"}
May 20 19:52:17.596687 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:17.596632    2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-587ccfb98-4zt2h" podStartSLOduration=2.081614232 podStartE2EDuration="7.596617732s" podCreationTimestamp="2026-05-20 19:52:10 +0000 UTC" firstStartedPulling="2026-05-20 19:52:11.078973174 +0000 UTC m=+473.527522005" lastFinishedPulling="2026-05-20 19:52:16.593976673 +0000 UTC m=+479.042525505" observedRunningTime="2026-05-20 19:52:17.59569617 +0000 UTC m=+480.044245023" watchObservedRunningTime="2026-05-20 19:52:17.596617732 +0000 UTC m=+480.045166585"
May 20 19:52:18.583920 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:18.583889    2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-587ccfb98-4zt2h"
May 20 19:52:21.636571 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:21.636529    2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-j7tsq"]
May 20 19:52:21.636999 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:21.636876    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="567c191c-142a-403f-bacb-1153472b2c6f" containerName="pull"
May 20 19:52:21.636999 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:21.636888    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="567c191c-142a-403f-bacb-1153472b2c6f" containerName="pull"
May 20 19:52:21.636999 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:21.636896    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="567c191c-142a-403f-bacb-1153472b2c6f" containerName="extract"
May 20 19:52:21.636999 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:21.636901    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="567c191c-142a-403f-bacb-1153472b2c6f" containerName="extract"
May 20 19:52:21.636999 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:21.636910    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="567c191c-142a-403f-bacb-1153472b2c6f" containerName="util"
May 20 19:52:21.636999 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:21.636916    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="567c191c-142a-403f-bacb-1153472b2c6f" containerName="util"
May 20 19:52:21.636999 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:21.636962    2578 memory_manager.go:356] "RemoveStaleState removing state" podUID="567c191c-142a-403f-bacb-1153472b2c6f" containerName="extract"
May 20 19:52:21.640087 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:21.640068    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-j7tsq"
May 20 19:52:21.642657 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:21.642635    2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
May 20 19:52:21.642792 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:21.642679    2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
May 20 19:52:21.643564 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:21.643548    2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-4bbzq\""
May 20 19:52:21.648512 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:21.648491    2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-j7tsq"]
May 20 19:52:21.737015 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:21.736979    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/aefbfd1a-5cb6-458d-a599-8d5637d1d5d7-tmp\") pod \"openshift-lws-operator-bfc7f696d-j7tsq\" (UID: \"aefbfd1a-5cb6-458d-a599-8d5637d1d5d7\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-j7tsq"
May 20 19:52:21.737205 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:21.737030    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jvk7v\" (UniqueName: \"kubernetes.io/projected/aefbfd1a-5cb6-458d-a599-8d5637d1d5d7-kube-api-access-jvk7v\") pod \"openshift-lws-operator-bfc7f696d-j7tsq\" (UID: \"aefbfd1a-5cb6-458d-a599-8d5637d1d5d7\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-j7tsq"
May 20 19:52:21.837859 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:21.837817    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/aefbfd1a-5cb6-458d-a599-8d5637d1d5d7-tmp\") pod \"openshift-lws-operator-bfc7f696d-j7tsq\" (UID: \"aefbfd1a-5cb6-458d-a599-8d5637d1d5d7\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-j7tsq"
May 20 19:52:21.838046 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:21.837874    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jvk7v\" (UniqueName: \"kubernetes.io/projected/aefbfd1a-5cb6-458d-a599-8d5637d1d5d7-kube-api-access-jvk7v\") pod \"openshift-lws-operator-bfc7f696d-j7tsq\" (UID: \"aefbfd1a-5cb6-458d-a599-8d5637d1d5d7\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-j7tsq"
May 20 19:52:21.838194 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:21.838170    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/aefbfd1a-5cb6-458d-a599-8d5637d1d5d7-tmp\") pod \"openshift-lws-operator-bfc7f696d-j7tsq\" (UID: \"aefbfd1a-5cb6-458d-a599-8d5637d1d5d7\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-j7tsq"
May 20 19:52:21.847568 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:21.847542    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jvk7v\" (UniqueName: \"kubernetes.io/projected/aefbfd1a-5cb6-458d-a599-8d5637d1d5d7-kube-api-access-jvk7v\") pod \"openshift-lws-operator-bfc7f696d-j7tsq\" (UID: \"aefbfd1a-5cb6-458d-a599-8d5637d1d5d7\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-j7tsq"
May 20 19:52:21.949905 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:21.949815    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-j7tsq"
May 20 19:52:22.079685 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:22.079660    2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-j7tsq"]
May 20 19:52:22.082102 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:52:22.082075    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podaefbfd1a_5cb6_458d_a599_8d5637d1d5d7.slice/crio-d1b6dafbc10fe481fcdd170a4fa5a4de7d24302269c7d90ec034ec876b5c4ff4 WatchSource:0}: Error finding container d1b6dafbc10fe481fcdd170a4fa5a4de7d24302269c7d90ec034ec876b5c4ff4: Status 404 returned error can't find the container with id d1b6dafbc10fe481fcdd170a4fa5a4de7d24302269c7d90ec034ec876b5c4ff4
May 20 19:52:22.601600 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:22.601550    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-j7tsq" event={"ID":"aefbfd1a-5cb6-458d-a599-8d5637d1d5d7","Type":"ContainerStarted","Data":"d1b6dafbc10fe481fcdd170a4fa5a4de7d24302269c7d90ec034ec876b5c4ff4"}
May 20 19:52:24.589367 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:24.589285    2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-587ccfb98-4zt2h"
May 20 19:52:24.609929 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:24.609902    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-j7tsq" event={"ID":"aefbfd1a-5cb6-458d-a599-8d5637d1d5d7","Type":"ContainerStarted","Data":"2771138c75a021903492ea3c4b81da055c22d55dbc9e409879d31d7bb42958e2"}
May 20 19:52:24.626852 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:24.626786    2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-j7tsq" podStartSLOduration=1.445757857 podStartE2EDuration="3.626767944s" podCreationTimestamp="2026-05-20 19:52:21 +0000 UTC" firstStartedPulling="2026-05-20 19:52:22.083833208 +0000 UTC m=+484.532382046" lastFinishedPulling="2026-05-20 19:52:24.264843297 +0000 UTC m=+486.713392133" observedRunningTime="2026-05-20 19:52:24.625570666 +0000 UTC m=+487.074119519" watchObservedRunningTime="2026-05-20 19:52:24.626767944 +0000 UTC m=+487.075316800"
May 20 19:52:27.238822 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:27.238785    2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c55bbwn"]
May 20 19:52:27.242563 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:27.242544    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c55bbwn"
May 20 19:52:27.246217 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:27.246191    2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-5p7qv\""
May 20 19:52:27.246344 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:27.246235    2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
May 20 19:52:27.246344 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:27.246235    2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
May 20 19:52:27.255825 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:27.255798    2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c55bbwn"]
May 20 19:52:27.387293 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:27.387257    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3bc5620c-07f5-42c4-8467-3c23cd534370-bundle\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c55bbwn\" (UID: \"3bc5620c-07f5-42c4-8467-3c23cd534370\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c55bbwn"
May 20 19:52:27.387293 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:27.387297    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3bc5620c-07f5-42c4-8467-3c23cd534370-util\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c55bbwn\" (UID: \"3bc5620c-07f5-42c4-8467-3c23cd534370\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c55bbwn"
May 20 19:52:27.387510 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:27.387320    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-grq6r\" (UniqueName: \"kubernetes.io/projected/3bc5620c-07f5-42c4-8467-3c23cd534370-kube-api-access-grq6r\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c55bbwn\" (UID: \"3bc5620c-07f5-42c4-8467-3c23cd534370\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c55bbwn"
May 20 19:52:27.488426 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:27.488390    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3bc5620c-07f5-42c4-8467-3c23cd534370-bundle\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c55bbwn\" (UID: \"3bc5620c-07f5-42c4-8467-3c23cd534370\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c55bbwn"
May 20 19:52:27.488630 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:27.488433    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3bc5620c-07f5-42c4-8467-3c23cd534370-util\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c55bbwn\" (UID: \"3bc5620c-07f5-42c4-8467-3c23cd534370\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c55bbwn"
May 20 19:52:27.488630 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:27.488458    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-grq6r\" (UniqueName: \"kubernetes.io/projected/3bc5620c-07f5-42c4-8467-3c23cd534370-kube-api-access-grq6r\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c55bbwn\" (UID: \"3bc5620c-07f5-42c4-8467-3c23cd534370\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c55bbwn"
May 20 19:52:27.488877 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:27.488822    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3bc5620c-07f5-42c4-8467-3c23cd534370-bundle\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c55bbwn\" (UID: \"3bc5620c-07f5-42c4-8467-3c23cd534370\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c55bbwn"
May 20 19:52:27.488877 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:27.488865    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3bc5620c-07f5-42c4-8467-3c23cd534370-util\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c55bbwn\" (UID: \"3bc5620c-07f5-42c4-8467-3c23cd534370\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c55bbwn"
May 20 19:52:27.497960 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:27.497933    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-grq6r\" (UniqueName: \"kubernetes.io/projected/3bc5620c-07f5-42c4-8467-3c23cd534370-kube-api-access-grq6r\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c55bbwn\" (UID: \"3bc5620c-07f5-42c4-8467-3c23cd534370\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c55bbwn"
May 20 19:52:27.558641 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:27.558609    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c55bbwn"
May 20 19:52:27.687394 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:27.687295    2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c55bbwn"]
May 20 19:52:27.690139 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:52:27.690106    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3bc5620c_07f5_42c4_8467_3c23cd534370.slice/crio-84bd7c5c256461dc7dcda666f59cfe49c413a9d09ed5b6f089117eef88678168 WatchSource:0}: Error finding container 84bd7c5c256461dc7dcda666f59cfe49c413a9d09ed5b6f089117eef88678168: Status 404 returned error can't find the container with id 84bd7c5c256461dc7dcda666f59cfe49c413a9d09ed5b6f089117eef88678168
May 20 19:52:28.628257 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:28.628226    2578 generic.go:358] "Generic (PLEG): container finished" podID="3bc5620c-07f5-42c4-8467-3c23cd534370" containerID="54692009bbbd50a1bda10aa68310acc65829e242fc9256a00e313040ffa712c6" exitCode=0
May 20 19:52:28.628641 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:28.628305    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c55bbwn" event={"ID":"3bc5620c-07f5-42c4-8467-3c23cd534370","Type":"ContainerDied","Data":"54692009bbbd50a1bda10aa68310acc65829e242fc9256a00e313040ffa712c6"}
May 20 19:52:28.628641 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:28.628338    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c55bbwn" event={"ID":"3bc5620c-07f5-42c4-8467-3c23cd534370","Type":"ContainerStarted","Data":"84bd7c5c256461dc7dcda666f59cfe49c413a9d09ed5b6f089117eef88678168"}
May 20 19:52:29.632922 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:29.632891    2578 generic.go:358] "Generic (PLEG): container finished" podID="3bc5620c-07f5-42c4-8467-3c23cd534370" containerID="18c1f56a700a61207486caf5174c9b5bd23ea9ef06eb986b9d2afa3fa10b3625" exitCode=0
May 20 19:52:29.633289 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:29.632958    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c55bbwn" event={"ID":"3bc5620c-07f5-42c4-8467-3c23cd534370","Type":"ContainerDied","Data":"18c1f56a700a61207486caf5174c9b5bd23ea9ef06eb986b9d2afa3fa10b3625"}
May 20 19:52:30.638056 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:30.638020    2578 generic.go:358] "Generic (PLEG): container finished" podID="3bc5620c-07f5-42c4-8467-3c23cd534370" containerID="a55591899a04a37291cc1891cc4d641b0d9bad478b1b067594c3c40c1bda6a9e" exitCode=0
May 20 19:52:30.638496 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:30.638073    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c55bbwn" event={"ID":"3bc5620c-07f5-42c4-8467-3c23cd534370","Type":"ContainerDied","Data":"a55591899a04a37291cc1891cc4d641b0d9bad478b1b067594c3c40c1bda6a9e"}
May 20 19:52:31.767457 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:31.767435    2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c55bbwn"
May 20 19:52:31.926495 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:31.926405    2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3bc5620c-07f5-42c4-8467-3c23cd534370-bundle\") pod \"3bc5620c-07f5-42c4-8467-3c23cd534370\" (UID: \"3bc5620c-07f5-42c4-8467-3c23cd534370\") "
May 20 19:52:31.926495 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:31.926450    2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-grq6r\" (UniqueName: \"kubernetes.io/projected/3bc5620c-07f5-42c4-8467-3c23cd534370-kube-api-access-grq6r\") pod \"3bc5620c-07f5-42c4-8467-3c23cd534370\" (UID: \"3bc5620c-07f5-42c4-8467-3c23cd534370\") "
May 20 19:52:31.926733 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:31.926526    2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3bc5620c-07f5-42c4-8467-3c23cd534370-util\") pod \"3bc5620c-07f5-42c4-8467-3c23cd534370\" (UID: \"3bc5620c-07f5-42c4-8467-3c23cd534370\") "
May 20 19:52:31.927178 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:31.927153    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3bc5620c-07f5-42c4-8467-3c23cd534370-bundle" (OuterVolumeSpecName: "bundle") pod "3bc5620c-07f5-42c4-8467-3c23cd534370" (UID: "3bc5620c-07f5-42c4-8467-3c23cd534370"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 20 19:52:31.928792 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:31.928768    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3bc5620c-07f5-42c4-8467-3c23cd534370-kube-api-access-grq6r" (OuterVolumeSpecName: "kube-api-access-grq6r") pod "3bc5620c-07f5-42c4-8467-3c23cd534370" (UID: "3bc5620c-07f5-42c4-8467-3c23cd534370"). InnerVolumeSpecName "kube-api-access-grq6r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 20 19:52:31.932002 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:31.931980    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3bc5620c-07f5-42c4-8467-3c23cd534370-util" (OuterVolumeSpecName: "util") pod "3bc5620c-07f5-42c4-8467-3c23cd534370" (UID: "3bc5620c-07f5-42c4-8467-3c23cd534370"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 20 19:52:32.027052 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:32.027014    2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3bc5620c-07f5-42c4-8467-3c23cd534370-util\") on node \"ip-10-0-134-167.ec2.internal\" DevicePath \"\""
May 20 19:52:32.027052 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:32.027048    2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3bc5620c-07f5-42c4-8467-3c23cd534370-bundle\") on node \"ip-10-0-134-167.ec2.internal\" DevicePath \"\""
May 20 19:52:32.027052 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:32.027060    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-grq6r\" (UniqueName: \"kubernetes.io/projected/3bc5620c-07f5-42c4-8467-3c23cd534370-kube-api-access-grq6r\") on node \"ip-10-0-134-167.ec2.internal\" DevicePath \"\""
May 20 19:52:32.646230 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:32.646192    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c55bbwn" event={"ID":"3bc5620c-07f5-42c4-8467-3c23cd534370","Type":"ContainerDied","Data":"84bd7c5c256461dc7dcda666f59cfe49c413a9d09ed5b6f089117eef88678168"}
May 20 19:52:32.646230 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:32.646229    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="84bd7c5c256461dc7dcda666f59cfe49c413a9d09ed5b6f089117eef88678168"
May 20 19:52:32.646445 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:32.646275    2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c55bbwn"
May 20 19:52:40.439159 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:40.439120    2578 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-9854f5658-dkbbm"]
May 20 19:52:41.421078 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:41.421039    2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9kdd8x"]
May 20 19:52:41.421342 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:41.421331    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3bc5620c-07f5-42c4-8467-3c23cd534370" containerName="pull"
May 20 19:52:41.421385 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:41.421344    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="3bc5620c-07f5-42c4-8467-3c23cd534370" containerName="pull"
May 20 19:52:41.421385 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:41.421361    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3bc5620c-07f5-42c4-8467-3c23cd534370" containerName="extract"
May 20 19:52:41.421385 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:41.421366    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="3bc5620c-07f5-42c4-8467-3c23cd534370" containerName="extract"
May 20 19:52:41.421385 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:41.421376    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3bc5620c-07f5-42c4-8467-3c23cd534370" containerName="util"
May 20 19:52:41.421385 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:41.421381    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="3bc5620c-07f5-42c4-8467-3c23cd534370" containerName="util"
May 20 19:52:41.421525 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:41.421431    2578 memory_manager.go:356] "RemoveStaleState removing state" podUID="3bc5620c-07f5-42c4-8467-3c23cd534370" containerName="extract"
May 20 19:52:41.426011 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:41.425986    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9kdd8x"
May 20 19:52:41.428466 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:41.428439    2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
May 20 19:52:41.428571 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:41.428442    2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
May 20 19:52:41.429258 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:41.429241    2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-5p7qv\""
May 20 19:52:41.435636 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:41.435612    2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9kdd8x"]
May 20 19:52:41.609505 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:41.609453    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kg6rq\" (UniqueName: \"kubernetes.io/projected/472c63a8-5668-42d7-a001-785b0099a419-kube-api-access-kg6rq\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9kdd8x\" (UID: \"472c63a8-5668-42d7-a001-785b0099a419\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9kdd8x"
May 20 19:52:41.609505 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:41.609514    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/472c63a8-5668-42d7-a001-785b0099a419-util\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9kdd8x\" (UID: \"472c63a8-5668-42d7-a001-785b0099a419\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9kdd8x"
May 20 19:52:41.609971 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:41.609605    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/472c63a8-5668-42d7-a001-785b0099a419-bundle\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9kdd8x\" (UID: \"472c63a8-5668-42d7-a001-785b0099a419\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9kdd8x"
May 20 19:52:41.710121 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:41.710037    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/472c63a8-5668-42d7-a001-785b0099a419-util\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9kdd8x\" (UID: \"472c63a8-5668-42d7-a001-785b0099a419\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9kdd8x"
May 20 19:52:41.710121 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:41.710086    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/472c63a8-5668-42d7-a001-785b0099a419-bundle\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9kdd8x\" (UID: \"472c63a8-5668-42d7-a001-785b0099a419\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9kdd8x"
May 20 19:52:41.710121 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:41.710119    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kg6rq\" (UniqueName: \"kubernetes.io/projected/472c63a8-5668-42d7-a001-785b0099a419-kube-api-access-kg6rq\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9kdd8x\" (UID: \"472c63a8-5668-42d7-a001-785b0099a419\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9kdd8x"
May 20 19:52:41.710423 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:41.710404    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/472c63a8-5668-42d7-a001-785b0099a419-util\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9kdd8x\" (UID: \"472c63a8-5668-42d7-a001-785b0099a419\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9kdd8x"
May 20 19:52:41.710513 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:41.710495    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/472c63a8-5668-42d7-a001-785b0099a419-bundle\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9kdd8x\" (UID: \"472c63a8-5668-42d7-a001-785b0099a419\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9kdd8x"
May 20 19:52:41.720093 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:41.720061    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kg6rq\" (UniqueName: \"kubernetes.io/projected/472c63a8-5668-42d7-a001-785b0099a419-kube-api-access-kg6rq\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9kdd8x\" (UID: \"472c63a8-5668-42d7-a001-785b0099a419\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9kdd8x"
May 20 19:52:41.735680 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:41.735656    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9kdd8x"
May 20 19:52:41.871185 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:41.871160    2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9kdd8x"]
May 20 19:52:41.874009 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:52:41.873970    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod472c63a8_5668_42d7_a001_785b0099a419.slice/crio-6914a6cfc3a91235daddd892a544cff60261a0b1fedb6b071f0c1ef8de26899d WatchSource:0}: Error finding container 6914a6cfc3a91235daddd892a544cff60261a0b1fedb6b071f0c1ef8de26899d: Status 404 returned error can't find the container with id 6914a6cfc3a91235daddd892a544cff60261a0b1fedb6b071f0c1ef8de26899d
May 20 19:52:42.681215 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:42.681176    2578 generic.go:358] "Generic (PLEG): container finished" podID="472c63a8-5668-42d7-a001-785b0099a419" containerID="33f284f0875f9c9fe2e8c93be10695baad1293bb7aed294275d581428941f65a" exitCode=0
May 20 19:52:42.681627 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:42.681262    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9kdd8x" event={"ID":"472c63a8-5668-42d7-a001-785b0099a419","Type":"ContainerDied","Data":"33f284f0875f9c9fe2e8c93be10695baad1293bb7aed294275d581428941f65a"}
May 20 19:52:42.681627 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:42.681297    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9kdd8x" event={"ID":"472c63a8-5668-42d7-a001-785b0099a419","Type":"ContainerStarted","Data":"6914a6cfc3a91235daddd892a544cff60261a0b1fedb6b071f0c1ef8de26899d"}
May 20 19:52:42.925053 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:42.925023    2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-74d7cb47bd-4twn6"]
May 20 19:52:42.928904 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:42.928884    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-74d7cb47bd-4twn6"
May 20 19:52:42.931649 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:42.931561    2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
May 20 19:52:42.931649 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:42.931630    2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
May 20 19:52:42.931649 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:42.931639    2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
May 20 19:52:42.931842 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:42.931786    2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
May 20 19:52:42.931945 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:42.931930    2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-q8fs8\""
May 20 19:52:42.944180 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:42.944155    2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-74d7cb47bd-4twn6"]
May 20 19:52:43.021466 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:43.021432    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1a82512a-abce-4072-ab13-01f1e114bd4b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-74d7cb47bd-4twn6\" (UID: \"1a82512a-abce-4072-ab13-01f1e114bd4b\") " pod="opendatahub/opendatahub-operator-controller-manager-74d7cb47bd-4twn6"
May 20 19:52:43.021466 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:43.021468    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2w4pd\" (UniqueName: \"kubernetes.io/projected/1a82512a-abce-4072-ab13-01f1e114bd4b-kube-api-access-2w4pd\") pod \"opendatahub-operator-controller-manager-74d7cb47bd-4twn6\" (UID: \"1a82512a-abce-4072-ab13-01f1e114bd4b\") " pod="opendatahub/opendatahub-operator-controller-manager-74d7cb47bd-4twn6"
May 20 19:52:43.021688 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:43.021607    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1a82512a-abce-4072-ab13-01f1e114bd4b-webhook-cert\") pod \"opendatahub-operator-controller-manager-74d7cb47bd-4twn6\" (UID: \"1a82512a-abce-4072-ab13-01f1e114bd4b\") " pod="opendatahub/opendatahub-operator-controller-manager-74d7cb47bd-4twn6"
May 20 19:52:43.121976 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:43.121946    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1a82512a-abce-4072-ab13-01f1e114bd4b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-74d7cb47bd-4twn6\" (UID: \"1a82512a-abce-4072-ab13-01f1e114bd4b\") " pod="opendatahub/opendatahub-operator-controller-manager-74d7cb47bd-4twn6"
May 20 19:52:43.121976 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:43.121979    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2w4pd\" (UniqueName: \"kubernetes.io/projected/1a82512a-abce-4072-ab13-01f1e114bd4b-kube-api-access-2w4pd\") pod \"opendatahub-operator-controller-manager-74d7cb47bd-4twn6\" (UID: \"1a82512a-abce-4072-ab13-01f1e114bd4b\") " pod="opendatahub/opendatahub-operator-controller-manager-74d7cb47bd-4twn6"
May 20 19:52:43.122180 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:43.122038    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1a82512a-abce-4072-ab13-01f1e114bd4b-webhook-cert\") pod \"opendatahub-operator-controller-manager-74d7cb47bd-4twn6\" (UID: \"1a82512a-abce-4072-ab13-01f1e114bd4b\") " pod="opendatahub/opendatahub-operator-controller-manager-74d7cb47bd-4twn6"
May 20 19:52:43.124536 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:43.124507    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1a82512a-abce-4072-ab13-01f1e114bd4b-webhook-cert\") pod \"opendatahub-operator-controller-manager-74d7cb47bd-4twn6\" (UID: \"1a82512a-abce-4072-ab13-01f1e114bd4b\") " pod="opendatahub/opendatahub-operator-controller-manager-74d7cb47bd-4twn6"
May 20 19:52:43.124659 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:43.124550    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1a82512a-abce-4072-ab13-01f1e114bd4b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-74d7cb47bd-4twn6\" (UID: \"1a82512a-abce-4072-ab13-01f1e114bd4b\") " pod="opendatahub/opendatahub-operator-controller-manager-74d7cb47bd-4twn6"
May 20 19:52:43.130635 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:43.130612    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2w4pd\" (UniqueName: \"kubernetes.io/projected/1a82512a-abce-4072-ab13-01f1e114bd4b-kube-api-access-2w4pd\") pod \"opendatahub-operator-controller-manager-74d7cb47bd-4twn6\" (UID: \"1a82512a-abce-4072-ab13-01f1e114bd4b\") " pod="opendatahub/opendatahub-operator-controller-manager-74d7cb47bd-4twn6"
May 20 19:52:43.239401 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:43.239322    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-74d7cb47bd-4twn6"
May 20 19:52:43.409640 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:43.409613    2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-74d7cb47bd-4twn6"]
May 20 19:52:43.411469 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:52:43.411443    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a82512a_abce_4072_ab13_01f1e114bd4b.slice/crio-ac110b3c92265d2fd6f7f754d13802318b62dd2f39152cbbcf29444372cd92eb WatchSource:0}: Error finding container ac110b3c92265d2fd6f7f754d13802318b62dd2f39152cbbcf29444372cd92eb: Status 404 returned error can't find the container with id ac110b3c92265d2fd6f7f754d13802318b62dd2f39152cbbcf29444372cd92eb
May 20 19:52:43.686753 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:43.686723    2578 generic.go:358] "Generic (PLEG): container finished" podID="472c63a8-5668-42d7-a001-785b0099a419" containerID="e67dbee80661ae4942cc128acaa9f056225009086287302aa1652045abd0d044" exitCode=0
May 20 19:52:43.687184 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:43.686812    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9kdd8x" event={"ID":"472c63a8-5668-42d7-a001-785b0099a419","Type":"ContainerDied","Data":"e67dbee80661ae4942cc128acaa9f056225009086287302aa1652045abd0d044"}
May 20 19:52:43.688027 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:43.688009    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-74d7cb47bd-4twn6" event={"ID":"1a82512a-abce-4072-ab13-01f1e114bd4b","Type":"ContainerStarted","Data":"ac110b3c92265d2fd6f7f754d13802318b62dd2f39152cbbcf29444372cd92eb"}
May 20 19:52:44.693601 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:44.693546    2578 generic.go:358] "Generic (PLEG): container finished" podID="472c63a8-5668-42d7-a001-785b0099a419" containerID="cf9a57fd9f29b03bde072dc76f0d6e9939eda07c95a28f67d0efa12f1e2c6fa9" exitCode=0
May 20 19:52:44.694012 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:44.693641    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9kdd8x" event={"ID":"472c63a8-5668-42d7-a001-785b0099a419","Type":"ContainerDied","Data":"cf9a57fd9f29b03bde072dc76f0d6e9939eda07c95a28f67d0efa12f1e2c6fa9"}
May 20 19:52:45.847052 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:45.847027    2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9kdd8x"
May 20 19:52:45.947250 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:45.947229    2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/472c63a8-5668-42d7-a001-785b0099a419-bundle\") pod \"472c63a8-5668-42d7-a001-785b0099a419\" (UID: \"472c63a8-5668-42d7-a001-785b0099a419\") "
May 20 19:52:45.947358 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:45.947291    2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kg6rq\" (UniqueName: \"kubernetes.io/projected/472c63a8-5668-42d7-a001-785b0099a419-kube-api-access-kg6rq\") pod \"472c63a8-5668-42d7-a001-785b0099a419\" (UID: \"472c63a8-5668-42d7-a001-785b0099a419\") "
May 20 19:52:45.947358 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:45.947333    2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/472c63a8-5668-42d7-a001-785b0099a419-util\") pod \"472c63a8-5668-42d7-a001-785b0099a419\" (UID: \"472c63a8-5668-42d7-a001-785b0099a419\") "
May 20 19:52:45.948061 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:45.947986    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/472c63a8-5668-42d7-a001-785b0099a419-bundle" (OuterVolumeSpecName: "bundle") pod "472c63a8-5668-42d7-a001-785b0099a419" (UID: "472c63a8-5668-42d7-a001-785b0099a419"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 20 19:52:45.949464 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:45.949411    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/472c63a8-5668-42d7-a001-785b0099a419-kube-api-access-kg6rq" (OuterVolumeSpecName: "kube-api-access-kg6rq") pod "472c63a8-5668-42d7-a001-785b0099a419" (UID: "472c63a8-5668-42d7-a001-785b0099a419"). InnerVolumeSpecName "kube-api-access-kg6rq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 20 19:52:45.953422 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:45.953398    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/472c63a8-5668-42d7-a001-785b0099a419-util" (OuterVolumeSpecName: "util") pod "472c63a8-5668-42d7-a001-785b0099a419" (UID: "472c63a8-5668-42d7-a001-785b0099a419"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 20 19:52:46.048737 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:46.048698    2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/472c63a8-5668-42d7-a001-785b0099a419-util\") on node \"ip-10-0-134-167.ec2.internal\" DevicePath \"\""
May 20 19:52:46.048737 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:46.048729    2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/472c63a8-5668-42d7-a001-785b0099a419-bundle\") on node \"ip-10-0-134-167.ec2.internal\" DevicePath \"\""
May 20 19:52:46.048737 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:46.048739    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kg6rq\" (UniqueName: \"kubernetes.io/projected/472c63a8-5668-42d7-a001-785b0099a419-kube-api-access-kg6rq\") on node \"ip-10-0-134-167.ec2.internal\" DevicePath \"\""
May 20 19:52:46.703858 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:46.703828    2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9kdd8x"
May 20 19:52:46.703858 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:46.703832    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9kdd8x" event={"ID":"472c63a8-5668-42d7-a001-785b0099a419","Type":"ContainerDied","Data":"6914a6cfc3a91235daddd892a544cff60261a0b1fedb6b071f0c1ef8de26899d"}
May 20 19:52:46.704110 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:46.703873    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6914a6cfc3a91235daddd892a544cff60261a0b1fedb6b071f0c1ef8de26899d"
May 20 19:52:46.705389 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:46.705342    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-74d7cb47bd-4twn6" event={"ID":"1a82512a-abce-4072-ab13-01f1e114bd4b","Type":"ContainerStarted","Data":"f176c0e010e0dfd9074e5c19ad754bb0b5630029849f545c1265ef7d467f80ac"}
May 20 19:52:46.705530 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:46.705456    2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-74d7cb47bd-4twn6"
May 20 19:52:46.730675 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:46.730623    2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-74d7cb47bd-4twn6" podStartSLOduration=2.264774479 podStartE2EDuration="4.730609102s" podCreationTimestamp="2026-05-20 19:52:42 +0000 UTC" firstStartedPulling="2026-05-20 19:52:43.413147048 +0000 UTC m=+505.861695881" lastFinishedPulling="2026-05-20 19:52:45.878981669 +0000 UTC m=+508.327530504" observedRunningTime="2026-05-20 19:52:46.72941048 +0000 UTC m=+509.177959333" watchObservedRunningTime="2026-05-20 19:52:46.730609102 +0000 UTC m=+509.179157952"
May 20 19:52:57.711731 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:57.711696    2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-74d7cb47bd-4twn6"
May 20 19:52:59.817244 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:59.817204    2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835gg9c7"]
May 20 19:52:59.817718 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:59.817513    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="472c63a8-5668-42d7-a001-785b0099a419" containerName="extract"
May 20 19:52:59.817718 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:59.817524    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="472c63a8-5668-42d7-a001-785b0099a419" containerName="extract"
May 20 19:52:59.817718 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:59.817532    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="472c63a8-5668-42d7-a001-785b0099a419" containerName="pull"
May 20 19:52:59.817718 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:59.817537    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="472c63a8-5668-42d7-a001-785b0099a419" containerName="pull"
May 20 19:52:59.817718 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:59.817552    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="472c63a8-5668-42d7-a001-785b0099a419" containerName="util"
May 20 19:52:59.817718 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:59.817558    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="472c63a8-5668-42d7-a001-785b0099a419" containerName="util"
May 20 19:52:59.817718 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:59.817620    2578 memory_manager.go:356] "RemoveStaleState removing state" podUID="472c63a8-5668-42d7-a001-785b0099a419" containerName="extract"
May 20 19:52:59.825982 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:59.825962    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835gg9c7"
May 20 19:52:59.828912 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:59.828886    2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-5p7qv\""
May 20 19:52:59.829030 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:59.828938    2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
May 20 19:52:59.829030 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:59.828886    2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
May 20 19:52:59.834118 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:59.834098    2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835gg9c7"]
May 20 19:52:59.867006 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:59.866972    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4cbcbd24-1dcf-439c-bdc2-4611a6769947-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835gg9c7\" (UID: \"4cbcbd24-1dcf-439c-bdc2-4611a6769947\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835gg9c7"
May 20 19:52:59.867006 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:59.867007    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7s9pv\" (UniqueName: \"kubernetes.io/projected/4cbcbd24-1dcf-439c-bdc2-4611a6769947-kube-api-access-7s9pv\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835gg9c7\" (UID: \"4cbcbd24-1dcf-439c-bdc2-4611a6769947\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835gg9c7"
May 20 19:52:59.867231 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:59.867044    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4cbcbd24-1dcf-439c-bdc2-4611a6769947-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835gg9c7\" (UID: \"4cbcbd24-1dcf-439c-bdc2-4611a6769947\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835gg9c7"
May 20 19:52:59.967656 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:59.967619    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4cbcbd24-1dcf-439c-bdc2-4611a6769947-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835gg9c7\" (UID: \"4cbcbd24-1dcf-439c-bdc2-4611a6769947\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835gg9c7"
May 20 19:52:59.967656 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:59.967657    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7s9pv\" (UniqueName: \"kubernetes.io/projected/4cbcbd24-1dcf-439c-bdc2-4611a6769947-kube-api-access-7s9pv\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835gg9c7\" (UID: \"4cbcbd24-1dcf-439c-bdc2-4611a6769947\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835gg9c7"
May 20 19:52:59.967865 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:59.967694    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4cbcbd24-1dcf-439c-bdc2-4611a6769947-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835gg9c7\" (UID: \"4cbcbd24-1dcf-439c-bdc2-4611a6769947\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835gg9c7"
May 20 19:52:59.968078 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:59.968061    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4cbcbd24-1dcf-439c-bdc2-4611a6769947-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835gg9c7\" (UID: \"4cbcbd24-1dcf-439c-bdc2-4611a6769947\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835gg9c7"
May 20 19:52:59.968111 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:59.968062    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4cbcbd24-1dcf-439c-bdc2-4611a6769947-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835gg9c7\" (UID: \"4cbcbd24-1dcf-439c-bdc2-4611a6769947\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835gg9c7"
May 20 19:52:59.977735 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:52:59.977709    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7s9pv\" (UniqueName: \"kubernetes.io/projected/4cbcbd24-1dcf-439c-bdc2-4611a6769947-kube-api-access-7s9pv\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835gg9c7\" (UID: \"4cbcbd24-1dcf-439c-bdc2-4611a6769947\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835gg9c7"
May 20 19:53:00.056829 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:00.056793    2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-547dffc8c7-95xxl"]
May 20 19:53:00.060814 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:00.060794    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-547dffc8c7-95xxl"
May 20 19:53:00.063279 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:00.063253    2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
May 20 19:53:00.063279 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:00.063253    2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
May 20 19:53:00.063448 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:00.063309    2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
May 20 19:53:00.063448 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:00.063313    2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
May 20 19:53:00.071179 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:00.071152    2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-547dffc8c7-95xxl"]
May 20 19:53:00.136532 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:00.136499    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835gg9c7"
May 20 19:53:00.168650 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:00.168620    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e43edc3c-5e3b-4f88-90c2-f2742ad65f2f-tmp\") pod \"kube-auth-proxy-547dffc8c7-95xxl\" (UID: \"e43edc3c-5e3b-4f88-90c2-f2742ad65f2f\") " pod="openshift-ingress/kube-auth-proxy-547dffc8c7-95xxl"
May 20 19:53:00.168835 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:00.168673    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fmqqw\" (UniqueName: \"kubernetes.io/projected/e43edc3c-5e3b-4f88-90c2-f2742ad65f2f-kube-api-access-fmqqw\") pod \"kube-auth-proxy-547dffc8c7-95xxl\" (UID: \"e43edc3c-5e3b-4f88-90c2-f2742ad65f2f\") " pod="openshift-ingress/kube-auth-proxy-547dffc8c7-95xxl"
May 20 19:53:00.168835 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:00.168768    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e43edc3c-5e3b-4f88-90c2-f2742ad65f2f-tls-certs\") pod \"kube-auth-proxy-547dffc8c7-95xxl\" (UID: \"e43edc3c-5e3b-4f88-90c2-f2742ad65f2f\") " pod="openshift-ingress/kube-auth-proxy-547dffc8c7-95xxl"
May 20 19:53:00.269187 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:00.269156    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e43edc3c-5e3b-4f88-90c2-f2742ad65f2f-tls-certs\") pod \"kube-auth-proxy-547dffc8c7-95xxl\" (UID: \"e43edc3c-5e3b-4f88-90c2-f2742ad65f2f\") " pod="openshift-ingress/kube-auth-proxy-547dffc8c7-95xxl"
May 20 19:53:00.269346 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:00.269231    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e43edc3c-5e3b-4f88-90c2-f2742ad65f2f-tmp\") pod \"kube-auth-proxy-547dffc8c7-95xxl\" (UID: \"e43edc3c-5e3b-4f88-90c2-f2742ad65f2f\") " pod="openshift-ingress/kube-auth-proxy-547dffc8c7-95xxl"
May 20 19:53:00.269346 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:00.269279    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fmqqw\" (UniqueName: \"kubernetes.io/projected/e43edc3c-5e3b-4f88-90c2-f2742ad65f2f-kube-api-access-fmqqw\") pod \"kube-auth-proxy-547dffc8c7-95xxl\" (UID: \"e43edc3c-5e3b-4f88-90c2-f2742ad65f2f\") " pod="openshift-ingress/kube-auth-proxy-547dffc8c7-95xxl"
May 20 19:53:00.269346 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:53:00.269315    2578 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found
May 20 19:53:00.269456 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:53:00.269385    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e43edc3c-5e3b-4f88-90c2-f2742ad65f2f-tls-certs podName:e43edc3c-5e3b-4f88-90c2-f2742ad65f2f nodeName:}" failed. No retries permitted until 2026-05-20 19:53:00.769363218 +0000 UTC m=+523.217912052 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/e43edc3c-5e3b-4f88-90c2-f2742ad65f2f-tls-certs") pod "kube-auth-proxy-547dffc8c7-95xxl" (UID: "e43edc3c-5e3b-4f88-90c2-f2742ad65f2f") : secret "kube-auth-proxy-tls" not found
May 20 19:53:00.271552 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:00.271523    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e43edc3c-5e3b-4f88-90c2-f2742ad65f2f-tmp\") pod \"kube-auth-proxy-547dffc8c7-95xxl\" (UID: \"e43edc3c-5e3b-4f88-90c2-f2742ad65f2f\") " pod="openshift-ingress/kube-auth-proxy-547dffc8c7-95xxl"
May 20 19:53:00.280313 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:00.280116    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fmqqw\" (UniqueName: \"kubernetes.io/projected/e43edc3c-5e3b-4f88-90c2-f2742ad65f2f-kube-api-access-fmqqw\") pod \"kube-auth-proxy-547dffc8c7-95xxl\" (UID: \"e43edc3c-5e3b-4f88-90c2-f2742ad65f2f\") " pod="openshift-ingress/kube-auth-proxy-547dffc8c7-95xxl"
May 20 19:53:00.281923 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:00.281902    2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835gg9c7"]
May 20 19:53:00.284972 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:53:00.284949    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4cbcbd24_1dcf_439c_bdc2_4611a6769947.slice/crio-ad66e4dec0716450b4fe7d452e3eaab099c4a6f6e5dbdc3d85c702ee25540847 WatchSource:0}: Error finding container ad66e4dec0716450b4fe7d452e3eaab099c4a6f6e5dbdc3d85c702ee25540847: Status 404 returned error can't find the container with id ad66e4dec0716450b4fe7d452e3eaab099c4a6f6e5dbdc3d85c702ee25540847
May 20 19:53:00.752675 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:00.752570    2578 generic.go:358] "Generic (PLEG): container finished" podID="4cbcbd24-1dcf-439c-bdc2-4611a6769947" containerID="1c769f59d994122f19121f54e5cf50839289b750bf90d29303e69108d5880bf9" exitCode=0
May 20 19:53:00.752675 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:00.752648    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835gg9c7" event={"ID":"4cbcbd24-1dcf-439c-bdc2-4611a6769947","Type":"ContainerDied","Data":"1c769f59d994122f19121f54e5cf50839289b750bf90d29303e69108d5880bf9"}
May 20 19:53:00.752939 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:00.752694    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835gg9c7" event={"ID":"4cbcbd24-1dcf-439c-bdc2-4611a6769947","Type":"ContainerStarted","Data":"ad66e4dec0716450b4fe7d452e3eaab099c4a6f6e5dbdc3d85c702ee25540847"}
May 20 19:53:00.773913 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:00.773879    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e43edc3c-5e3b-4f88-90c2-f2742ad65f2f-tls-certs\") pod \"kube-auth-proxy-547dffc8c7-95xxl\" (UID: \"e43edc3c-5e3b-4f88-90c2-f2742ad65f2f\") " pod="openshift-ingress/kube-auth-proxy-547dffc8c7-95xxl"
May 20 19:53:00.776415 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:00.776397    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e43edc3c-5e3b-4f88-90c2-f2742ad65f2f-tls-certs\") pod \"kube-auth-proxy-547dffc8c7-95xxl\" (UID: \"e43edc3c-5e3b-4f88-90c2-f2742ad65f2f\") " pod="openshift-ingress/kube-auth-proxy-547dffc8c7-95xxl"
May 20 19:53:00.973251 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:00.973169    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-547dffc8c7-95xxl"
May 20 19:53:01.107048 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:01.106887    2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-547dffc8c7-95xxl"]
May 20 19:53:01.109320 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:53:01.109290    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode43edc3c_5e3b_4f88_90c2_f2742ad65f2f.slice/crio-6c8ca16eb0f6ceba0c6926097d5904506ae5c61bb4417a193641ceca8aa4df4f WatchSource:0}: Error finding container 6c8ca16eb0f6ceba0c6926097d5904506ae5c61bb4417a193641ceca8aa4df4f: Status 404 returned error can't find the container with id 6c8ca16eb0f6ceba0c6926097d5904506ae5c61bb4417a193641ceca8aa4df4f
May 20 19:53:01.758383 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:01.758352    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-547dffc8c7-95xxl" event={"ID":"e43edc3c-5e3b-4f88-90c2-f2742ad65f2f","Type":"ContainerStarted","Data":"6c8ca16eb0f6ceba0c6926097d5904506ae5c61bb4417a193641ceca8aa4df4f"}
May 20 19:53:02.764250 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:02.764209    2578 generic.go:358] "Generic (PLEG): container finished" podID="4cbcbd24-1dcf-439c-bdc2-4611a6769947" containerID="c09e382171f315205dd2b0e893bf6bd9b60190422a18ae391614539a6932384c" exitCode=0
May 20 19:53:02.764736 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:02.764291    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835gg9c7" event={"ID":"4cbcbd24-1dcf-439c-bdc2-4611a6769947","Type":"ContainerDied","Data":"c09e382171f315205dd2b0e893bf6bd9b60190422a18ae391614539a6932384c"}
May 20 19:53:03.069693 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:03.069614    2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-858dbf95b8-wps2x"]
May 20 19:53:03.080569 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:03.080011    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-858dbf95b8-wps2x"
May 20 19:53:03.082350 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:03.082322    2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-858dbf95b8-wps2x"]
May 20 19:53:03.082781 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:03.082758    2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
May 20 19:53:03.083154 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:03.082785    2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-vt4f5\""
May 20 19:53:03.195958 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:03.195923    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bkfs8\" (UniqueName: \"kubernetes.io/projected/233ea0c3-5de9-4c5b-9cd5-f591284cffd2-kube-api-access-bkfs8\") pod \"odh-model-controller-858dbf95b8-wps2x\" (UID: \"233ea0c3-5de9-4c5b-9cd5-f591284cffd2\") " pod="opendatahub/odh-model-controller-858dbf95b8-wps2x"
May 20 19:53:03.196151 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:03.196046    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/233ea0c3-5de9-4c5b-9cd5-f591284cffd2-cert\") pod \"odh-model-controller-858dbf95b8-wps2x\" (UID: \"233ea0c3-5de9-4c5b-9cd5-f591284cffd2\") " pod="opendatahub/odh-model-controller-858dbf95b8-wps2x"
May 20 19:53:03.296884 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:03.296863    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bkfs8\" (UniqueName: \"kubernetes.io/projected/233ea0c3-5de9-4c5b-9cd5-f591284cffd2-kube-api-access-bkfs8\") pod \"odh-model-controller-858dbf95b8-wps2x\" (UID: \"233ea0c3-5de9-4c5b-9cd5-f591284cffd2\") " pod="opendatahub/odh-model-controller-858dbf95b8-wps2x"
May 20 19:53:03.296970 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:03.296908    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/233ea0c3-5de9-4c5b-9cd5-f591284cffd2-cert\") pod \"odh-model-controller-858dbf95b8-wps2x\" (UID: \"233ea0c3-5de9-4c5b-9cd5-f591284cffd2\") " pod="opendatahub/odh-model-controller-858dbf95b8-wps2x"
May 20 19:53:03.297026 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:53:03.297015    2578 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
May 20 19:53:03.297076 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:53:03.297067    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/233ea0c3-5de9-4c5b-9cd5-f591284cffd2-cert podName:233ea0c3-5de9-4c5b-9cd5-f591284cffd2 nodeName:}" failed. No retries permitted until 2026-05-20 19:53:03.797049802 +0000 UTC m=+526.245598640 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/233ea0c3-5de9-4c5b-9cd5-f591284cffd2-cert") pod "odh-model-controller-858dbf95b8-wps2x" (UID: "233ea0c3-5de9-4c5b-9cd5-f591284cffd2") : secret "odh-model-controller-webhook-cert" not found
May 20 19:53:03.312292 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:03.312266    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bkfs8\" (UniqueName: \"kubernetes.io/projected/233ea0c3-5de9-4c5b-9cd5-f591284cffd2-kube-api-access-bkfs8\") pod \"odh-model-controller-858dbf95b8-wps2x\" (UID: \"233ea0c3-5de9-4c5b-9cd5-f591284cffd2\") " pod="opendatahub/odh-model-controller-858dbf95b8-wps2x"
May 20 19:53:03.771446 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:03.771390    2578 generic.go:358] "Generic (PLEG): container finished" podID="4cbcbd24-1dcf-439c-bdc2-4611a6769947" containerID="92c566f44137be280be3cb5dbc26ba99f96b25d70ea8066c387a71cddd9777c2" exitCode=0
May 20 19:53:03.771900 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:03.771497    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835gg9c7" event={"ID":"4cbcbd24-1dcf-439c-bdc2-4611a6769947","Type":"ContainerDied","Data":"92c566f44137be280be3cb5dbc26ba99f96b25d70ea8066c387a71cddd9777c2"}
May 20 19:53:03.803292 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:03.803258    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/233ea0c3-5de9-4c5b-9cd5-f591284cffd2-cert\") pod \"odh-model-controller-858dbf95b8-wps2x\" (UID: \"233ea0c3-5de9-4c5b-9cd5-f591284cffd2\") " pod="opendatahub/odh-model-controller-858dbf95b8-wps2x"
May 20 19:53:03.806296 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:03.806265    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/233ea0c3-5de9-4c5b-9cd5-f591284cffd2-cert\") pod \"odh-model-controller-858dbf95b8-wps2x\" (UID: \"233ea0c3-5de9-4c5b-9cd5-f591284cffd2\") " pod="opendatahub/odh-model-controller-858dbf95b8-wps2x"
May 20 19:53:03.993553 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:03.993513    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-858dbf95b8-wps2x"
May 20 19:53:04.383766 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:04.383742    2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-858dbf95b8-wps2x"]
May 20 19:53:04.385277 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:53:04.385246    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod233ea0c3_5de9_4c5b_9cd5_f591284cffd2.slice/crio-83f32d8d652b2dd4428ddf1c9c6208b93e6d8f7166a560a7d840b9e722bf324a WatchSource:0}: Error finding container 83f32d8d652b2dd4428ddf1c9c6208b93e6d8f7166a560a7d840b9e722bf324a: Status 404 returned error can't find the container with id 83f32d8d652b2dd4428ddf1c9c6208b93e6d8f7166a560a7d840b9e722bf324a
May 20 19:53:04.777004 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:04.776962    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-547dffc8c7-95xxl" event={"ID":"e43edc3c-5e3b-4f88-90c2-f2742ad65f2f","Type":"ContainerStarted","Data":"713dc50ff91b8f26166d09d0fa7db7d15a43b9e6a0b7bda332109a20474f0fcc"}
May 20 19:53:04.778079 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:04.778051    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-wps2x" event={"ID":"233ea0c3-5de9-4c5b-9cd5-f591284cffd2","Type":"ContainerStarted","Data":"83f32d8d652b2dd4428ddf1c9c6208b93e6d8f7166a560a7d840b9e722bf324a"}
May 20 19:53:04.794659 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:04.794611    2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-547dffc8c7-95xxl" podStartSLOduration=1.594462197 podStartE2EDuration="4.794595935s" podCreationTimestamp="2026-05-20 19:53:00 +0000 UTC" firstStartedPulling="2026-05-20 19:53:01.111146788 +0000 UTC m=+523.559695624" lastFinishedPulling="2026-05-20 19:53:04.311280516 +0000 UTC m=+526.759829362" observedRunningTime="2026-05-20 19:53:04.792228272 +0000 UTC m=+527.240777138" watchObservedRunningTime="2026-05-20 19:53:04.794595935 +0000 UTC m=+527.243144784"
May 20 19:53:04.907647 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:04.907625    2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835gg9c7"
May 20 19:53:05.011215 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:05.011175    2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4cbcbd24-1dcf-439c-bdc2-4611a6769947-bundle\") pod \"4cbcbd24-1dcf-439c-bdc2-4611a6769947\" (UID: \"4cbcbd24-1dcf-439c-bdc2-4611a6769947\") "
May 20 19:53:05.011404 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:05.011241    2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4cbcbd24-1dcf-439c-bdc2-4611a6769947-util\") pod \"4cbcbd24-1dcf-439c-bdc2-4611a6769947\" (UID: \"4cbcbd24-1dcf-439c-bdc2-4611a6769947\") "
May 20 19:53:05.011404 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:05.011272    2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7s9pv\" (UniqueName: \"kubernetes.io/projected/4cbcbd24-1dcf-439c-bdc2-4611a6769947-kube-api-access-7s9pv\") pod \"4cbcbd24-1dcf-439c-bdc2-4611a6769947\" (UID: \"4cbcbd24-1dcf-439c-bdc2-4611a6769947\") "
May 20 19:53:05.011988 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:05.011954    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4cbcbd24-1dcf-439c-bdc2-4611a6769947-bundle" (OuterVolumeSpecName: "bundle") pod "4cbcbd24-1dcf-439c-bdc2-4611a6769947" (UID: "4cbcbd24-1dcf-439c-bdc2-4611a6769947"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 20 19:53:05.013442 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:05.013417    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4cbcbd24-1dcf-439c-bdc2-4611a6769947-kube-api-access-7s9pv" (OuterVolumeSpecName: "kube-api-access-7s9pv") pod "4cbcbd24-1dcf-439c-bdc2-4611a6769947" (UID: "4cbcbd24-1dcf-439c-bdc2-4611a6769947"). InnerVolumeSpecName "kube-api-access-7s9pv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 20 19:53:05.017211 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:05.017193    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4cbcbd24-1dcf-439c-bdc2-4611a6769947-util" (OuterVolumeSpecName: "util") pod "4cbcbd24-1dcf-439c-bdc2-4611a6769947" (UID: "4cbcbd24-1dcf-439c-bdc2-4611a6769947"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 20 19:53:05.112744 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:05.112669    2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4cbcbd24-1dcf-439c-bdc2-4611a6769947-bundle\") on node \"ip-10-0-134-167.ec2.internal\" DevicePath \"\""
May 20 19:53:05.112744 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:05.112695    2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4cbcbd24-1dcf-439c-bdc2-4611a6769947-util\") on node \"ip-10-0-134-167.ec2.internal\" DevicePath \"\""
May 20 19:53:05.112744 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:05.112706    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7s9pv\" (UniqueName: \"kubernetes.io/projected/4cbcbd24-1dcf-439c-bdc2-4611a6769947-kube-api-access-7s9pv\") on node \"ip-10-0-134-167.ec2.internal\" DevicePath \"\""
May 20 19:53:05.458858 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:05.458798    2578 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-9854f5658-dkbbm" podUID="db7699a5-a474-4a1e-a8af-ca5cb13f67b0" containerName="console" containerID="cri-o://16dde8293ae09d2380fe1647d0c4ce1bac410e75bf93b785d40fcbd196a86339" gracePeriod=15
May 20 19:53:05.726848 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:05.726781    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-9854f5658-dkbbm_db7699a5-a474-4a1e-a8af-ca5cb13f67b0/console/0.log"
May 20 19:53:05.726995 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:05.726864    2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9854f5658-dkbbm"
May 20 19:53:05.783732 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:05.783702    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-9854f5658-dkbbm_db7699a5-a474-4a1e-a8af-ca5cb13f67b0/console/0.log"
May 20 19:53:05.784180 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:05.783751    2578 generic.go:358] "Generic (PLEG): container finished" podID="db7699a5-a474-4a1e-a8af-ca5cb13f67b0" containerID="16dde8293ae09d2380fe1647d0c4ce1bac410e75bf93b785d40fcbd196a86339" exitCode=2
May 20 19:53:05.784180 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:05.783795    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9854f5658-dkbbm" event={"ID":"db7699a5-a474-4a1e-a8af-ca5cb13f67b0","Type":"ContainerDied","Data":"16dde8293ae09d2380fe1647d0c4ce1bac410e75bf93b785d40fcbd196a86339"}
May 20 19:53:05.784180 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:05.783833    2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9854f5658-dkbbm"
May 20 19:53:05.784180 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:05.783852    2578 scope.go:117] "RemoveContainer" containerID="16dde8293ae09d2380fe1647d0c4ce1bac410e75bf93b785d40fcbd196a86339"
May 20 19:53:05.784180 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:05.783839    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9854f5658-dkbbm" event={"ID":"db7699a5-a474-4a1e-a8af-ca5cb13f67b0","Type":"ContainerDied","Data":"fff763fe29ad389dfa32dcdb9e7e8b9a55c21b94763f3ae98c9230f52644cf67"}
May 20 19:53:05.786218 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:05.786156    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835gg9c7" event={"ID":"4cbcbd24-1dcf-439c-bdc2-4611a6769947","Type":"ContainerDied","Data":"ad66e4dec0716450b4fe7d452e3eaab099c4a6f6e5dbdc3d85c702ee25540847"}
May 20 19:53:05.786218 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:05.786183    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ad66e4dec0716450b4fe7d452e3eaab099c4a6f6e5dbdc3d85c702ee25540847"
May 20 19:53:05.786345 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:05.786289    2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835gg9c7"
May 20 19:53:05.794814 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:05.794794    2578 scope.go:117] "RemoveContainer" containerID="16dde8293ae09d2380fe1647d0c4ce1bac410e75bf93b785d40fcbd196a86339"
May 20 19:53:05.795125 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:53:05.795099    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"16dde8293ae09d2380fe1647d0c4ce1bac410e75bf93b785d40fcbd196a86339\": container with ID starting with 16dde8293ae09d2380fe1647d0c4ce1bac410e75bf93b785d40fcbd196a86339 not found: ID does not exist" containerID="16dde8293ae09d2380fe1647d0c4ce1bac410e75bf93b785d40fcbd196a86339"
May 20 19:53:05.795215 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:05.795138    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"16dde8293ae09d2380fe1647d0c4ce1bac410e75bf93b785d40fcbd196a86339"} err="failed to get container status \"16dde8293ae09d2380fe1647d0c4ce1bac410e75bf93b785d40fcbd196a86339\": rpc error: code = NotFound desc = could not find container \"16dde8293ae09d2380fe1647d0c4ce1bac410e75bf93b785d40fcbd196a86339\": container with ID starting with 16dde8293ae09d2380fe1647d0c4ce1bac410e75bf93b785d40fcbd196a86339 not found: ID does not exist"
May 20 19:53:05.819378 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:05.819342    2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/db7699a5-a474-4a1e-a8af-ca5cb13f67b0-console-serving-cert\") pod \"db7699a5-a474-4a1e-a8af-ca5cb13f67b0\" (UID: \"db7699a5-a474-4a1e-a8af-ca5cb13f67b0\") "
May 20 19:53:05.819378 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:05.819382    2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/db7699a5-a474-4a1e-a8af-ca5cb13f67b0-console-config\") pod \"db7699a5-a474-4a1e-a8af-ca5cb13f67b0\" (UID: \"db7699a5-a474-4a1e-a8af-ca5cb13f67b0\") "
May 20 19:53:05.819635 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:05.819409    2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/db7699a5-a474-4a1e-a8af-ca5cb13f67b0-trusted-ca-bundle\") pod \"db7699a5-a474-4a1e-a8af-ca5cb13f67b0\" (UID: \"db7699a5-a474-4a1e-a8af-ca5cb13f67b0\") "
May 20 19:53:05.819635 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:05.819444    2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/db7699a5-a474-4a1e-a8af-ca5cb13f67b0-oauth-serving-cert\") pod \"db7699a5-a474-4a1e-a8af-ca5cb13f67b0\" (UID: \"db7699a5-a474-4a1e-a8af-ca5cb13f67b0\") "
May 20 19:53:05.819635 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:05.819475    2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/db7699a5-a474-4a1e-a8af-ca5cb13f67b0-console-oauth-config\") pod \"db7699a5-a474-4a1e-a8af-ca5cb13f67b0\" (UID: \"db7699a5-a474-4a1e-a8af-ca5cb13f67b0\") "
May 20 19:53:05.819635 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:05.819548    2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/db7699a5-a474-4a1e-a8af-ca5cb13f67b0-service-ca\") pod \"db7699a5-a474-4a1e-a8af-ca5cb13f67b0\" (UID: \"db7699a5-a474-4a1e-a8af-ca5cb13f67b0\") "
May 20 19:53:05.819845 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:05.819648    2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lcfv7\" (UniqueName: \"kubernetes.io/projected/db7699a5-a474-4a1e-a8af-ca5cb13f67b0-kube-api-access-lcfv7\") pod \"db7699a5-a474-4a1e-a8af-ca5cb13f67b0\" (UID: \"db7699a5-a474-4a1e-a8af-ca5cb13f67b0\") "
May 20 19:53:05.819845 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:05.819810    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/db7699a5-a474-4a1e-a8af-ca5cb13f67b0-console-config" (OuterVolumeSpecName: "console-config") pod "db7699a5-a474-4a1e-a8af-ca5cb13f67b0" (UID: "db7699a5-a474-4a1e-a8af-ca5cb13f67b0"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 20 19:53:05.820177 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:05.820145    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/db7699a5-a474-4a1e-a8af-ca5cb13f67b0-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "db7699a5-a474-4a1e-a8af-ca5cb13f67b0" (UID: "db7699a5-a474-4a1e-a8af-ca5cb13f67b0"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 20 19:53:05.820311 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:05.820285    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/db7699a5-a474-4a1e-a8af-ca5cb13f67b0-service-ca" (OuterVolumeSpecName: "service-ca") pod "db7699a5-a474-4a1e-a8af-ca5cb13f67b0" (UID: "db7699a5-a474-4a1e-a8af-ca5cb13f67b0"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 20 19:53:05.820670 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:05.820630    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/db7699a5-a474-4a1e-a8af-ca5cb13f67b0-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "db7699a5-a474-4a1e-a8af-ca5cb13f67b0" (UID: "db7699a5-a474-4a1e-a8af-ca5cb13f67b0"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 20 19:53:05.822321 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:05.822287    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/db7699a5-a474-4a1e-a8af-ca5cb13f67b0-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "db7699a5-a474-4a1e-a8af-ca5cb13f67b0" (UID: "db7699a5-a474-4a1e-a8af-ca5cb13f67b0"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 20 19:53:05.822722 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:05.822695    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/db7699a5-a474-4a1e-a8af-ca5cb13f67b0-kube-api-access-lcfv7" (OuterVolumeSpecName: "kube-api-access-lcfv7") pod "db7699a5-a474-4a1e-a8af-ca5cb13f67b0" (UID: "db7699a5-a474-4a1e-a8af-ca5cb13f67b0"). InnerVolumeSpecName "kube-api-access-lcfv7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 20 19:53:05.822883 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:05.822859    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/db7699a5-a474-4a1e-a8af-ca5cb13f67b0-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "db7699a5-a474-4a1e-a8af-ca5cb13f67b0" (UID: "db7699a5-a474-4a1e-a8af-ca5cb13f67b0"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 20 19:53:05.920837 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:05.920795    2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/db7699a5-a474-4a1e-a8af-ca5cb13f67b0-trusted-ca-bundle\") on node \"ip-10-0-134-167.ec2.internal\" DevicePath \"\""
May 20 19:53:05.920837 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:05.920829    2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/db7699a5-a474-4a1e-a8af-ca5cb13f67b0-oauth-serving-cert\") on node \"ip-10-0-134-167.ec2.internal\" DevicePath \"\""
May 20 19:53:05.920837 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:05.920838    2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/db7699a5-a474-4a1e-a8af-ca5cb13f67b0-console-oauth-config\") on node \"ip-10-0-134-167.ec2.internal\" DevicePath \"\""
May 20 19:53:05.920837 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:05.920847    2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/db7699a5-a474-4a1e-a8af-ca5cb13f67b0-service-ca\") on node \"ip-10-0-134-167.ec2.internal\" DevicePath \"\""
May 20 19:53:05.921092 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:05.920857    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lcfv7\" (UniqueName: \"kubernetes.io/projected/db7699a5-a474-4a1e-a8af-ca5cb13f67b0-kube-api-access-lcfv7\") on node \"ip-10-0-134-167.ec2.internal\" DevicePath \"\""
May 20 19:53:05.921092 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:05.920866    2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/db7699a5-a474-4a1e-a8af-ca5cb13f67b0-console-serving-cert\") on node \"ip-10-0-134-167.ec2.internal\" DevicePath \"\""
May 20 19:53:05.921092 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:05.920875    2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/db7699a5-a474-4a1e-a8af-ca5cb13f67b0-console-config\") on node \"ip-10-0-134-167.ec2.internal\" DevicePath \"\""
May 20 19:53:06.108782 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:06.108749    2578 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-9854f5658-dkbbm"]
May 20 19:53:06.112715 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:06.112689    2578 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-9854f5658-dkbbm"]
May 20 19:53:07.795844 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:07.795806    2578 generic.go:358] "Generic (PLEG): container finished" podID="233ea0c3-5de9-4c5b-9cd5-f591284cffd2" containerID="a83b1a56427423264f16927d562e365af159e0836e6ac05cfa371d78e477ba84" exitCode=1
May 20 19:53:07.796215 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:07.795896    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-wps2x" event={"ID":"233ea0c3-5de9-4c5b-9cd5-f591284cffd2","Type":"ContainerDied","Data":"a83b1a56427423264f16927d562e365af159e0836e6ac05cfa371d78e477ba84"}
May 20 19:53:07.796215 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:07.796134    2578 scope.go:117] "RemoveContainer" containerID="a83b1a56427423264f16927d562e365af159e0836e6ac05cfa371d78e477ba84"
May 20 19:53:08.100873 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:08.100798    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="db7699a5-a474-4a1e-a8af-ca5cb13f67b0" path="/var/lib/kubelet/pods/db7699a5-a474-4a1e-a8af-ca5cb13f67b0/volumes"
May 20 19:53:08.449191 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:08.449154    2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-856948b99f-4xfxw"]
May 20 19:53:08.449542 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:08.449524    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="db7699a5-a474-4a1e-a8af-ca5cb13f67b0" containerName="console"
May 20 19:53:08.449654 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:08.449544    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="db7699a5-a474-4a1e-a8af-ca5cb13f67b0" containerName="console"
May 20 19:53:08.449654 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:08.449566    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4cbcbd24-1dcf-439c-bdc2-4611a6769947" containerName="extract"
May 20 19:53:08.449654 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:08.449575    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="4cbcbd24-1dcf-439c-bdc2-4611a6769947" containerName="extract"
May 20 19:53:08.449654 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:08.449622    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4cbcbd24-1dcf-439c-bdc2-4611a6769947" containerName="util"
May 20 19:53:08.449654 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:08.449631    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="4cbcbd24-1dcf-439c-bdc2-4611a6769947" containerName="util"
May 20 19:53:08.449654 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:08.449645    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4cbcbd24-1dcf-439c-bdc2-4611a6769947" containerName="pull"
May 20 19:53:08.449654 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:08.449654    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="4cbcbd24-1dcf-439c-bdc2-4611a6769947" containerName="pull"
May 20 19:53:08.449966 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:08.449750    2578 memory_manager.go:356] "RemoveStaleState removing state" podUID="db7699a5-a474-4a1e-a8af-ca5cb13f67b0" containerName="console"
May 20 19:53:08.449966 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:08.449762    2578 memory_manager.go:356] "RemoveStaleState removing state" podUID="4cbcbd24-1dcf-439c-bdc2-4611a6769947" containerName="extract"
May 20 19:53:08.452955 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:08.452933    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-856948b99f-4xfxw"
May 20 19:53:08.455476 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:08.455399    2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-gzz5l\""
May 20 19:53:08.455629 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:08.455472    2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
May 20 19:53:08.460336 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:08.460312    2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-856948b99f-4xfxw"]
May 20 19:53:08.543723 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:08.543689    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/eb7b87ee-fe3c-4b1b-8ba0-74c41367302f-cert\") pod \"kserve-controller-manager-856948b99f-4xfxw\" (UID: \"eb7b87ee-fe3c-4b1b-8ba0-74c41367302f\") " pod="opendatahub/kserve-controller-manager-856948b99f-4xfxw"
May 20 19:53:08.543917 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:08.543751    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g8j4h\" (UniqueName: \"kubernetes.io/projected/eb7b87ee-fe3c-4b1b-8ba0-74c41367302f-kube-api-access-g8j4h\") pod \"kserve-controller-manager-856948b99f-4xfxw\" (UID: \"eb7b87ee-fe3c-4b1b-8ba0-74c41367302f\") " pod="opendatahub/kserve-controller-manager-856948b99f-4xfxw"
May 20 19:53:08.644992 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:08.644929    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/eb7b87ee-fe3c-4b1b-8ba0-74c41367302f-cert\") pod \"kserve-controller-manager-856948b99f-4xfxw\" (UID: \"eb7b87ee-fe3c-4b1b-8ba0-74c41367302f\") " pod="opendatahub/kserve-controller-manager-856948b99f-4xfxw"
May 20 19:53:08.645182 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:08.645022    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g8j4h\" (UniqueName: \"kubernetes.io/projected/eb7b87ee-fe3c-4b1b-8ba0-74c41367302f-kube-api-access-g8j4h\") pod \"kserve-controller-manager-856948b99f-4xfxw\" (UID: \"eb7b87ee-fe3c-4b1b-8ba0-74c41367302f\") " pod="opendatahub/kserve-controller-manager-856948b99f-4xfxw"
May 20 19:53:08.645182 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:53:08.645088    2578 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
May 20 19:53:08.645182 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:53:08.645156    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eb7b87ee-fe3c-4b1b-8ba0-74c41367302f-cert podName:eb7b87ee-fe3c-4b1b-8ba0-74c41367302f nodeName:}" failed. No retries permitted until 2026-05-20 19:53:09.145136653 +0000 UTC m=+531.593685485 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/eb7b87ee-fe3c-4b1b-8ba0-74c41367302f-cert") pod "kserve-controller-manager-856948b99f-4xfxw" (UID: "eb7b87ee-fe3c-4b1b-8ba0-74c41367302f") : secret "kserve-webhook-server-cert" not found
May 20 19:53:08.661754 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:08.661726    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g8j4h\" (UniqueName: \"kubernetes.io/projected/eb7b87ee-fe3c-4b1b-8ba0-74c41367302f-kube-api-access-g8j4h\") pod \"kserve-controller-manager-856948b99f-4xfxw\" (UID: \"eb7b87ee-fe3c-4b1b-8ba0-74c41367302f\") " pod="opendatahub/kserve-controller-manager-856948b99f-4xfxw"
May 20 19:53:08.802044 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:08.801951    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-wps2x" event={"ID":"233ea0c3-5de9-4c5b-9cd5-f591284cffd2","Type":"ContainerStarted","Data":"c2c3520b1adb2bd9ee00dc92d794342270eb9c4cea74152adc5eb2bae8aa5880"}
May 20 19:53:08.802433 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:08.802080    2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-858dbf95b8-wps2x"
May 20 19:53:08.819636 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:08.819572    2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/odh-model-controller-858dbf95b8-wps2x" podStartSLOduration=1.957486584 podStartE2EDuration="5.819557333s" podCreationTimestamp="2026-05-20 19:53:03 +0000 UTC" firstStartedPulling="2026-05-20 19:53:04.386710732 +0000 UTC m=+526.835259565" lastFinishedPulling="2026-05-20 19:53:08.248781478 +0000 UTC m=+530.697330314" observedRunningTime="2026-05-20 19:53:08.818821447 +0000 UTC m=+531.267370302" watchObservedRunningTime="2026-05-20 19:53:08.819557333 +0000 UTC m=+531.268106186"
May 20 19:53:09.150824 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:09.150786    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/eb7b87ee-fe3c-4b1b-8ba0-74c41367302f-cert\") pod \"kserve-controller-manager-856948b99f-4xfxw\" (UID: \"eb7b87ee-fe3c-4b1b-8ba0-74c41367302f\") " pod="opendatahub/kserve-controller-manager-856948b99f-4xfxw"
May 20 19:53:09.153421 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:09.153394    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/eb7b87ee-fe3c-4b1b-8ba0-74c41367302f-cert\") pod \"kserve-controller-manager-856948b99f-4xfxw\" (UID: \"eb7b87ee-fe3c-4b1b-8ba0-74c41367302f\") " pod="opendatahub/kserve-controller-manager-856948b99f-4xfxw"
May 20 19:53:09.366992 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:09.366943    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-856948b99f-4xfxw"
May 20 19:53:09.507675 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:09.507649    2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-856948b99f-4xfxw"]
May 20 19:53:09.510333 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:53:09.510289    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb7b87ee_fe3c_4b1b_8ba0_74c41367302f.slice/crio-7439c2ebae3e685c472cfd6829c6981ba893c31234fbc7b9bca4124b33538a89 WatchSource:0}: Error finding container 7439c2ebae3e685c472cfd6829c6981ba893c31234fbc7b9bca4124b33538a89: Status 404 returned error can't find the container with id 7439c2ebae3e685c472cfd6829c6981ba893c31234fbc7b9bca4124b33538a89
May 20 19:53:09.806416 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:09.806314    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-856948b99f-4xfxw" event={"ID":"eb7b87ee-fe3c-4b1b-8ba0-74c41367302f","Type":"ContainerStarted","Data":"7439c2ebae3e685c472cfd6829c6981ba893c31234fbc7b9bca4124b33538a89"}
May 20 19:53:13.823931 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:13.823896    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-856948b99f-4xfxw" event={"ID":"eb7b87ee-fe3c-4b1b-8ba0-74c41367302f","Type":"ContainerStarted","Data":"3a451166658e7958d07e1e18a25af291289df27370a99572558c53853fc62ec0"}
May 20 19:53:13.824309 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:13.823980    2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-856948b99f-4xfxw"
May 20 19:53:13.873068 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:13.873017    2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-856948b99f-4xfxw" podStartSLOduration=2.054561321 podStartE2EDuration="5.873001271s" podCreationTimestamp="2026-05-20 19:53:08 +0000 UTC" firstStartedPulling="2026-05-20 19:53:09.512055858 +0000 UTC m=+531.960604690" lastFinishedPulling="2026-05-20 19:53:13.330495806 +0000 UTC m=+535.779044640" observedRunningTime="2026-05-20 19:53:13.864663123 +0000 UTC m=+536.313211976" watchObservedRunningTime="2026-05-20 19:53:13.873001271 +0000 UTC m=+536.321550125"
May 20 19:53:14.096460 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:14.096388    2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6m56l"]
May 20 19:53:14.100901 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:14.100879    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6m56l"
May 20 19:53:14.104343 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:14.104320    2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-5p7qv\""
May 20 19:53:14.104704 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:14.104687    2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
May 20 19:53:14.105267 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:14.105248    2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
May 20 19:53:14.110136 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:14.110114    2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6m56l"]
May 20 19:53:14.199212 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:14.199174    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/707c9601-0581-491f-b3d2-865bc1b5f85f-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6m56l\" (UID: \"707c9601-0581-491f-b3d2-865bc1b5f85f\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6m56l"
May 20 19:53:14.199388 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:14.199245    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fknkk\" (UniqueName: \"kubernetes.io/projected/707c9601-0581-491f-b3d2-865bc1b5f85f-kube-api-access-fknkk\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6m56l\" (UID: \"707c9601-0581-491f-b3d2-865bc1b5f85f\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6m56l"
May 20 19:53:14.199388 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:14.199316    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/707c9601-0581-491f-b3d2-865bc1b5f85f-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6m56l\" (UID: \"707c9601-0581-491f-b3d2-865bc1b5f85f\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6m56l"
May 20 19:53:14.299752 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:14.299716    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/707c9601-0581-491f-b3d2-865bc1b5f85f-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6m56l\" (UID: \"707c9601-0581-491f-b3d2-865bc1b5f85f\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6m56l"
May 20 19:53:14.299928 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:14.299768    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/707c9601-0581-491f-b3d2-865bc1b5f85f-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6m56l\" (UID: \"707c9601-0581-491f-b3d2-865bc1b5f85f\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6m56l"
May 20 19:53:14.299928 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:14.299814    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fknkk\" (UniqueName: \"kubernetes.io/projected/707c9601-0581-491f-b3d2-865bc1b5f85f-kube-api-access-fknkk\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6m56l\" (UID: \"707c9601-0581-491f-b3d2-865bc1b5f85f\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6m56l"
May 20 19:53:14.300191 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:14.300168    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/707c9601-0581-491f-b3d2-865bc1b5f85f-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6m56l\" (UID: \"707c9601-0581-491f-b3d2-865bc1b5f85f\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6m56l"
May 20 19:53:14.300191 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:14.300185    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/707c9601-0581-491f-b3d2-865bc1b5f85f-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6m56l\" (UID: \"707c9601-0581-491f-b3d2-865bc1b5f85f\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6m56l"
May 20 19:53:14.316099 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:14.316068    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fknkk\" (UniqueName: \"kubernetes.io/projected/707c9601-0581-491f-b3d2-865bc1b5f85f-kube-api-access-fknkk\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6m56l\" (UID: \"707c9601-0581-491f-b3d2-865bc1b5f85f\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6m56l"
May 20 19:53:14.411871 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:14.411832    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6m56l"
May 20 19:53:14.585647 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:14.585552    2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6m56l"]
May 20 19:53:14.588448 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:53:14.588417    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod707c9601_0581_491f_b3d2_865bc1b5f85f.slice/crio-d2871df114e2a4e12312f2629400adf2028580ac33388babbe564723cc3bae7c WatchSource:0}: Error finding container d2871df114e2a4e12312f2629400adf2028580ac33388babbe564723cc3bae7c: Status 404 returned error can't find the container with id d2871df114e2a4e12312f2629400adf2028580ac33388babbe564723cc3bae7c
May 20 19:53:14.829023 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:14.828991    2578 generic.go:358] "Generic (PLEG): container finished" podID="707c9601-0581-491f-b3d2-865bc1b5f85f" containerID="3395594a2c74bda1be8528e04ec117ba6bb36e51d5623b17037daf51bded2deb" exitCode=0
May 20 19:53:14.829438 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:14.829051    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6m56l" event={"ID":"707c9601-0581-491f-b3d2-865bc1b5f85f","Type":"ContainerDied","Data":"3395594a2c74bda1be8528e04ec117ba6bb36e51d5623b17037daf51bded2deb"}
May 20 19:53:14.829438 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:14.829089    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6m56l" event={"ID":"707c9601-0581-491f-b3d2-865bc1b5f85f","Type":"ContainerStarted","Data":"d2871df114e2a4e12312f2629400adf2028580ac33388babbe564723cc3bae7c"}
May 20 19:53:15.290391 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:15.290358    2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-rszwt"]
May 20 19:53:15.293699 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:15.293679    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-55f49c5f94-rszwt"
May 20 19:53:15.296858 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:15.296836    2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\""
May 20 19:53:15.296994 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:15.296965    2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\""
May 20 19:53:15.297151 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:15.297127    2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-76zpp\""
May 20 19:53:15.316861 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:15.316834    2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-rszwt"]
May 20 19:53:15.411033 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:15.411003    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hbpd6\" (UniqueName: \"kubernetes.io/projected/cad8c188-ad90-456e-8eea-6c109796c1a9-kube-api-access-hbpd6\") pod \"servicemesh-operator3-55f49c5f94-rszwt\" (UID: \"cad8c188-ad90-456e-8eea-6c109796c1a9\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-rszwt"
May 20 19:53:15.411182 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:15.411051    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/cad8c188-ad90-456e-8eea-6c109796c1a9-operator-config\") pod \"servicemesh-operator3-55f49c5f94-rszwt\" (UID: \"cad8c188-ad90-456e-8eea-6c109796c1a9\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-rszwt"
May 20 19:53:15.512280 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:15.512227    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hbpd6\" (UniqueName: \"kubernetes.io/projected/cad8c188-ad90-456e-8eea-6c109796c1a9-kube-api-access-hbpd6\") pod \"servicemesh-operator3-55f49c5f94-rszwt\" (UID: \"cad8c188-ad90-456e-8eea-6c109796c1a9\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-rszwt"
May 20 19:53:15.512482 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:15.512296    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/cad8c188-ad90-456e-8eea-6c109796c1a9-operator-config\") pod \"servicemesh-operator3-55f49c5f94-rszwt\" (UID: \"cad8c188-ad90-456e-8eea-6c109796c1a9\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-rszwt"
May 20 19:53:15.515043 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:15.515016    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/cad8c188-ad90-456e-8eea-6c109796c1a9-operator-config\") pod \"servicemesh-operator3-55f49c5f94-rszwt\" (UID: \"cad8c188-ad90-456e-8eea-6c109796c1a9\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-rszwt"
May 20 19:53:15.521893 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:15.521872    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hbpd6\" (UniqueName: \"kubernetes.io/projected/cad8c188-ad90-456e-8eea-6c109796c1a9-kube-api-access-hbpd6\") pod \"servicemesh-operator3-55f49c5f94-rszwt\" (UID: \"cad8c188-ad90-456e-8eea-6c109796c1a9\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-rszwt"
May 20 19:53:15.602948 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:15.602860    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-55f49c5f94-rszwt"
May 20 19:53:15.743170 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:15.740461    2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-rszwt"]
May 20 19:53:15.743646 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:53:15.743619    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcad8c188_ad90_456e_8eea_6c109796c1a9.slice/crio-66e0304223cd7ea57bd7e9d8dd66370be39363bcc93c3c7b6e2abe885d644d3c WatchSource:0}: Error finding container 66e0304223cd7ea57bd7e9d8dd66370be39363bcc93c3c7b6e2abe885d644d3c: Status 404 returned error can't find the container with id 66e0304223cd7ea57bd7e9d8dd66370be39363bcc93c3c7b6e2abe885d644d3c
May 20 19:53:15.834221 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:15.834188    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-55f49c5f94-rszwt" event={"ID":"cad8c188-ad90-456e-8eea-6c109796c1a9","Type":"ContainerStarted","Data":"66e0304223cd7ea57bd7e9d8dd66370be39363bcc93c3c7b6e2abe885d644d3c"}
May 20 19:53:16.841076 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:16.841037    2578 generic.go:358] "Generic (PLEG): container finished" podID="707c9601-0581-491f-b3d2-865bc1b5f85f" containerID="8efb37988ca2486ff19e1bf42231ecd53a64768b6d5381dcbb881d9695993fcd" exitCode=0
May 20 19:53:16.841528 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:16.841098    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6m56l" event={"ID":"707c9601-0581-491f-b3d2-865bc1b5f85f","Type":"ContainerDied","Data":"8efb37988ca2486ff19e1bf42231ecd53a64768b6d5381dcbb881d9695993fcd"}
May 20 19:53:17.847574 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:17.847538    2578 generic.go:358] "Generic (PLEG): container finished" podID="707c9601-0581-491f-b3d2-865bc1b5f85f" containerID="2a801c173bc2f0023fd89b34a5d882c7ccac5ae35a9c051f29d89240463da55a" exitCode=0
May 20 19:53:17.847574 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:17.847630    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6m56l" event={"ID":"707c9601-0581-491f-b3d2-865bc1b5f85f","Type":"ContainerDied","Data":"2a801c173bc2f0023fd89b34a5d882c7ccac5ae35a9c051f29d89240463da55a"}
May 20 19:53:18.853902 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:18.853807    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-55f49c5f94-rszwt" event={"ID":"cad8c188-ad90-456e-8eea-6c109796c1a9","Type":"ContainerStarted","Data":"4699581d73fc8075dcc67de7ef23f6f25d2ec3c05135dc9685cca3c05cebcbc8"}
May 20 19:53:18.854291 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:18.853960    2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-55f49c5f94-rszwt"
May 20 19:53:18.872247 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:18.872031    2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-55f49c5f94-rszwt" podStartSLOduration=1.14588944 podStartE2EDuration="3.872012317s" podCreationTimestamp="2026-05-20 19:53:15 +0000 UTC" firstStartedPulling="2026-05-20 19:53:15.746413023 +0000 UTC m=+538.194961856" lastFinishedPulling="2026-05-20 19:53:18.472535898 +0000 UTC m=+540.921084733" observedRunningTime="2026-05-20 19:53:18.87036779 +0000 UTC m=+541.318916645" watchObservedRunningTime="2026-05-20 19:53:18.872012317 +0000 UTC m=+541.320561171"
May 20 19:53:19.010051 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:19.010026    2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6m56l"
May 20 19:53:19.147477 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:19.147437    2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/707c9601-0581-491f-b3d2-865bc1b5f85f-util\") pod \"707c9601-0581-491f-b3d2-865bc1b5f85f\" (UID: \"707c9601-0581-491f-b3d2-865bc1b5f85f\") "
May 20 19:53:19.147692 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:19.147498    2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/707c9601-0581-491f-b3d2-865bc1b5f85f-bundle\") pod \"707c9601-0581-491f-b3d2-865bc1b5f85f\" (UID: \"707c9601-0581-491f-b3d2-865bc1b5f85f\") "
May 20 19:53:19.147692 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:19.147554    2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fknkk\" (UniqueName: \"kubernetes.io/projected/707c9601-0581-491f-b3d2-865bc1b5f85f-kube-api-access-fknkk\") pod \"707c9601-0581-491f-b3d2-865bc1b5f85f\" (UID: \"707c9601-0581-491f-b3d2-865bc1b5f85f\") "
May 20 19:53:19.148930 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:19.148886    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/707c9601-0581-491f-b3d2-865bc1b5f85f-bundle" (OuterVolumeSpecName: "bundle") pod "707c9601-0581-491f-b3d2-865bc1b5f85f" (UID: "707c9601-0581-491f-b3d2-865bc1b5f85f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 20 19:53:19.150162 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:19.150114    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/707c9601-0581-491f-b3d2-865bc1b5f85f-kube-api-access-fknkk" (OuterVolumeSpecName: "kube-api-access-fknkk") pod "707c9601-0581-491f-b3d2-865bc1b5f85f" (UID: "707c9601-0581-491f-b3d2-865bc1b5f85f"). InnerVolumeSpecName "kube-api-access-fknkk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 20 19:53:19.153920 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:19.153893    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/707c9601-0581-491f-b3d2-865bc1b5f85f-util" (OuterVolumeSpecName: "util") pod "707c9601-0581-491f-b3d2-865bc1b5f85f" (UID: "707c9601-0581-491f-b3d2-865bc1b5f85f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 20 19:53:19.248624 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:19.248577    2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/707c9601-0581-491f-b3d2-865bc1b5f85f-util\") on node \"ip-10-0-134-167.ec2.internal\" DevicePath \"\""
May 20 19:53:19.248624 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:19.248622    2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/707c9601-0581-491f-b3d2-865bc1b5f85f-bundle\") on node \"ip-10-0-134-167.ec2.internal\" DevicePath \"\""
May 20 19:53:19.248624 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:19.248632    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fknkk\" (UniqueName: \"kubernetes.io/projected/707c9601-0581-491f-b3d2-865bc1b5f85f-kube-api-access-fknkk\") on node \"ip-10-0-134-167.ec2.internal\" DevicePath \"\""
May 20 19:53:19.432388 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:19.432292    2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-l99nl"]
May 20 19:53:19.433036 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:19.433016    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="707c9601-0581-491f-b3d2-865bc1b5f85f" containerName="pull"
May 20 19:53:19.433144 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:19.433040    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="707c9601-0581-491f-b3d2-865bc1b5f85f" containerName="pull"
May 20 19:53:19.433144 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:19.433072    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="707c9601-0581-491f-b3d2-865bc1b5f85f" containerName="util"
May 20 19:53:19.433144 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:19.433081    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="707c9601-0581-491f-b3d2-865bc1b5f85f" containerName="util"
May 20 19:53:19.433144 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:19.433123    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="707c9601-0581-491f-b3d2-865bc1b5f85f" containerName="extract"
May 20 19:53:19.433144 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:19.433131    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="707c9601-0581-491f-b3d2-865bc1b5f85f" containerName="extract"
May 20 19:53:19.433369 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:19.433269    2578 memory_manager.go:356] "RemoveStaleState removing state" podUID="707c9601-0581-491f-b3d2-865bc1b5f85f" containerName="extract"
May 20 19:53:19.442628 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:19.442603    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-l99nl"
May 20 19:53:19.444093 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:19.444067    2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-l99nl"]
May 20 19:53:19.445019 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:19.444995    2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
May 20 19:53:19.445161 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:19.445139    2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-nbcz6\""
May 20 19:53:19.445268 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:19.445145    2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
May 20 19:53:19.445268 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:19.445233    2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
May 20 19:53:19.445410 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:19.445266    2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
May 20 19:53:19.550908 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:19.550853    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b6tz8\" (UniqueName: \"kubernetes.io/projected/e51b10d5-8b59-4e8f-a5b1-510574f278db-kube-api-access-b6tz8\") pod \"istiod-openshift-gateway-798958bb55-l99nl\" (UID: \"e51b10d5-8b59-4e8f-a5b1-510574f278db\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-l99nl"
May 20 19:53:19.551078 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:19.550921    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e51b10d5-8b59-4e8f-a5b1-510574f278db-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-l99nl\" (UID: \"e51b10d5-8b59-4e8f-a5b1-510574f278db\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-l99nl"
May 20 19:53:19.551078 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:19.550955    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e51b10d5-8b59-4e8f-a5b1-510574f278db-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-l99nl\" (UID: \"e51b10d5-8b59-4e8f-a5b1-510574f278db\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-l99nl"
May 20 19:53:19.551078 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:19.551016    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e51b10d5-8b59-4e8f-a5b1-510574f278db-local-certs\") pod \"istiod-openshift-gateway-798958bb55-l99nl\" (UID: \"e51b10d5-8b59-4e8f-a5b1-510574f278db\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-l99nl"
May 20 19:53:19.551226 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:19.551102    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e51b10d5-8b59-4e8f-a5b1-510574f278db-cacerts\") pod \"istiod-openshift-gateway-798958bb55-l99nl\" (UID: \"e51b10d5-8b59-4e8f-a5b1-510574f278db\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-l99nl"
May 20 19:53:19.551226 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:19.551154    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e51b10d5-8b59-4e8f-a5b1-510574f278db-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-l99nl\" (UID: \"e51b10d5-8b59-4e8f-a5b1-510574f278db\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-l99nl"
May 20 19:53:19.551226 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:19.551183    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e51b10d5-8b59-4e8f-a5b1-510574f278db-istio-token\") pod \"istiod-openshift-gateway-798958bb55-l99nl\" (UID: \"e51b10d5-8b59-4e8f-a5b1-510574f278db\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-l99nl"
May 20 19:53:19.651627 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:19.651569    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-b6tz8\" (UniqueName: \"kubernetes.io/projected/e51b10d5-8b59-4e8f-a5b1-510574f278db-kube-api-access-b6tz8\") pod \"istiod-openshift-gateway-798958bb55-l99nl\" (UID: \"e51b10d5-8b59-4e8f-a5b1-510574f278db\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-l99nl"
May 20 19:53:19.651822 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:19.651637    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e51b10d5-8b59-4e8f-a5b1-510574f278db-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-l99nl\" (UID: \"e51b10d5-8b59-4e8f-a5b1-510574f278db\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-l99nl"
May 20 19:53:19.651822 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:19.651669    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e51b10d5-8b59-4e8f-a5b1-510574f278db-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-l99nl\" (UID: \"e51b10d5-8b59-4e8f-a5b1-510574f278db\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-l99nl"
May 20 19:53:19.651822 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:19.651713    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e51b10d5-8b59-4e8f-a5b1-510574f278db-local-certs\") pod \"istiod-openshift-gateway-798958bb55-l99nl\" (UID: \"e51b10d5-8b59-4e8f-a5b1-510574f278db\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-l99nl"
May 20 19:53:19.651822 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:19.651779    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e51b10d5-8b59-4e8f-a5b1-510574f278db-cacerts\") pod \"istiod-openshift-gateway-798958bb55-l99nl\" (UID: \"e51b10d5-8b59-4e8f-a5b1-510574f278db\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-l99nl"
May 20 19:53:19.652031 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:19.651824    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e51b10d5-8b59-4e8f-a5b1-510574f278db-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-l99nl\" (UID: \"e51b10d5-8b59-4e8f-a5b1-510574f278db\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-l99nl"
May 20 19:53:19.652031 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:19.651863    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e51b10d5-8b59-4e8f-a5b1-510574f278db-istio-token\") pod \"istiod-openshift-gateway-798958bb55-l99nl\" (UID: \"e51b10d5-8b59-4e8f-a5b1-510574f278db\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-l99nl"
May 20 19:53:19.652486 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:19.652459    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e51b10d5-8b59-4e8f-a5b1-510574f278db-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-l99nl\" (UID: \"e51b10d5-8b59-4e8f-a5b1-510574f278db\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-l99nl"
May 20 19:53:19.654780 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:19.654753    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e51b10d5-8b59-4e8f-a5b1-510574f278db-local-certs\") pod \"istiod-openshift-gateway-798958bb55-l99nl\" (UID: \"e51b10d5-8b59-4e8f-a5b1-510574f278db\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-l99nl"
May 20 19:53:19.654976 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:19.654947    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e51b10d5-8b59-4e8f-a5b1-510574f278db-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-l99nl\" (UID: \"e51b10d5-8b59-4e8f-a5b1-510574f278db\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-l99nl"
May 20 19:53:19.655166 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:19.655125    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e51b10d5-8b59-4e8f-a5b1-510574f278db-cacerts\") pod \"istiod-openshift-gateway-798958bb55-l99nl\" (UID: \"e51b10d5-8b59-4e8f-a5b1-510574f278db\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-l99nl"
May 20 19:53:19.655356 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:19.655337    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e51b10d5-8b59-4e8f-a5b1-510574f278db-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-l99nl\" (UID: \"e51b10d5-8b59-4e8f-a5b1-510574f278db\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-l99nl"
May 20 19:53:19.659793 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:19.659773    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b6tz8\" (UniqueName: \"kubernetes.io/projected/e51b10d5-8b59-4e8f-a5b1-510574f278db-kube-api-access-b6tz8\") pod \"istiod-openshift-gateway-798958bb55-l99nl\" (UID: \"e51b10d5-8b59-4e8f-a5b1-510574f278db\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-l99nl"
May 20 19:53:19.659898 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:19.659805    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e51b10d5-8b59-4e8f-a5b1-510574f278db-istio-token\") pod \"istiod-openshift-gateway-798958bb55-l99nl\" (UID: \"e51b10d5-8b59-4e8f-a5b1-510574f278db\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-l99nl"
May 20 19:53:19.753462 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:19.753368    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-l99nl"
May 20 19:53:19.809983 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:19.809897    2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-858dbf95b8-wps2x"
May 20 19:53:19.864964 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:19.864878    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6m56l" event={"ID":"707c9601-0581-491f-b3d2-865bc1b5f85f","Type":"ContainerDied","Data":"d2871df114e2a4e12312f2629400adf2028580ac33388babbe564723cc3bae7c"}
May 20 19:53:19.864964 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:19.864920    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d2871df114e2a4e12312f2629400adf2028580ac33388babbe564723cc3bae7c"
May 20 19:53:19.864964 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:19.864963    2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6m56l"
May 20 19:53:19.904867 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:19.904837    2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-l99nl"]
May 20 19:53:19.906634 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:53:19.906602    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode51b10d5_8b59_4e8f_a5b1_510574f278db.slice/crio-bc9063d0c311321fbd00d27049e717d1851f8177729973d5b24104fbe222f2f2 WatchSource:0}: Error finding container bc9063d0c311321fbd00d27049e717d1851f8177729973d5b24104fbe222f2f2: Status 404 returned error can't find the container with id bc9063d0c311321fbd00d27049e717d1851f8177729973d5b24104fbe222f2f2
May 20 19:53:20.870233 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:20.870192    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-l99nl" event={"ID":"e51b10d5-8b59-4e8f-a5b1-510574f278db","Type":"ContainerStarted","Data":"bc9063d0c311321fbd00d27049e717d1851f8177729973d5b24104fbe222f2f2"}
May 20 19:53:22.962193 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:22.962150    2578 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
May 20 19:53:22.962463 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:22.962229    2578 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
May 20 19:53:23.883723 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:23.883687    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-l99nl" event={"ID":"e51b10d5-8b59-4e8f-a5b1-510574f278db","Type":"ContainerStarted","Data":"76196f885caf11da983de044815767b0a06becdb63d53cb84fce4094c602cccf"}
May 20 19:53:23.883894 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:23.883792    2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-l99nl"
May 20 19:53:23.906356 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:23.906297    2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-l99nl" podStartSLOduration=1.853167423 podStartE2EDuration="4.906281948s" podCreationTimestamp="2026-05-20 19:53:19 +0000 UTC" firstStartedPulling="2026-05-20 19:53:19.908805092 +0000 UTC m=+542.357353924" lastFinishedPulling="2026-05-20 19:53:22.961919617 +0000 UTC m=+545.410468449" observedRunningTime="2026-05-20 19:53:23.903937176 +0000 UTC m=+546.352486053" watchObservedRunningTime="2026-05-20 19:53:23.906281948 +0000 UTC m=+546.354830801"
May 20 19:53:24.890428 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:24.890398    2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-l99nl"
May 20 19:53:29.867634 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:29.867602    2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-55f49c5f94-rszwt"
May 20 19:53:44.834548 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:53:44.834515    2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-856948b99f-4xfxw"
May 20 19:54:15.910290 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:15.910250    2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15fhl7"]
May 20 19:54:15.913811 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:15.913794    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15fhl7"
May 20 19:54:15.916211 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:15.916187    2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
May 20 19:54:15.916349 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:15.916187    2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-68js4\""
May 20 19:54:15.916349 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:15.916258    2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
May 20 19:54:15.920493 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:15.920467    2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15fhl7"]
May 20 19:54:16.056799 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:16.056756    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/20eab907-6808-4cf3-a63f-89e328eca172-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15fhl7\" (UID: \"20eab907-6808-4cf3-a63f-89e328eca172\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15fhl7"
May 20 19:54:16.056993 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:16.056848    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rmlfz\" (UniqueName: \"kubernetes.io/projected/20eab907-6808-4cf3-a63f-89e328eca172-kube-api-access-rmlfz\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15fhl7\" (UID: \"20eab907-6808-4cf3-a63f-89e328eca172\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15fhl7"
May 20 19:54:16.056993 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:16.056900    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/20eab907-6808-4cf3-a63f-89e328eca172-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15fhl7\" (UID: \"20eab907-6808-4cf3-a63f-89e328eca172\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15fhl7"
May 20 19:54:16.157950 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:16.157907    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rmlfz\" (UniqueName: \"kubernetes.io/projected/20eab907-6808-4cf3-a63f-89e328eca172-kube-api-access-rmlfz\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15fhl7\" (UID: \"20eab907-6808-4cf3-a63f-89e328eca172\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15fhl7"
May 20 19:54:16.158142 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:16.157967    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/20eab907-6808-4cf3-a63f-89e328eca172-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15fhl7\" (UID: \"20eab907-6808-4cf3-a63f-89e328eca172\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15fhl7"
May 20 19:54:16.158142 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:16.158016    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/20eab907-6808-4cf3-a63f-89e328eca172-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15fhl7\" (UID: \"20eab907-6808-4cf3-a63f-89e328eca172\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15fhl7"
May 20 19:54:16.158411 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:16.158387    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/20eab907-6808-4cf3-a63f-89e328eca172-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15fhl7\" (UID: \"20eab907-6808-4cf3-a63f-89e328eca172\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15fhl7"
May 20 19:54:16.158411 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:16.158406    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/20eab907-6808-4cf3-a63f-89e328eca172-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15fhl7\" (UID: \"20eab907-6808-4cf3-a63f-89e328eca172\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15fhl7"
May 20 19:54:16.167393 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:16.167332    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rmlfz\" (UniqueName: \"kubernetes.io/projected/20eab907-6808-4cf3-a63f-89e328eca172-kube-api-access-rmlfz\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15fhl7\" (UID: \"20eab907-6808-4cf3-a63f-89e328eca172\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15fhl7"
May 20 19:54:16.224208 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:16.224173    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15fhl7"
May 20 19:54:16.311106 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:16.311074    2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759g4znt"]
May 20 19:54:16.317723 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:16.317701    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759g4znt"
May 20 19:54:16.322463 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:16.322436    2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759g4znt"]
May 20 19:54:16.370738 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:16.367571    2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15fhl7"]
May 20 19:54:16.460354 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:16.460319    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v7smm\" (UniqueName: \"kubernetes.io/projected/d1b84208-34ef-400e-b775-e9525da1c6b7-kube-api-access-v7smm\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759g4znt\" (UID: \"d1b84208-34ef-400e-b775-e9525da1c6b7\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759g4znt"
May 20 19:54:16.460536 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:16.460368    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d1b84208-34ef-400e-b775-e9525da1c6b7-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759g4znt\" (UID: \"d1b84208-34ef-400e-b775-e9525da1c6b7\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759g4znt"
May 20 19:54:16.460536 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:16.460479    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d1b84208-34ef-400e-b775-e9525da1c6b7-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759g4znt\" (UID: \"d1b84208-34ef-400e-b775-e9525da1c6b7\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759g4znt"
May 20 19:54:16.561442 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:16.561403    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d1b84208-34ef-400e-b775-e9525da1c6b7-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759g4znt\" (UID: \"d1b84208-34ef-400e-b775-e9525da1c6b7\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759g4znt"
May 20 19:54:16.561686 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:16.561469    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-v7smm\" (UniqueName: \"kubernetes.io/projected/d1b84208-34ef-400e-b775-e9525da1c6b7-kube-api-access-v7smm\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759g4znt\" (UID: \"d1b84208-34ef-400e-b775-e9525da1c6b7\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759g4znt"
May 20 19:54:16.561686 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:16.561498    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d1b84208-34ef-400e-b775-e9525da1c6b7-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759g4znt\" (UID: \"d1b84208-34ef-400e-b775-e9525da1c6b7\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759g4znt"
May 20 19:54:16.561861 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:16.561845    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d1b84208-34ef-400e-b775-e9525da1c6b7-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759g4znt\" (UID: \"d1b84208-34ef-400e-b775-e9525da1c6b7\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759g4znt"
May 20 19:54:16.561933 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:16.561904    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d1b84208-34ef-400e-b775-e9525da1c6b7-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759g4znt\" (UID: \"d1b84208-34ef-400e-b775-e9525da1c6b7\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759g4znt"
May 20 19:54:16.571009 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:16.570986    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v7smm\" (UniqueName: \"kubernetes.io/projected/d1b84208-34ef-400e-b775-e9525da1c6b7-kube-api-access-v7smm\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759g4znt\" (UID: \"d1b84208-34ef-400e-b775-e9525da1c6b7\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759g4znt"
May 20 19:54:16.630736 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:16.630695    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759g4znt"
May 20 19:54:16.709212 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:16.709182    2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73l7qpk"]
May 20 19:54:16.714287 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:16.714266    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73l7qpk"
May 20 19:54:16.723536 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:16.723484    2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73l7qpk"]
May 20 19:54:16.770483 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:16.770457    2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759g4znt"]
May 20 19:54:16.772226 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:54:16.772198    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1b84208_34ef_400e_b775_e9525da1c6b7.slice/crio-88e87b40a3312a7d1ee8a86c406131b8a342544e37f0c8c29c6427d48339fec8 WatchSource:0}: Error finding container 88e87b40a3312a7d1ee8a86c406131b8a342544e37f0c8c29c6427d48339fec8: Status 404 returned error can't find the container with id 88e87b40a3312a7d1ee8a86c406131b8a342544e37f0c8c29c6427d48339fec8
May 20 19:54:16.865102 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:16.865060    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3c11ca31-775c-4458-8866-4961543fe323-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73l7qpk\" (UID: \"3c11ca31-775c-4458-8866-4961543fe323\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73l7qpk"
May 20 19:54:16.865315 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:16.865141    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bs2q7\" (UniqueName: \"kubernetes.io/projected/3c11ca31-775c-4458-8866-4961543fe323-kube-api-access-bs2q7\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73l7qpk\" (UID: \"3c11ca31-775c-4458-8866-4961543fe323\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73l7qpk"
May 20 19:54:16.865315 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:16.865264    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3c11ca31-775c-4458-8866-4961543fe323-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73l7qpk\" (UID: \"3c11ca31-775c-4458-8866-4961543fe323\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73l7qpk"
May 20 19:54:16.966833 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:16.966725    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3c11ca31-775c-4458-8866-4961543fe323-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73l7qpk\" (UID: \"3c11ca31-775c-4458-8866-4961543fe323\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73l7qpk"
May 20 19:54:16.966833 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:16.966782    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bs2q7\" (UniqueName: \"kubernetes.io/projected/3c11ca31-775c-4458-8866-4961543fe323-kube-api-access-bs2q7\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73l7qpk\" (UID: \"3c11ca31-775c-4458-8866-4961543fe323\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73l7qpk"
May 20 19:54:16.967250 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:16.966851    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3c11ca31-775c-4458-8866-4961543fe323-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73l7qpk\" (UID: \"3c11ca31-775c-4458-8866-4961543fe323\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73l7qpk"
May 20 19:54:16.967250 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:16.967104    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3c11ca31-775c-4458-8866-4961543fe323-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73l7qpk\" (UID: \"3c11ca31-775c-4458-8866-4961543fe323\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73l7qpk"
May 20 19:54:16.967250 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:16.967142    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3c11ca31-775c-4458-8866-4961543fe323-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73l7qpk\" (UID: \"3c11ca31-775c-4458-8866-4961543fe323\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73l7qpk"
May 20 19:54:16.975265 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:16.975237    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bs2q7\" (UniqueName: \"kubernetes.io/projected/3c11ca31-775c-4458-8866-4961543fe323-kube-api-access-bs2q7\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73l7qpk\" (UID: \"3c11ca31-775c-4458-8866-4961543fe323\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73l7qpk"
May 20 19:54:17.027271 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:17.027234    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73l7qpk"
May 20 19:54:17.079421 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:17.079390    2578 generic.go:358] "Generic (PLEG): container finished" podID="d1b84208-34ef-400e-b775-e9525da1c6b7" containerID="6372a0739356c7bdddfd68b92649f337094aca9a234623666e66df687ed82128" exitCode=0
May 20 19:54:17.079560 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:17.079476    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759g4znt" event={"ID":"d1b84208-34ef-400e-b775-e9525da1c6b7","Type":"ContainerDied","Data":"6372a0739356c7bdddfd68b92649f337094aca9a234623666e66df687ed82128"}
May 20 19:54:17.079560 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:17.079499    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759g4znt" event={"ID":"d1b84208-34ef-400e-b775-e9525da1c6b7","Type":"ContainerStarted","Data":"88e87b40a3312a7d1ee8a86c406131b8a342544e37f0c8c29c6427d48339fec8"}
May 20 19:54:17.081452 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:17.081424    2578 generic.go:358] "Generic (PLEG): container finished" podID="20eab907-6808-4cf3-a63f-89e328eca172" containerID="eacb32b842fc5069cefd8797e951b2e722c90f53cd53920edc23d2af2ed2187e" exitCode=0
May 20 19:54:17.081613 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:17.081564    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15fhl7" event={"ID":"20eab907-6808-4cf3-a63f-89e328eca172","Type":"ContainerDied","Data":"eacb32b842fc5069cefd8797e951b2e722c90f53cd53920edc23d2af2ed2187e"}
May 20 19:54:17.081671 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:17.081619    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15fhl7" event={"ID":"20eab907-6808-4cf3-a63f-89e328eca172","Type":"ContainerStarted","Data":"7b1fa59dfb1b42b0079a108e9f9d11ed6cd66672bbd25a6ecca56b7688ddf084"}
May 20 19:54:17.111613 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:17.111553    2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kmgzp"]
May 20 19:54:17.116669 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:17.116645    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kmgzp"
May 20 19:54:17.126902 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:17.126869    2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kmgzp"]
May 20 19:54:17.171494 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:17.171471    2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73l7qpk"]
May 20 19:54:17.172768 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:54:17.172739    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c11ca31_775c_4458_8866_4961543fe323.slice/crio-c30dfcf5c50f88f075c8092cd8fea5e5ace1339622cf2ea95939d691bd7e72fe WatchSource:0}: Error finding container c30dfcf5c50f88f075c8092cd8fea5e5ace1339622cf2ea95939d691bd7e72fe: Status 404 returned error can't find the container with id c30dfcf5c50f88f075c8092cd8fea5e5ace1339622cf2ea95939d691bd7e72fe
May 20 19:54:17.270713 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:17.270683    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8ec02d37-fde3-47fd-86d6-2262234a92b6-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kmgzp\" (UID: \"8ec02d37-fde3-47fd-86d6-2262234a92b6\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kmgzp"
May 20 19:54:17.270994 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:17.270973    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8ec02d37-fde3-47fd-86d6-2262234a92b6-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kmgzp\" (UID: \"8ec02d37-fde3-47fd-86d6-2262234a92b6\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kmgzp"
May 20 19:54:17.271095 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:17.271032    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zmvzc\" (UniqueName: \"kubernetes.io/projected/8ec02d37-fde3-47fd-86d6-2262234a92b6-kube-api-access-zmvzc\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kmgzp\" (UID: \"8ec02d37-fde3-47fd-86d6-2262234a92b6\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kmgzp"
May 20 19:54:17.372369 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:17.372333    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8ec02d37-fde3-47fd-86d6-2262234a92b6-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kmgzp\" (UID: \"8ec02d37-fde3-47fd-86d6-2262234a92b6\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kmgzp"
May 20 19:54:17.372524 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:17.372374    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zmvzc\" (UniqueName: \"kubernetes.io/projected/8ec02d37-fde3-47fd-86d6-2262234a92b6-kube-api-access-zmvzc\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kmgzp\" (UID: \"8ec02d37-fde3-47fd-86d6-2262234a92b6\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kmgzp"
May 20 19:54:17.372524 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:17.372401    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8ec02d37-fde3-47fd-86d6-2262234a92b6-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kmgzp\" (UID: \"8ec02d37-fde3-47fd-86d6-2262234a92b6\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kmgzp"
May 20 19:54:17.372774 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:17.372755    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8ec02d37-fde3-47fd-86d6-2262234a92b6-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kmgzp\" (UID: \"8ec02d37-fde3-47fd-86d6-2262234a92b6\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kmgzp"
May 20 19:54:17.372813 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:17.372782    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8ec02d37-fde3-47fd-86d6-2262234a92b6-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kmgzp\" (UID: \"8ec02d37-fde3-47fd-86d6-2262234a92b6\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kmgzp"
May 20 19:54:17.381671 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:17.381647    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zmvzc\" (UniqueName: \"kubernetes.io/projected/8ec02d37-fde3-47fd-86d6-2262234a92b6-kube-api-access-zmvzc\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kmgzp\" (UID: \"8ec02d37-fde3-47fd-86d6-2262234a92b6\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kmgzp"
May 20 19:54:17.429598 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:17.429565    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kmgzp"
May 20 19:54:17.562280 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:17.562188    2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kmgzp"]
May 20 19:54:17.564372 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:54:17.564342    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ec02d37_fde3_47fd_86d6_2262234a92b6.slice/crio-c4b6d53ec73007f6d9e192199756d14d1cb1f59cefd1eca5e387ee3c767f6993 WatchSource:0}: Error finding container c4b6d53ec73007f6d9e192199756d14d1cb1f59cefd1eca5e387ee3c767f6993: Status 404 returned error can't find the container with id c4b6d53ec73007f6d9e192199756d14d1cb1f59cefd1eca5e387ee3c767f6993
May 20 19:54:18.086700 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:18.086671    2578 generic.go:358] "Generic (PLEG): container finished" podID="8ec02d37-fde3-47fd-86d6-2262234a92b6" containerID="17d693fe06ed1e1f12e0dade43f014870c55113f1162eeaa5dbd388e799f9814" exitCode=0
May 20 19:54:18.087098 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:18.086734    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kmgzp" event={"ID":"8ec02d37-fde3-47fd-86d6-2262234a92b6","Type":"ContainerDied","Data":"17d693fe06ed1e1f12e0dade43f014870c55113f1162eeaa5dbd388e799f9814"}
May 20 19:54:18.087098 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:18.086764    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kmgzp" event={"ID":"8ec02d37-fde3-47fd-86d6-2262234a92b6","Type":"ContainerStarted","Data":"c4b6d53ec73007f6d9e192199756d14d1cb1f59cefd1eca5e387ee3c767f6993"}
May 20 19:54:18.088298 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:18.088273    2578 generic.go:358] "Generic (PLEG): container finished" podID="3c11ca31-775c-4458-8866-4961543fe323" containerID="93453f856bedc183d95ec8851c4d337a2a064a51ca3809afe5854437bfe4e288" exitCode=0
May 20 19:54:18.088464 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:18.088441    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73l7qpk" event={"ID":"3c11ca31-775c-4458-8866-4961543fe323","Type":"ContainerDied","Data":"93453f856bedc183d95ec8851c4d337a2a064a51ca3809afe5854437bfe4e288"}
May 20 19:54:18.088534 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:18.088472    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73l7qpk" event={"ID":"3c11ca31-775c-4458-8866-4961543fe323","Type":"ContainerStarted","Data":"c30dfcf5c50f88f075c8092cd8fea5e5ace1339622cf2ea95939d691bd7e72fe"}
May 20 19:54:18.114985 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:18.114958    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8nrkk_3bb0c612-bb6f-4213-a7d8-88534ba9e6ee/ovn-acl-logging/0.log"
May 20 19:54:18.116737 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:18.116712    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8nrkk_3bb0c612-bb6f-4213-a7d8-88534ba9e6ee/ovn-acl-logging/0.log"
May 20 19:54:19.094202 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:19.094172    2578 generic.go:358] "Generic (PLEG): container finished" podID="d1b84208-34ef-400e-b775-e9525da1c6b7" containerID="d3199066559ae4537353030ad17cb6f16b2987b7246c08a443ec9d908d316556" exitCode=0
May 20 19:54:19.094616 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:19.094242    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759g4znt" event={"ID":"d1b84208-34ef-400e-b775-e9525da1c6b7","Type":"ContainerDied","Data":"d3199066559ae4537353030ad17cb6f16b2987b7246c08a443ec9d908d316556"}
May 20 19:54:19.096052 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:19.095942    2578 generic.go:358] "Generic (PLEG): container finished" podID="8ec02d37-fde3-47fd-86d6-2262234a92b6" containerID="afc0adedce28899abe8045fca04c8d174709281c7239392f27254ac33b26b368" exitCode=0
May 20 19:54:19.096052 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:19.095999    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kmgzp" event={"ID":"8ec02d37-fde3-47fd-86d6-2262234a92b6","Type":"ContainerDied","Data":"afc0adedce28899abe8045fca04c8d174709281c7239392f27254ac33b26b368"}
May 20 19:54:19.097608 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:19.097573    2578 generic.go:358] "Generic (PLEG): container finished" podID="3c11ca31-775c-4458-8866-4961543fe323" containerID="8455fdaea649a0393a3ec08494bf508f98e8f089f41595b0c807783efe1d7c5a" exitCode=0
May 20 19:54:19.097698 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:19.097624    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73l7qpk" event={"ID":"3c11ca31-775c-4458-8866-4961543fe323","Type":"ContainerDied","Data":"8455fdaea649a0393a3ec08494bf508f98e8f089f41595b0c807783efe1d7c5a"}
May 20 19:54:19.099331 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:19.099310    2578 generic.go:358] "Generic (PLEG): container finished" podID="20eab907-6808-4cf3-a63f-89e328eca172" containerID="d199dc9c08f8309b3822745953c9bdec395f97530ec4d97e50c1e1fbcc22fd3f" exitCode=0
May 20 19:54:19.099426 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:19.099381    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15fhl7" event={"ID":"20eab907-6808-4cf3-a63f-89e328eca172","Type":"ContainerDied","Data":"d199dc9c08f8309b3822745953c9bdec395f97530ec4d97e50c1e1fbcc22fd3f"}
May 20 19:54:20.105379 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:20.105343    2578 generic.go:358] "Generic (PLEG): container finished" podID="d1b84208-34ef-400e-b775-e9525da1c6b7" containerID="e1d58017451e66aabe4b0f31af237b317b07c66eccad902cfd068b2ecfd31ecb" exitCode=0
May 20 19:54:20.105802 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:20.105417    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759g4znt" event={"ID":"d1b84208-34ef-400e-b775-e9525da1c6b7","Type":"ContainerDied","Data":"e1d58017451e66aabe4b0f31af237b317b07c66eccad902cfd068b2ecfd31ecb"}
May 20 19:54:20.107326 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:20.107294    2578 generic.go:358] "Generic (PLEG): container finished" podID="8ec02d37-fde3-47fd-86d6-2262234a92b6" containerID="05e9eb0ab0a2fc4bdef71b93d9b586e5a50d640bb990de27f3528f9274f61e2a" exitCode=0
May 20 19:54:20.107452 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:20.107359    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kmgzp" event={"ID":"8ec02d37-fde3-47fd-86d6-2262234a92b6","Type":"ContainerDied","Data":"05e9eb0ab0a2fc4bdef71b93d9b586e5a50d640bb990de27f3528f9274f61e2a"}
May 20 19:54:20.109000 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:20.108980    2578 generic.go:358] "Generic (PLEG): container finished" podID="3c11ca31-775c-4458-8866-4961543fe323" containerID="d18398a76558e51453b859383426a2b3a85a1b3bd6910862b0b11acfdd08198e" exitCode=0
May 20 19:54:20.109084 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:20.109005    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73l7qpk" event={"ID":"3c11ca31-775c-4458-8866-4961543fe323","Type":"ContainerDied","Data":"d18398a76558e51453b859383426a2b3a85a1b3bd6910862b0b11acfdd08198e"}
May 20 19:54:20.110806 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:20.110790    2578 generic.go:358] "Generic (PLEG): container finished" podID="20eab907-6808-4cf3-a63f-89e328eca172" containerID="13731ba328b4b6e2d80dd812262060587572c84e39f7c626ecf28ca752a8f670" exitCode=0
May 20 19:54:20.110892 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:20.110876    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15fhl7" event={"ID":"20eab907-6808-4cf3-a63f-89e328eca172","Type":"ContainerDied","Data":"13731ba328b4b6e2d80dd812262060587572c84e39f7c626ecf28ca752a8f670"}
May 20 19:54:21.296807 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:21.296783    2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kmgzp"
May 20 19:54:21.299945 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:21.299924    2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73l7qpk"
May 20 19:54:21.365218 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:21.344847    2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759g4znt"
May 20 19:54:21.365218 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:21.348315    2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15fhl7"
May 20 19:54:21.406686 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:21.406651    2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zmvzc\" (UniqueName: \"kubernetes.io/projected/8ec02d37-fde3-47fd-86d6-2262234a92b6-kube-api-access-zmvzc\") pod \"8ec02d37-fde3-47fd-86d6-2262234a92b6\" (UID: \"8ec02d37-fde3-47fd-86d6-2262234a92b6\") "
May 20 19:54:21.406881 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:21.406746    2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3c11ca31-775c-4458-8866-4961543fe323-bundle\") pod \"3c11ca31-775c-4458-8866-4961543fe323\" (UID: \"3c11ca31-775c-4458-8866-4961543fe323\") "
May 20 19:54:21.406881 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:21.406775    2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3c11ca31-775c-4458-8866-4961543fe323-util\") pod \"3c11ca31-775c-4458-8866-4961543fe323\" (UID: \"3c11ca31-775c-4458-8866-4961543fe323\") "
May 20 19:54:21.406881 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:21.406811    2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8ec02d37-fde3-47fd-86d6-2262234a92b6-bundle\") pod \"8ec02d37-fde3-47fd-86d6-2262234a92b6\" (UID: \"8ec02d37-fde3-47fd-86d6-2262234a92b6\") "
May 20 19:54:21.406881 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:21.406847    2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bs2q7\" (UniqueName: \"kubernetes.io/projected/3c11ca31-775c-4458-8866-4961543fe323-kube-api-access-bs2q7\") pod \"3c11ca31-775c-4458-8866-4961543fe323\" (UID: \"3c11ca31-775c-4458-8866-4961543fe323\") "
May 20 19:54:21.406881 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:21.406876    2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8ec02d37-fde3-47fd-86d6-2262234a92b6-util\") pod \"8ec02d37-fde3-47fd-86d6-2262234a92b6\" (UID: \"8ec02d37-fde3-47fd-86d6-2262234a92b6\") "
May 20 19:54:21.407401 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:21.407374    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ec02d37-fde3-47fd-86d6-2262234a92b6-bundle" (OuterVolumeSpecName: "bundle") pod "8ec02d37-fde3-47fd-86d6-2262234a92b6" (UID: "8ec02d37-fde3-47fd-86d6-2262234a92b6"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 20 19:54:21.407513 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:21.407456    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c11ca31-775c-4458-8866-4961543fe323-bundle" (OuterVolumeSpecName: "bundle") pod "3c11ca31-775c-4458-8866-4961543fe323" (UID: "3c11ca31-775c-4458-8866-4961543fe323"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 20 19:54:21.409835 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:21.409811    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3c11ca31-775c-4458-8866-4961543fe323-kube-api-access-bs2q7" (OuterVolumeSpecName: "kube-api-access-bs2q7") pod "3c11ca31-775c-4458-8866-4961543fe323" (UID: "3c11ca31-775c-4458-8866-4961543fe323"). InnerVolumeSpecName "kube-api-access-bs2q7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 20 19:54:21.409923 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:21.409844    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ec02d37-fde3-47fd-86d6-2262234a92b6-kube-api-access-zmvzc" (OuterVolumeSpecName: "kube-api-access-zmvzc") pod "8ec02d37-fde3-47fd-86d6-2262234a92b6" (UID: "8ec02d37-fde3-47fd-86d6-2262234a92b6"). InnerVolumeSpecName "kube-api-access-zmvzc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 20 19:54:21.415301 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:21.415256    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ec02d37-fde3-47fd-86d6-2262234a92b6-util" (OuterVolumeSpecName: "util") pod "8ec02d37-fde3-47fd-86d6-2262234a92b6" (UID: "8ec02d37-fde3-47fd-86d6-2262234a92b6"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 20 19:54:21.415526 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:21.415512    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c11ca31-775c-4458-8866-4961543fe323-util" (OuterVolumeSpecName: "util") pod "3c11ca31-775c-4458-8866-4961543fe323" (UID: "3c11ca31-775c-4458-8866-4961543fe323"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 20 19:54:21.508390 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:21.508354    2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d1b84208-34ef-400e-b775-e9525da1c6b7-util\") pod \"d1b84208-34ef-400e-b775-e9525da1c6b7\" (UID: \"d1b84208-34ef-400e-b775-e9525da1c6b7\") "
May 20 19:54:21.508612 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:21.508416    2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v7smm\" (UniqueName: \"kubernetes.io/projected/d1b84208-34ef-400e-b775-e9525da1c6b7-kube-api-access-v7smm\") pod \"d1b84208-34ef-400e-b775-e9525da1c6b7\" (UID: \"d1b84208-34ef-400e-b775-e9525da1c6b7\") "
May 20 19:54:21.508612 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:21.508440    2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d1b84208-34ef-400e-b775-e9525da1c6b7-bundle\") pod \"d1b84208-34ef-400e-b775-e9525da1c6b7\" (UID: \"d1b84208-34ef-400e-b775-e9525da1c6b7\") "
May 20 19:54:21.508612 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:21.508456    2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/20eab907-6808-4cf3-a63f-89e328eca172-util\") pod \"20eab907-6808-4cf3-a63f-89e328eca172\" (UID: \"20eab907-6808-4cf3-a63f-89e328eca172\") "
May 20 19:54:21.508612 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:21.508489    2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rmlfz\" (UniqueName: \"kubernetes.io/projected/20eab907-6808-4cf3-a63f-89e328eca172-kube-api-access-rmlfz\") pod \"20eab907-6808-4cf3-a63f-89e328eca172\" (UID: \"20eab907-6808-4cf3-a63f-89e328eca172\") "
May 20 19:54:21.508612 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:21.508508    2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/20eab907-6808-4cf3-a63f-89e328eca172-bundle\") pod \"20eab907-6808-4cf3-a63f-89e328eca172\" (UID: \"20eab907-6808-4cf3-a63f-89e328eca172\") "
May 20 19:54:21.508901 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:21.508761    2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3c11ca31-775c-4458-8866-4961543fe323-bundle\") on node \"ip-10-0-134-167.ec2.internal\" DevicePath \"\""
May 20 19:54:21.508901 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:21.508779    2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3c11ca31-775c-4458-8866-4961543fe323-util\") on node \"ip-10-0-134-167.ec2.internal\" DevicePath \"\""
May 20 19:54:21.508901 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:21.508791    2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8ec02d37-fde3-47fd-86d6-2262234a92b6-bundle\") on node \"ip-10-0-134-167.ec2.internal\" DevicePath \"\""
May 20 19:54:21.508901 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:21.508804    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bs2q7\" (UniqueName: \"kubernetes.io/projected/3c11ca31-775c-4458-8866-4961543fe323-kube-api-access-bs2q7\") on node \"ip-10-0-134-167.ec2.internal\" DevicePath \"\""
May 20 19:54:21.508901 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:21.508818    2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8ec02d37-fde3-47fd-86d6-2262234a92b6-util\") on node \"ip-10-0-134-167.ec2.internal\" DevicePath \"\""
May 20 19:54:21.508901 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:21.508831    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zmvzc\" (UniqueName: \"kubernetes.io/projected/8ec02d37-fde3-47fd-86d6-2262234a92b6-kube-api-access-zmvzc\") on node \"ip-10-0-134-167.ec2.internal\" DevicePath \"\""
May 20 19:54:21.509144 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:21.508984    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d1b84208-34ef-400e-b775-e9525da1c6b7-bundle" (OuterVolumeSpecName: "bundle") pod "d1b84208-34ef-400e-b775-e9525da1c6b7" (UID: "d1b84208-34ef-400e-b775-e9525da1c6b7"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 20 19:54:21.509144 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:21.509114    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/20eab907-6808-4cf3-a63f-89e328eca172-bundle" (OuterVolumeSpecName: "bundle") pod "20eab907-6808-4cf3-a63f-89e328eca172" (UID: "20eab907-6808-4cf3-a63f-89e328eca172"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 20 19:54:21.511176 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:21.511154    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/20eab907-6808-4cf3-a63f-89e328eca172-kube-api-access-rmlfz" (OuterVolumeSpecName: "kube-api-access-rmlfz") pod "20eab907-6808-4cf3-a63f-89e328eca172" (UID: "20eab907-6808-4cf3-a63f-89e328eca172"). InnerVolumeSpecName "kube-api-access-rmlfz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 20 19:54:21.511287 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:21.511269    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d1b84208-34ef-400e-b775-e9525da1c6b7-kube-api-access-v7smm" (OuterVolumeSpecName: "kube-api-access-v7smm") pod "d1b84208-34ef-400e-b775-e9525da1c6b7" (UID: "d1b84208-34ef-400e-b775-e9525da1c6b7"). InnerVolumeSpecName "kube-api-access-v7smm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 20 19:54:21.515096 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:21.515075    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/20eab907-6808-4cf3-a63f-89e328eca172-util" (OuterVolumeSpecName: "util") pod "20eab907-6808-4cf3-a63f-89e328eca172" (UID: "20eab907-6808-4cf3-a63f-89e328eca172"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 20 19:54:21.515192 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:21.515174    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d1b84208-34ef-400e-b775-e9525da1c6b7-util" (OuterVolumeSpecName: "util") pod "d1b84208-34ef-400e-b775-e9525da1c6b7" (UID: "d1b84208-34ef-400e-b775-e9525da1c6b7"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 20 19:54:21.609640 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:21.609609    2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d1b84208-34ef-400e-b775-e9525da1c6b7-util\") on node \"ip-10-0-134-167.ec2.internal\" DevicePath \"\""
May 20 19:54:21.609640 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:21.609642    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v7smm\" (UniqueName: \"kubernetes.io/projected/d1b84208-34ef-400e-b775-e9525da1c6b7-kube-api-access-v7smm\") on node \"ip-10-0-134-167.ec2.internal\" DevicePath \"\""
May 20 19:54:21.609817 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:21.609653    2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d1b84208-34ef-400e-b775-e9525da1c6b7-bundle\") on node \"ip-10-0-134-167.ec2.internal\" DevicePath \"\""
May 20 19:54:21.609817 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:21.609664    2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/20eab907-6808-4cf3-a63f-89e328eca172-util\") on node \"ip-10-0-134-167.ec2.internal\" DevicePath \"\""
May 20 19:54:21.609817 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:21.609672    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rmlfz\" (UniqueName: \"kubernetes.io/projected/20eab907-6808-4cf3-a63f-89e328eca172-kube-api-access-rmlfz\") on node \"ip-10-0-134-167.ec2.internal\" DevicePath \"\""
May 20 19:54:21.609817 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:21.609681    2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/20eab907-6808-4cf3-a63f-89e328eca172-bundle\") on node \"ip-10-0-134-167.ec2.internal\" DevicePath \"\""
May 20 19:54:22.123800 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:22.123768    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759g4znt" event={"ID":"d1b84208-34ef-400e-b775-e9525da1c6b7","Type":"ContainerDied","Data":"88e87b40a3312a7d1ee8a86c406131b8a342544e37f0c8c29c6427d48339fec8"}
May 20 19:54:22.123921 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:22.123804    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="88e87b40a3312a7d1ee8a86c406131b8a342544e37f0c8c29c6427d48339fec8"
May 20 19:54:22.123921 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:22.123818    2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759g4znt"
May 20 19:54:22.125496 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:22.125417    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kmgzp" event={"ID":"8ec02d37-fde3-47fd-86d6-2262234a92b6","Type":"ContainerDied","Data":"c4b6d53ec73007f6d9e192199756d14d1cb1f59cefd1eca5e387ee3c767f6993"}
May 20 19:54:22.125496 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:22.125446    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c4b6d53ec73007f6d9e192199756d14d1cb1f59cefd1eca5e387ee3c767f6993"
May 20 19:54:22.125496 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:22.125449    2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kmgzp"
May 20 19:54:22.127502 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:22.127456    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73l7qpk" event={"ID":"3c11ca31-775c-4458-8866-4961543fe323","Type":"ContainerDied","Data":"c30dfcf5c50f88f075c8092cd8fea5e5ace1339622cf2ea95939d691bd7e72fe"}
May 20 19:54:22.127608 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:22.127514    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c30dfcf5c50f88f075c8092cd8fea5e5ace1339622cf2ea95939d691bd7e72fe"
May 20 19:54:22.127608 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:22.127487    2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73l7qpk"
May 20 19:54:22.129377 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:22.129357    2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15fhl7"
May 20 19:54:22.129473 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:22.129376    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15fhl7" event={"ID":"20eab907-6808-4cf3-a63f-89e328eca172","Type":"ContainerDied","Data":"7b1fa59dfb1b42b0079a108e9f9d11ed6cd66672bbd25a6ecca56b7688ddf084"}
May 20 19:54:22.129473 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:22.129401    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7b1fa59dfb1b42b0079a108e9f9d11ed6cd66672bbd25a6ecca56b7688ddf084"
May 20 19:54:32.444186 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:32.444092    2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-8w2s8"]
May 20 19:54:32.444654 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:32.444601    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ec02d37-fde3-47fd-86d6-2262234a92b6" containerName="util"
May 20 19:54:32.444654 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:32.444619    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ec02d37-fde3-47fd-86d6-2262234a92b6" containerName="util"
May 20 19:54:32.444654 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:32.444635    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c11ca31-775c-4458-8866-4961543fe323" containerName="util"
May 20 19:54:32.444654 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:32.444643    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c11ca31-775c-4458-8866-4961543fe323" containerName="util"
May 20 19:54:32.444654 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:32.444654    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ec02d37-fde3-47fd-86d6-2262234a92b6" containerName="extract"
May 20 19:54:32.444918 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:32.444662    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ec02d37-fde3-47fd-86d6-2262234a92b6" containerName="extract"
May 20 19:54:32.444918 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:32.444680    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="20eab907-6808-4cf3-a63f-89e328eca172" containerName="util"
May 20 19:54:32.444918 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:32.444688    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="20eab907-6808-4cf3-a63f-89e328eca172" containerName="util"
May 20 19:54:32.444918 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:32.444699    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d1b84208-34ef-400e-b775-e9525da1c6b7" containerName="extract"
May 20 19:54:32.444918 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:32.444707    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="d1b84208-34ef-400e-b775-e9525da1c6b7" containerName="extract"
May 20 19:54:32.444918 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:32.444716    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="20eab907-6808-4cf3-a63f-89e328eca172" containerName="extract"
May 20 19:54:32.444918 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:32.444724    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="20eab907-6808-4cf3-a63f-89e328eca172" containerName="extract"
May 20 19:54:32.444918 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:32.444752    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ec02d37-fde3-47fd-86d6-2262234a92b6" containerName="pull"
May 20 19:54:32.444918 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:32.444760    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ec02d37-fde3-47fd-86d6-2262234a92b6" containerName="pull"
May 20 19:54:32.444918 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:32.444771    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c11ca31-775c-4458-8866-4961543fe323" containerName="pull"
May 20 19:54:32.444918 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:32.444779    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c11ca31-775c-4458-8866-4961543fe323" containerName="pull"
May 20 19:54:32.444918 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:32.444790    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c11ca31-775c-4458-8866-4961543fe323" containerName="extract"
May 20 19:54:32.444918 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:32.444799    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c11ca31-775c-4458-8866-4961543fe323" containerName="extract"
May 20 19:54:32.444918 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:32.444812    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d1b84208-34ef-400e-b775-e9525da1c6b7" containerName="util"
May 20 19:54:32.444918 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:32.444820    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="d1b84208-34ef-400e-b775-e9525da1c6b7" containerName="util"
May 20 19:54:32.444918 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:32.444829    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d1b84208-34ef-400e-b775-e9525da1c6b7" containerName="pull"
May 20 19:54:32.444918 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:32.444837    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="d1b84208-34ef-400e-b775-e9525da1c6b7" containerName="pull"
May 20 19:54:32.444918 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:32.444846    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="20eab907-6808-4cf3-a63f-89e328eca172" containerName="pull"
May 20 19:54:32.444918 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:32.444853    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="20eab907-6808-4cf3-a63f-89e328eca172" containerName="pull"
May 20 19:54:32.445784 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:32.444939    2578 memory_manager.go:356] "RemoveStaleState removing state" podUID="8ec02d37-fde3-47fd-86d6-2262234a92b6" containerName="extract"
May 20 19:54:32.445784 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:32.444970    2578 memory_manager.go:356] "RemoveStaleState removing state" podUID="3c11ca31-775c-4458-8866-4961543fe323" containerName="extract"
May 20 19:54:32.445784 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:32.444981    2578 memory_manager.go:356] "RemoveStaleState removing state" podUID="d1b84208-34ef-400e-b775-e9525da1c6b7" containerName="extract"
May 20 19:54:32.445784 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:32.444991    2578 memory_manager.go:356] "RemoveStaleState removing state" podUID="20eab907-6808-4cf3-a63f-89e328eca172" containerName="extract"
May 20 19:54:32.449489 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:32.449469    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-657f44b778-8w2s8"
May 20 19:54:32.452331 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:32.452308    2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
May 20 19:54:32.453090 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:32.453075    2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
May 20 19:54:32.453164 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:32.453077    2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-4v22g\""
May 20 19:54:32.458738 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:32.458716    2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-8w2s8"]
May 20 19:54:32.503513 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:32.503476    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gzzwt\" (UniqueName: \"kubernetes.io/projected/1c55f495-ff90-457d-8c33-e646fd2ab9b2-kube-api-access-gzzwt\") pod \"authorino-operator-657f44b778-8w2s8\" (UID: \"1c55f495-ff90-457d-8c33-e646fd2ab9b2\") " pod="kuadrant-system/authorino-operator-657f44b778-8w2s8"
May 20 19:54:32.604519 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:32.604482    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gzzwt\" (UniqueName: \"kubernetes.io/projected/1c55f495-ff90-457d-8c33-e646fd2ab9b2-kube-api-access-gzzwt\") pod \"authorino-operator-657f44b778-8w2s8\" (UID: \"1c55f495-ff90-457d-8c33-e646fd2ab9b2\") " pod="kuadrant-system/authorino-operator-657f44b778-8w2s8"
May 20 19:54:32.620408 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:32.620378    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gzzwt\" (UniqueName: \"kubernetes.io/projected/1c55f495-ff90-457d-8c33-e646fd2ab9b2-kube-api-access-gzzwt\") pod \"authorino-operator-657f44b778-8w2s8\" (UID: \"1c55f495-ff90-457d-8c33-e646fd2ab9b2\") " pod="kuadrant-system/authorino-operator-657f44b778-8w2s8"
May 20 19:54:32.761255 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:32.761164    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-657f44b778-8w2s8"
May 20 19:54:32.896381 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:32.896359    2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-8w2s8"]
May 20 19:54:32.899051 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:54:32.899024    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c55f495_ff90_457d_8c33_e646fd2ab9b2.slice/crio-b49e717bae041133d0e79b07a6ebcb7e04a88f9f2cb45c8ad0c3575938791402 WatchSource:0}: Error finding container b49e717bae041133d0e79b07a6ebcb7e04a88f9f2cb45c8ad0c3575938791402: Status 404 returned error can't find the container with id b49e717bae041133d0e79b07a6ebcb7e04a88f9f2cb45c8ad0c3575938791402
May 20 19:54:32.900909 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:32.900891    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 20 19:54:33.171312 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:33.171275    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-657f44b778-8w2s8" event={"ID":"1c55f495-ff90-457d-8c33-e646fd2ab9b2","Type":"ContainerStarted","Data":"b49e717bae041133d0e79b07a6ebcb7e04a88f9f2cb45c8ad0c3575938791402"}
May 20 19:54:35.186247 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:35.186210    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-657f44b778-8w2s8" event={"ID":"1c55f495-ff90-457d-8c33-e646fd2ab9b2","Type":"ContainerStarted","Data":"0af40827c323ad59ec7b06720d59264fbefd19f9c0890f10c41d0fda60401228"}
May 20 19:54:35.186701 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:35.186341    2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-657f44b778-8w2s8"
May 20 19:54:35.204114 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:35.204063    2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-657f44b778-8w2s8" podStartSLOduration=1.446199693 podStartE2EDuration="3.204047932s" podCreationTimestamp="2026-05-20 19:54:32 +0000 UTC" firstStartedPulling="2026-05-20 19:54:32.901042509 +0000 UTC m=+615.349591341" lastFinishedPulling="2026-05-20 19:54:34.658890749 +0000 UTC m=+617.107439580" observedRunningTime="2026-05-20 19:54:35.201724369 +0000 UTC m=+617.650273223" watchObservedRunningTime="2026-05-20 19:54:35.204047932 +0000 UTC m=+617.652596871"
May 20 19:54:46.193145 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:46.193112    2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-657f44b778-8w2s8"
May 20 19:54:58.773812 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:58.773774    2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-hlk67"]
May 20 19:54:58.778497 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:58.778481    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-hlk67"
May 20 19:54:58.781720 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:58.781698    2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-wvs6r\""
May 20 19:54:58.795436 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:58.795406    2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-hlk67"]
May 20 19:54:58.934624 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:58.934560    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3a74f74b-f38a-4afc-8f74-5addb61e838a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-hlk67\" (UID: \"3a74f74b-f38a-4afc-8f74-5addb61e838a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-hlk67"
May 20 19:54:58.934797 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:58.934693    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mnkmb\" (UniqueName: \"kubernetes.io/projected/3a74f74b-f38a-4afc-8f74-5addb61e838a-kube-api-access-mnkmb\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-hlk67\" (UID: \"3a74f74b-f38a-4afc-8f74-5addb61e838a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-hlk67"
May 20 19:54:59.035648 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:59.035530    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mnkmb\" (UniqueName: \"kubernetes.io/projected/3a74f74b-f38a-4afc-8f74-5addb61e838a-kube-api-access-mnkmb\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-hlk67\" (UID: \"3a74f74b-f38a-4afc-8f74-5addb61e838a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-hlk67"
May 20 19:54:59.035800 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:59.035654    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3a74f74b-f38a-4afc-8f74-5addb61e838a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-hlk67\" (UID: \"3a74f74b-f38a-4afc-8f74-5addb61e838a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-hlk67"
May 20 19:54:59.035996 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:59.035978    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3a74f74b-f38a-4afc-8f74-5addb61e838a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-hlk67\" (UID: \"3a74f74b-f38a-4afc-8f74-5addb61e838a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-hlk67"
May 20 19:54:59.046670 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:59.046637    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mnkmb\" (UniqueName: \"kubernetes.io/projected/3a74f74b-f38a-4afc-8f74-5addb61e838a-kube-api-access-mnkmb\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-hlk67\" (UID: \"3a74f74b-f38a-4afc-8f74-5addb61e838a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-hlk67"
May 20 19:54:59.089105 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:59.089056    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-hlk67"
May 20 19:54:59.230988 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:59.230963    2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-hlk67"]
May 20 19:54:59.233305 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:54:59.233273    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a74f74b_f38a_4afc_8f74_5addb61e838a.slice/crio-d93fbe37f3b08d7ad22ecd46332f8b3956275a459bc2aaf6e95d78110c0cc902 WatchSource:0}: Error finding container d93fbe37f3b08d7ad22ecd46332f8b3956275a459bc2aaf6e95d78110c0cc902: Status 404 returned error can't find the container with id d93fbe37f3b08d7ad22ecd46332f8b3956275a459bc2aaf6e95d78110c0cc902
May 20 19:54:59.283848 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:59.283814    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-hlk67" event={"ID":"3a74f74b-f38a-4afc-8f74-5addb61e838a","Type":"ContainerStarted","Data":"d93fbe37f3b08d7ad22ecd46332f8b3956275a459bc2aaf6e95d78110c0cc902"}
May 20 19:54:59.437600 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:59.437550    2578 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-hlk67"]
May 20 19:54:59.453485 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:59.453455    2578 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-hlk67"]
May 20 19:54:59.467170 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:59.467140    2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-44fwb"]
May 20 19:54:59.472570 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:59.472545    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-44fwb"
May 20 19:54:59.494826 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:59.494797    2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-44fwb"]
May 20 19:54:59.540058 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:59.540028    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-76jxw\" (UniqueName: \"kubernetes.io/projected/70174ad3-a025-4c28-824b-9607ab294e79-kube-api-access-76jxw\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-44fwb\" (UID: \"70174ad3-a025-4c28-824b-9607ab294e79\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-44fwb"
May 20 19:54:59.540222 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:59.540076    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/70174ad3-a025-4c28-824b-9607ab294e79-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-44fwb\" (UID: \"70174ad3-a025-4c28-824b-9607ab294e79\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-44fwb"
May 20 19:54:59.640662 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:59.640628    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-76jxw\" (UniqueName: \"kubernetes.io/projected/70174ad3-a025-4c28-824b-9607ab294e79-kube-api-access-76jxw\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-44fwb\" (UID: \"70174ad3-a025-4c28-824b-9607ab294e79\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-44fwb"
May 20 19:54:59.640808 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:59.640686    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/70174ad3-a025-4c28-824b-9607ab294e79-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-44fwb\" (UID: \"70174ad3-a025-4c28-824b-9607ab294e79\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-44fwb"
May 20 19:54:59.641091 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:59.641072    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/70174ad3-a025-4c28-824b-9607ab294e79-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-44fwb\" (UID: \"70174ad3-a025-4c28-824b-9607ab294e79\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-44fwb"
May 20 19:54:59.649888 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:59.649867    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-76jxw\" (UniqueName: \"kubernetes.io/projected/70174ad3-a025-4c28-824b-9607ab294e79-kube-api-access-76jxw\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-44fwb\" (UID: \"70174ad3-a025-4c28-824b-9607ab294e79\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-44fwb"
May 20 19:54:59.784444 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:59.784372    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-44fwb"
May 20 19:54:59.931165 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:54:59.931023    2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-44fwb"]
May 20 19:55:00.180146 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:55:00.180109    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70174ad3_a025_4c28_824b_9607ab294e79.slice/crio-475dbcace1cc7c1ea75db67d0240cab7927ad138963453cc8e62976241f1adeb WatchSource:0}: Error finding container 475dbcace1cc7c1ea75db67d0240cab7927ad138963453cc8e62976241f1adeb: Status 404 returned error can't find the container with id 475dbcace1cc7c1ea75db67d0240cab7927ad138963453cc8e62976241f1adeb
May 20 19:55:00.289317 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:55:00.289286    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-44fwb" event={"ID":"70174ad3-a025-4c28-824b-9607ab294e79","Type":"ContainerStarted","Data":"475dbcace1cc7c1ea75db67d0240cab7927ad138963453cc8e62976241f1adeb"}
May 20 19:55:04.310829 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:55:04.310791    2578 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-hlk67" podUID="3a74f74b-f38a-4afc-8f74-5addb61e838a" containerName="manager" containerID="cri-o://707498b824126b66460cf7b7aab1943b7104c399a061e509aa9c6fdbbd89fbf7" gracePeriod=2
May 20 19:55:04.312362 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:55:04.312326    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-44fwb" event={"ID":"70174ad3-a025-4c28-824b-9607ab294e79","Type":"ContainerStarted","Data":"a91c8416ce97c2a18bde9c58588e84beef5dd7e792f8e06fb1e1636e2a5303a9"}
May 20 19:55:04.312488 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:55:04.312377    2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-44fwb"
May 20 19:55:04.332858 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:55:04.332813    2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-44fwb" podStartSLOduration=2.089064892 podStartE2EDuration="5.332799389s" podCreationTimestamp="2026-05-20 19:54:59 +0000 UTC" firstStartedPulling="2026-05-20 19:55:00.182967462 +0000 UTC m=+642.631516294" lastFinishedPulling="2026-05-20 19:55:03.426701959 +0000 UTC m=+645.875250791" observedRunningTime="2026-05-20 19:55:04.330577623 +0000 UTC m=+646.779126478" watchObservedRunningTime="2026-05-20 19:55:04.332799389 +0000 UTC m=+646.781348245"
May 20 19:55:04.549738 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:55:04.549714    2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-hlk67"
May 20 19:55:04.553290 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:55:04.553265    2578 status_manager.go:895] "Failed to get status for pod" podUID="3a74f74b-f38a-4afc-8f74-5addb61e838a" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-hlk67" err="pods \"kuadrant-operator-controller-manager-6bc9f4c76f-hlk67\" is forbidden: User \"system:node:ip-10-0-134-167.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-167.ec2.internal' and this object"
May 20 19:55:04.692121 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:55:04.692085    2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3a74f74b-f38a-4afc-8f74-5addb61e838a-extensions-socket-volume\") pod \"3a74f74b-f38a-4afc-8f74-5addb61e838a\" (UID: \"3a74f74b-f38a-4afc-8f74-5addb61e838a\") "
May 20 19:55:04.692307 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:55:04.692159    2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mnkmb\" (UniqueName: \"kubernetes.io/projected/3a74f74b-f38a-4afc-8f74-5addb61e838a-kube-api-access-mnkmb\") pod \"3a74f74b-f38a-4afc-8f74-5addb61e838a\" (UID: \"3a74f74b-f38a-4afc-8f74-5addb61e838a\") "
May 20 19:55:04.692380 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:55:04.692351    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a74f74b-f38a-4afc-8f74-5addb61e838a-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "3a74f74b-f38a-4afc-8f74-5addb61e838a" (UID: "3a74f74b-f38a-4afc-8f74-5addb61e838a"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 20 19:55:04.694367 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:55:04.694341    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3a74f74b-f38a-4afc-8f74-5addb61e838a-kube-api-access-mnkmb" (OuterVolumeSpecName: "kube-api-access-mnkmb") pod "3a74f74b-f38a-4afc-8f74-5addb61e838a" (UID: "3a74f74b-f38a-4afc-8f74-5addb61e838a"). InnerVolumeSpecName "kube-api-access-mnkmb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 20 19:55:04.793104 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:55:04.793070    2578 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3a74f74b-f38a-4afc-8f74-5addb61e838a-extensions-socket-volume\") on node \"ip-10-0-134-167.ec2.internal\" DevicePath \"\""
May 20 19:55:04.793104 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:55:04.793098    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mnkmb\" (UniqueName: \"kubernetes.io/projected/3a74f74b-f38a-4afc-8f74-5addb61e838a-kube-api-access-mnkmb\") on node \"ip-10-0-134-167.ec2.internal\" DevicePath \"\""
May 20 19:55:05.317633 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:55:05.317573    2578 generic.go:358] "Generic (PLEG): container finished" podID="3a74f74b-f38a-4afc-8f74-5addb61e838a" containerID="707498b824126b66460cf7b7aab1943b7104c399a061e509aa9c6fdbbd89fbf7" exitCode=2
May 20 19:55:05.318096 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:55:05.317642    2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-hlk67"
May 20 19:55:05.318096 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:55:05.317676    2578 scope.go:117] "RemoveContainer" containerID="707498b824126b66460cf7b7aab1943b7104c399a061e509aa9c6fdbbd89fbf7"
May 20 19:55:05.319998 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:55:05.319975    2578 status_manager.go:895] "Failed to get status for pod" podUID="3a74f74b-f38a-4afc-8f74-5addb61e838a" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-hlk67" err="pods \"kuadrant-operator-controller-manager-6bc9f4c76f-hlk67\" is forbidden: User \"system:node:ip-10-0-134-167.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-167.ec2.internal' and this object"
May 20 19:55:05.327025 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:55:05.327001    2578 scope.go:117] "RemoveContainer" containerID="707498b824126b66460cf7b7aab1943b7104c399a061e509aa9c6fdbbd89fbf7"
May 20 19:55:05.327264 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:55:05.327248    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"707498b824126b66460cf7b7aab1943b7104c399a061e509aa9c6fdbbd89fbf7\": container with ID starting with 707498b824126b66460cf7b7aab1943b7104c399a061e509aa9c6fdbbd89fbf7 not found: ID does not exist" containerID="707498b824126b66460cf7b7aab1943b7104c399a061e509aa9c6fdbbd89fbf7"
May 20 19:55:05.327321 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:55:05.327271    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"707498b824126b66460cf7b7aab1943b7104c399a061e509aa9c6fdbbd89fbf7"} err="failed to get container status \"707498b824126b66460cf7b7aab1943b7104c399a061e509aa9c6fdbbd89fbf7\": rpc error: code = NotFound desc = could not find container \"707498b824126b66460cf7b7aab1943b7104c399a061e509aa9c6fdbbd89fbf7\": container with ID starting with 707498b824126b66460cf7b7aab1943b7104c399a061e509aa9c6fdbbd89fbf7 not found: ID does not exist"
May 20 19:55:05.327835 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:55:05.327817    2578 status_manager.go:895] "Failed to get status for pod" podUID="3a74f74b-f38a-4afc-8f74-5addb61e838a" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-hlk67" err="pods \"kuadrant-operator-controller-manager-6bc9f4c76f-hlk67\" is forbidden: User \"system:node:ip-10-0-134-167.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-167.ec2.internal' and this object"
May 20 19:55:06.101290 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:55:06.101262    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3a74f74b-f38a-4afc-8f74-5addb61e838a" path="/var/lib/kubelet/pods/3a74f74b-f38a-4afc-8f74-5addb61e838a/volumes"
May 20 19:55:15.320739 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:55:15.320707    2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-44fwb"
May 20 19:55:27.875933 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:55:27.875890    2578 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-44fwb"]
May 20 19:55:27.876412 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:55:27.876151    2578 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-44fwb" podUID="70174ad3-a025-4c28-824b-9607ab294e79" containerName="manager" containerID="cri-o://a91c8416ce97c2a18bde9c58588e84beef5dd7e792f8e06fb1e1636e2a5303a9" gracePeriod=10
May 20 19:55:28.127024 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:55:28.127004    2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-44fwb"
May 20 19:55:28.187086 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:55:28.187055    2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/70174ad3-a025-4c28-824b-9607ab294e79-extensions-socket-volume\") pod \"70174ad3-a025-4c28-824b-9607ab294e79\" (UID: \"70174ad3-a025-4c28-824b-9607ab294e79\") "
May 20 19:55:28.187251 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:55:28.187162    2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-76jxw\" (UniqueName: \"kubernetes.io/projected/70174ad3-a025-4c28-824b-9607ab294e79-kube-api-access-76jxw\") pod \"70174ad3-a025-4c28-824b-9607ab294e79\" (UID: \"70174ad3-a025-4c28-824b-9607ab294e79\") "
May 20 19:55:28.187463 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:55:28.187438    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/70174ad3-a025-4c28-824b-9607ab294e79-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "70174ad3-a025-4c28-824b-9607ab294e79" (UID: "70174ad3-a025-4c28-824b-9607ab294e79"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 20 19:55:28.189462 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:55:28.189437    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/70174ad3-a025-4c28-824b-9607ab294e79-kube-api-access-76jxw" (OuterVolumeSpecName: "kube-api-access-76jxw") pod "70174ad3-a025-4c28-824b-9607ab294e79" (UID: "70174ad3-a025-4c28-824b-9607ab294e79"). InnerVolumeSpecName "kube-api-access-76jxw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 20 19:55:28.287743 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:55:28.287708    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-76jxw\" (UniqueName: \"kubernetes.io/projected/70174ad3-a025-4c28-824b-9607ab294e79-kube-api-access-76jxw\") on node \"ip-10-0-134-167.ec2.internal\" DevicePath \"\""
May 20 19:55:28.287743 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:55:28.287737    2578 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/70174ad3-a025-4c28-824b-9607ab294e79-extensions-socket-volume\") on node \"ip-10-0-134-167.ec2.internal\" DevicePath \"\""
May 20 19:55:28.406931 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:55:28.406845    2578 generic.go:358] "Generic (PLEG): container finished" podID="70174ad3-a025-4c28-824b-9607ab294e79" containerID="a91c8416ce97c2a18bde9c58588e84beef5dd7e792f8e06fb1e1636e2a5303a9" exitCode=0
May 20 19:55:28.406931 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:55:28.406908    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-44fwb" event={"ID":"70174ad3-a025-4c28-824b-9607ab294e79","Type":"ContainerDied","Data":"a91c8416ce97c2a18bde9c58588e84beef5dd7e792f8e06fb1e1636e2a5303a9"}
May 20 19:55:28.407101 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:55:28.406929    2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-44fwb"
May 20 19:55:28.407101 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:55:28.406946    2578 scope.go:117] "RemoveContainer" containerID="a91c8416ce97c2a18bde9c58588e84beef5dd7e792f8e06fb1e1636e2a5303a9"
May 20 19:55:28.407101 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:55:28.406936    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-44fwb" event={"ID":"70174ad3-a025-4c28-824b-9607ab294e79","Type":"ContainerDied","Data":"475dbcace1cc7c1ea75db67d0240cab7927ad138963453cc8e62976241f1adeb"}
May 20 19:55:28.417126 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:55:28.417111    2578 scope.go:117] "RemoveContainer" containerID="a91c8416ce97c2a18bde9c58588e84beef5dd7e792f8e06fb1e1636e2a5303a9"
May 20 19:55:28.417369 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:55:28.417347    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a91c8416ce97c2a18bde9c58588e84beef5dd7e792f8e06fb1e1636e2a5303a9\": container with ID starting with a91c8416ce97c2a18bde9c58588e84beef5dd7e792f8e06fb1e1636e2a5303a9 not found: ID does not exist" containerID="a91c8416ce97c2a18bde9c58588e84beef5dd7e792f8e06fb1e1636e2a5303a9"
May 20 19:55:28.417432 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:55:28.417377    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a91c8416ce97c2a18bde9c58588e84beef5dd7e792f8e06fb1e1636e2a5303a9"} err="failed to get container status \"a91c8416ce97c2a18bde9c58588e84beef5dd7e792f8e06fb1e1636e2a5303a9\": rpc error: code = NotFound desc = could not find container \"a91c8416ce97c2a18bde9c58588e84beef5dd7e792f8e06fb1e1636e2a5303a9\": container with ID starting with a91c8416ce97c2a18bde9c58588e84beef5dd7e792f8e06fb1e1636e2a5303a9 not found: ID does not exist"
May 20 19:55:28.429226 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:55:28.429201    2578 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-44fwb"]
May 20 19:55:28.435031 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:55:28.435010    2578 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-44fwb"]
May 20 19:55:30.103973 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:55:30.103939    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="70174ad3-a025-4c28-824b-9607ab294e79" path="/var/lib/kubelet/pods/70174ad3-a025-4c28-824b-9607ab294e79/volumes"
May 20 19:55:46.465138 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:55:46.465097    2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-ghnq5"]
May 20 19:55:46.465577 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:55:46.465443    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a74f74b-f38a-4afc-8f74-5addb61e838a" containerName="manager"
May 20 19:55:46.465577 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:55:46.465454    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a74f74b-f38a-4afc-8f74-5addb61e838a" containerName="manager"
May 20 19:55:46.465577 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:55:46.465468    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="70174ad3-a025-4c28-824b-9607ab294e79" containerName="manager"
May 20 19:55:46.465577 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:55:46.465473    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="70174ad3-a025-4c28-824b-9607ab294e79" containerName="manager"
May 20 19:55:46.465577 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:55:46.465538    2578 memory_manager.go:356] "RemoveStaleState removing state" podUID="3a74f74b-f38a-4afc-8f74-5addb61e838a" containerName="manager"
May 20 19:55:46.465577 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:55:46.465547    2578 memory_manager.go:356] "RemoveStaleState removing state" podUID="70174ad3-a025-4c28-824b-9607ab294e79" containerName="manager"
May 20 19:55:46.468616 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:55:46.468598    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-ghnq5"
May 20 19:55:46.471227 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:55:46.471204    2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-68js4\""
May 20 19:55:46.471325 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:55:46.471204    2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
May 20 19:55:46.477762 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:55:46.477739    2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-ghnq5"]
May 20 19:55:46.543929 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:55:46.543896    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nq46m\" (UniqueName: \"kubernetes.io/projected/df2898f6-c918-4819-91c6-5286847124a4-kube-api-access-nq46m\") pod \"limitador-limitador-7d549b5b-ghnq5\" (UID: \"df2898f6-c918-4819-91c6-5286847124a4\") " pod="kuadrant-system/limitador-limitador-7d549b5b-ghnq5"
May 20 19:55:46.544111 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:55:46.544061    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/df2898f6-c918-4819-91c6-5286847124a4-config-file\") pod \"limitador-limitador-7d549b5b-ghnq5\" (UID: \"df2898f6-c918-4819-91c6-5286847124a4\") " pod="kuadrant-system/limitador-limitador-7d549b5b-ghnq5"
May 20 19:55:46.560133 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:55:46.560093    2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-ghnq5"]
May 20 19:55:46.644521 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:55:46.644484    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/df2898f6-c918-4819-91c6-5286847124a4-config-file\") pod \"limitador-limitador-7d549b5b-ghnq5\" (UID: \"df2898f6-c918-4819-91c6-5286847124a4\") " pod="kuadrant-system/limitador-limitador-7d549b5b-ghnq5"
May 20 19:55:46.644521 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:55:46.644524    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nq46m\" (UniqueName: \"kubernetes.io/projected/df2898f6-c918-4819-91c6-5286847124a4-kube-api-access-nq46m\") pod \"limitador-limitador-7d549b5b-ghnq5\" (UID: \"df2898f6-c918-4819-91c6-5286847124a4\") " pod="kuadrant-system/limitador-limitador-7d549b5b-ghnq5"
May 20 19:55:46.645173 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:55:46.645149    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/df2898f6-c918-4819-91c6-5286847124a4-config-file\") pod \"limitador-limitador-7d549b5b-ghnq5\" (UID: \"df2898f6-c918-4819-91c6-5286847124a4\") " pod="kuadrant-system/limitador-limitador-7d549b5b-ghnq5"
May 20 19:55:46.652744 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:55:46.652720    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nq46m\" (UniqueName: \"kubernetes.io/projected/df2898f6-c918-4819-91c6-5286847124a4-kube-api-access-nq46m\") pod \"limitador-limitador-7d549b5b-ghnq5\" (UID: \"df2898f6-c918-4819-91c6-5286847124a4\") " pod="kuadrant-system/limitador-limitador-7d549b5b-ghnq5"
May 20 19:55:46.779245 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:55:46.779164    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-ghnq5"
May 20 19:55:46.917004 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:55:46.916978    2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-ghnq5"]
May 20 19:55:47.397718 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:55:47.397684    2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7498df8756-5ngr9"]
May 20 19:55:47.402548 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:55:47.402525    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-5ngr9"
May 20 19:55:47.405518 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:55:47.405501    2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-8zs9p\""
May 20 19:55:47.409975 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:55:47.409941    2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7498df8756-5ngr9"]
May 20 19:55:47.490036 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:55:47.490002    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-ghnq5" event={"ID":"df2898f6-c918-4819-91c6-5286847124a4","Type":"ContainerStarted","Data":"553528dab089465afcd2b8c78eaf6df87a1bc057a828f31ef8c8267c1a1defe1"}
May 20 19:55:47.551892 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:55:47.551828    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sp5cf\" (UniqueName: \"kubernetes.io/projected/3d1642ef-a7ab-47b4-967c-f63230c5904b-kube-api-access-sp5cf\") pod \"authorino-7498df8756-5ngr9\" (UID: \"3d1642ef-a7ab-47b4-967c-f63230c5904b\") " pod="kuadrant-system/authorino-7498df8756-5ngr9"
May 20 19:55:47.653489 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:55:47.653397    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sp5cf\" (UniqueName: \"kubernetes.io/projected/3d1642ef-a7ab-47b4-967c-f63230c5904b-kube-api-access-sp5cf\") pod \"authorino-7498df8756-5ngr9\" (UID: \"3d1642ef-a7ab-47b4-967c-f63230c5904b\") " pod="kuadrant-system/authorino-7498df8756-5ngr9"
May 20 19:55:47.665675 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:55:47.665616    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sp5cf\" (UniqueName: \"kubernetes.io/projected/3d1642ef-a7ab-47b4-967c-f63230c5904b-kube-api-access-sp5cf\") pod \"authorino-7498df8756-5ngr9\" (UID: \"3d1642ef-a7ab-47b4-967c-f63230c5904b\") " pod="kuadrant-system/authorino-7498df8756-5ngr9"
May 20 19:55:47.713996 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:55:47.713934    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-5ngr9"
May 20 19:55:47.886623 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:55:47.886575    2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7498df8756-5ngr9"]
May 20 19:55:48.496418 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:55:48.496383    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-5ngr9" event={"ID":"3d1642ef-a7ab-47b4-967c-f63230c5904b","Type":"ContainerStarted","Data":"c06fb38dbc15b33a98fa7b0f99c1c432fc1ca43558f19ec8a13ad5f6e316a839"}
May 20 19:55:51.510828 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:55:51.510791    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-ghnq5" event={"ID":"df2898f6-c918-4819-91c6-5286847124a4","Type":"ContainerStarted","Data":"f67963cf04f7bbe2c8492729cc5a49a900dd41b35f8b4cbc06bc8208668e92ae"}
May 20 19:55:51.511189 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:55:51.510893    2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-7d549b5b-ghnq5"
May 20 19:55:51.528884 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:55:51.528830    2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-7d549b5b-ghnq5" podStartSLOduration=2.595380863 podStartE2EDuration="5.528816425s" podCreationTimestamp="2026-05-20 19:55:46 +0000 UTC" firstStartedPulling="2026-05-20 19:55:46.920683934 +0000 UTC m=+689.369232766" lastFinishedPulling="2026-05-20 19:55:49.85411949 +0000 UTC m=+692.302668328" observedRunningTime="2026-05-20 19:55:51.527219576 +0000 UTC m=+693.975768431" watchObservedRunningTime="2026-05-20 19:55:51.528816425 +0000 UTC m=+693.977365328"
May 20 19:55:52.516106 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:55:52.516064    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-5ngr9" event={"ID":"3d1642ef-a7ab-47b4-967c-f63230c5904b","Type":"ContainerStarted","Data":"71f6c8786c2745eec3a9aa6bbf13d5ff5e22500b074bb5acb366105ad69c3f1b"}
May 20 19:55:52.530406 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:55:52.530348    2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-7498df8756-5ngr9" podStartSLOduration=1.898922416 podStartE2EDuration="5.530332262s" podCreationTimestamp="2026-05-20 19:55:47 +0000 UTC" firstStartedPulling="2026-05-20 19:55:47.88929287 +0000 UTC m=+690.337841704" lastFinishedPulling="2026-05-20 19:55:51.52070271 +0000 UTC m=+693.969251550" observedRunningTime="2026-05-20 19:55:52.530113656 +0000 UTC m=+694.978662509" watchObservedRunningTime="2026-05-20 19:55:52.530332262 +0000 UTC m=+694.978881129"
May 20 19:56:00.971633 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:56:00.971529    2578 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-ghnq5"]
May 20 19:56:00.972024 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:56:00.971793    2578 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-7d549b5b-ghnq5" podUID="df2898f6-c918-4819-91c6-5286847124a4" containerName="limitador" containerID="cri-o://f67963cf04f7bbe2c8492729cc5a49a900dd41b35f8b4cbc06bc8208668e92ae" gracePeriod=30
May 20 19:56:00.972453 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:56:00.972436    2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-7d549b5b-ghnq5"
May 20 19:56:01.514132 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:56:01.514110    2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-ghnq5"
May 20 19:56:01.553045 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:56:01.552943    2578 generic.go:358] "Generic (PLEG): container finished" podID="df2898f6-c918-4819-91c6-5286847124a4" containerID="f67963cf04f7bbe2c8492729cc5a49a900dd41b35f8b4cbc06bc8208668e92ae" exitCode=0
May 20 19:56:01.553045 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:56:01.553017    2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-ghnq5"
May 20 19:56:01.553045 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:56:01.553038    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-ghnq5" event={"ID":"df2898f6-c918-4819-91c6-5286847124a4","Type":"ContainerDied","Data":"f67963cf04f7bbe2c8492729cc5a49a900dd41b35f8b4cbc06bc8208668e92ae"}
May 20 19:56:01.553319 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:56:01.553081    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-ghnq5" event={"ID":"df2898f6-c918-4819-91c6-5286847124a4","Type":"ContainerDied","Data":"553528dab089465afcd2b8c78eaf6df87a1bc057a828f31ef8c8267c1a1defe1"}
May 20 19:56:01.553319 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:56:01.553103    2578 scope.go:117] "RemoveContainer" containerID="f67963cf04f7bbe2c8492729cc5a49a900dd41b35f8b4cbc06bc8208668e92ae"
May 20 19:56:01.562455 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:56:01.562437    2578 scope.go:117] "RemoveContainer" containerID="f67963cf04f7bbe2c8492729cc5a49a900dd41b35f8b4cbc06bc8208668e92ae"
May 20 19:56:01.562731 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:56:01.562712    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f67963cf04f7bbe2c8492729cc5a49a900dd41b35f8b4cbc06bc8208668e92ae\": container with ID starting with f67963cf04f7bbe2c8492729cc5a49a900dd41b35f8b4cbc06bc8208668e92ae not found: ID does not exist" containerID="f67963cf04f7bbe2c8492729cc5a49a900dd41b35f8b4cbc06bc8208668e92ae"
May 20 19:56:01.562811 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:56:01.562744    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f67963cf04f7bbe2c8492729cc5a49a900dd41b35f8b4cbc06bc8208668e92ae"} err="failed to get container status \"f67963cf04f7bbe2c8492729cc5a49a900dd41b35f8b4cbc06bc8208668e92ae\": rpc error: code = NotFound desc = could not find container \"f67963cf04f7bbe2c8492729cc5a49a900dd41b35f8b4cbc06bc8208668e92ae\": container with ID starting with f67963cf04f7bbe2c8492729cc5a49a900dd41b35f8b4cbc06bc8208668e92ae not found: ID does not exist"
May 20 19:56:01.676154 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:56:01.676123    2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nq46m\" (UniqueName: \"kubernetes.io/projected/df2898f6-c918-4819-91c6-5286847124a4-kube-api-access-nq46m\") pod \"df2898f6-c918-4819-91c6-5286847124a4\" (UID: \"df2898f6-c918-4819-91c6-5286847124a4\") "
May 20 19:56:01.676337 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:56:01.676166    2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/df2898f6-c918-4819-91c6-5286847124a4-config-file\") pod \"df2898f6-c918-4819-91c6-5286847124a4\" (UID: \"df2898f6-c918-4819-91c6-5286847124a4\") "
May 20 19:56:01.676570 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:56:01.676544    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/df2898f6-c918-4819-91c6-5286847124a4-config-file" (OuterVolumeSpecName: "config-file") pod "df2898f6-c918-4819-91c6-5286847124a4" (UID: "df2898f6-c918-4819-91c6-5286847124a4"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 20 19:56:01.678343 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:56:01.678323    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/df2898f6-c918-4819-91c6-5286847124a4-kube-api-access-nq46m" (OuterVolumeSpecName: "kube-api-access-nq46m") pod "df2898f6-c918-4819-91c6-5286847124a4" (UID: "df2898f6-c918-4819-91c6-5286847124a4"). InnerVolumeSpecName "kube-api-access-nq46m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 20 19:56:01.777482 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:56:01.777444    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nq46m\" (UniqueName: \"kubernetes.io/projected/df2898f6-c918-4819-91c6-5286847124a4-kube-api-access-nq46m\") on node \"ip-10-0-134-167.ec2.internal\" DevicePath \"\""
May 20 19:56:01.777482 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:56:01.777474    2578 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/df2898f6-c918-4819-91c6-5286847124a4-config-file\") on node \"ip-10-0-134-167.ec2.internal\" DevicePath \"\""
May 20 19:56:01.875040 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:56:01.875004    2578 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-ghnq5"]
May 20 19:56:01.877215 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:56:01.877189    2578 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-ghnq5"]
May 20 19:56:02.101425 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:56:02.101395    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="df2898f6-c918-4819-91c6-5286847124a4" path="/var/lib/kubelet/pods/df2898f6-c918-4819-91c6-5286847124a4/volumes"
May 20 19:56:02.373091 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:56:02.373045    2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-68c4fbbd6f-qdk87"]
May 20 19:56:02.373440 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:56:02.373427    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="df2898f6-c918-4819-91c6-5286847124a4" containerName="limitador"
May 20 19:56:02.373440 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:56:02.373442    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="df2898f6-c918-4819-91c6-5286847124a4" containerName="limitador"
May 20 19:56:02.373569 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:56:02.373530    2578 memory_manager.go:356] "RemoveStaleState removing state" podUID="df2898f6-c918-4819-91c6-5286847124a4" containerName="limitador"
May 20 19:56:02.377789 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:56:02.377770    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-68c4fbbd6f-qdk87"
May 20 19:56:02.380515 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:56:02.380493    2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-jsx4r\""
May 20 19:56:02.380635 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:56:02.380493    2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\""
May 20 19:56:02.386732 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:56:02.386676    2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-68c4fbbd6f-qdk87"]
May 20 19:56:02.483675 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:56:02.483637    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pk56n\" (UniqueName: \"kubernetes.io/projected/70ecee7c-5759-40fc-98bc-afc553ecd179-kube-api-access-pk56n\") pod \"postgres-68c4fbbd6f-qdk87\" (UID: \"70ecee7c-5759-40fc-98bc-afc553ecd179\") " pod="opendatahub/postgres-68c4fbbd6f-qdk87"
May 20 19:56:02.483868 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:56:02.483721    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/70ecee7c-5759-40fc-98bc-afc553ecd179-data\") pod \"postgres-68c4fbbd6f-qdk87\" (UID: \"70ecee7c-5759-40fc-98bc-afc553ecd179\") " pod="opendatahub/postgres-68c4fbbd6f-qdk87"
May 20 19:56:02.584717 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:56:02.584686    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/70ecee7c-5759-40fc-98bc-afc553ecd179-data\") pod \"postgres-68c4fbbd6f-qdk87\" (UID: \"70ecee7c-5759-40fc-98bc-afc553ecd179\") " pod="opendatahub/postgres-68c4fbbd6f-qdk87"
May 20 19:56:02.584891 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:56:02.584758    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pk56n\" (UniqueName: \"kubernetes.io/projected/70ecee7c-5759-40fc-98bc-afc553ecd179-kube-api-access-pk56n\") pod \"postgres-68c4fbbd6f-qdk87\" (UID: \"70ecee7c-5759-40fc-98bc-afc553ecd179\") " pod="opendatahub/postgres-68c4fbbd6f-qdk87"
May 20 19:56:02.585113 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:56:02.585093    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/70ecee7c-5759-40fc-98bc-afc553ecd179-data\") pod \"postgres-68c4fbbd6f-qdk87\" (UID: \"70ecee7c-5759-40fc-98bc-afc553ecd179\") " pod="opendatahub/postgres-68c4fbbd6f-qdk87"
May 20 19:56:02.593697 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:56:02.593667    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pk56n\" (UniqueName: \"kubernetes.io/projected/70ecee7c-5759-40fc-98bc-afc553ecd179-kube-api-access-pk56n\") pod \"postgres-68c4fbbd6f-qdk87\" (UID: \"70ecee7c-5759-40fc-98bc-afc553ecd179\") " pod="opendatahub/postgres-68c4fbbd6f-qdk87"
May 20 19:56:02.690511 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:56:02.690472    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-68c4fbbd6f-qdk87"
May 20 19:56:02.824982 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:56:02.824957    2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-68c4fbbd6f-qdk87"]
May 20 19:56:02.826912 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:56:02.826882    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70ecee7c_5759_40fc_98bc_afc553ecd179.slice/crio-189a517542a6a55f5e8998fb111ad92c90f382740c2160e61f4f73abd2ff1718 WatchSource:0}: Error finding container 189a517542a6a55f5e8998fb111ad92c90f382740c2160e61f4f73abd2ff1718: Status 404 returned error can't find the container with id 189a517542a6a55f5e8998fb111ad92c90f382740c2160e61f4f73abd2ff1718
May 20 19:56:03.565077 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:56:03.564990    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-68c4fbbd6f-qdk87" event={"ID":"70ecee7c-5759-40fc-98bc-afc553ecd179","Type":"ContainerStarted","Data":"189a517542a6a55f5e8998fb111ad92c90f382740c2160e61f4f73abd2ff1718"}
May 20 19:56:08.588389 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:56:08.588352    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-68c4fbbd6f-qdk87" event={"ID":"70ecee7c-5759-40fc-98bc-afc553ecd179","Type":"ContainerStarted","Data":"a11894d87254dfa05378b4df725b004da41bf9ce465b568a5785badcebefde6a"}
May 20 19:56:08.588841 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:56:08.588500    2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-68c4fbbd6f-qdk87"
May 20 19:56:08.607385 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:56:08.607329    2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/postgres-68c4fbbd6f-qdk87" podStartSLOduration=1.816187411 podStartE2EDuration="6.607315274s" podCreationTimestamp="2026-05-20 19:56:02 +0000 UTC" firstStartedPulling="2026-05-20 19:56:02.82867709 +0000 UTC m=+705.277225924" lastFinishedPulling="2026-05-20 19:56:07.619804952 +0000 UTC m=+710.068353787" observedRunningTime="2026-05-20 19:56:08.604552155 +0000 UTC m=+711.053101020" watchObservedRunningTime="2026-05-20 19:56:08.607315274 +0000 UTC m=+711.055864165"
May 20 19:56:14.622521 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:56:14.622490    2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-68c4fbbd6f-qdk87"
May 20 19:56:20.055658 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:56:20.055625    2578 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7498df8756-5ngr9"]
May 20 19:56:20.056085 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:56:20.055818    2578 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-7498df8756-5ngr9" podUID="3d1642ef-a7ab-47b4-967c-f63230c5904b" containerName="authorino" containerID="cri-o://71f6c8786c2745eec3a9aa6bbf13d5ff5e22500b074bb5acb366105ad69c3f1b" gracePeriod=30
May 20 19:56:20.637118 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:56:20.637080    2578 generic.go:358] "Generic (PLEG): container finished" podID="3d1642ef-a7ab-47b4-967c-f63230c5904b" containerID="71f6c8786c2745eec3a9aa6bbf13d5ff5e22500b074bb5acb366105ad69c3f1b" exitCode=0
May 20 19:56:20.637420 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:56:20.637160    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-5ngr9" event={"ID":"3d1642ef-a7ab-47b4-967c-f63230c5904b","Type":"ContainerDied","Data":"71f6c8786c2745eec3a9aa6bbf13d5ff5e22500b074bb5acb366105ad69c3f1b"}
May 20 19:56:20.833521 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:56:20.833499    2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-5ngr9"
May 20 19:56:20.931433 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:56:20.931350    2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sp5cf\" (UniqueName: \"kubernetes.io/projected/3d1642ef-a7ab-47b4-967c-f63230c5904b-kube-api-access-sp5cf\") pod \"3d1642ef-a7ab-47b4-967c-f63230c5904b\" (UID: \"3d1642ef-a7ab-47b4-967c-f63230c5904b\") "
May 20 19:56:20.933574 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:56:20.933542    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3d1642ef-a7ab-47b4-967c-f63230c5904b-kube-api-access-sp5cf" (OuterVolumeSpecName: "kube-api-access-sp5cf") pod "3d1642ef-a7ab-47b4-967c-f63230c5904b" (UID: "3d1642ef-a7ab-47b4-967c-f63230c5904b"). InnerVolumeSpecName "kube-api-access-sp5cf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 20 19:56:21.031926 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:56:21.031880    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sp5cf\" (UniqueName: \"kubernetes.io/projected/3d1642ef-a7ab-47b4-967c-f63230c5904b-kube-api-access-sp5cf\") on node \"ip-10-0-134-167.ec2.internal\" DevicePath \"\""
May 20 19:56:21.641951 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:56:21.641915    2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-5ngr9"
May 20 19:56:21.642416 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:56:21.641956    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-5ngr9" event={"ID":"3d1642ef-a7ab-47b4-967c-f63230c5904b","Type":"ContainerDied","Data":"c06fb38dbc15b33a98fa7b0f99c1c432fc1ca43558f19ec8a13ad5f6e316a839"}
May 20 19:56:21.642416 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:56:21.642001    2578 scope.go:117] "RemoveContainer" containerID="71f6c8786c2745eec3a9aa6bbf13d5ff5e22500b074bb5acb366105ad69c3f1b"
May 20 19:56:21.663471 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:56:21.663439    2578 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7498df8756-5ngr9"]
May 20 19:56:21.665781 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:56:21.665760    2578 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7498df8756-5ngr9"]
May 20 19:56:22.101137 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:56:22.101054    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3d1642ef-a7ab-47b4-967c-f63230c5904b" path="/var/lib/kubelet/pods/3d1642ef-a7ab-47b4-967c-f63230c5904b/volumes"
May 20 19:56:23.135207 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:56:23.135173    2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6c47cd95d5-6f7cq"]
May 20 19:56:23.136005 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:56:23.135542    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d1642ef-a7ab-47b4-967c-f63230c5904b" containerName="authorino"
May 20 19:56:23.136005 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:56:23.135554    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d1642ef-a7ab-47b4-967c-f63230c5904b" containerName="authorino"
May 20 19:56:23.136005 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:56:23.135640    2578 memory_manager.go:356] "RemoveStaleState removing state" podUID="3d1642ef-a7ab-47b4-967c-f63230c5904b" containerName="authorino"
May 20 19:56:23.140235 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:56:23.140213    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6c47cd95d5-6f7cq"
May 20 19:56:23.143079 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:56:23.143057    2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-w5nmk\""
May 20 19:56:23.143175 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:56:23.143098    2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
May 20 19:56:23.144902 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:56:23.144880    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z9kpq\" (UniqueName: \"kubernetes.io/projected/a49f268a-2139-4e2a-b7d2-bbe3c7ae72b1-kube-api-access-z9kpq\") pod \"maas-controller-6c47cd95d5-6f7cq\" (UID: \"a49f268a-2139-4e2a-b7d2-bbe3c7ae72b1\") " pod="opendatahub/maas-controller-6c47cd95d5-6f7cq"
May 20 19:56:23.150128 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:56:23.150106    2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6c47cd95d5-6f7cq"]
May 20 19:56:23.245862 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:56:23.245825    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-z9kpq\" (UniqueName: \"kubernetes.io/projected/a49f268a-2139-4e2a-b7d2-bbe3c7ae72b1-kube-api-access-z9kpq\") pod \"maas-controller-6c47cd95d5-6f7cq\" (UID: \"a49f268a-2139-4e2a-b7d2-bbe3c7ae72b1\") " pod="opendatahub/maas-controller-6c47cd95d5-6f7cq"
May 20 19:56:23.255519 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:56:23.255495    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z9kpq\" (UniqueName: \"kubernetes.io/projected/a49f268a-2139-4e2a-b7d2-bbe3c7ae72b1-kube-api-access-z9kpq\") pod \"maas-controller-6c47cd95d5-6f7cq\" (UID: \"a49f268a-2139-4e2a-b7d2-bbe3c7ae72b1\") " pod="opendatahub/maas-controller-6c47cd95d5-6f7cq"
May 20 19:56:23.290643 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:56:23.290608    2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6ff67b8ddc-jzqlk"]
May 20 19:56:23.294208 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:56:23.294179    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6ff67b8ddc-jzqlk"
May 20 19:56:23.306574 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:56:23.306546    2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6ff67b8ddc-jzqlk"]
May 20 19:56:23.346370 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:56:23.346338    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-thtbl\" (UniqueName: \"kubernetes.io/projected/f8d17c3a-2ba2-4291-a971-60bc2671cfae-kube-api-access-thtbl\") pod \"maas-controller-6ff67b8ddc-jzqlk\" (UID: \"f8d17c3a-2ba2-4291-a971-60bc2671cfae\") " pod="opendatahub/maas-controller-6ff67b8ddc-jzqlk"
May 20 19:56:23.447311 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:56:23.447222    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-thtbl\" (UniqueName: \"kubernetes.io/projected/f8d17c3a-2ba2-4291-a971-60bc2671cfae-kube-api-access-thtbl\") pod \"maas-controller-6ff67b8ddc-jzqlk\" (UID: \"f8d17c3a-2ba2-4291-a971-60bc2671cfae\") " pod="opendatahub/maas-controller-6ff67b8ddc-jzqlk"
May 20 19:56:23.452178 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:56:23.452156    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6c47cd95d5-6f7cq"
May 20 19:56:23.456504 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:56:23.456479    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-thtbl\" (UniqueName: \"kubernetes.io/projected/f8d17c3a-2ba2-4291-a971-60bc2671cfae-kube-api-access-thtbl\") pod \"maas-controller-6ff67b8ddc-jzqlk\" (UID: \"f8d17c3a-2ba2-4291-a971-60bc2671cfae\") " pod="opendatahub/maas-controller-6ff67b8ddc-jzqlk"
May 20 19:56:23.588130 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:56:23.588103    2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6c47cd95d5-6f7cq"]
May 20 19:56:23.589916 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:56:23.589887    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda49f268a_2139_4e2a_b7d2_bbe3c7ae72b1.slice/crio-20eae453ffe4df7d37f6fbb2998771e38b65c9fd4178929e380ac1847945de77 WatchSource:0}: Error finding container 20eae453ffe4df7d37f6fbb2998771e38b65c9fd4178929e380ac1847945de77: Status 404 returned error can't find the container with id 20eae453ffe4df7d37f6fbb2998771e38b65c9fd4178929e380ac1847945de77
May 20 19:56:23.605689 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:56:23.605665    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6ff67b8ddc-jzqlk"
May 20 19:56:23.652281 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:56:23.652222    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6c47cd95d5-6f7cq" event={"ID":"a49f268a-2139-4e2a-b7d2-bbe3c7ae72b1","Type":"ContainerStarted","Data":"20eae453ffe4df7d37f6fbb2998771e38b65c9fd4178929e380ac1847945de77"}
May 20 19:56:23.741830 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:56:23.741804    2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6ff67b8ddc-jzqlk"]
May 20 19:56:23.742863 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:56:23.742840    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8d17c3a_2ba2_4291_a971_60bc2671cfae.slice/crio-8780f1a8419be736c77f9a1941c4a41814c30da7a100c201578baafbed5d6602 WatchSource:0}: Error finding container 8780f1a8419be736c77f9a1941c4a41814c30da7a100c201578baafbed5d6602: Status 404 returned error can't find the container with id 8780f1a8419be736c77f9a1941c4a41814c30da7a100c201578baafbed5d6602
May 20 19:56:24.659613 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:56:24.659559    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6ff67b8ddc-jzqlk" event={"ID":"f8d17c3a-2ba2-4291-a971-60bc2671cfae","Type":"ContainerStarted","Data":"8780f1a8419be736c77f9a1941c4a41814c30da7a100c201578baafbed5d6602"}
May 20 19:56:26.670001 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:56:26.669959    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6ff67b8ddc-jzqlk" event={"ID":"f8d17c3a-2ba2-4291-a971-60bc2671cfae","Type":"ContainerStarted","Data":"f30f862eb00e4ed296fc9cfb5881752485b506261fe07b7b6194b83e8ae8ef7a"}
May 20 19:56:26.670492 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:56:26.670098    2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6ff67b8ddc-jzqlk"
May 20 19:56:26.671772 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:56:26.671745    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6c47cd95d5-6f7cq" event={"ID":"a49f268a-2139-4e2a-b7d2-bbe3c7ae72b1","Type":"ContainerStarted","Data":"93ee7990da15696d2041ee546a26e065bccc39d474514cd59621418e1fa680f8"}
May 20 19:56:26.671883 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:56:26.671862    2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6c47cd95d5-6f7cq"
May 20 19:56:26.689128 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:56:26.689078    2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-6ff67b8ddc-jzqlk" podStartSLOduration=1.072410497 podStartE2EDuration="3.689061729s" podCreationTimestamp="2026-05-20 19:56:23 +0000 UTC" firstStartedPulling="2026-05-20 19:56:23.744189129 +0000 UTC m=+726.192737962" lastFinishedPulling="2026-05-20 19:56:26.360840362 +0000 UTC m=+728.809389194" observedRunningTime="2026-05-20 19:56:26.687225569 +0000 UTC m=+729.135774420" watchObservedRunningTime="2026-05-20 19:56:26.689061729 +0000 UTC m=+729.137610585"
May 20 19:56:26.704551 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:56:26.704502    2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-6c47cd95d5-6f7cq" podStartSLOduration=0.921428805 podStartE2EDuration="3.704485469s" podCreationTimestamp="2026-05-20 19:56:23 +0000 UTC" firstStartedPulling="2026-05-20 19:56:23.591230648 +0000 UTC m=+726.039779480" lastFinishedPulling="2026-05-20 19:56:26.374287307 +0000 UTC m=+728.822836144" observedRunningTime="2026-05-20 19:56:26.703924713 +0000 UTC m=+729.152473568" watchObservedRunningTime="2026-05-20 19:56:26.704485469 +0000 UTC m=+729.153034323"
May 20 19:56:37.681201 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:56:37.681171    2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6ff67b8ddc-jzqlk"
May 20 19:56:37.681710 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:56:37.681220    2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6c47cd95d5-6f7cq"
May 20 19:56:37.741601 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:56:37.741550    2578 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6c47cd95d5-6f7cq"]
May 20 19:56:37.741889 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:56:37.741859    2578 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-controller-6c47cd95d5-6f7cq" podUID="a49f268a-2139-4e2a-b7d2-bbe3c7ae72b1" containerName="manager" containerID="cri-o://93ee7990da15696d2041ee546a26e065bccc39d474514cd59621418e1fa680f8" gracePeriod=30
May 20 19:56:37.990971 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:56:37.990944    2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6c47cd95d5-6f7cq"
May 20 19:56:38.072246 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:56:38.072215    2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z9kpq\" (UniqueName: \"kubernetes.io/projected/a49f268a-2139-4e2a-b7d2-bbe3c7ae72b1-kube-api-access-z9kpq\") pod \"a49f268a-2139-4e2a-b7d2-bbe3c7ae72b1\" (UID: \"a49f268a-2139-4e2a-b7d2-bbe3c7ae72b1\") "
May 20 19:56:38.074513 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:56:38.074492    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a49f268a-2139-4e2a-b7d2-bbe3c7ae72b1-kube-api-access-z9kpq" (OuterVolumeSpecName: "kube-api-access-z9kpq") pod "a49f268a-2139-4e2a-b7d2-bbe3c7ae72b1" (UID: "a49f268a-2139-4e2a-b7d2-bbe3c7ae72b1"). InnerVolumeSpecName "kube-api-access-z9kpq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 20 19:56:38.173744 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:56:38.173717    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z9kpq\" (UniqueName: \"kubernetes.io/projected/a49f268a-2139-4e2a-b7d2-bbe3c7ae72b1-kube-api-access-z9kpq\") on node \"ip-10-0-134-167.ec2.internal\" DevicePath \"\""
May 20 19:56:38.721775 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:56:38.721746    2578 generic.go:358] "Generic (PLEG): container finished" podID="a49f268a-2139-4e2a-b7d2-bbe3c7ae72b1" containerID="93ee7990da15696d2041ee546a26e065bccc39d474514cd59621418e1fa680f8" exitCode=0
May 20 19:56:38.722202 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:56:38.721807    2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6c47cd95d5-6f7cq"
May 20 19:56:38.722202 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:56:38.721831    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6c47cd95d5-6f7cq" event={"ID":"a49f268a-2139-4e2a-b7d2-bbe3c7ae72b1","Type":"ContainerDied","Data":"93ee7990da15696d2041ee546a26e065bccc39d474514cd59621418e1fa680f8"}
May 20 19:56:38.722202 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:56:38.721869    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6c47cd95d5-6f7cq" event={"ID":"a49f268a-2139-4e2a-b7d2-bbe3c7ae72b1","Type":"ContainerDied","Data":"20eae453ffe4df7d37f6fbb2998771e38b65c9fd4178929e380ac1847945de77"}
May 20 19:56:38.722202 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:56:38.721884    2578 scope.go:117] "RemoveContainer" containerID="93ee7990da15696d2041ee546a26e065bccc39d474514cd59621418e1fa680f8"
May 20 19:56:38.730773 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:56:38.730742    2578 scope.go:117] "RemoveContainer" containerID="93ee7990da15696d2041ee546a26e065bccc39d474514cd59621418e1fa680f8"
May 20 19:56:38.731035 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:56:38.731012    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"93ee7990da15696d2041ee546a26e065bccc39d474514cd59621418e1fa680f8\": container with ID starting with 93ee7990da15696d2041ee546a26e065bccc39d474514cd59621418e1fa680f8 not found: ID does not exist" containerID="93ee7990da15696d2041ee546a26e065bccc39d474514cd59621418e1fa680f8"
May 20 19:56:38.731102 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:56:38.731045    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93ee7990da15696d2041ee546a26e065bccc39d474514cd59621418e1fa680f8"} err="failed to get container status \"93ee7990da15696d2041ee546a26e065bccc39d474514cd59621418e1fa680f8\": rpc error: code = NotFound desc = could not find container \"93ee7990da15696d2041ee546a26e065bccc39d474514cd59621418e1fa680f8\": container with ID starting with 93ee7990da15696d2041ee546a26e065bccc39d474514cd59621418e1fa680f8 not found: ID does not exist"
May 20 19:56:38.740180 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:56:38.740151    2578 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6c47cd95d5-6f7cq"]
May 20 19:56:38.742992 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:56:38.742971    2578 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6c47cd95d5-6f7cq"]
May 20 19:56:40.101089 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:56:40.101052    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a49f268a-2139-4e2a-b7d2-bbe3c7ae72b1" path="/var/lib/kubelet/pods/a49f268a-2139-4e2a-b7d2-bbe3c7ae72b1/volumes"
May 20 19:56:56.587374 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:56:56.587334    2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-5fb69bd499-2r9jn"]
May 20 19:56:56.587981 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:56:56.587889    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a49f268a-2139-4e2a-b7d2-bbe3c7ae72b1" containerName="manager"
May 20 19:56:56.587981 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:56:56.587909    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="a49f268a-2139-4e2a-b7d2-bbe3c7ae72b1" containerName="manager"
May 20 19:56:56.588102 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:56:56.587997    2578 memory_manager.go:356] "RemoveStaleState removing state" podUID="a49f268a-2139-4e2a-b7d2-bbe3c7ae72b1" containerName="manager"
May 20 19:56:56.592443 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:56:56.592423    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-5fb69bd499-2r9jn"
May 20 19:56:56.595379 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:56:56.595356    2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-v6h5n\""
May 20 19:56:56.595473 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:56:56.595384    2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\""
May 20 19:56:56.602199 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:56:56.602174    2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-5fb69bd499-2r9jn"]
May 20 19:56:56.736205 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:56:56.736174    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t7tbt\" (UniqueName: \"kubernetes.io/projected/d7f87878-c485-4ac9-af9b-e0af38ed3aee-kube-api-access-t7tbt\") pod \"maas-api-5fb69bd499-2r9jn\" (UID: \"d7f87878-c485-4ac9-af9b-e0af38ed3aee\") " pod="opendatahub/maas-api-5fb69bd499-2r9jn"
May 20 19:56:56.736381 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:56:56.736279    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d7f87878-c485-4ac9-af9b-e0af38ed3aee-maas-api-tls\") pod \"maas-api-5fb69bd499-2r9jn\" (UID: \"d7f87878-c485-4ac9-af9b-e0af38ed3aee\") " pod="opendatahub/maas-api-5fb69bd499-2r9jn"
May 20 19:56:56.837442 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:56:56.837355    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d7f87878-c485-4ac9-af9b-e0af38ed3aee-maas-api-tls\") pod \"maas-api-5fb69bd499-2r9jn\" (UID: \"d7f87878-c485-4ac9-af9b-e0af38ed3aee\") " pod="opendatahub/maas-api-5fb69bd499-2r9jn"
May 20 19:56:56.837442 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:56:56.837409    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t7tbt\" (UniqueName: \"kubernetes.io/projected/d7f87878-c485-4ac9-af9b-e0af38ed3aee-kube-api-access-t7tbt\") pod \"maas-api-5fb69bd499-2r9jn\" (UID: \"d7f87878-c485-4ac9-af9b-e0af38ed3aee\") " pod="opendatahub/maas-api-5fb69bd499-2r9jn"
May 20 19:56:56.837653 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:56:56.837531    2578 secret.go:189] Couldn't get secret opendatahub/maas-api-serving-cert: secret "maas-api-serving-cert" not found
May 20 19:56:56.837653 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:56:56.837642    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d7f87878-c485-4ac9-af9b-e0af38ed3aee-maas-api-tls podName:d7f87878-c485-4ac9-af9b-e0af38ed3aee nodeName:}" failed. No retries permitted until 2026-05-20 19:56:57.33761776 +0000 UTC m=+759.786166593 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/d7f87878-c485-4ac9-af9b-e0af38ed3aee-maas-api-tls") pod "maas-api-5fb69bd499-2r9jn" (UID: "d7f87878-c485-4ac9-af9b-e0af38ed3aee") : secret "maas-api-serving-cert" not found
May 20 19:56:56.847448 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:56:56.847419    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t7tbt\" (UniqueName: \"kubernetes.io/projected/d7f87878-c485-4ac9-af9b-e0af38ed3aee-kube-api-access-t7tbt\") pod \"maas-api-5fb69bd499-2r9jn\" (UID: \"d7f87878-c485-4ac9-af9b-e0af38ed3aee\") " pod="opendatahub/maas-api-5fb69bd499-2r9jn"
May 20 19:56:57.343922 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:56:57.343888    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d7f87878-c485-4ac9-af9b-e0af38ed3aee-maas-api-tls\") pod \"maas-api-5fb69bd499-2r9jn\" (UID: \"d7f87878-c485-4ac9-af9b-e0af38ed3aee\") " pod="opendatahub/maas-api-5fb69bd499-2r9jn"
May 20 19:56:57.346516 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:56:57.346491    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d7f87878-c485-4ac9-af9b-e0af38ed3aee-maas-api-tls\") pod \"maas-api-5fb69bd499-2r9jn\" (UID: \"d7f87878-c485-4ac9-af9b-e0af38ed3aee\") " pod="opendatahub/maas-api-5fb69bd499-2r9jn"
May 20 19:56:57.504062 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:56:57.504026    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-5fb69bd499-2r9jn"
May 20 19:56:57.643223 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:56:57.643199    2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-5fb69bd499-2r9jn"]
May 20 19:56:57.645441 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:56:57.645402    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7f87878_c485_4ac9_af9b_e0af38ed3aee.slice/crio-6de4a31274ef402c893f2855c0769b1929bfd46f21742506eb41c0d20676b5d4 WatchSource:0}: Error finding container 6de4a31274ef402c893f2855c0769b1929bfd46f21742506eb41c0d20676b5d4: Status 404 returned error can't find the container with id 6de4a31274ef402c893f2855c0769b1929bfd46f21742506eb41c0d20676b5d4
May 20 19:56:57.794881 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:56:57.794847    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-5fb69bd499-2r9jn" event={"ID":"d7f87878-c485-4ac9-af9b-e0af38ed3aee","Type":"ContainerStarted","Data":"6de4a31274ef402c893f2855c0769b1929bfd46f21742506eb41c0d20676b5d4"}
May 20 19:57:00.809967 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:57:00.809925    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-5fb69bd499-2r9jn" event={"ID":"d7f87878-c485-4ac9-af9b-e0af38ed3aee","Type":"ContainerStarted","Data":"f985bb258b24a970f45f03b8ee9b32cc37d1b0991103f8acfac9d7f0c6a7ee5e"}
May 20 19:57:00.810475 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:57:00.809984    2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-5fb69bd499-2r9jn"
May 20 19:57:00.829718 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:57:00.829670    2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-api-5fb69bd499-2r9jn" podStartSLOduration=2.573799846 podStartE2EDuration="4.829655793s" podCreationTimestamp="2026-05-20 19:56:56 +0000 UTC" firstStartedPulling="2026-05-20 19:56:57.646666049 +0000 UTC m=+760.095214880" lastFinishedPulling="2026-05-20 19:56:59.902521996 +0000 UTC m=+762.351070827" observedRunningTime="2026-05-20 19:57:00.828177364 +0000 UTC m=+763.276726218" watchObservedRunningTime="2026-05-20 19:57:00.829655793 +0000 UTC m=+763.278204647"
May 20 19:57:06.820158 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:57:06.820132    2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-5fb69bd499-2r9jn"
May 20 19:57:22.090300 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:57:22.090264    2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-6b97b89985-rhmkc"]
May 20 19:57:22.095222 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:57:22.095206    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-rhmkc"
May 20 19:57:22.097866 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:57:22.097840    2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
May 20 19:57:22.099058 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:57:22.098938    2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
May 20 19:57:22.099191 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:57:22.099129    2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
May 20 19:57:22.099786 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:57:22.099288    2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-v7hts\""
May 20 19:57:22.103616 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:57:22.103568    2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-6b97b89985-rhmkc"]
May 20 19:57:22.153324 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:57:22.153290    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e75c0f51-01c8-4df1-b95f-e2975dea79d6-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-rhmkc\" (UID: \"e75c0f51-01c8-4df1-b95f-e2975dea79d6\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-rhmkc"
May 20 19:57:22.153514 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:57:22.153331    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e75c0f51-01c8-4df1-b95f-e2975dea79d6-home\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-rhmkc\" (UID: \"e75c0f51-01c8-4df1-b95f-e2975dea79d6\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-rhmkc"
May 20 19:57:22.153514 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:57:22.153349    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e75c0f51-01c8-4df1-b95f-e2975dea79d6-dshm\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-rhmkc\" (UID: \"e75c0f51-01c8-4df1-b95f-e2975dea79d6\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-rhmkc"
May 20 19:57:22.153514 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:57:22.153438    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r95qk\" (UniqueName: \"kubernetes.io/projected/e75c0f51-01c8-4df1-b95f-e2975dea79d6-kube-api-access-r95qk\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-rhmkc\" (UID: \"e75c0f51-01c8-4df1-b95f-e2975dea79d6\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-rhmkc"
May 20 19:57:22.153723 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:57:22.153566    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e75c0f51-01c8-4df1-b95f-e2975dea79d6-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-rhmkc\" (UID: \"e75c0f51-01c8-4df1-b95f-e2975dea79d6\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-rhmkc"
May 20 19:57:22.153723 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:57:22.153638    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e75c0f51-01c8-4df1-b95f-e2975dea79d6-model-cache\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-rhmkc\" (UID: \"e75c0f51-01c8-4df1-b95f-e2975dea79d6\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-rhmkc"
May 20 19:57:22.254041 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:57:22.254008    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r95qk\" (UniqueName: \"kubernetes.io/projected/e75c0f51-01c8-4df1-b95f-e2975dea79d6-kube-api-access-r95qk\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-rhmkc\" (UID: \"e75c0f51-01c8-4df1-b95f-e2975dea79d6\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-rhmkc"
May 20 19:57:22.254269 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:57:22.254106    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e75c0f51-01c8-4df1-b95f-e2975dea79d6-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-rhmkc\" (UID: \"e75c0f51-01c8-4df1-b95f-e2975dea79d6\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-rhmkc"
May 20 19:57:22.254269 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:57:22.254139    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e75c0f51-01c8-4df1-b95f-e2975dea79d6-model-cache\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-rhmkc\" (UID: \"e75c0f51-01c8-4df1-b95f-e2975dea79d6\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-rhmkc"
May 20 19:57:22.254269 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:57:22.254180    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e75c0f51-01c8-4df1-b95f-e2975dea79d6-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-rhmkc\" (UID: \"e75c0f51-01c8-4df1-b95f-e2975dea79d6\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-rhmkc"
May 20 19:57:22.254269 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:57:22.254221    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e75c0f51-01c8-4df1-b95f-e2975dea79d6-home\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-rhmkc\" (UID: \"e75c0f51-01c8-4df1-b95f-e2975dea79d6\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-rhmkc"
May 20 19:57:22.254269 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:57:22.254243    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e75c0f51-01c8-4df1-b95f-e2975dea79d6-dshm\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-rhmkc\" (UID: \"e75c0f51-01c8-4df1-b95f-e2975dea79d6\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-rhmkc"
May 20 19:57:22.254552 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:57:22.254531    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e75c0f51-01c8-4df1-b95f-e2975dea79d6-model-cache\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-rhmkc\" (UID: \"e75c0f51-01c8-4df1-b95f-e2975dea79d6\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-rhmkc"
May 20 19:57:22.254645 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:57:22.254570    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e75c0f51-01c8-4df1-b95f-e2975dea79d6-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-rhmkc\" (UID: \"e75c0f51-01c8-4df1-b95f-e2975dea79d6\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-rhmkc"
May 20 19:57:22.254705 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:57:22.254674    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e75c0f51-01c8-4df1-b95f-e2975dea79d6-home\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-rhmkc\" (UID: \"e75c0f51-01c8-4df1-b95f-e2975dea79d6\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-rhmkc"
May 20 19:57:22.256903 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:57:22.256876    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e75c0f51-01c8-4df1-b95f-e2975dea79d6-dshm\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-rhmkc\" (UID: \"e75c0f51-01c8-4df1-b95f-e2975dea79d6\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-rhmkc"
May 20 19:57:22.257124 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:57:22.257098    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e75c0f51-01c8-4df1-b95f-e2975dea79d6-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-rhmkc\" (UID: \"e75c0f51-01c8-4df1-b95f-e2975dea79d6\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-rhmkc"
May 20 19:57:22.261980 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:57:22.261961    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r95qk\" (UniqueName: \"kubernetes.io/projected/e75c0f51-01c8-4df1-b95f-e2975dea79d6-kube-api-access-r95qk\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-rhmkc\" (UID: \"e75c0f51-01c8-4df1-b95f-e2975dea79d6\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-rhmkc"
May 20 19:57:22.406232 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:57:22.406196    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-rhmkc"
May 20 19:57:22.545282 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:57:22.545248    2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-6b97b89985-rhmkc"]
May 20 19:57:22.546659 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:57:22.546626    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode75c0f51_01c8_4df1_b95f_e2975dea79d6.slice/crio-7c9691d0cd4a5efa1246e8e7a356e50b391a1c35136afc984594c8f611472f3e WatchSource:0}: Error finding container 7c9691d0cd4a5efa1246e8e7a356e50b391a1c35136afc984594c8f611472f3e: Status 404 returned error can't find the container with id 7c9691d0cd4a5efa1246e8e7a356e50b391a1c35136afc984594c8f611472f3e
May 20 19:57:22.903308 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:57:22.903270    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-rhmkc" event={"ID":"e75c0f51-01c8-4df1-b95f-e2975dea79d6","Type":"ContainerStarted","Data":"7c9691d0cd4a5efa1246e8e7a356e50b391a1c35136afc984594c8f611472f3e"}
May 20 19:57:28.931060 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:57:28.931027    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-rhmkc" event={"ID":"e75c0f51-01c8-4df1-b95f-e2975dea79d6","Type":"ContainerStarted","Data":"d1afe1b45178657a32776e77a6779f844d7a2f2e731537731fb7b24854b9d1fa"}
May 20 19:57:35.375550 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:57:35.375460    2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-ssgbb"]
May 20 19:57:35.379909 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:57:35.379888    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-ssgbb"
May 20 19:57:35.382628 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:57:35.382599    2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
May 20 19:57:35.390744 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:57:35.390717    2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-ssgbb"]
May 20 19:57:35.470989 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:57:35.470956    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/541e4ddf-826f-4c90-8498-bc582bc3bf91-dshm\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-ssgbb\" (UID: \"541e4ddf-826f-4c90-8498-bc582bc3bf91\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-ssgbb"
May 20 19:57:35.471172 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:57:35.470995    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/541e4ddf-826f-4c90-8498-bc582bc3bf91-home\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-ssgbb\" (UID: \"541e4ddf-826f-4c90-8498-bc582bc3bf91\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-ssgbb"
May 20 19:57:35.471172 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:57:35.471021    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lr96c\" (UniqueName: \"kubernetes.io/projected/541e4ddf-826f-4c90-8498-bc582bc3bf91-kube-api-access-lr96c\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-ssgbb\" (UID: \"541e4ddf-826f-4c90-8498-bc582bc3bf91\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-ssgbb"
May 20 19:57:35.471172 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:57:35.471070    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/541e4ddf-826f-4c90-8498-bc582bc3bf91-model-cache\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-ssgbb\" (UID: \"541e4ddf-826f-4c90-8498-bc582bc3bf91\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-ssgbb"
May 20 19:57:35.471172 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:57:35.471095    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/541e4ddf-826f-4c90-8498-bc582bc3bf91-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-ssgbb\" (UID: \"541e4ddf-826f-4c90-8498-bc582bc3bf91\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-ssgbb"
May 20 19:57:35.471333 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:57:35.471173    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/541e4ddf-826f-4c90-8498-bc582bc3bf91-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-ssgbb\" (UID: \"541e4ddf-826f-4c90-8498-bc582bc3bf91\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-ssgbb"
May 20 19:57:35.572577 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:57:35.572542    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/541e4ddf-826f-4c90-8498-bc582bc3bf91-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-ssgbb\" (UID: \"541e4ddf-826f-4c90-8498-bc582bc3bf91\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-ssgbb"
May 20 19:57:35.572784 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:57:35.572627    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/541e4ddf-826f-4c90-8498-bc582bc3bf91-dshm\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-ssgbb\" (UID: \"541e4ddf-826f-4c90-8498-bc582bc3bf91\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-ssgbb"
May 20 19:57:35.572784 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:57:35.572669    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/541e4ddf-826f-4c90-8498-bc582bc3bf91-home\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-ssgbb\" (UID: \"541e4ddf-826f-4c90-8498-bc582bc3bf91\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-ssgbb"
May 20 19:57:35.572784 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:57:35.572706    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lr96c\" (UniqueName: \"kubernetes.io/projected/541e4ddf-826f-4c90-8498-bc582bc3bf91-kube-api-access-lr96c\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-ssgbb\" (UID: \"541e4ddf-826f-4c90-8498-bc582bc3bf91\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-ssgbb"
May 20 19:57:35.572784 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:57:35.572759    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/541e4ddf-826f-4c90-8498-bc582bc3bf91-model-cache\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-ssgbb\" (UID: \"541e4ddf-826f-4c90-8498-bc582bc3bf91\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-ssgbb"
May 20 19:57:35.573013 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:57:35.572811    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/541e4ddf-826f-4c90-8498-bc582bc3bf91-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-ssgbb\" (UID: \"541e4ddf-826f-4c90-8498-bc582bc3bf91\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-ssgbb"
May 20 19:57:35.573068 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:57:35.573004    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/541e4ddf-826f-4c90-8498-bc582bc3bf91-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-ssgbb\" (UID: \"541e4ddf-826f-4c90-8498-bc582bc3bf91\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-ssgbb"
May 20 19:57:35.573307 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:57:35.573237    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/541e4ddf-826f-4c90-8498-bc582bc3bf91-model-cache\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-ssgbb\" (UID: \"541e4ddf-826f-4c90-8498-bc582bc3bf91\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-ssgbb"
May 20 19:57:35.573471 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:57:35.573451    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/541e4ddf-826f-4c90-8498-bc582bc3bf91-home\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-ssgbb\" (UID: \"541e4ddf-826f-4c90-8498-bc582bc3bf91\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-ssgbb"
May 20 19:57:35.575763 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:57:35.575742    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/541e4ddf-826f-4c90-8498-bc582bc3bf91-dshm\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-ssgbb\" (UID: \"541e4ddf-826f-4c90-8498-bc582bc3bf91\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-ssgbb"
May 20 19:57:35.576012 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:57:35.575991    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/541e4ddf-826f-4c90-8498-bc582bc3bf91-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-ssgbb\" (UID: \"541e4ddf-826f-4c90-8498-bc582bc3bf91\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-ssgbb"
May 20 19:57:35.585285 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:57:35.585254    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lr96c\" (UniqueName: \"kubernetes.io/projected/541e4ddf-826f-4c90-8498-bc582bc3bf91-kube-api-access-lr96c\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-ssgbb\" (UID: \"541e4ddf-826f-4c90-8498-bc582bc3bf91\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-ssgbb"
May 20 19:57:35.691763 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:57:35.691725    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-ssgbb"
May 20 19:57:35.870148 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:57:35.870112    2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-ssgbb"]
May 20 19:57:35.872616 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:57:35.872571    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod541e4ddf_826f_4c90_8498_bc582bc3bf91.slice/crio-ad55f72e4ce983dbd42e5fecc85a9255dcdac50b54f84b37065700a38f88b75f WatchSource:0}: Error finding container ad55f72e4ce983dbd42e5fecc85a9255dcdac50b54f84b37065700a38f88b75f: Status 404 returned error can't find the container with id ad55f72e4ce983dbd42e5fecc85a9255dcdac50b54f84b37065700a38f88b75f
May 20 19:57:35.966208 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:57:35.966115    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-ssgbb" event={"ID":"541e4ddf-826f-4c90-8498-bc582bc3bf91","Type":"ContainerStarted","Data":"58583eaf86578e2437ff60d775025b035c9df6c7e88d1a50c08d688429297805"}
May 20 19:57:35.966208 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:57:35.966177    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-ssgbb" event={"ID":"541e4ddf-826f-4c90-8498-bc582bc3bf91","Type":"ContainerStarted","Data":"ad55f72e4ce983dbd42e5fecc85a9255dcdac50b54f84b37065700a38f88b75f"}
May 20 19:57:36.971400 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:57:36.971360    2578 generic.go:358] "Generic (PLEG): container finished" podID="e75c0f51-01c8-4df1-b95f-e2975dea79d6" containerID="d1afe1b45178657a32776e77a6779f844d7a2f2e731537731fb7b24854b9d1fa" exitCode=0
May 20 19:57:36.971776 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:57:36.971438    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-rhmkc" event={"ID":"e75c0f51-01c8-4df1-b95f-e2975dea79d6","Type":"ContainerDied","Data":"d1afe1b45178657a32776e77a6779f844d7a2f2e731537731fb7b24854b9d1fa"}
May 20 19:57:38.983248 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:57:38.983215    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-rhmkc" event={"ID":"e75c0f51-01c8-4df1-b95f-e2975dea79d6","Type":"ContainerStarted","Data":"ab3a1f6e5024dd3f224025a3138c4980b61be5006a9089c5ef3605996fdab54e"}
May 20 19:57:38.983651 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:57:38.983413    2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-rhmkc"
May 20 19:57:39.001850 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:57:39.001802    2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-rhmkc" podStartSLOduration=1.274127797 podStartE2EDuration="17.001788634s" podCreationTimestamp="2026-05-20 19:57:22 +0000 UTC" firstStartedPulling="2026-05-20 19:57:22.548452213 +0000 UTC m=+784.997001045" lastFinishedPulling="2026-05-20 19:57:38.276113046 +0000 UTC m=+800.724661882" observedRunningTime="2026-05-20 19:57:39.000491626 +0000 UTC m=+801.449040515" watchObservedRunningTime="2026-05-20 19:57:39.001788634 +0000 UTC m=+801.450337487"
May 20 19:57:42.003306 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:57:42.003275    2578 generic.go:358] "Generic (PLEG): container finished" podID="541e4ddf-826f-4c90-8498-bc582bc3bf91" containerID="58583eaf86578e2437ff60d775025b035c9df6c7e88d1a50c08d688429297805" exitCode=0
May 20 19:57:42.003723 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:57:42.003341    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-ssgbb" event={"ID":"541e4ddf-826f-4c90-8498-bc582bc3bf91","Type":"ContainerDied","Data":"58583eaf86578e2437ff60d775025b035c9df6c7e88d1a50c08d688429297805"}
May 20 19:57:43.008943 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:57:43.008909    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-ssgbb" event={"ID":"541e4ddf-826f-4c90-8498-bc582bc3bf91","Type":"ContainerStarted","Data":"30f50c4d92f76111385b9f7de7a96870ea2f55f5f891036c7066c30db6f456d0"}
May 20 19:57:43.009317 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:57:43.009115    2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-ssgbb"
May 20 19:57:43.029671 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:57:43.029629    2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-ssgbb" podStartSLOduration=7.802570634 podStartE2EDuration="8.029615749s" podCreationTimestamp="2026-05-20 19:57:35 +0000 UTC" firstStartedPulling="2026-05-20 19:57:42.003953959 +0000 UTC m=+804.452502791" lastFinishedPulling="2026-05-20 19:57:42.230999074 +0000 UTC m=+804.679547906" observedRunningTime="2026-05-20 19:57:43.026104604 +0000 UTC m=+805.474653459" watchObservedRunningTime="2026-05-20 19:57:43.029615749 +0000 UTC m=+805.478164602"
May 20 19:57:45.378961 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:57:45.378927    2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84db68679b-b67k2"]
May 20 19:57:45.415926 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:57:45.415896    2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84db68679b-b67k2"]
May 20 19:57:45.416085 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:57:45.415977    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-b67k2"
May 20 19:57:45.418508 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:57:45.418487    2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
May 20 19:57:45.465962 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:57:45.465924    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rfphb\" (UniqueName: \"kubernetes.io/projected/1f420582-acdc-4804-aa86-e5a3186c779a-kube-api-access-rfphb\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-b67k2\" (UID: \"1f420582-acdc-4804-aa86-e5a3186c779a\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-b67k2"
May 20 19:57:45.466155 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:57:45.465972    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1f420582-acdc-4804-aa86-e5a3186c779a-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-b67k2\" (UID: \"1f420582-acdc-4804-aa86-e5a3186c779a\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-b67k2"
May 20 19:57:45.466155 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:57:45.466016    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1f420582-acdc-4804-aa86-e5a3186c779a-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-b67k2\" (UID: \"1f420582-acdc-4804-aa86-e5a3186c779a\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-b67k2"
May 20 19:57:45.466254 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:57:45.466147    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1f420582-acdc-4804-aa86-e5a3186c779a-dshm\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-b67k2\" (UID: \"1f420582-acdc-4804-aa86-e5a3186c779a\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-b67k2"
May 20 19:57:45.466290 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:57:45.466251    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1f420582-acdc-4804-aa86-e5a3186c779a-home\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-b67k2\" (UID: \"1f420582-acdc-4804-aa86-e5a3186c779a\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-b67k2"
May 20 19:57:45.466343 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:57:45.466325    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/1f420582-acdc-4804-aa86-e5a3186c779a-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-b67k2\" (UID: \"1f420582-acdc-4804-aa86-e5a3186c779a\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-b67k2"
May 20 19:57:45.567781 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:57:45.567741    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rfphb\" (UniqueName: \"kubernetes.io/projected/1f420582-acdc-4804-aa86-e5a3186c779a-kube-api-access-rfphb\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-b67k2\" (UID: \"1f420582-acdc-4804-aa86-e5a3186c779a\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-b67k2"
May 20 19:57:45.567781 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:57:45.567785    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1f420582-acdc-4804-aa86-e5a3186c779a-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-b67k2\" (UID: \"1f420582-acdc-4804-aa86-e5a3186c779a\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-b67k2"
May 20 19:57:45.568018 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:57:45.567967    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1f420582-acdc-4804-aa86-e5a3186c779a-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-b67k2\" (UID: \"1f420582-acdc-4804-aa86-e5a3186c779a\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-b67k2"
May 20 19:57:45.568082 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:57:45.568042    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1f420582-acdc-4804-aa86-e5a3186c779a-dshm\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-b67k2\" (UID: \"1f420582-acdc-4804-aa86-e5a3186c779a\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-b67k2"
May 20 19:57:45.568149 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:57:45.568102    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1f420582-acdc-4804-aa86-e5a3186c779a-home\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-b67k2\" (UID: \"1f420582-acdc-4804-aa86-e5a3186c779a\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-b67k2"
May 20 19:57:45.568202 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:57:45.568165    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/1f420582-acdc-4804-aa86-e5a3186c779a-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-b67k2\" (UID: \"1f420582-acdc-4804-aa86-e5a3186c779a\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-b67k2"
May 20 19:57:45.568256 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:57:45.568166    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1f420582-acdc-4804-aa86-e5a3186c779a-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-b67k2\" (UID: \"1f420582-acdc-4804-aa86-e5a3186c779a\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-b67k2"
May 20 19:57:45.568507 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:57:45.568472    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1f420582-acdc-4804-aa86-e5a3186c779a-home\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-b67k2\" (UID: \"1f420582-acdc-4804-aa86-e5a3186c779a\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-b67k2"
May 20 19:57:45.568644 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:57:45.568529    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/1f420582-acdc-4804-aa86-e5a3186c779a-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-b67k2\" (UID: \"1f420582-acdc-4804-aa86-e5a3186c779a\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-b67k2"
May 20 19:57:45.570853 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:57:45.570807    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1f420582-acdc-4804-aa86-e5a3186c779a-dshm\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-b67k2\" (UID: \"1f420582-acdc-4804-aa86-e5a3186c779a\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-b67k2"
May 20 19:57:45.570959 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:57:45.570832    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1f420582-acdc-4804-aa86-e5a3186c779a-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-b67k2\" (UID: \"1f420582-acdc-4804-aa86-e5a3186c779a\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-b67k2"
May 20 19:57:45.576978 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:57:45.576956    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rfphb\" (UniqueName: \"kubernetes.io/projected/1f420582-acdc-4804-aa86-e5a3186c779a-kube-api-access-rfphb\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-b67k2\" (UID: \"1f420582-acdc-4804-aa86-e5a3186c779a\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-b67k2"
May 20 19:57:45.726850 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:57:45.726756    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-b67k2"
May 20 19:57:45.875027 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:57:45.874990    2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84db68679b-b67k2"]
May 20 19:57:45.877908 ip-10-0-134-167 kubenswrapper[2578]: W0520 19:57:45.877876    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f420582_acdc_4804_aa86_e5a3186c779a.slice/crio-e1fae4d74c6e2a6a2b84a1efe9d93f37f846716fd728d8620a443827c413ccea WatchSource:0}: Error finding container e1fae4d74c6e2a6a2b84a1efe9d93f37f846716fd728d8620a443827c413ccea: Status 404 returned error can't find the container with id e1fae4d74c6e2a6a2b84a1efe9d93f37f846716fd728d8620a443827c413ccea
May 20 19:57:46.022316 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:57:46.022280    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-b67k2" event={"ID":"1f420582-acdc-4804-aa86-e5a3186c779a","Type":"ContainerStarted","Data":"a94e9f1c6ffa0d27dd9eea0089163a75849407164d30d15a04fd309f5bf31256"}
May 20 19:57:46.022316 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:57:46.022321    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-b67k2" event={"ID":"1f420582-acdc-4804-aa86-e5a3186c779a","Type":"ContainerStarted","Data":"e1fae4d74c6e2a6a2b84a1efe9d93f37f846716fd728d8620a443827c413ccea"}
May 20 19:57:50.002064 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:57:50.002033    2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-rhmkc"
May 20 19:57:52.053486 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:57:52.053455    2578 generic.go:358] "Generic (PLEG): container finished" podID="1f420582-acdc-4804-aa86-e5a3186c779a" containerID="a94e9f1c6ffa0d27dd9eea0089163a75849407164d30d15a04fd309f5bf31256" exitCode=0
May 20 19:57:52.053915 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:57:52.053533    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-b67k2" event={"ID":"1f420582-acdc-4804-aa86-e5a3186c779a","Type":"ContainerDied","Data":"a94e9f1c6ffa0d27dd9eea0089163a75849407164d30d15a04fd309f5bf31256"}
May 20 19:57:53.060477 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:57:53.060439    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-b67k2" event={"ID":"1f420582-acdc-4804-aa86-e5a3186c779a","Type":"ContainerStarted","Data":"9fc8d811b3eef6251e939a9589575daed8e961331d1f6b191856b70e41530013"}
May 20 19:57:53.060982 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:57:53.060704    2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-b67k2"
May 20 19:57:53.079006 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:57:53.078958    2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-b67k2" podStartSLOduration=7.638135454 podStartE2EDuration="8.078945092s" podCreationTimestamp="2026-05-20 19:57:45 +0000 UTC" firstStartedPulling="2026-05-20 19:57:52.05417454 +0000 UTC m=+814.502723372" lastFinishedPulling="2026-05-20 19:57:52.494984164 +0000 UTC m=+814.943533010" observedRunningTime="2026-05-20 19:57:53.077449232 +0000 UTC m=+815.525998086" watchObservedRunningTime="2026-05-20 19:57:53.078945092 +0000 UTC m=+815.527493946"
May 20 19:57:54.026465 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:57:54.026424    2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-ssgbb"
May 20 19:58:04.078775 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:58:04.078738    2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-b67k2"
May 20 19:59:18.149976 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:59:18.149946    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8nrkk_3bb0c612-bb6f-4213-a7d8-88534ba9e6ee/ovn-acl-logging/0.log"
May 20 19:59:18.153393 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:59:18.153373    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8nrkk_3bb0c612-bb6f-4213-a7d8-88534ba9e6ee/ovn-acl-logging/0.log"
May 20 19:59:28.698936 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:59:28.698899    2578 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6ff67b8ddc-jzqlk"]
May 20 19:59:28.701494 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:59:28.699148    2578 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-controller-6ff67b8ddc-jzqlk" podUID="f8d17c3a-2ba2-4291-a971-60bc2671cfae" containerName="manager" containerID="cri-o://f30f862eb00e4ed296fc9cfb5881752485b506261fe07b7b6194b83e8ae8ef7a" gracePeriod=30
May 20 19:59:28.951521 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:59:28.951464    2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6ff67b8ddc-jzqlk"
May 20 19:59:29.120945 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:59:29.120907    2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-thtbl\" (UniqueName: \"kubernetes.io/projected/f8d17c3a-2ba2-4291-a971-60bc2671cfae-kube-api-access-thtbl\") pod \"f8d17c3a-2ba2-4291-a971-60bc2671cfae\" (UID: \"f8d17c3a-2ba2-4291-a971-60bc2671cfae\") "
May 20 19:59:29.123122 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:59:29.123100    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f8d17c3a-2ba2-4291-a971-60bc2671cfae-kube-api-access-thtbl" (OuterVolumeSpecName: "kube-api-access-thtbl") pod "f8d17c3a-2ba2-4291-a971-60bc2671cfae" (UID: "f8d17c3a-2ba2-4291-a971-60bc2671cfae"). InnerVolumeSpecName "kube-api-access-thtbl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 20 19:59:29.221793 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:59:29.221694    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-thtbl\" (UniqueName: \"kubernetes.io/projected/f8d17c3a-2ba2-4291-a971-60bc2671cfae-kube-api-access-thtbl\") on node \"ip-10-0-134-167.ec2.internal\" DevicePath \"\""
May 20 19:59:29.462899 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:59:29.462860    2578 generic.go:358] "Generic (PLEG): container finished" podID="f8d17c3a-2ba2-4291-a971-60bc2671cfae" containerID="f30f862eb00e4ed296fc9cfb5881752485b506261fe07b7b6194b83e8ae8ef7a" exitCode=0
May 20 19:59:29.463093 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:59:29.462920    2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6ff67b8ddc-jzqlk"
May 20 19:59:29.463093 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:59:29.462952    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6ff67b8ddc-jzqlk" event={"ID":"f8d17c3a-2ba2-4291-a971-60bc2671cfae","Type":"ContainerDied","Data":"f30f862eb00e4ed296fc9cfb5881752485b506261fe07b7b6194b83e8ae8ef7a"}
May 20 19:59:29.463093 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:59:29.462997    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6ff67b8ddc-jzqlk" event={"ID":"f8d17c3a-2ba2-4291-a971-60bc2671cfae","Type":"ContainerDied","Data":"8780f1a8419be736c77f9a1941c4a41814c30da7a100c201578baafbed5d6602"}
May 20 19:59:29.463093 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:59:29.463016    2578 scope.go:117] "RemoveContainer" containerID="f30f862eb00e4ed296fc9cfb5881752485b506261fe07b7b6194b83e8ae8ef7a"
May 20 19:59:29.472433 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:59:29.472416    2578 scope.go:117] "RemoveContainer" containerID="f30f862eb00e4ed296fc9cfb5881752485b506261fe07b7b6194b83e8ae8ef7a"
May 20 19:59:29.472708 ip-10-0-134-167 kubenswrapper[2578]: E0520 19:59:29.472680    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f30f862eb00e4ed296fc9cfb5881752485b506261fe07b7b6194b83e8ae8ef7a\": container with ID starting with f30f862eb00e4ed296fc9cfb5881752485b506261fe07b7b6194b83e8ae8ef7a not found: ID does not exist" containerID="f30f862eb00e4ed296fc9cfb5881752485b506261fe07b7b6194b83e8ae8ef7a"
May 20 19:59:29.472767 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:59:29.472720    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f30f862eb00e4ed296fc9cfb5881752485b506261fe07b7b6194b83e8ae8ef7a"} err="failed to get container status \"f30f862eb00e4ed296fc9cfb5881752485b506261fe07b7b6194b83e8ae8ef7a\": rpc error: code = NotFound desc = could not find container \"f30f862eb00e4ed296fc9cfb5881752485b506261fe07b7b6194b83e8ae8ef7a\": container with ID starting with f30f862eb00e4ed296fc9cfb5881752485b506261fe07b7b6194b83e8ae8ef7a not found: ID does not exist"
May 20 19:59:29.483983 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:59:29.483961    2578 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6ff67b8ddc-jzqlk"]
May 20 19:59:29.487450 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:59:29.487426    2578 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6ff67b8ddc-jzqlk"]
May 20 19:59:30.101144 ip-10-0-134-167 kubenswrapper[2578]: I0520 19:59:30.101111    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f8d17c3a-2ba2-4291-a971-60bc2671cfae" path="/var/lib/kubelet/pods/f8d17c3a-2ba2-4291-a971-60bc2671cfae/volumes"
May 20 20:04:18.183216 ip-10-0-134-167 kubenswrapper[2578]: I0520 20:04:18.183190    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8nrkk_3bb0c612-bb6f-4213-a7d8-88534ba9e6ee/ovn-acl-logging/0.log"
May 20 20:04:18.187735 ip-10-0-134-167 kubenswrapper[2578]: I0520 20:04:18.187716    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8nrkk_3bb0c612-bb6f-4213-a7d8-88534ba9e6ee/ovn-acl-logging/0.log"
May 20 20:09:18.224037 ip-10-0-134-167 kubenswrapper[2578]: I0520 20:09:18.224004    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8nrkk_3bb0c612-bb6f-4213-a7d8-88534ba9e6ee/ovn-acl-logging/0.log"
May 20 20:09:18.229356 ip-10-0-134-167 kubenswrapper[2578]: I0520 20:09:18.229336    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8nrkk_3bb0c612-bb6f-4213-a7d8-88534ba9e6ee/ovn-acl-logging/0.log"
May 20 20:14:18.258791 ip-10-0-134-167 kubenswrapper[2578]: I0520 20:14:18.258689    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8nrkk_3bb0c612-bb6f-4213-a7d8-88534ba9e6ee/ovn-acl-logging/0.log"
May 20 20:14:18.265204 ip-10-0-134-167 kubenswrapper[2578]: I0520 20:14:18.265179    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8nrkk_3bb0c612-bb6f-4213-a7d8-88534ba9e6ee/ovn-acl-logging/0.log"
May 20 20:19:18.292842 ip-10-0-134-167 kubenswrapper[2578]: I0520 20:19:18.292697    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8nrkk_3bb0c612-bb6f-4213-a7d8-88534ba9e6ee/ovn-acl-logging/0.log"
May 20 20:19:18.300692 ip-10-0-134-167 kubenswrapper[2578]: I0520 20:19:18.300671    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8nrkk_3bb0c612-bb6f-4213-a7d8-88534ba9e6ee/ovn-acl-logging/0.log"
May 20 20:20:51.988019 ip-10-0-134-167 kubenswrapper[2578]: I0520 20:20:51.987976    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-856948b99f-4xfxw_eb7b87ee-fe3c-4b1b-8ba0-74c41367302f/manager/0.log"
May 20 20:20:52.119697 ip-10-0-134-167 kubenswrapper[2578]: I0520 20:20:52.119671    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-5fb69bd499-2r9jn_d7f87878-c485-4ac9-af9b-e0af38ed3aee/maas-api/0.log"
May 20 20:20:52.667353 ip-10-0-134-167 kubenswrapper[2578]: I0520 20:20:52.667319    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-858dbf95b8-wps2x_233ea0c3-5de9-4c5b-9cd5-f591284cffd2/manager/1.log"
May 20 20:20:52.816417 ip-10-0-134-167 kubenswrapper[2578]: I0520 20:20:52.816375    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-74d7cb47bd-4twn6_1a82512a-abce-4072-ab13-01f1e114bd4b/manager/0.log"
May 20 20:20:53.197377 ip-10-0-134-167 kubenswrapper[2578]: I0520 20:20:53.197348    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-68c4fbbd6f-qdk87_70ecee7c-5759-40fc-98bc-afc553ecd179/postgres/0.log"
May 20 20:20:53.949153 ip-10-0-134-167 kubenswrapper[2578]: I0520 20:20:53.949123    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759g4znt_d1b84208-34ef-400e-b775-e9525da1c6b7/util/0.log"
May 20 20:20:53.958140 ip-10-0-134-167 kubenswrapper[2578]: I0520 20:20:53.958117    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759g4znt_d1b84208-34ef-400e-b775-e9525da1c6b7/pull/0.log"
May 20 20:20:53.970720 ip-10-0-134-167 kubenswrapper[2578]: I0520 20:20:53.970692    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759g4znt_d1b84208-34ef-400e-b775-e9525da1c6b7/extract/0.log"
May 20 20:20:54.081256 ip-10-0-134-167 kubenswrapper[2578]: I0520 20:20:54.081234    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kmgzp_8ec02d37-fde3-47fd-86d6-2262234a92b6/util/0.log"
May 20 20:20:54.087789 ip-10-0-134-167 kubenswrapper[2578]: I0520 20:20:54.087769    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kmgzp_8ec02d37-fde3-47fd-86d6-2262234a92b6/pull/0.log"
May 20 20:20:54.094658 ip-10-0-134-167 kubenswrapper[2578]: I0520 20:20:54.094639    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kmgzp_8ec02d37-fde3-47fd-86d6-2262234a92b6/extract/0.log"
May 20 20:20:54.201715 ip-10-0-134-167 kubenswrapper[2578]: I0520 20:20:54.201633    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73l7qpk_3c11ca31-775c-4458-8866-4961543fe323/util/0.log"
May 20 20:20:54.211313 ip-10-0-134-167 kubenswrapper[2578]: I0520 20:20:54.211263    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73l7qpk_3c11ca31-775c-4458-8866-4961543fe323/pull/0.log"
May 20 20:20:54.218116 ip-10-0-134-167 kubenswrapper[2578]: I0520 20:20:54.218095    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73l7qpk_3c11ca31-775c-4458-8866-4961543fe323/extract/0.log"
May 20 20:20:54.331823 ip-10-0-134-167 kubenswrapper[2578]: I0520 20:20:54.331789    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15fhl7_20eab907-6808-4cf3-a63f-89e328eca172/util/0.log"
May 20 20:20:54.350931 ip-10-0-134-167 kubenswrapper[2578]: I0520 20:20:54.350901    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15fhl7_20eab907-6808-4cf3-a63f-89e328eca172/pull/0.log"
May 20 20:20:54.373566 ip-10-0-134-167 kubenswrapper[2578]: I0520 20:20:54.373531    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15fhl7_20eab907-6808-4cf3-a63f-89e328eca172/extract/0.log"
May 20 20:20:54.634881 ip-10-0-134-167 kubenswrapper[2578]: I0520 20:20:54.634858    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-657f44b778-8w2s8_1c55f495-ff90-457d-8c33-e646fd2ab9b2/manager/0.log"
May 20 20:20:55.843592 ip-10-0-134-167 kubenswrapper[2578]: I0520 20:20:55.843552    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-798958bb55-l99nl_e51b10d5-8b59-4e8f-a5b1-510574f278db/discovery/0.log"
May 20 20:20:55.958412 ip-10-0-134-167 kubenswrapper[2578]: I0520 20:20:55.958384    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-547dffc8c7-95xxl_e43edc3c-5e3b-4f88-90c2-f2742ad65f2f/kube-auth-proxy/0.log"
May 20 20:20:57.085454 ip-10-0-134-167 kubenswrapper[2578]: I0520 20:20:57.085420    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-84db68679b-b67k2_1f420582-acdc-4804-aa86-e5a3186c779a/storage-initializer/0.log"
May 20 20:20:57.098402 ip-10-0-134-167 kubenswrapper[2578]: I0520 20:20:57.098358    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-84db68679b-b67k2_1f420582-acdc-4804-aa86-e5a3186c779a/main/0.log"
May 20 20:20:57.335831 ip-10-0-134-167 kubenswrapper[2578]: I0520 20:20:57.335713    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-8f8dc67b7-ssgbb_541e4ddf-826f-4c90-8498-bc582bc3bf91/storage-initializer/0.log"
May 20 20:20:57.344094 ip-10-0-134-167 kubenswrapper[2578]: I0520 20:20:57.344072    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-8f8dc67b7-ssgbb_541e4ddf-826f-4c90-8498-bc582bc3bf91/main/0.log"
May 20 20:20:57.462983 ip-10-0-134-167 kubenswrapper[2578]: I0520 20:20:57.462953    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-6b97b89985-rhmkc_e75c0f51-01c8-4df1-b95f-e2975dea79d6/storage-initializer/0.log"
May 20 20:20:57.475321 ip-10-0-134-167 kubenswrapper[2578]: I0520 20:20:57.475296    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-6b97b89985-rhmkc_e75c0f51-01c8-4df1-b95f-e2975dea79d6/main/0.log"
May 20 20:21:05.682606 ip-10-0-134-167 kubenswrapper[2578]: I0520 20:21:05.682557    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-sjvdr_16af1a4f-77e8-4350-a543-635b06eec283/global-pull-secret-syncer/0.log"
May 20 20:21:05.805873 ip-10-0-134-167 kubenswrapper[2578]: I0520 20:21:05.805845    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-gwj68_32f98a02-52ac-4222-805b-97bfd60ec8dc/konnectivity-agent/0.log"
May 20 20:21:05.895709 ip-10-0-134-167 kubenswrapper[2578]: I0520 20:21:05.895678    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-134-167.ec2.internal_c154af641d973d5a0b0e558435e3a97e/haproxy/0.log"
May 20 20:21:09.204832 ip-10-0-134-167 kubenswrapper[2578]: I0520 20:21:09.204787    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759g4znt_d1b84208-34ef-400e-b775-e9525da1c6b7/extract/0.log"
May 20 20:21:09.261873 ip-10-0-134-167 kubenswrapper[2578]: I0520 20:21:09.261844    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759g4znt_d1b84208-34ef-400e-b775-e9525da1c6b7/util/0.log"
May 20 20:21:09.301578 ip-10-0-134-167 kubenswrapper[2578]: I0520 20:21:09.301552    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759g4znt_d1b84208-34ef-400e-b775-e9525da1c6b7/pull/0.log"
May 20 20:21:09.343871 ip-10-0-134-167 kubenswrapper[2578]: I0520 20:21:09.343843    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kmgzp_8ec02d37-fde3-47fd-86d6-2262234a92b6/extract/0.log"
May 20 20:21:09.377204 ip-10-0-134-167 kubenswrapper[2578]: I0520 20:21:09.377179    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kmgzp_8ec02d37-fde3-47fd-86d6-2262234a92b6/util/0.log"
May 20 20:21:09.405329 ip-10-0-134-167 kubenswrapper[2578]: I0520 20:21:09.405302    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kmgzp_8ec02d37-fde3-47fd-86d6-2262234a92b6/pull/0.log"
May 20 20:21:09.441309 ip-10-0-134-167 kubenswrapper[2578]: I0520 20:21:09.441265    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73l7qpk_3c11ca31-775c-4458-8866-4961543fe323/extract/0.log"
May 20 20:21:09.471067 ip-10-0-134-167 kubenswrapper[2578]: I0520 20:21:09.470992    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73l7qpk_3c11ca31-775c-4458-8866-4961543fe323/util/0.log"
May 20 20:21:09.497287 ip-10-0-134-167 kubenswrapper[2578]: I0520 20:21:09.497259    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73l7qpk_3c11ca31-775c-4458-8866-4961543fe323/pull/0.log"
May 20 20:21:09.533770 ip-10-0-134-167 kubenswrapper[2578]: I0520 20:21:09.533749    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15fhl7_20eab907-6808-4cf3-a63f-89e328eca172/extract/0.log"
May 20 20:21:09.567522 ip-10-0-134-167 kubenswrapper[2578]: I0520 20:21:09.567498    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15fhl7_20eab907-6808-4cf3-a63f-89e328eca172/util/0.log"
May 20 20:21:09.593701 ip-10-0-134-167 kubenswrapper[2578]: I0520 20:21:09.593668    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15fhl7_20eab907-6808-4cf3-a63f-89e328eca172/pull/0.log"
May 20 20:21:09.887460 ip-10-0-134-167 kubenswrapper[2578]: I0520 20:21:09.887435    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-657f44b778-8w2s8_1c55f495-ff90-457d-8c33-e646fd2ab9b2/manager/0.log"
May 20 20:21:12.092194 ip-10-0-134-167 kubenswrapper[2578]: I0520 20:21:12.092155    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6c75959455-w7grq_9438ccc5-f4ae-4304-815d-ef1af9cdd459/cluster-monitoring-operator/0.log"
May 20 20:21:12.641349 ip-10-0-134-167 kubenswrapper[2578]: I0520 20:21:12.641323    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wmqdr_8f2fd804-794d-414a-bec8-2f486409098a/node-exporter/0.log"
May 20 20:21:12.694409 ip-10-0-134-167 kubenswrapper[2578]: I0520 20:21:12.694375    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wmqdr_8f2fd804-794d-414a-bec8-2f486409098a/kube-rbac-proxy/0.log"
May 20 20:21:12.735423 ip-10-0-134-167 kubenswrapper[2578]: I0520 20:21:12.735398    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wmqdr_8f2fd804-794d-414a-bec8-2f486409098a/init-textfile/0.log"
May 20 20:21:13.249167 ip-10-0-134-167 kubenswrapper[2578]: I0520 20:21:13.249138    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-6c4bbc67b7-z4x5h_7a1d3bad-a626-46c1-b512-2e4c4681cfb4/prometheus-operator-admission-webhook/0.log"
May 20 20:21:13.418295 ip-10-0-134-167 kubenswrapper[2578]: I0520 20:21:13.418270    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7dbb8667fb-zfh2w_93a0230d-77d3-474e-b324-450c719b7ed1/thanos-query/0.log"
May 20 20:21:13.449679 ip-10-0-134-167 kubenswrapper[2578]: I0520 20:21:13.449657    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7dbb8667fb-zfh2w_93a0230d-77d3-474e-b324-450c719b7ed1/kube-rbac-proxy-web/0.log"
May 20 20:21:13.485606 ip-10-0-134-167 kubenswrapper[2578]: I0520 20:21:13.485559    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7dbb8667fb-zfh2w_93a0230d-77d3-474e-b324-450c719b7ed1/kube-rbac-proxy/0.log"
May 20 20:21:13.508808 ip-10-0-134-167 kubenswrapper[2578]: I0520 20:21:13.508730    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7dbb8667fb-zfh2w_93a0230d-77d3-474e-b324-450c719b7ed1/prom-label-proxy/0.log"
May 20 20:21:13.533570 ip-10-0-134-167 kubenswrapper[2578]: I0520 20:21:13.533546    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7dbb8667fb-zfh2w_93a0230d-77d3-474e-b324-450c719b7ed1/kube-rbac-proxy-rules/0.log"
May 20 20:21:13.556435 ip-10-0-134-167 kubenswrapper[2578]: I0520 20:21:13.556409    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7dbb8667fb-zfh2w_93a0230d-77d3-474e-b324-450c719b7ed1/kube-rbac-proxy-metrics/0.log"
May 20 20:21:14.105493 ip-10-0-134-167 kubenswrapper[2578]: I0520 20:21:14.105456    2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-8dcwp/perf-node-gather-daemonset-jkl6h"]
May 20 20:21:14.106485 ip-10-0-134-167 kubenswrapper[2578]: I0520 20:21:14.106458    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f8d17c3a-2ba2-4291-a971-60bc2671cfae" containerName="manager"
May 20 20:21:14.106671 ip-10-0-134-167 kubenswrapper[2578]: I0520 20:21:14.106659    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8d17c3a-2ba2-4291-a971-60bc2671cfae" containerName="manager"
May 20 20:21:14.107008 ip-10-0-134-167 kubenswrapper[2578]: I0520 20:21:14.106993    2578 memory_manager.go:356] "RemoveStaleState removing state" podUID="f8d17c3a-2ba2-4291-a971-60bc2671cfae" containerName="manager"
May 20 20:21:14.111015 ip-10-0-134-167 kubenswrapper[2578]: I0520 20:21:14.110988    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8dcwp/perf-node-gather-daemonset-jkl6h"
May 20 20:21:14.118344 ip-10-0-134-167 kubenswrapper[2578]: I0520 20:21:14.118321    2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-8dcwp\"/\"kube-root-ca.crt\""
May 20 20:21:14.118514 ip-10-0-134-167 kubenswrapper[2578]: I0520 20:21:14.118498    2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-8dcwp\"/\"default-dockercfg-2dcxt\""
May 20 20:21:14.120465 ip-10-0-134-167 kubenswrapper[2578]: I0520 20:21:14.120445    2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-8dcwp\"/\"openshift-service-ca.crt\""
May 20 20:21:14.120692 ip-10-0-134-167 kubenswrapper[2578]: I0520 20:21:14.120671    2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8dcwp/perf-node-gather-daemonset-jkl6h"]
May 20 20:21:14.130731 ip-10-0-134-167 kubenswrapper[2578]: I0520 20:21:14.130703    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/69871589-a2e3-4d34-9820-2ed8192511a9-proc\") pod \"perf-node-gather-daemonset-jkl6h\" (UID: \"69871589-a2e3-4d34-9820-2ed8192511a9\") " pod="openshift-must-gather-8dcwp/perf-node-gather-daemonset-jkl6h"
May 20 20:21:14.130857 ip-10-0-134-167 kubenswrapper[2578]: I0520 20:21:14.130740    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/69871589-a2e3-4d34-9820-2ed8192511a9-lib-modules\") pod \"perf-node-gather-daemonset-jkl6h\" (UID: \"69871589-a2e3-4d34-9820-2ed8192511a9\") " pod="openshift-must-gather-8dcwp/perf-node-gather-daemonset-jkl6h"
May 20 20:21:14.130928 ip-10-0-134-167 kubenswrapper[2578]: I0520 20:21:14.130866    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/69871589-a2e3-4d34-9820-2ed8192511a9-sys\") pod \"perf-node-gather-daemonset-jkl6h\" (UID: \"69871589-a2e3-4d34-9820-2ed8192511a9\") " pod="openshift-must-gather-8dcwp/perf-node-gather-daemonset-jkl6h"
May 20 20:21:14.130928 ip-10-0-134-167 kubenswrapper[2578]: I0520 20:21:14.130889    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/69871589-a2e3-4d34-9820-2ed8192511a9-podres\") pod \"perf-node-gather-daemonset-jkl6h\" (UID: \"69871589-a2e3-4d34-9820-2ed8192511a9\") " pod="openshift-must-gather-8dcwp/perf-node-gather-daemonset-jkl6h"
May 20 20:21:14.131036 ip-10-0-134-167 kubenswrapper[2578]: I0520 20:21:14.131007    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bs7p5\" (UniqueName: \"kubernetes.io/projected/69871589-a2e3-4d34-9820-2ed8192511a9-kube-api-access-bs7p5\") pod \"perf-node-gather-daemonset-jkl6h\" (UID: \"69871589-a2e3-4d34-9820-2ed8192511a9\") " pod="openshift-must-gather-8dcwp/perf-node-gather-daemonset-jkl6h"
May 20 20:21:14.232143 ip-10-0-134-167 kubenswrapper[2578]: I0520 20:21:14.232109    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/69871589-a2e3-4d34-9820-2ed8192511a9-sys\") pod \"perf-node-gather-daemonset-jkl6h\" (UID: \"69871589-a2e3-4d34-9820-2ed8192511a9\") " pod="openshift-must-gather-8dcwp/perf-node-gather-daemonset-jkl6h"
May 20 20:21:14.232143 ip-10-0-134-167 kubenswrapper[2578]: I0520 20:21:14.232144    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/69871589-a2e3-4d34-9820-2ed8192511a9-podres\") pod \"perf-node-gather-daemonset-jkl6h\" (UID: \"69871589-a2e3-4d34-9820-2ed8192511a9\") " pod="openshift-must-gather-8dcwp/perf-node-gather-daemonset-jkl6h"
May 20 20:21:14.232368 ip-10-0-134-167 kubenswrapper[2578]: I0520 20:21:14.232192    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bs7p5\" (UniqueName: \"kubernetes.io/projected/69871589-a2e3-4d34-9820-2ed8192511a9-kube-api-access-bs7p5\") pod \"perf-node-gather-daemonset-jkl6h\" (UID: \"69871589-a2e3-4d34-9820-2ed8192511a9\") " pod="openshift-must-gather-8dcwp/perf-node-gather-daemonset-jkl6h"
May 20 20:21:14.232368 ip-10-0-134-167 kubenswrapper[2578]: I0520 20:21:14.232218    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/69871589-a2e3-4d34-9820-2ed8192511a9-proc\") pod \"perf-node-gather-daemonset-jkl6h\" (UID: \"69871589-a2e3-4d34-9820-2ed8192511a9\") " pod="openshift-must-gather-8dcwp/perf-node-gather-daemonset-jkl6h"
May 20 20:21:14.232368 ip-10-0-134-167 kubenswrapper[2578]: I0520 20:21:14.232232    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/69871589-a2e3-4d34-9820-2ed8192511a9-lib-modules\") pod \"perf-node-gather-daemonset-jkl6h\" (UID: \"69871589-a2e3-4d34-9820-2ed8192511a9\") " pod="openshift-must-gather-8dcwp/perf-node-gather-daemonset-jkl6h"
May 20 20:21:14.232368 ip-10-0-134-167 kubenswrapper[2578]: I0520 20:21:14.232244    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/69871589-a2e3-4d34-9820-2ed8192511a9-sys\") pod \"perf-node-gather-daemonset-jkl6h\" (UID: \"69871589-a2e3-4d34-9820-2ed8192511a9\") " pod="openshift-must-gather-8dcwp/perf-node-gather-daemonset-jkl6h"
May 20 20:21:14.232368 ip-10-0-134-167 kubenswrapper[2578]: I0520 20:21:14.232307    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/69871589-a2e3-4d34-9820-2ed8192511a9-proc\") pod \"perf-node-gather-daemonset-jkl6h\" (UID: \"69871589-a2e3-4d34-9820-2ed8192511a9\") " pod="openshift-must-gather-8dcwp/perf-node-gather-daemonset-jkl6h"
May 20 20:21:14.232534 ip-10-0-134-167 kubenswrapper[2578]: I0520 20:21:14.232375    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/69871589-a2e3-4d34-9820-2ed8192511a9-lib-modules\") pod \"perf-node-gather-daemonset-jkl6h\" (UID: \"69871589-a2e3-4d34-9820-2ed8192511a9\") " pod="openshift-must-gather-8dcwp/perf-node-gather-daemonset-jkl6h"
May 20 20:21:14.232534 ip-10-0-134-167 kubenswrapper[2578]: I0520 20:21:14.232390    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/69871589-a2e3-4d34-9820-2ed8192511a9-podres\") pod \"perf-node-gather-daemonset-jkl6h\" (UID: \"69871589-a2e3-4d34-9820-2ed8192511a9\") " pod="openshift-must-gather-8dcwp/perf-node-gather-daemonset-jkl6h"
May 20 20:21:14.243184 ip-10-0-134-167 kubenswrapper[2578]: I0520 20:21:14.243147    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bs7p5\" (UniqueName: \"kubernetes.io/projected/69871589-a2e3-4d34-9820-2ed8192511a9-kube-api-access-bs7p5\") pod \"perf-node-gather-daemonset-jkl6h\" (UID: \"69871589-a2e3-4d34-9820-2ed8192511a9\") " pod="openshift-must-gather-8dcwp/perf-node-gather-daemonset-jkl6h"
May 20 20:21:14.421519 ip-10-0-134-167 kubenswrapper[2578]: I0520 20:21:14.421493    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8dcwp/perf-node-gather-daemonset-jkl6h"
May 20 20:21:14.574738 ip-10-0-134-167 kubenswrapper[2578]: W0520 20:21:14.574692    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod69871589_a2e3_4d34_9820_2ed8192511a9.slice/crio-e6018e8180c3b468bc301d5c6502ba6dc134afba93219f8fcf4cf950db5d0d58 WatchSource:0}: Error finding container e6018e8180c3b468bc301d5c6502ba6dc134afba93219f8fcf4cf950db5d0d58: Status 404 returned error can't find the container with id e6018e8180c3b468bc301d5c6502ba6dc134afba93219f8fcf4cf950db5d0d58
May 20 20:21:14.578633 ip-10-0-134-167 kubenswrapper[2578]: I0520 20:21:14.577508    2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8dcwp/perf-node-gather-daemonset-jkl6h"]
May 20 20:21:14.579781 ip-10-0-134-167 kubenswrapper[2578]: I0520 20:21:14.579756    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 20 20:21:14.656431 ip-10-0-134-167 kubenswrapper[2578]: I0520 20:21:14.656407    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-d4d8f94f9-2jjjl_6c107f5d-7dac-4b0c-8b34-e52b84ab2075/networking-console-plugin/0.log"
May 20 20:21:14.800408 ip-10-0-134-167 kubenswrapper[2578]: I0520 20:21:14.800321    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8dcwp/perf-node-gather-daemonset-jkl6h" event={"ID":"69871589-a2e3-4d34-9820-2ed8192511a9","Type":"ContainerStarted","Data":"f8a8d574d0362c8eb8318403d61d5ea1b376b242af9c5f3feaaf58956f13d4b5"}
May 20 20:21:14.800408 ip-10-0-134-167 kubenswrapper[2578]: I0520 20:21:14.800362    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8dcwp/perf-node-gather-daemonset-jkl6h" event={"ID":"69871589-a2e3-4d34-9820-2ed8192511a9","Type":"ContainerStarted","Data":"e6018e8180c3b468bc301d5c6502ba6dc134afba93219f8fcf4cf950db5d0d58"}
May 20 20:21:14.800408 ip-10-0-134-167 kubenswrapper[2578]: I0520 20:21:14.800381    2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-8dcwp/perf-node-gather-daemonset-jkl6h"
May 20 20:21:14.819345 ip-10-0-134-167 kubenswrapper[2578]: I0520 20:21:14.819294    2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-8dcwp/perf-node-gather-daemonset-jkl6h" podStartSLOduration=0.819279243 podStartE2EDuration="819.279243ms" podCreationTimestamp="2026-05-20 20:21:14 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-20 20:21:14.818534569 +0000 UTC m=+2217.267083422" watchObservedRunningTime="2026-05-20 20:21:14.819279243 +0000 UTC m=+2217.267828149"
May 20 20:21:15.915856 ip-10-0-134-167 kubenswrapper[2578]: I0520 20:21:15.915829    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-57bd96b888-nnjln_60de8576-f74a-44a5-b5de-bfa3597b2c85/download-server/0.log"
May 20 20:21:16.534562 ip-10-0-134-167 kubenswrapper[2578]: I0520 20:21:16.534533    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5cf8c89d64-fd6t5_dbcb72b7-120b-4be2-836c-7981af7baa1e/volume-data-source-validator/0.log"
May 20 20:21:17.655015 ip-10-0-134-167 kubenswrapper[2578]: I0520 20:21:17.654986    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-t8kn6_3e5d41c3-bec4-4344-a58c-e52112542af8/dns/0.log"
May 20 20:21:17.695500 ip-10-0-134-167 kubenswrapper[2578]: I0520 20:21:17.695474    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-t8kn6_3e5d41c3-bec4-4344-a58c-e52112542af8/kube-rbac-proxy/0.log"
May 20 20:21:17.823958 ip-10-0-134-167 kubenswrapper[2578]: I0520 20:21:17.823923    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-lmf6r_cb2e0a0a-0a02-4144-8e95-2888159f5bd2/dns-node-resolver/0.log"
May 20 20:21:18.378923 ip-10-0-134-167 kubenswrapper[2578]: I0520 20:21:18.378880    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-7dcd5658f9-9lmdq_e676d7d6-3fc2-4c85-b627-e65515c5d6ce/registry/0.log"
May 20 20:21:18.446183 ip-10-0-134-167 kubenswrapper[2578]: I0520 20:21:18.446151    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-mszww_4639ddbd-2055-4d5f-8bda-d0cd32aca639/node-ca/0.log"
May 20 20:21:19.508534 ip-10-0-134-167 kubenswrapper[2578]: I0520 20:21:19.508502    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-798958bb55-l99nl_e51b10d5-8b59-4e8f-a5b1-510574f278db/discovery/0.log"
May 20 20:21:19.555665 ip-10-0-134-167 kubenswrapper[2578]: I0520 20:21:19.555635    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-547dffc8c7-95xxl_e43edc3c-5e3b-4f88-90c2-f2742ad65f2f/kube-auth-proxy/0.log"
May 20 20:21:20.647773 ip-10-0-134-167 kubenswrapper[2578]: I0520 20:21:20.647743    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-rj5rw_b63a00ba-256d-476a-9f16-f0ae99f6e73b/serve-healthcheck-canary/0.log"
May 20 20:21:20.814768 ip-10-0-134-167 kubenswrapper[2578]: I0520 20:21:20.814743    2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-8dcwp/perf-node-gather-daemonset-jkl6h"
May 20 20:21:21.446824 ip-10-0-134-167 kubenswrapper[2578]: I0520 20:21:21.446793    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mqvzm_9e0c6bfa-4fd1-4fbd-b1f2-b0796e7ff69c/kube-rbac-proxy/0.log"
May 20 20:21:21.475283 ip-10-0-134-167 kubenswrapper[2578]: I0520 20:21:21.475261    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mqvzm_9e0c6bfa-4fd1-4fbd-b1f2-b0796e7ff69c/exporter/0.log"
May 20 20:21:21.497349 ip-10-0-134-167 kubenswrapper[2578]: I0520 20:21:21.497329    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mqvzm_9e0c6bfa-4fd1-4fbd-b1f2-b0796e7ff69c/extractor/0.log"
May 20 20:21:23.746154 ip-10-0-134-167 kubenswrapper[2578]: I0520 20:21:23.741330    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-856948b99f-4xfxw_eb7b87ee-fe3c-4b1b-8ba0-74c41367302f/manager/0.log"
May 20 20:21:23.796363 ip-10-0-134-167 kubenswrapper[2578]: I0520 20:21:23.796336    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-5fb69bd499-2r9jn_d7f87878-c485-4ac9-af9b-e0af38ed3aee/maas-api/0.log"
May 20 20:21:23.987378 ip-10-0-134-167 kubenswrapper[2578]: I0520 20:21:23.987344    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-858dbf95b8-wps2x_233ea0c3-5de9-4c5b-9cd5-f591284cffd2/manager/0.log"
May 20 20:21:23.998113 ip-10-0-134-167 kubenswrapper[2578]: I0520 20:21:23.998037    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-858dbf95b8-wps2x_233ea0c3-5de9-4c5b-9cd5-f591284cffd2/manager/1.log"
May 20 20:21:24.037962 ip-10-0-134-167 kubenswrapper[2578]: I0520 20:21:24.037931    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-74d7cb47bd-4twn6_1a82512a-abce-4072-ab13-01f1e114bd4b/manager/0.log"
May 20 20:21:24.172370 ip-10-0-134-167 kubenswrapper[2578]: I0520 20:21:24.172342    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-68c4fbbd6f-qdk87_70ecee7c-5759-40fc-98bc-afc553ecd179/postgres/0.log"
May 20 20:21:25.500097 ip-10-0-134-167 kubenswrapper[2578]: I0520 20:21:25.500067    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-bfc7f696d-j7tsq_aefbfd1a-5cb6-458d-a599-8d5637d1d5d7/openshift-lws-operator/0.log"