May 28 14:50:14.576007 ip-10-0-137-84 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
May 28 14:50:14.576022 ip-10-0-137-84 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
May 28 14:50:14.576032 ip-10-0-137-84 systemd[1]: kubelet.service: Failed with result 'resources'.
May 28 14:50:14.576362 ip-10-0-137-84 systemd[1]: Failed to start Kubernetes Kubelet.
May 28 14:50:24.580055 ip-10-0-137-84 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
May 28 14:50:24.580075 ip-10-0-137-84 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 9802ad7e431043e4868b848334a08750 --
May 28 14:52:59.788982 ip-10-0-137-84 systemd[1]: Starting Kubernetes Kubelet...
May 28 14:53:00.227795 ip-10-0-137-84 kubenswrapper[2563]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 28 14:53:00.227795 ip-10-0-137-84 kubenswrapper[2563]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
May 28 14:53:00.227795 ip-10-0-137-84 kubenswrapper[2563]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 28 14:53:00.227795 ip-10-0-137-84 kubenswrapper[2563]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
May 28 14:53:00.227795 ip-10-0-137-84 kubenswrapper[2563]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 28 14:53:00.230234 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.230140    2563 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
May 28 14:53:00.233267 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.233252    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 28 14:53:00.233267 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.233267    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 28 14:53:00.233332 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.233271    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 28 14:53:00.233332 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.233276    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 28 14:53:00.233332 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.233278    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 28 14:53:00.233332 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.233282    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 28 14:53:00.233332 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.233285    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 28 14:53:00.233332 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.233288    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 28 14:53:00.233332 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.233291    2563 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 28 14:53:00.233332 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.233294    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 28 14:53:00.233332 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.233297    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 28 14:53:00.233332 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.233299    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 28 14:53:00.233332 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.233302    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 28 14:53:00.233332 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.233305    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 28 14:53:00.233332 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.233308    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 28 14:53:00.233332 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.233310    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 28 14:53:00.233332 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.233313    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 28 14:53:00.233332 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.233316    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
May 28 14:53:00.233332 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.233318    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 28 14:53:00.233332 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.233328    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 28 14:53:00.233332 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.233331    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 28 14:53:00.233802 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.233333    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 28 14:53:00.233802 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.233336    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 28 14:53:00.233802 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.233339    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 28 14:53:00.233802 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.233342    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 28 14:53:00.233802 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.233344    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 28 14:53:00.233802 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.233347    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 28 14:53:00.233802 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.233350    2563 feature_gate.go:328] unrecognized feature gate: Example
May 28 14:53:00.233802 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.233353    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 28 14:53:00.233802 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.233355    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 28 14:53:00.233802 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.233358    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 28 14:53:00.233802 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.233360    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 28 14:53:00.233802 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.233362    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 28 14:53:00.233802 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.233365    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 28 14:53:00.233802 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.233367    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 28 14:53:00.233802 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.233370    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 28 14:53:00.233802 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.233372    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 28 14:53:00.233802 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.233375    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 28 14:53:00.233802 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.233378    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 28 14:53:00.233802 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.233381    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 28 14:53:00.234302 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.233386    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 28 14:53:00.234302 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.233389    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 28 14:53:00.234302 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.233393    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 28 14:53:00.234302 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.233397    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 28 14:53:00.234302 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.233399    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 28 14:53:00.234302 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.233402    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 28 14:53:00.234302 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.233405    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 28 14:53:00.234302 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.233407    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 28 14:53:00.234302 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.233410    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 28 14:53:00.234302 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.233412    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 28 14:53:00.234302 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.233415    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 28 14:53:00.234302 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.233417    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 28 14:53:00.234302 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.233419    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 28 14:53:00.234302 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.233422    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 28 14:53:00.234302 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.233425    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 28 14:53:00.234302 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.233428    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 28 14:53:00.234302 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.233431    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 28 14:53:00.234302 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.233433    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
May 28 14:53:00.234302 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.233437    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 28 14:53:00.234302 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.233440    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 28 14:53:00.234815 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.233443    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 28 14:53:00.234815 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.233445    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 28 14:53:00.234815 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.233448    2563 feature_gate.go:328] unrecognized feature gate: Example2
May 28 14:53:00.234815 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.233451    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 28 14:53:00.234815 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.233453    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 28 14:53:00.234815 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.233456    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 28 14:53:00.234815 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.233459    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 28 14:53:00.234815 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.233462    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 28 14:53:00.234815 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.233464    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 28 14:53:00.234815 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.233467    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 28 14:53:00.234815 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.233469    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 28 14:53:00.234815 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.233472    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 28 14:53:00.234815 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.233474    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 28 14:53:00.234815 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.233477    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 28 14:53:00.234815 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.233479    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 28 14:53:00.234815 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.233482    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 28 14:53:00.234815 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.233484    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 28 14:53:00.234815 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.233486    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 28 14:53:00.234815 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.233489    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 28 14:53:00.234815 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.233491    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 28 14:53:00.235290 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.233494    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 28 14:53:00.235290 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.233496    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 28 14:53:00.235290 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.233499    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 28 14:53:00.235290 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.233501    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 28 14:53:00.235290 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.233505    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 28 14:53:00.235290 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.233508    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 28 14:53:00.235290 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.233908    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 28 14:53:00.235290 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.233916    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 28 14:53:00.235290 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.233920    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 28 14:53:00.235290 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.233924    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 28 14:53:00.235290 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.233927    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 28 14:53:00.235290 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.233930    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 28 14:53:00.235290 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.233933    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 28 14:53:00.235290 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.233936    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 28 14:53:00.235290 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.233939    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 28 14:53:00.235290 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.233942    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 28 14:53:00.235290 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.233945    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 28 14:53:00.235290 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.233947    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 28 14:53:00.235290 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.233951    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 28 14:53:00.235746 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.233954    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 28 14:53:00.235746 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.233958    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 28 14:53:00.235746 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.233960    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 28 14:53:00.235746 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.233963    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 28 14:53:00.235746 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.233966    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 28 14:53:00.235746 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.233968    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 28 14:53:00.235746 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.233971    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 28 14:53:00.235746 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.233973    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 28 14:53:00.235746 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.233976    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 28 14:53:00.235746 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.233978    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 28 14:53:00.235746 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.233980    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 28 14:53:00.235746 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.233983    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 28 14:53:00.235746 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.233985    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 28 14:53:00.235746 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.233988    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 28 14:53:00.235746 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.233990    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 28 14:53:00.235746 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.233993    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 28 14:53:00.235746 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.233995    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 28 14:53:00.235746 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.233998    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 28 14:53:00.235746 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.234001    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 28 14:53:00.236217 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.234004    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 28 14:53:00.236217 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.234007    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 28 14:53:00.236217 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.234010    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 28 14:53:00.236217 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.234012    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 28 14:53:00.236217 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.234015    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 28 14:53:00.236217 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.234017    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 28 14:53:00.236217 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.234020    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 28 14:53:00.236217 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.234022    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 28 14:53:00.236217 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.234025    2563 feature_gate.go:328] unrecognized feature gate: Example2
May 28 14:53:00.236217 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.234027    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
May 28 14:53:00.236217 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.234030    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 28 14:53:00.236217 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.234033    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 28 14:53:00.236217 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.234035    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 28 14:53:00.236217 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.234038    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 28 14:53:00.236217 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.234040    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 28 14:53:00.236217 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.234043    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 28 14:53:00.236217 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.234045    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 28 14:53:00.236217 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.234047    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
May 28 14:53:00.236217 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.234050    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 28 14:53:00.236217 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.234053    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 28 14:53:00.236725 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.234055    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 28 14:53:00.236725 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.234058    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 28 14:53:00.236725 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.234060    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 28 14:53:00.236725 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.234062    2563 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 28 14:53:00.236725 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.234065    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 28 14:53:00.236725 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.234067    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 28 14:53:00.236725 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.234069    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 28 14:53:00.236725 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.234072    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 28 14:53:00.236725 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.234074    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 28 14:53:00.236725 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.234077    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 28 14:53:00.236725 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.234080    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 28 14:53:00.236725 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.234082    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 28 14:53:00.236725 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.234085    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 28 14:53:00.236725 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.234088    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 28 14:53:00.236725 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.234090    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 28 14:53:00.236725 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.234093    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 28 14:53:00.236725 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.234096    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 28 14:53:00.236725 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.234098    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 28 14:53:00.236725 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.234101    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 28 14:53:00.236725 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.234103    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 28 14:53:00.237242 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.234106    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 28 14:53:00.237242 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.234109    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 28 14:53:00.237242 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.234112    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 28 14:53:00.237242 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.234114    2563 feature_gate.go:328] unrecognized feature gate: Example
May 28 14:53:00.237242 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.234117    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 28 14:53:00.237242 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.234119    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 28 14:53:00.237242 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.234122    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 28 14:53:00.237242 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.234124    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 28 14:53:00.237242 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.234127    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 28 14:53:00.237242 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.234129    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 28 14:53:00.237242 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.234132    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 28 14:53:00.237242 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.234134    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 28 14:53:00.237242 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.234137    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 28 14:53:00.237242 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.234139    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 28 14:53:00.237242 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.234220    2563 flags.go:64] FLAG: --address="0.0.0.0"
May 28 14:53:00.237242 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.234237    2563 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
May 28 14:53:00.237242 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.234244    2563 flags.go:64] FLAG: --anonymous-auth="true"
May 28 14:53:00.237242 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.234249    2563 flags.go:64] FLAG: --application-metrics-count-limit="100"
May 28 14:53:00.237242 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.234253    2563 flags.go:64] FLAG: --authentication-token-webhook="false"
May 28 14:53:00.237242 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.234256    2563 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
May 28 14:53:00.237242 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.234260    2563 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
May 28 14:53:00.237771 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.234265    2563 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
May 28 14:53:00.237771 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.234268    2563 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
May 28 14:53:00.237771 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.234272    2563 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
May 28 14:53:00.237771 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.234275    2563 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
May 28 14:53:00.237771 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.234279    2563 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
May 28 14:53:00.237771 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.234282    2563 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
May 28 14:53:00.237771 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.234286    2563 flags.go:64] FLAG: --cgroup-root=""
May 28 14:53:00.237771 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.234289    2563 flags.go:64] FLAG: --cgroups-per-qos="true"
May 28 14:53:00.237771 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.234292    2563 flags.go:64] FLAG: --client-ca-file=""
May 28 14:53:00.237771 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.234295    2563 flags.go:64] FLAG: --cloud-config=""
May 28 14:53:00.237771 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.234297    2563 flags.go:64] FLAG: --cloud-provider="external"
May 28 14:53:00.237771 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.234300    2563 flags.go:64] FLAG: --cluster-dns="[]"
May 28 14:53:00.237771 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.234304    2563 flags.go:64] FLAG: --cluster-domain=""
May 28 14:53:00.237771 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.234307    2563 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
May 28 14:53:00.237771 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.234311    2563 flags.go:64] FLAG: --config-dir=""
May 28 14:53:00.237771 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.234315    2563 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
May 28 14:53:00.237771 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.234318    2563 flags.go:64] FLAG: --container-log-max-files="5"
May 28 14:53:00.237771 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.234322    2563 flags.go:64] FLAG: --container-log-max-size="10Mi"
May 28 14:53:00.237771 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.234325    2563 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
May 28 14:53:00.237771 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.234329    2563 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
May 28 14:53:00.237771 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.234332    2563 flags.go:64] FLAG: --containerd-namespace="k8s.io"
May 28 14:53:00.237771 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.234335    2563 flags.go:64] FLAG: --contention-profiling="false"
May 28 14:53:00.237771 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.234338    2563 flags.go:64] FLAG: --cpu-cfs-quota="true"
May 28 14:53:00.237771 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.234341    2563 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
May 28 14:53:00.238471 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.234344    2563 flags.go:64] FLAG: --cpu-manager-policy="none"
May 28 14:53:00.238471 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.234347    2563 flags.go:64] FLAG: --cpu-manager-policy-options=""
May 28 14:53:00.238471 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.234352    2563 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
May 28 14:53:00.238471 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.234355    2563 flags.go:64] FLAG: --enable-controller-attach-detach="true"
May 28 14:53:00.238471 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.234358    2563 flags.go:64] FLAG: --enable-debugging-handlers="true"
May 28 14:53:00.238471 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.234361    2563 flags.go:64] FLAG: --enable-load-reader="false"
May 28 14:53:00.238471 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.234364    2563 flags.go:64] FLAG: --enable-server="true"
May 28 14:53:00.238471 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.234367    2563 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
May 28 14:53:00.238471 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.234372    2563 flags.go:64] FLAG: --event-burst="100"
May 28 14:53:00.238471 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.234375    2563 flags.go:64] FLAG: --event-qps="50"
May 28 14:53:00.238471 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.234378    2563 flags.go:64] FLAG: --event-storage-age-limit="default=0"
May 28 14:53:00.238471 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.234382    2563 flags.go:64] FLAG: --event-storage-event-limit="default=0"
May 28 14:53:00.238471 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.234384    2563 flags.go:64] FLAG: --eviction-hard=""
May 28 14:53:00.238471 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.234389    2563 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
May 28 14:53:00.238471 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.234391    2563 flags.go:64] FLAG: --eviction-minimum-reclaim=""
May 28 14:53:00.238471 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.234394    2563 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
May 28 14:53:00.238471 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.234397    2563 flags.go:64] FLAG: --eviction-soft=""
May 28 14:53:00.238471 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.234400    2563 flags.go:64] FLAG: --eviction-soft-grace-period=""
May 28 14:53:00.238471 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.234403    2563 flags.go:64] FLAG: --exit-on-lock-contention="false"
May 28 14:53:00.238471 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.234406    2563 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
May 28 14:53:00.238471 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.234409    2563 flags.go:64] FLAG: --experimental-mounter-path=""
May 28 14:53:00.238471 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.234412    2563 flags.go:64] FLAG: --fail-cgroupv1="false"
May 28 14:53:00.238471 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.234415    2563 flags.go:64] FLAG: --fail-swap-on="true"
May 28 14:53:00.238471 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.234418    2563 flags.go:64] FLAG: --feature-gates=""
May 28 14:53:00.238471 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.234422    2563 flags.go:64] FLAG: --file-check-frequency="20s"
May 28 14:53:00.239088 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.234425    2563 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
May 28 14:53:00.239088 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.234428    2563 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
May 28 14:53:00.239088 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.234431    2563 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
May 28 14:53:00.239088 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.234434    2563 flags.go:64] FLAG: --healthz-port="10248"
May 28 14:53:00.239088 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.234437    2563 flags.go:64] FLAG: --help="false"
May 28 14:53:00.239088 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.234440    2563 flags.go:64] FLAG: --hostname-override="ip-10-0-137-84.ec2.internal"
May 28 14:53:00.239088 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.234443    2563 flags.go:64] FLAG: --housekeeping-interval="10s"
May 28 14:53:00.239088 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.234446    2563 flags.go:64] FLAG: --http-check-frequency="20s"
May 28 14:53:00.239088 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.234449    2563 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
May 28 14:53:00.239088 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.234452    2563 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
May 28 14:53:00.239088 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.234456    2563 flags.go:64] FLAG: --image-gc-high-threshold="85"
May 28 14:53:00.239088 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.234459    2563 flags.go:64] FLAG: --image-gc-low-threshold="80"
May 28 14:53:00.239088 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.234461    2563 flags.go:64] FLAG: --image-service-endpoint=""
May 28 14:53:00.239088 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.234464    2563 flags.go:64] FLAG: --kernel-memcg-notification="false"
May 28 14:53:00.239088 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.234467    2563 flags.go:64] FLAG: --kube-api-burst="100"
May 28 14:53:00.239088 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.234470    2563 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
May 28 14:53:00.239088 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.234473    2563 flags.go:64] FLAG: --kube-api-qps="50"
May 28 14:53:00.239088 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.234476    2563 flags.go:64] FLAG: --kube-reserved=""
May 28 14:53:00.239088 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.234480    2563 flags.go:64] FLAG: --kube-reserved-cgroup=""
May 28 14:53:00.239088 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.234483    2563 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
May 28 14:53:00.239088 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.234486    2563 flags.go:64] FLAG: --kubelet-cgroups=""
May 28 14:53:00.239088 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.234488    2563 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
May 28 14:53:00.239088 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.234491    2563 flags.go:64] FLAG: --lock-file=""
May 28 14:53:00.239088 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.234494    2563 flags.go:64] FLAG: --log-cadvisor-usage="false"
May 28 14:53:00.239670 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.234497    2563 flags.go:64] FLAG: --log-flush-frequency="5s"
May 28 14:53:00.239670 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.234500    2563 flags.go:64] FLAG: --log-json-info-buffer-size="0"
May 28 14:53:00.239670 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.234506    2563 flags.go:64] FLAG: --log-json-split-stream="false"
May 28 14:53:00.239670 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.234509    2563 flags.go:64] FLAG: --log-text-info-buffer-size="0"
May 28 14:53:00.239670 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.234511    2563 flags.go:64] FLAG: --log-text-split-stream="false"
May 28 14:53:00.239670 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.234514    2563 flags.go:64] FLAG: --logging-format="text"
May 28 14:53:00.239670 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.234517    2563 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
May 28 14:53:00.239670 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.234520    2563 flags.go:64] FLAG: --make-iptables-util-chains="true"
May 28 14:53:00.239670 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.234523    2563 flags.go:64] FLAG: --manifest-url=""
May 28 14:53:00.239670 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.234526    2563 flags.go:64] FLAG: --manifest-url-header=""
May 28 14:53:00.239670 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.234531    2563 flags.go:64] FLAG: --max-housekeeping-interval="15s"
May 28 14:53:00.239670 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.234535    2563 flags.go:64] FLAG: --max-open-files="1000000"
May 28 14:53:00.239670 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.234539    2563 flags.go:64] FLAG: --max-pods="110"
May 28 14:53:00.239670 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.234542    2563 flags.go:64] FLAG: --maximum-dead-containers="-1"
May 28 14:53:00.239670 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.234545    2563 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
May 28 14:53:00.239670 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.234548    2563 flags.go:64] FLAG: --memory-manager-policy="None"
May 28 14:53:00.239670 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.234551    2563 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
May 28 14:53:00.239670 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.234554    2563 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
May 28 14:53:00.239670 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.234558    2563 flags.go:64] FLAG: --node-ip="0.0.0.0"
May 28 14:53:00.239670 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.234560    2563 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
May 28 14:53:00.239670 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.234568    2563 flags.go:64] FLAG: --node-status-max-images="50"
May 28 14:53:00.239670 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.234571    2563 flags.go:64] FLAG: --node-status-update-frequency="10s"
May 28 14:53:00.239670 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.234574    2563 flags.go:64] FLAG: --oom-score-adj="-999"
May 28 14:53:00.239670 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.234577    2563 flags.go:64] FLAG: --pod-cidr=""
May 28 14:53:00.240286 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.234580    2563 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc"
May 28 14:53:00.240286 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.234586    2563 flags.go:64] FLAG: --pod-manifest-path=""
May 28 14:53:00.240286 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.234589    2563 flags.go:64] FLAG: --pod-max-pids="-1"
May 28 14:53:00.240286 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.234593    2563 flags.go:64] FLAG: --pods-per-core="0"
May 28 14:53:00.240286 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.234596    2563 flags.go:64] FLAG: --port="10250"
May 28 14:53:00.240286 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.234600    2563 flags.go:64] FLAG: --protect-kernel-defaults="false"
May 28 14:53:00.240286 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.234603    2563 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-070eea9d5687fb98f"
May 28 14:53:00.240286 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.234606    2563 flags.go:64] FLAG: --qos-reserved=""
May 28 14:53:00.240286 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.234609    2563 flags.go:64] FLAG: --read-only-port="10255"
May 28 14:53:00.240286 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.234612    2563 flags.go:64] FLAG: --register-node="true"
May 28 14:53:00.240286 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.234615    2563 flags.go:64] FLAG: --register-schedulable="true"
May 28 14:53:00.240286 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.234618    2563 flags.go:64] FLAG: --register-with-taints=""
May 28 14:53:00.240286 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.234622    2563 flags.go:64] FLAG: --registry-burst="10"
May 28 14:53:00.240286 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.234625    2563 flags.go:64] FLAG: --registry-qps="5"
May 28 14:53:00.240286 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.234627    2563 flags.go:64] FLAG: --reserved-cpus=""
May 28 14:53:00.240286 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.234631    2563 flags.go:64] FLAG: --reserved-memory=""
May 28 14:53:00.240286 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.234634    2563 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
May 28 14:53:00.240286 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.234638    2563 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
May 28 14:53:00.240286 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.234642    2563 flags.go:64] FLAG: --rotate-certificates="false"
May 28 14:53:00.240286 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.234645    2563 flags.go:64] FLAG: --rotate-server-certificates="false"
May 28 14:53:00.240286 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.234648    2563 flags.go:64] FLAG: --runonce="false"
May 28 14:53:00.240286 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.234651    2563 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
May 28 14:53:00.240286 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.234654    2563 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
May 28 14:53:00.240286 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.234657    2563 flags.go:64] FLAG: --seccomp-default="false"
May 28 14:53:00.240286 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.234660    2563 flags.go:64] FLAG: --serialize-image-pulls="true"
May 28 14:53:00.240924 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.234663    2563 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
May 28 14:53:00.240924 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.234666    2563 flags.go:64] FLAG: --storage-driver-db="cadvisor"
May 28 14:53:00.240924 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.234669    2563 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
May 28 14:53:00.240924 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.234686    2563 flags.go:64] FLAG: --storage-driver-password="root"
May 28 14:53:00.240924 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.234689    2563 flags.go:64] FLAG: --storage-driver-secure="false"
May 28 14:53:00.240924 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.234693    2563 flags.go:64] FLAG: --storage-driver-table="stats"
May 28 14:53:00.240924 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.234695    2563 flags.go:64] FLAG: --storage-driver-user="root"
May 28 14:53:00.240924 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.234698    2563 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
May 28 14:53:00.240924 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.234702    2563 flags.go:64] FLAG: --sync-frequency="1m0s"
May 28 14:53:00.240924 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.234705    2563 flags.go:64] FLAG: --system-cgroups=""
May 28 14:53:00.240924 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.234708    2563 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
May 28 14:53:00.240924 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.234713    2563 flags.go:64] FLAG: --system-reserved-cgroup=""
May 28 14:53:00.240924 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.234716    2563 flags.go:64] FLAG: --tls-cert-file=""
May 28 14:53:00.240924 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.234719    2563 flags.go:64] FLAG: --tls-cipher-suites="[]"
May 28 14:53:00.240924 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.234723    2563 flags.go:64] FLAG: --tls-min-version=""
May 28 14:53:00.240924 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.234726    2563 flags.go:64] FLAG: --tls-private-key-file=""
May 28 14:53:00.240924 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.234728    2563 flags.go:64] FLAG: --topology-manager-policy="none"
May 28 14:53:00.240924 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.234734    2563 flags.go:64] FLAG: --topology-manager-policy-options=""
May 28 14:53:00.240924 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.234737    2563 flags.go:64] FLAG: --topology-manager-scope="container"
May 28 14:53:00.240924 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.234740    2563 flags.go:64] FLAG: --v="2"
May 28 14:53:00.240924 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.234744    2563 flags.go:64] FLAG: --version="false"
May 28 14:53:00.240924 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.234749    2563 flags.go:64] FLAG: --vmodule=""
May 28 14:53:00.240924 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.234753    2563 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
May 28 14:53:00.240924 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.234756    2563 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
May 28 14:53:00.241499 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.234848    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 28 14:53:00.241499 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.234853    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 28 14:53:00.241499 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.234857    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 28 14:53:00.241499 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.234860    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 28 14:53:00.241499 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.234864    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 28 14:53:00.241499 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.234867    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 28 14:53:00.241499 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.234870    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 28 14:53:00.241499 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.234873    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 28 14:53:00.241499 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.234875    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 28 14:53:00.241499 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.234880    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 28 14:53:00.241499 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.234883    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 28 14:53:00.241499 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.234886    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 28 14:53:00.241499 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.234889    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
May 28 14:53:00.241499 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.234892    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 28 14:53:00.241499 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.234895    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 28 14:53:00.241499 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.234897    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 28 14:53:00.241499 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.234900    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 28 14:53:00.241499 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.234902    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 28 14:53:00.241499 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.234908    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 28 14:53:00.242150 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.234911    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 28 14:53:00.242150 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.234914    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 28 14:53:00.242150 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.234916    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 28 14:53:00.242150 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.234919    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 28 14:53:00.242150 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.234921    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 28 14:53:00.242150 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.234924    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 28 14:53:00.242150 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.234931    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 28 14:53:00.242150 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.234934    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 28 14:53:00.242150 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.234936    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 28 14:53:00.242150 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.234939    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 28 14:53:00.242150 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.234942    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 28 14:53:00.242150 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.234945    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 28 14:53:00.242150 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.234947    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 28 14:53:00.242150 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.234950    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 28 14:53:00.242150 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.234953    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 28 14:53:00.242150 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.234955    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 28 14:53:00.242150 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.234958    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 28 14:53:00.242150 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.234962    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 28 14:53:00.242150 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.234965    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 28 14:53:00.242856 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.234968    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 28 14:53:00.242856 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.234971    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 28 14:53:00.242856 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.234973    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 28 14:53:00.242856 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.234976    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 28 14:53:00.242856 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.234979    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 28 14:53:00.242856 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.234981    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 28 14:53:00.242856 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.234984    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 28 14:53:00.242856 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.234986    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 28 14:53:00.242856 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.234989    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 28 14:53:00.242856 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.234991    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 28 14:53:00.242856 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.234994    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 28 14:53:00.242856 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.234996    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 28 14:53:00.242856 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.235000    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 28 14:53:00.242856 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.235003    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 28 14:53:00.242856 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.235006    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 28 14:53:00.242856 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.235008    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 28 14:53:00.242856 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.235011    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 28 14:53:00.242856 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.235013    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 28 14:53:00.242856 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.235016    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 28 14:53:00.242856 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.235020    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 28 14:53:00.243415 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.235023    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
May 28 14:53:00.243415 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.235025    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 28 14:53:00.243415 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.235028    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 28 14:53:00.243415 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.235030    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 28 14:53:00.243415 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.235033    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 28 14:53:00.243415 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.235036    2563 feature_gate.go:328] unrecognized feature gate: Example
May 28 14:53:00.243415 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.235038    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 28 14:53:00.243415 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.235041    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 28 14:53:00.243415 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.235043    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 28 14:53:00.243415 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.235046    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 28 14:53:00.243415 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.235048    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 28 14:53:00.243415 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.235051    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 28 14:53:00.243415 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.235054    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 28 14:53:00.243415 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.235056    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 28 14:53:00.243415 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.235059    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 28 14:53:00.243415 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.235062    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 28 14:53:00.243415 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.235064    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 28 14:53:00.243415 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.235067    2563 feature_gate.go:328] unrecognized feature gate: Example2
May 28 14:53:00.243415 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.235069    2563 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 28 14:53:00.243415 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.235072    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 28 14:53:00.243966 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.235074    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 28 14:53:00.243966 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.235077    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 28 14:53:00.243966 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.235079    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 28 14:53:00.243966 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.235082    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 28 14:53:00.243966 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.235085    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 28 14:53:00.243966 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.235088    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 28 14:53:00.243966 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.235091    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 28 14:53:00.243966 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.235093    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 28 14:53:00.243966 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.235099    2563 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 28 14:53:00.243966 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.243241    2563 server.go:530] "Kubelet version" kubeletVersion="v1.33.11"
May 28 14:53:00.243966 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.243443    2563 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
May 28 14:53:00.243966 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.243538    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 28 14:53:00.243966 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.243545    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 28 14:53:00.243966 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.243550    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 28 14:53:00.243966 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.243553    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 28 14:53:00.243966 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.243556    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 28 14:53:00.244375 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.243559    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 28 14:53:00.244375 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.243562    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 28 14:53:00.244375 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.243565    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 28 14:53:00.244375 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.243568    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 28 14:53:00.244375 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.243571    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 28 14:53:00.244375 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.243574    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 28 14:53:00.244375 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.243576    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 28 14:53:00.244375 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.243579    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 28 14:53:00.244375 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.243581    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 28 14:53:00.244375 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.243584    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
May 28 14:53:00.244375 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.243587    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 28 14:53:00.244375 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.243589    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 28 14:53:00.244375 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.243592    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 28 14:53:00.244375 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.243595    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 28 14:53:00.244375 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.243597    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 28 14:53:00.244375 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.243600    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 28 14:53:00.244375 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.243603    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 28 14:53:00.244375 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.243605    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 28 14:53:00.244375 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.243608    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 28 14:53:00.244375 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.243610    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 28 14:53:00.244876 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.243613    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 28 14:53:00.244876 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.243616    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 28 14:53:00.244876 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.243618    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 28 14:53:00.244876 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.243620    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 28 14:53:00.244876 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.243624    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 28 14:53:00.244876 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.243628    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 28 14:53:00.244876 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.243631    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 28 14:53:00.244876 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.243633    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 28 14:53:00.244876 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.243636    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 28 14:53:00.244876 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.243638    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
May 28 14:53:00.244876 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.243641    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 28 14:53:00.244876 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.243644    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 28 14:53:00.244876 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.243646    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 28 14:53:00.244876 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.243649    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 28 14:53:00.244876 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.243653    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 28 14:53:00.244876 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.243657    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 28 14:53:00.244876 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.243659    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 28 14:53:00.244876 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.243662    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 28 14:53:00.244876 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.243664    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 28 14:53:00.244876 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.243667    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 28 14:53:00.245366 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.243669    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 28 14:53:00.245366 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.243672    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 28 14:53:00.245366 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.243685    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 28 14:53:00.245366 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.243688    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 28 14:53:00.245366 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.243691    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 28 14:53:00.245366 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.243694    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 28 14:53:00.245366 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.243697    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 28 14:53:00.245366 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.243699    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 28 14:53:00.245366 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.243702    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 28 14:53:00.245366 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.243704    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 28 14:53:00.245366 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.243707    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 28 14:53:00.245366 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.243710    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 28 14:53:00.245366 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.243712    2563 feature_gate.go:328] unrecognized feature gate: Example
May 28 14:53:00.245366 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.243717    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 28 14:53:00.245366 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.243721    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 28 14:53:00.245366 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.243724    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 28 14:53:00.245366 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.243728    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 28 14:53:00.245366 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.243731    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 28 14:53:00.245366 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.243734    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 28 14:53:00.245847 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.243738    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 28 14:53:00.245847 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.243740    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 28 14:53:00.245847 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.243743    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 28 14:53:00.245847 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.243746    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 28 14:53:00.245847 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.243749    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 28 14:53:00.245847 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.243752    2563 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 28 14:53:00.245847 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.243754    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 28 14:53:00.245847 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.243757    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 28 14:53:00.245847 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.243760    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 28 14:53:00.245847 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.243762    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 28 14:53:00.245847 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.243765    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 28 14:53:00.245847 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.243768    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 28 14:53:00.245847 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.243771    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 28 14:53:00.245847 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.243773    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 28 14:53:00.245847 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.243775    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 28 14:53:00.245847 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.243778    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 28 14:53:00.245847 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.243781    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 28 14:53:00.245847 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.243784    2563 feature_gate.go:328] unrecognized feature gate: Example2
May 28 14:53:00.245847 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.243786    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 28 14:53:00.246304 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.243789    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 28 14:53:00.246304 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.243791    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 28 14:53:00.246304 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.243794    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 28 14:53:00.246304 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.243799    2563 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 28 14:53:00.246304 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.243902    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 28 14:53:00.246304 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.243908    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 28 14:53:00.246304 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.243911    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 28 14:53:00.246304 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.243914    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 28 14:53:00.246304 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.243917    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 28 14:53:00.246304 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.243920    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 28 14:53:00.246304 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.243923    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 28 14:53:00.246304 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.243934    2563 feature_gate.go:328] unrecognized feature gate: Example2
May 28 14:53:00.246304 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.243938    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 28 14:53:00.246304 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.243941    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 28 14:53:00.246304 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.243944    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 28 14:53:00.246304 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.243947    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 28 14:53:00.246783 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.243949    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 28 14:53:00.246783 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.243952    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
May 28 14:53:00.246783 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.243955    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 28 14:53:00.246783 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.243958    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 28 14:53:00.246783 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.243963    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 28 14:53:00.246783 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.243966    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 28 14:53:00.246783 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.243969    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 28 14:53:00.246783 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.243972    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 28 14:53:00.246783 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.243975    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 28 14:53:00.246783 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.243977    2563 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 28 14:53:00.246783 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.243981    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 28 14:53:00.246783 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.243984    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 28 14:53:00.246783 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.243987    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 28 14:53:00.246783 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.243990    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 28 14:53:00.246783 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.243992    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 28 14:53:00.246783 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.243995    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 28 14:53:00.246783 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.243997    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 28 14:53:00.246783 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.244000    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 28 14:53:00.246783 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.244003    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 28 14:53:00.246783 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.244005    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 28 14:53:00.247266 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.244008    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 28 14:53:00.247266 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.244010    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 28 14:53:00.247266 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.244013    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 28 14:53:00.247266 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.244015    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 28 14:53:00.247266 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.244018    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 28 14:53:00.247266 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.244021    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 28 14:53:00.247266 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.244023    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 28 14:53:00.247266 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.244026    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 28 14:53:00.247266 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.244029    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 28 14:53:00.247266 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.244031    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 28 14:53:00.247266 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.244034    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 28 14:53:00.247266 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.244036    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 28 14:53:00.247266 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.244039    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
May 28 14:53:00.247266 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.244041    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 28 14:53:00.247266 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.244044    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 28 14:53:00.247266 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.244046    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 28 14:53:00.247266 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.244049    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 28 14:53:00.247266 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.244051    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 28 14:53:00.247266 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.244054    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 28 14:53:00.247266 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.244056    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 28 14:53:00.247757 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.244059    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 28 14:53:00.247757 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.244062    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 28 14:53:00.247757 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.244064    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 28 14:53:00.247757 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.244068    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 28 14:53:00.247757 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.244072    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 28 14:53:00.247757 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.244075    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 28 14:53:00.247757 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.244078    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 28 14:53:00.247757 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.244081    2563 feature_gate.go:328] unrecognized feature gate: Example
May 28 14:53:00.247757 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.244084    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 28 14:53:00.247757 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.244087    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 28 14:53:00.247757 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.244089    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 28 14:53:00.247757 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.244092    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 28 14:53:00.247757 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.244095    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 28 14:53:00.247757 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.244097    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 28 14:53:00.247757 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.244100    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 28 14:53:00.247757 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.244102    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 28 14:53:00.247757 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.244105    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 28 14:53:00.247757 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.244108    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 28 14:53:00.247757 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.244111    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 28 14:53:00.247757 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.244113    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 28 14:53:00.248252 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.244116    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 28 14:53:00.248252 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.244118    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 28 14:53:00.248252 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.244121    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 28 14:53:00.248252 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.244123    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 28 14:53:00.248252 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.244126    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 28 14:53:00.248252 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.244128    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 28 14:53:00.248252 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.244131    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 28 14:53:00.248252 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.244133    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 28 14:53:00.248252 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.244136    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 28 14:53:00.248252 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.244138    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 28 14:53:00.248252 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.244141    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 28 14:53:00.248252 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.244144    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 28 14:53:00.248252 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.244146    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 28 14:53:00.248252 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:00.244149    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 28 14:53:00.248252 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.244154    2563 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 28 14:53:00.248619 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.244266    2563 server.go:962] "Client rotation is on, will bootstrap in background"
May 28 14:53:00.249733 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.249719    2563 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
May 28 14:53:00.250630 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.250617    2563 server.go:1019] "Starting client certificate rotation"
May 28 14:53:00.250733 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.250719    2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 28 14:53:00.250772 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.250748    2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 28 14:53:00.275849 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.275830    2563 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 28 14:53:00.279733 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.279713    2563 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 28 14:53:00.295200 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.295183    2563 log.go:25] "Validated CRI v1 runtime API"
May 28 14:53:00.301377 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.301362    2563 log.go:25] "Validated CRI v1 image API"
May 28 14:53:00.302790 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.302772    2563 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
May 28 14:53:00.306380 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.306363    2563 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 28 14:53:00.307048 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.307027    2563 fs.go:135] Filesystem UUIDs: map[10b61cd9-964a-4a63-96b8-21e8a7e6365a:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 d47a39e4-c005-426a-8c83-28d75a63677a:/dev/nvme0n1p4]
May 28 14:53:00.307133 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.307046    2563 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
May 28 14:53:00.312238 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.312124    2563 manager.go:217] Machine: {Timestamp:2026-05-28 14:53:00.311618872 +0000 UTC m=+0.400835586 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099223 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2cd240eedaa24815d3e7b81d0ebc19 SystemUUID:ec2cd240-eeda-a248-15d3-e7b81d0ebc19 BootID:9802ad7e-4310-43e4-868b-848334a08750 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ca:0a:45:92:cf Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ca:0a:45:92:cf Speed:0 Mtu:9001} {Name:ovs-system MacAddress:4a:32:4d:22:61:cd Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
May 28 14:53:00.312889 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.312878    2563 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
May 28 14:53:00.313018 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.313005    2563 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
May 28 14:53:00.314881 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.314856    2563 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
May 28 14:53:00.315021 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.314884    2563 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-137-84.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
May 28 14:53:00.315067 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.315031    2563 topology_manager.go:138] "Creating topology manager with none policy"
May 28 14:53:00.315067 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.315039    2563 container_manager_linux.go:306] "Creating device plugin manager"
May 28 14:53:00.315067 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.315047    2563 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
May 28 14:53:00.317127 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.317115    2563 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
May 28 14:53:00.318334 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.318324    2563 state_mem.go:36] "Initialized new in-memory state store"
May 28 14:53:00.318433 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.318424    2563 server.go:1267] "Using root directory" path="/var/lib/kubelet"
May 28 14:53:00.320822 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.320803    2563 kubelet.go:491] "Attempting to sync node with API server"
May 28 14:53:00.320822 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.320826    2563 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests"
May 28 14:53:00.320896 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.320837    2563 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
May 28 14:53:00.320896 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.320847    2563 kubelet.go:397] "Adding apiserver pod source"
May 28 14:53:00.320896 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.320856    2563 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
May 28 14:53:00.321920 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.321909    2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 28 14:53:00.321965 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.321927    2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 28 14:53:00.324767 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.324748    2563 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1"
May 28 14:53:00.326372 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.326355    2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-dqft9"
May 28 14:53:00.327193 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.327180    2563 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
May 28 14:53:00.329162 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.329148    2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
May 28 14:53:00.329162 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.329165    2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
May 28 14:53:00.329259 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.329172    2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
May 28 14:53:00.329259 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.329178    2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
May 28 14:53:00.329259 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.329194    2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
May 28 14:53:00.329259 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.329201    2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret"
May 28 14:53:00.329259 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.329207    2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
May 28 14:53:00.329259 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.329213    2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
May 28 14:53:00.329259 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.329220    2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc"
May 28 14:53:00.329259 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.329226    2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
May 28 14:53:00.329259 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.329240    2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected"
May 28 14:53:00.329259 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.329247    2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
May 28 14:53:00.330044 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.330034    2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi"
May 28 14:53:00.330044 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.330043    2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image"
May 28 14:53:00.333243 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.333223    2563 watchdog_linux.go:99] "Systemd watchdog is not enabled"
May 28 14:53:00.333313 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.333286    2563 server.go:1295] "Started kubelet"
May 28 14:53:00.333417 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.333350    2563 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
May 28 14:53:00.333477 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.333389    2563 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
May 28 14:53:00.333477 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.333461    2563 server_v1.go:47] "podresources" method="list" useActivePods=true
May 28 14:53:00.333911 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.333886    2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-dqft9"
May 28 14:53:00.334015 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.333976    2563 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-137-84.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
May 28 14:53:00.334150 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:53:00.334118    2563 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-137-84.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
May 28 14:53:00.334221 ip-10-0-137-84 systemd[1]: Started Kubernetes Kubelet.
May 28 14:53:00.334788 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:53:00.334246    2563 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
May 28 14:53:00.334970 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.334957    2563 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
May 28 14:53:00.336848 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.336830    2563 server.go:317] "Adding debug handlers to kubelet server"
May 28 14:53:00.343958 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.343939    2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
May 28 14:53:00.344409 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.344390    2563 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
May 28 14:53:00.344490 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:53:00.344412    2563 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
May 28 14:53:00.344490 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.344468    2563 volume_manager.go:295] "The desired_state_of_world populator starts"
May 28 14:53:00.344490 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.344482    2563 volume_manager.go:297] "Starting Kubelet Volume Manager"
May 28 14:53:00.344641 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.344608    2563 desired_state_of_world_populator.go:150] "Desired state populator starts to run"
May 28 14:53:00.344711 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.344693    2563 reconstruct.go:97] "Volume reconstruction finished"
May 28 14:53:00.344711 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.344702    2563 reconciler.go:26] "Reconciler: start to sync state"
May 28 14:53:00.345715 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:53:00.345451    2563 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-84.ec2.internal\" not found"
May 28 14:53:00.345912 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.345897    2563 factory.go:153] Registering CRI-O factory
May 28 14:53:00.345912 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.345914    2563 factory.go:223] Registration of the crio container factory successfully
May 28 14:53:00.346004 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.345957    2563 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
May 28 14:53:00.346004 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.345963    2563 factory.go:55] Registering systemd factory
May 28 14:53:00.346004 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.345969    2563 factory.go:223] Registration of the systemd container factory successfully
May 28 14:53:00.346004 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.345981    2563 factory.go:103] Registering Raw factory
May 28 14:53:00.346004 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.346002    2563 manager.go:1196] Started watching for new ooms in manager
May 28 14:53:00.346430 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.346415    2563 manager.go:319] Starting recovery of all containers
May 28 14:53:00.348086 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.348059    2563 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
May 28 14:53:00.349734 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:53:00.349706    2563 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-137-84.ec2.internal\" not found" node="ip-10-0-137-84.ec2.internal"
May 28 14:53:00.356554 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.356514    2563 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6"
May 28 14:53:00.357599 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.357581    2563 manager.go:324] Recovery completed
May 28 14:53:00.361840 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.361826    2563 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 28 14:53:00.363793 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.363776    2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-84.ec2.internal" event="NodeHasSufficientMemory"
May 28 14:53:00.363851 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.363806    2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-84.ec2.internal" event="NodeHasNoDiskPressure"
May 28 14:53:00.363851 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.363817    2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-84.ec2.internal" event="NodeHasSufficientPID"
May 28 14:53:00.364352 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.364340    2563 cpu_manager.go:222] "Starting CPU manager" policy="none"
May 28 14:53:00.364352 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.364351    2563 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
May 28 14:53:00.364432 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.364368    2563 state_mem.go:36] "Initialized new in-memory state store"
May 28 14:53:00.367225 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.367214    2563 policy_none.go:49] "None policy: Start"
May 28 14:53:00.367269 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.367230    2563 memory_manager.go:186] "Starting memorymanager" policy="None"
May 28 14:53:00.367269 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.367240    2563 state_mem.go:35] "Initializing new in-memory state store"
May 28 14:53:00.404292 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.404276    2563 manager.go:341] "Starting Device Plugin manager"
May 28 14:53:00.417629 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:53:00.404342    2563 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
May 28 14:53:00.417629 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.404356    2563 server.go:85] "Starting device plugin registration server"
May 28 14:53:00.417629 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.404657    2563 eviction_manager.go:189] "Eviction manager: starting control loop"
May 28 14:53:00.417629 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.404694    2563 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
May 28 14:53:00.417629 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.404801    2563 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
May 28 14:53:00.417629 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.404866    2563 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
May 28 14:53:00.417629 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.404874    2563 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
May 28 14:53:00.417629 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:53:00.405408    2563 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
May 28 14:53:00.417629 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:53:00.405446    2563 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-137-84.ec2.internal\" not found"
May 28 14:53:00.474686 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.474649    2563 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4"
May 28 14:53:00.474686 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.474691    2563 status_manager.go:230] "Starting to sync pod status with apiserver"
May 28 14:53:00.474864 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.474711    2563 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
May 28 14:53:00.474864 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.474719    2563 kubelet.go:2451] "Starting kubelet main sync loop"
May 28 14:53:00.474864 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:53:00.474830    2563 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
May 28 14:53:00.477662 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.477645    2563 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 28 14:53:00.505520 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.505450    2563 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 28 14:53:00.506406 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.506391    2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-84.ec2.internal" event="NodeHasSufficientMemory"
May 28 14:53:00.506487 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.506422    2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-84.ec2.internal" event="NodeHasNoDiskPressure"
May 28 14:53:00.506487 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.506434    2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-84.ec2.internal" event="NodeHasSufficientPID"
May 28 14:53:00.506487 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.506460    2563 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-137-84.ec2.internal"
May 28 14:53:00.515250 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.515233    2563 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-137-84.ec2.internal"
May 28 14:53:00.515297 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:53:00.515257    2563 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-137-84.ec2.internal\": node \"ip-10-0-137-84.ec2.internal\" not found"
May 28 14:53:00.538248 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:53:00.538221    2563 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-84.ec2.internal\" not found"
May 28 14:53:00.575454 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.575421    2563 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-84.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-137-84.ec2.internal"]
May 28 14:53:00.575537 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.575523    2563 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 28 14:53:00.576427 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.576412    2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-84.ec2.internal" event="NodeHasSufficientMemory"
May 28 14:53:00.576510 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.576458    2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-84.ec2.internal" event="NodeHasNoDiskPressure"
May 28 14:53:00.576510 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.576469    2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-84.ec2.internal" event="NodeHasSufficientPID"
May 28 14:53:00.577754 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.577739    2563 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 28 14:53:00.577896 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.577879    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-84.ec2.internal"
May 28 14:53:00.577961 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.577920    2563 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 28 14:53:00.578835 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.578819    2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-84.ec2.internal" event="NodeHasSufficientMemory"
May 28 14:53:00.578835 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.578827    2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-84.ec2.internal" event="NodeHasSufficientMemory"
May 28 14:53:00.578950 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.578848    2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-84.ec2.internal" event="NodeHasNoDiskPressure"
May 28 14:53:00.578950 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.578864    2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-84.ec2.internal" event="NodeHasNoDiskPressure"
May 28 14:53:00.578950 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.578874    2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-84.ec2.internal" event="NodeHasSufficientPID"
May 28 14:53:00.578950 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.578865    2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-84.ec2.internal" event="NodeHasSufficientPID"
May 28 14:53:00.579922 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.579906    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-84.ec2.internal"
May 28 14:53:00.580012 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.579937    2563 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 28 14:53:00.580626 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.580609    2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-84.ec2.internal" event="NodeHasSufficientMemory"
May 28 14:53:00.580731 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.580634    2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-84.ec2.internal" event="NodeHasNoDiskPressure"
May 28 14:53:00.580731 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.580644    2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-84.ec2.internal" event="NodeHasSufficientPID"
May 28 14:53:00.596245 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:53:00.596228    2563 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-84.ec2.internal\" not found" node="ip-10-0-137-84.ec2.internal"
May 28 14:53:00.600874 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:53:00.600858    2563 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-84.ec2.internal\" not found" node="ip-10-0-137-84.ec2.internal"
May 28 14:53:00.638735 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:53:00.638702    2563 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-84.ec2.internal\" not found"
May 28 14:53:00.645880 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.645847    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c495a4962e3de6b293414ea1b7e89480-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-84.ec2.internal\" (UID: \"c495a4962e3de6b293414ea1b7e89480\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-84.ec2.internal"
May 28 14:53:00.645948 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.645889    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c495a4962e3de6b293414ea1b7e89480-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-84.ec2.internal\" (UID: \"c495a4962e3de6b293414ea1b7e89480\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-84.ec2.internal"
May 28 14:53:00.645948 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.645922    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5826301e72f9d56159e32c558dac538c-config\") pod \"kube-apiserver-proxy-ip-10-0-137-84.ec2.internal\" (UID: \"5826301e72f9d56159e32c558dac538c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-84.ec2.internal"
May 28 14:53:00.739106 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:53:00.739071    2563 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-84.ec2.internal\" not found"
May 28 14:53:00.746383 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.746363    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c495a4962e3de6b293414ea1b7e89480-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-84.ec2.internal\" (UID: \"c495a4962e3de6b293414ea1b7e89480\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-84.ec2.internal"
May 28 14:53:00.746432 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.746394    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c495a4962e3de6b293414ea1b7e89480-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-84.ec2.internal\" (UID: \"c495a4962e3de6b293414ea1b7e89480\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-84.ec2.internal"
May 28 14:53:00.746432 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.746416    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5826301e72f9d56159e32c558dac538c-config\") pod \"kube-apiserver-proxy-ip-10-0-137-84.ec2.internal\" (UID: \"5826301e72f9d56159e32c558dac538c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-84.ec2.internal"
May 28 14:53:00.746493 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.746451    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5826301e72f9d56159e32c558dac538c-config\") pod \"kube-apiserver-proxy-ip-10-0-137-84.ec2.internal\" (UID: \"5826301e72f9d56159e32c558dac538c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-84.ec2.internal"
May 28 14:53:00.746493 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.746460    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c495a4962e3de6b293414ea1b7e89480-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-84.ec2.internal\" (UID: \"c495a4962e3de6b293414ea1b7e89480\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-84.ec2.internal"
May 28 14:53:00.746493 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.746460    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c495a4962e3de6b293414ea1b7e89480-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-84.ec2.internal\" (UID: \"c495a4962e3de6b293414ea1b7e89480\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-84.ec2.internal"
May 28 14:53:00.839813 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:53:00.839753    2563 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-84.ec2.internal\" not found"
May 28 14:53:00.900205 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.900181    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-84.ec2.internal"
May 28 14:53:00.904230 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:00.904211    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-84.ec2.internal"
May 28 14:53:00.940454 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:53:00.940422    2563 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-84.ec2.internal\" not found"
May 28 14:53:01.040954 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:53:01.040912    2563 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-84.ec2.internal\" not found"
May 28 14:53:01.141459 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:53:01.141382    2563 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-84.ec2.internal\" not found"
May 28 14:53:01.241879 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:53:01.241844    2563 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-84.ec2.internal\" not found"
May 28 14:53:01.250225 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:01.250200    2563 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
May 28 14:53:01.250376 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:01.250350    2563 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 28 14:53:01.250420 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:01.250364    2563 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 28 14:53:01.337496 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:01.337460    2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-27 14:48:00 +0000 UTC" deadline="2027-11-02 12:14:53.921809374 +0000 UTC"
May 28 14:53:01.337496 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:01.337491    2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12549h21m52.584321321s"
May 28 14:53:01.342873 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:53:01.342847    2563 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-84.ec2.internal\" not found"
May 28 14:53:01.344860 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:01.344841    2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
May 28 14:53:01.355939 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:01.355910    2563 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 28 14:53:01.380500 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:01.380470    2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-blfrb"
May 28 14:53:01.388516 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:01.388487    2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-blfrb"
May 28 14:53:01.443972 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:53:01.443948    2563 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-84.ec2.internal\" not found"
May 28 14:53:01.450774 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:01.450598    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc495a4962e3de6b293414ea1b7e89480.slice/crio-45fc66468c92986550e06428271f1418a6ef7c677d07d6e583793841d11e2da1 WatchSource:0}: Error finding container 45fc66468c92986550e06428271f1418a6ef7c677d07d6e583793841d11e2da1: Status 404 returned error can't find the container with id 45fc66468c92986550e06428271f1418a6ef7c677d07d6e583793841d11e2da1
May 28 14:53:01.450997 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:01.450965    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5826301e72f9d56159e32c558dac538c.slice/crio-759c000c8e6e9ed8dee604269d22218c721ef998816f0fda99c54480cb3e9edb WatchSource:0}: Error finding container 759c000c8e6e9ed8dee604269d22218c721ef998816f0fda99c54480cb3e9edb: Status 404 returned error can't find the container with id 759c000c8e6e9ed8dee604269d22218c721ef998816f0fda99c54480cb3e9edb
May 28 14:53:01.455319 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:01.455300    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 28 14:53:01.477251 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:01.477207    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-84.ec2.internal" event={"ID":"c495a4962e3de6b293414ea1b7e89480","Type":"ContainerStarted","Data":"45fc66468c92986550e06428271f1418a6ef7c677d07d6e583793841d11e2da1"}
May 28 14:53:01.478107 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:01.478088    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-84.ec2.internal" event={"ID":"5826301e72f9d56159e32c558dac538c","Type":"ContainerStarted","Data":"759c000c8e6e9ed8dee604269d22218c721ef998816f0fda99c54480cb3e9edb"}
May 28 14:53:01.498803 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:01.498782    2563 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
May 28 14:53:01.544821 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:01.544788    2563 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-84.ec2.internal"
May 28 14:53:01.555967 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:01.555944    2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 28 14:53:01.557514 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:01.557502    2563 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-84.ec2.internal"
May 28 14:53:01.568068 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:01.568054    2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 28 14:53:01.925482 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:01.925396    2563 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
May 28 14:53:02.207996 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.207902    2563 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 28 14:53:02.322600 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.322553    2563 apiserver.go:52] "Watching apiserver"
May 28 14:53:02.329060 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.329038    2563 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
May 28 14:53:02.331531 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.331498    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-mh529","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-84.ec2.internal","openshift-multus/multus-nldsr","openshift-multus/network-metrics-daemon-v4dpk","openshift-ovn-kubernetes/ovnkube-node-ssv8l","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k8rjj","openshift-cluster-node-tuning-operator/tuned-lj62g","openshift-dns/node-resolver-r8s4x","openshift-multus/multus-additional-cni-plugins-l8h9g","openshift-network-diagnostics/network-check-target-zj7gq","openshift-network-operator/iptables-alerter-khjnn","kube-system/global-pull-secret-syncer-5bqrk","kube-system/konnectivity-agent-889lh","kube-system/kube-apiserver-proxy-ip-10-0-137-84.ec2.internal"]
May 28 14:53:02.333879 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.333855    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-lj62g"
May 28 14:53:02.335250 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.335229    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-889lh"
May 28 14:53:02.336951 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.336430    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-fclhj\""
May 28 14:53:02.336951 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.336478    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
May 28 14:53:02.336951 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.336689    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
May 28 14:53:02.337587 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.337569    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-nldsr"
May 28 14:53:02.337697 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.337618    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
May 28 14:53:02.337807 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.337782    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v4dpk"
May 28 14:53:02.338160 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:53:02.337884    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v4dpk" podUID="b51f6e42-ac3f-47b9-8962-ec51c836ad35"
May 28 14:53:02.338160 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.338152    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-2xvbn\""
May 28 14:53:02.338297 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.338181    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
May 28 14:53:02.339278 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.339260    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-ssv8l"
May 28 14:53:02.340943 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.340926    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
May 28 14:53:02.341172 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.341154    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
May 28 14:53:02.341172 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.341163    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
May 28 14:53:02.341469 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.341453    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
May 28 14:53:02.341848 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.341659    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-ckfpl\""
May 28 14:53:02.342438 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.342004    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k8rjj"
May 28 14:53:02.342438 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.342096    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
May 28 14:53:02.342438 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.342137    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
May 28 14:53:02.342438 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.342180    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
May 28 14:53:02.342438 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.342297    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-zmpkl\""
May 28 14:53:02.342438 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.342369    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
May 28 14:53:02.342438 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.342372    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
May 28 14:53:02.342911 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.342508    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
May 28 14:53:02.344656 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.343949    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-l8h9g"
May 28 14:53:02.344656 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.344026    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-kvhvp\""
May 28 14:53:02.344656 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.344378    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
May 28 14:53:02.344656 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.344652    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
May 28 14:53:02.344882 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.344700    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
May 28 14:53:02.346008 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.345546    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-mh529"
May 28 14:53:02.346008 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.345639    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-r8s4x"
May 28 14:53:02.346418 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.346237    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
May 28 14:53:02.346563 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.346547    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
May 28 14:53:02.346664 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.346637    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-5dgjk\""
May 28 14:53:02.351765 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.348893    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zj7gq"
May 28 14:53:02.351765 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:53:02.348984    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zj7gq" podUID="49117ec2-5908-41bd-a305-59ddea54b26d"
May 28 14:53:02.351765 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.349952    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-sntc6\""
May 28 14:53:02.351765 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.350287    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
May 28 14:53:02.351765 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.350561    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-bd8vs\""
May 28 14:53:02.351765 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.351504    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
May 28 14:53:02.351765 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.351536    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
May 28 14:53:02.352151 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.351957    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
May 28 14:53:02.352151 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.352039    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
May 28 14:53:02.354782 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.354352    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f9b48604-9b1a-4e1d-96ce-b27af88be3ef-sys\") pod \"tuned-lj62g\" (UID: \"f9b48604-9b1a-4e1d-96ce-b27af88be3ef\") " pod="openshift-cluster-node-tuning-operator/tuned-lj62g"
May 28 14:53:02.354782 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.354400    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9be2177d-67fc-4eec-aa1a-bbe5602495d5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-l8h9g\" (UID: \"9be2177d-67fc-4eec-aa1a-bbe5602495d5\") " pod="openshift-multus/multus-additional-cni-plugins-l8h9g"
May 28 14:53:02.354782 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.354434    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dg2qr\" (UniqueName: \"kubernetes.io/projected/9be2177d-67fc-4eec-aa1a-bbe5602495d5-kube-api-access-dg2qr\") pod \"multus-additional-cni-plugins-l8h9g\" (UID: \"9be2177d-67fc-4eec-aa1a-bbe5602495d5\") " pod="openshift-multus/multus-additional-cni-plugins-l8h9g"
May 28 14:53:02.354782 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.354465    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/18e17dc3-da42-4b11-8f21-5eb66227c6f7-host\") pod \"node-ca-mh529\" (UID: \"18e17dc3-da42-4b11-8f21-5eb66227c6f7\") " pod="openshift-image-registry/node-ca-mh529"
May 28 14:53:02.354782 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.354498    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f9b48604-9b1a-4e1d-96ce-b27af88be3ef-var-lib-kubelet\") pod \"tuned-lj62g\" (UID: \"f9b48604-9b1a-4e1d-96ce-b27af88be3ef\") " pod="openshift-cluster-node-tuning-operator/tuned-lj62g"
May 28 14:53:02.354782 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.354522    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/163ec1a8-e490-49fe-91c4-5536fe100364-cnibin\") pod \"multus-nldsr\" (UID: \"163ec1a8-e490-49fe-91c4-5536fe100364\") " pod="openshift-multus/multus-nldsr"
May 28 14:53:02.354782 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.354551    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f3df342f-512f-410a-8b64-171bc7255a0e-ovnkube-script-lib\") pod \"ovnkube-node-ssv8l\" (UID: \"f3df342f-512f-410a-8b64-171bc7255a0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-ssv8l"
May 28 14:53:02.354782 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.354583    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/163ec1a8-e490-49fe-91c4-5536fe100364-host-run-k8s-cni-cncf-io\") pod \"multus-nldsr\" (UID: \"163ec1a8-e490-49fe-91c4-5536fe100364\") " pod="openshift-multus/multus-nldsr"
May 28 14:53:02.354782 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.354614    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/163ec1a8-e490-49fe-91c4-5536fe100364-host-run-netns\") pod \"multus-nldsr\" (UID: \"163ec1a8-e490-49fe-91c4-5536fe100364\") " pod="openshift-multus/multus-nldsr"
May 28 14:53:02.354782 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.354641    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/abda2870-be5c-44d4-8ba7-1d2d057e36df-socket-dir\") pod \"aws-ebs-csi-driver-node-k8rjj\" (UID: \"abda2870-be5c-44d4-8ba7-1d2d057e36df\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k8rjj"
May 28 14:53:02.354782 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.354666    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f3df342f-512f-410a-8b64-171bc7255a0e-run-systemd\") pod \"ovnkube-node-ssv8l\" (UID: \"f3df342f-512f-410a-8b64-171bc7255a0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-ssv8l"
May 28 14:53:02.354782 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.354714    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/163ec1a8-e490-49fe-91c4-5536fe100364-multus-daemon-config\") pod \"multus-nldsr\" (UID: \"163ec1a8-e490-49fe-91c4-5536fe100364\") " pod="openshift-multus/multus-nldsr"
May 28 14:53:02.355345 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.354831    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f3df342f-512f-410a-8b64-171bc7255a0e-host-cni-bin\") pod \"ovnkube-node-ssv8l\" (UID: \"f3df342f-512f-410a-8b64-171bc7255a0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-ssv8l"
May 28 14:53:02.355345 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.354870    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f3df342f-512f-410a-8b64-171bc7255a0e-host-cni-netd\") pod \"ovnkube-node-ssv8l\" (UID: \"f3df342f-512f-410a-8b64-171bc7255a0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-ssv8l"
May 28 14:53:02.355345 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.354902    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cpt2s\" (UniqueName: \"kubernetes.io/projected/f9b48604-9b1a-4e1d-96ce-b27af88be3ef-kube-api-access-cpt2s\") pod \"tuned-lj62g\" (UID: \"f9b48604-9b1a-4e1d-96ce-b27af88be3ef\") " pod="openshift-cluster-node-tuning-operator/tuned-lj62g"
May 28 14:53:02.355345 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.354987    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/163ec1a8-e490-49fe-91c4-5536fe100364-cni-binary-copy\") pod \"multus-nldsr\" (UID: \"163ec1a8-e490-49fe-91c4-5536fe100364\") " pod="openshift-multus/multus-nldsr"
May 28 14:53:02.355345 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.355031    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/163ec1a8-e490-49fe-91c4-5536fe100364-multus-conf-dir\") pod \"multus-nldsr\" (UID: \"163ec1a8-e490-49fe-91c4-5536fe100364\") " pod="openshift-multus/multus-nldsr"
May 28 14:53:02.355345 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.355070    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gbckd\" (UniqueName: \"kubernetes.io/projected/abda2870-be5c-44d4-8ba7-1d2d057e36df-kube-api-access-gbckd\") pod \"aws-ebs-csi-driver-node-k8rjj\" (UID: \"abda2870-be5c-44d4-8ba7-1d2d057e36df\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k8rjj"
May 28 14:53:02.355345 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.355101    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f9b48604-9b1a-4e1d-96ce-b27af88be3ef-lib-modules\") pod \"tuned-lj62g\" (UID: \"f9b48604-9b1a-4e1d-96ce-b27af88be3ef\") " pod="openshift-cluster-node-tuning-operator/tuned-lj62g"
May 28 14:53:02.355345 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.355303    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f9b48604-9b1a-4e1d-96ce-b27af88be3ef-etc-tuned\") pod \"tuned-lj62g\" (UID: \"f9b48604-9b1a-4e1d-96ce-b27af88be3ef\") " pod="openshift-cluster-node-tuning-operator/tuned-lj62g"
May 28 14:53:02.355345 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.355333    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/163ec1a8-e490-49fe-91c4-5536fe100364-host-var-lib-cni-bin\") pod \"multus-nldsr\" (UID: \"163ec1a8-e490-49fe-91c4-5536fe100364\") " pod="openshift-multus/multus-nldsr"
May 28 14:53:02.355700 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.355359    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f3df342f-512f-410a-8b64-171bc7255a0e-host-slash\") pod \"ovnkube-node-ssv8l\" (UID: \"f3df342f-512f-410a-8b64-171bc7255a0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-ssv8l"
May 28 14:53:02.355700 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.355385    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/abda2870-be5c-44d4-8ba7-1d2d057e36df-registration-dir\") pod \"aws-ebs-csi-driver-node-k8rjj\" (UID: \"abda2870-be5c-44d4-8ba7-1d2d057e36df\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k8rjj"
May 28 14:53:02.355700 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.355416    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9be2177d-67fc-4eec-aa1a-bbe5602495d5-os-release\") pod \"multus-additional-cni-plugins-l8h9g\" (UID: \"9be2177d-67fc-4eec-aa1a-bbe5602495d5\") " pod="openshift-multus/multus-additional-cni-plugins-l8h9g"
May 28 14:53:02.355700 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.355449    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/18e17dc3-da42-4b11-8f21-5eb66227c6f7-serviceca\") pod \"node-ca-mh529\" (UID: \"18e17dc3-da42-4b11-8f21-5eb66227c6f7\") " pod="openshift-image-registry/node-ca-mh529"
May 28 14:53:02.355700 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.355519    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0595a2ba-deef-42af-aef6-ad8abc4fbfba-agent-certs\") pod \"konnectivity-agent-889lh\" (UID: \"0595a2ba-deef-42af-aef6-ad8abc4fbfba\") " pod="kube-system/konnectivity-agent-889lh"
May 28 14:53:02.355700 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.355594    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/abda2870-be5c-44d4-8ba7-1d2d057e36df-device-dir\") pod \"aws-ebs-csi-driver-node-k8rjj\" (UID: \"abda2870-be5c-44d4-8ba7-1d2d057e36df\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k8rjj"
May 28 14:53:02.355700 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.355636    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5e470d5c-c76c-452d-8add-a20856bab41f-hosts-file\") pod \"node-resolver-r8s4x\" (UID: \"5e470d5c-c76c-452d-8add-a20856bab41f\") " pod="openshift-dns/node-resolver-r8s4x"
May 28 14:53:02.355956 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.355702    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/163ec1a8-e490-49fe-91c4-5536fe100364-system-cni-dir\") pod \"multus-nldsr\" (UID: \"163ec1a8-e490-49fe-91c4-5536fe100364\") " pod="openshift-multus/multus-nldsr"
May 28 14:53:02.355956 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.355786    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/163ec1a8-e490-49fe-91c4-5536fe100364-host-run-multus-certs\") pod \"multus-nldsr\" (UID: \"163ec1a8-e490-49fe-91c4-5536fe100364\") " pod="openshift-multus/multus-nldsr"
May 28 14:53:02.355956 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.355816    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p69k2\" (UniqueName: \"kubernetes.io/projected/163ec1a8-e490-49fe-91c4-5536fe100364-kube-api-access-p69k2\") pod \"multus-nldsr\" (UID: \"163ec1a8-e490-49fe-91c4-5536fe100364\") " pod="openshift-multus/multus-nldsr"
May 28 14:53:02.355956 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.355857    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b51f6e42-ac3f-47b9-8962-ec51c836ad35-metrics-certs\") pod \"network-metrics-daemon-v4dpk\" (UID: \"b51f6e42-ac3f-47b9-8962-ec51c836ad35\") " pod="openshift-multus/network-metrics-daemon-v4dpk"
May 28 14:53:02.355956 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.355889    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9be2177d-67fc-4eec-aa1a-bbe5602495d5-cni-binary-copy\") pod \"multus-additional-cni-plugins-l8h9g\" (UID: \"9be2177d-67fc-4eec-aa1a-bbe5602495d5\") " pod="openshift-multus/multus-additional-cni-plugins-l8h9g"
May 28 14:53:02.355956 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.355956    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f3df342f-512f-410a-8b64-171bc7255a0e-run-ovn\") pod \"ovnkube-node-ssv8l\" (UID: \"f3df342f-512f-410a-8b64-171bc7255a0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-ssv8l"
May 28 14:53:02.356165 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.355979    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/abda2870-be5c-44d4-8ba7-1d2d057e36df-etc-selinux\") pod \"aws-ebs-csi-driver-node-k8rjj\" (UID: \"abda2870-be5c-44d4-8ba7-1d2d057e36df\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k8rjj"
May 28 14:53:02.356165 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.355999    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-656rp\" (UniqueName: \"kubernetes.io/projected/5e470d5c-c76c-452d-8add-a20856bab41f-kube-api-access-656rp\") pod \"node-resolver-r8s4x\" (UID: \"5e470d5c-c76c-452d-8add-a20856bab41f\") " pod="openshift-dns/node-resolver-r8s4x"
May 28 14:53:02.356165 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.356023    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/163ec1a8-e490-49fe-91c4-5536fe100364-host-var-lib-kubelet\") pod \"multus-nldsr\" (UID: \"163ec1a8-e490-49fe-91c4-5536fe100364\") " pod="openshift-multus/multus-nldsr"
May 28 14:53:02.356165 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.356111    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9be2177d-67fc-4eec-aa1a-bbe5602495d5-cnibin\") pod \"multus-additional-cni-plugins-l8h9g\" (UID: \"9be2177d-67fc-4eec-aa1a-bbe5602495d5\") " pod="openshift-multus/multus-additional-cni-plugins-l8h9g"
May 28 14:53:02.356165 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.356146    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-khjnn"
May 28 14:53:02.356382 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.356155    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f3df342f-512f-410a-8b64-171bc7255a0e-host-kubelet\") pod \"ovnkube-node-ssv8l\" (UID: \"f3df342f-512f-410a-8b64-171bc7255a0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-ssv8l"
May 28 14:53:02.356637 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.356609    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f3df342f-512f-410a-8b64-171bc7255a0e-etc-openvswitch\") pod \"ovnkube-node-ssv8l\" (UID: \"f3df342f-512f-410a-8b64-171bc7255a0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-ssv8l"
May 28 14:53:02.356766 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.356657    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f3df342f-512f-410a-8b64-171bc7255a0e-host-run-ovn-kubernetes\") pod \"ovnkube-node-ssv8l\" (UID: \"f3df342f-512f-410a-8b64-171bc7255a0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-ssv8l"
May 28 14:53:02.356766 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.356704    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f3df342f-512f-410a-8b64-171bc7255a0e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ssv8l\" (UID: \"f3df342f-512f-410a-8b64-171bc7255a0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-ssv8l"
May 28 14:53:02.356766 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.356730    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/abda2870-be5c-44d4-8ba7-1d2d057e36df-sys-fs\") pod \"aws-ebs-csi-driver-node-k8rjj\" (UID: \"abda2870-be5c-44d4-8ba7-1d2d057e36df\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k8rjj"
May 28 14:53:02.356915 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.356752    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f9b48604-9b1a-4e1d-96ce-b27af88be3ef-etc-modprobe-d\") pod \"tuned-lj62g\" (UID: \"f9b48604-9b1a-4e1d-96ce-b27af88be3ef\") " pod="openshift-cluster-node-tuning-operator/tuned-lj62g"
May 28 14:53:02.356915 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.356789    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f9b48604-9b1a-4e1d-96ce-b27af88be3ef-etc-sysconfig\") pod \"tuned-lj62g\" (UID: \"f9b48604-9b1a-4e1d-96ce-b27af88be3ef\") " pod="openshift-cluster-node-tuning-operator/tuned-lj62g"
May 28 14:53:02.356915 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.356821    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f9b48604-9b1a-4e1d-96ce-b27af88be3ef-etc-systemd\") pod \"tuned-lj62g\" (UID: \"f9b48604-9b1a-4e1d-96ce-b27af88be3ef\") " pod="openshift-cluster-node-tuning-operator/tuned-lj62g"
May 28 14:53:02.356915 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.356842    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-57bfr\" (UniqueName: \"kubernetes.io/projected/f3df342f-512f-410a-8b64-171bc7255a0e-kube-api-access-57bfr\") pod \"ovnkube-node-ssv8l\" (UID: \"f3df342f-512f-410a-8b64-171bc7255a0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-ssv8l"
May 28 14:53:02.356915 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.356865    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/abda2870-be5c-44d4-8ba7-1d2d057e36df-kubelet-dir\") pod \"aws-ebs-csi-driver-node-k8rjj\" (UID: \"abda2870-be5c-44d4-8ba7-1d2d057e36df\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k8rjj"
May 28 14:53:02.356915 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.356885    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f3df342f-512f-410a-8b64-171bc7255a0e-host-run-netns\") pod \"ovnkube-node-ssv8l\" (UID: \"f3df342f-512f-410a-8b64-171bc7255a0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-ssv8l"
May 28 14:53:02.356915 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.356904    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f3df342f-512f-410a-8b64-171bc7255a0e-ovnkube-config\") pod \"ovnkube-node-ssv8l\" (UID: \"f3df342f-512f-410a-8b64-171bc7255a0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-ssv8l"
May 28 14:53:02.357509 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.356957    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f3df342f-512f-410a-8b64-171bc7255a0e-systemd-units\") pod \"ovnkube-node-ssv8l\" (UID: \"f3df342f-512f-410a-8b64-171bc7255a0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-ssv8l"
May 28 14:53:02.357668 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.357642    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f9b48604-9b1a-4e1d-96ce-b27af88be3ef-run\") pod \"tuned-lj62g\" (UID: \"f9b48604-9b1a-4e1d-96ce-b27af88be3ef\") " pod="openshift-cluster-node-tuning-operator/tuned-lj62g"
May 28 14:53:02.357776 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.357698    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0595a2ba-deef-42af-aef6-ad8abc4fbfba-konnectivity-ca\") pod \"konnectivity-agent-889lh\" (UID: \"0595a2ba-deef-42af-aef6-ad8abc4fbfba\") " pod="kube-system/konnectivity-agent-889lh"
May 28 14:53:02.357776 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.357724    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/163ec1a8-e490-49fe-91c4-5536fe100364-multus-cni-dir\") pod \"multus-nldsr\" (UID: \"163ec1a8-e490-49fe-91c4-5536fe100364\") " pod="openshift-multus/multus-nldsr"
May 28 14:53:02.357776 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.357770    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f3df342f-512f-410a-8b64-171bc7255a0e-ovn-node-metrics-cert\") pod \"ovnkube-node-ssv8l\" (UID: \"f3df342f-512f-410a-8b64-171bc7255a0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-ssv8l"
May 28 14:53:02.357926 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.357821    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/163ec1a8-e490-49fe-91c4-5536fe100364-hostroot\") pod \"multus-nldsr\" (UID: \"163ec1a8-e490-49fe-91c4-5536fe100364\") " pod="openshift-multus/multus-nldsr"
May 28 14:53:02.357926 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.357862    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9be2177d-67fc-4eec-aa1a-bbe5602495d5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-l8h9g\" (UID: \"9be2177d-67fc-4eec-aa1a-bbe5602495d5\") " pod="openshift-multus/multus-additional-cni-plugins-l8h9g"
May 28 14:53:02.357926 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.357889    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9be2177d-67fc-4eec-aa1a-bbe5602495d5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-l8h9g\" (UID: \"9be2177d-67fc-4eec-aa1a-bbe5602495d5\") " pod="openshift-multus/multus-additional-cni-plugins-l8h9g"
May 28 14:53:02.358350 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.357940    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f3df342f-512f-410a-8b64-171bc7255a0e-env-overrides\") pod \"ovnkube-node-ssv8l\" (UID: \"f3df342f-512f-410a-8b64-171bc7255a0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-ssv8l"
May 28 14:53:02.358350 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.358058    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ltsft\" (UniqueName: \"kubernetes.io/projected/b51f6e42-ac3f-47b9-8962-ec51c836ad35-kube-api-access-ltsft\") pod \"network-metrics-daemon-v4dpk\" (UID: \"b51f6e42-ac3f-47b9-8962-ec51c836ad35\") " pod="openshift-multus/network-metrics-daemon-v4dpk"
May 28 14:53:02.358350 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.358087    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jvwjp\" (UniqueName: \"kubernetes.io/projected/18e17dc3-da42-4b11-8f21-5eb66227c6f7-kube-api-access-jvwjp\") pod \"node-ca-mh529\" (UID: \"18e17dc3-da42-4b11-8f21-5eb66227c6f7\") " pod="openshift-image-registry/node-ca-mh529"
May 28 14:53:02.358350 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.358140    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f3df342f-512f-410a-8b64-171bc7255a0e-run-openvswitch\") pod \"ovnkube-node-ssv8l\" (UID: \"f3df342f-512f-410a-8b64-171bc7255a0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-ssv8l"
May 28 14:53:02.358350 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.358181    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f3df342f-512f-410a-8b64-171bc7255a0e-log-socket\") pod \"ovnkube-node-ssv8l\" (UID: \"f3df342f-512f-410a-8b64-171bc7255a0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-ssv8l"
May 28 14:53:02.358350 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.358268    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5e470d5c-c76c-452d-8add-a20856bab41f-tmp-dir\") pod \"node-resolver-r8s4x\" (UID: \"5e470d5c-c76c-452d-8add-a20856bab41f\") " pod="openshift-dns/node-resolver-r8s4x"
May 28 14:53:02.358350 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.358289    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f9b48604-9b1a-4e1d-96ce-b27af88be3ef-host\") pod \"tuned-lj62g\" (UID: \"f9b48604-9b1a-4e1d-96ce-b27af88be3ef\") " pod="openshift-cluster-node-tuning-operator/tuned-lj62g"
May 28 14:53:02.358350 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.358310    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/163ec1a8-e490-49fe-91c4-5536fe100364-os-release\") pod \"multus-nldsr\" (UID: \"163ec1a8-e490-49fe-91c4-5536fe100364\") " pod="openshift-multus/multus-nldsr"
May 28 14:53:02.358748 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.358371    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/163ec1a8-e490-49fe-91c4-5536fe100364-host-var-lib-cni-multus\") pod \"multus-nldsr\" (UID: \"163ec1a8-e490-49fe-91c4-5536fe100364\") " pod="openshift-multus/multus-nldsr"
May 28 14:53:02.358748 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.358388    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5bqrk"
May 28 14:53:02.358748 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.358415    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9be2177d-67fc-4eec-aa1a-bbe5602495d5-system-cni-dir\") pod \"multus-additional-cni-plugins-l8h9g\" (UID: \"9be2177d-67fc-4eec-aa1a-bbe5602495d5\") " pod="openshift-multus/multus-additional-cni-plugins-l8h9g"
May 28 14:53:02.358748 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:53:02.358443    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5bqrk" podUID="248847de-48dc-4cb1-aa31-e48dc53e7f10"
May 28 14:53:02.358748 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.358448    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f9b48604-9b1a-4e1d-96ce-b27af88be3ef-tmp\") pod \"tuned-lj62g\" (UID: \"f9b48604-9b1a-4e1d-96ce-b27af88be3ef\") " pod="openshift-cluster-node-tuning-operator/tuned-lj62g"
May 28 14:53:02.358748 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.358500    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/163ec1a8-e490-49fe-91c4-5536fe100364-multus-socket-dir-parent\") pod \"multus-nldsr\" (UID: \"163ec1a8-e490-49fe-91c4-5536fe100364\") " pod="openshift-multus/multus-nldsr"
May 28 14:53:02.358748 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.358529    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/163ec1a8-e490-49fe-91c4-5536fe100364-etc-kubernetes\") pod \"multus-nldsr\" (UID: \"163ec1a8-e490-49fe-91c4-5536fe100364\") " pod="openshift-multus/multus-nldsr"
May 28 14:53:02.358748 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.358552    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f3df342f-512f-410a-8b64-171bc7255a0e-var-lib-openvswitch\") pod \"ovnkube-node-ssv8l\" (UID: \"f3df342f-512f-410a-8b64-171bc7255a0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-ssv8l"
May 28 14:53:02.358748 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.358575    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f3df342f-512f-410a-8b64-171bc7255a0e-node-log\") pod \"ovnkube-node-ssv8l\" (UID: \"f3df342f-512f-410a-8b64-171bc7255a0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-ssv8l"
May 28 14:53:02.358748 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.358596    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f9b48604-9b1a-4e1d-96ce-b27af88be3ef-etc-kubernetes\") pod \"tuned-lj62g\" (UID: \"f9b48604-9b1a-4e1d-96ce-b27af88be3ef\") " pod="openshift-cluster-node-tuning-operator/tuned-lj62g"
May 28 14:53:02.358748 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.358617    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f9b48604-9b1a-4e1d-96ce-b27af88be3ef-etc-sysctl-d\") pod \"tuned-lj62g\" (UID: \"f9b48604-9b1a-4e1d-96ce-b27af88be3ef\") " pod="openshift-cluster-node-tuning-operator/tuned-lj62g"
May 28 14:53:02.358748 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.358638    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f9b48604-9b1a-4e1d-96ce-b27af88be3ef-etc-sysctl-conf\") pod \"tuned-lj62g\" (UID: \"f9b48604-9b1a-4e1d-96ce-b27af88be3ef\") " pod="openshift-cluster-node-tuning-operator/tuned-lj62g"
May 28 14:53:02.359104 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.358915    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-ngv78\""
May 28 14:53:02.359104 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.359011    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
May 28 14:53:02.359168 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.359133    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
May 28 14:53:02.359336 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.359304    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
May 28 14:53:02.389205 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.389142    2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-27 14:48:01 +0000 UTC" deadline="2027-11-11 22:55:04.203005481 +0000 UTC"
May 28 14:53:02.389205 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.389170    2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12776h2m1.813838314s"
May 28 14:53:02.445919 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.445892    2563 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world"
May 28 14:53:02.459204 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.459133    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/248847de-48dc-4cb1-aa31-e48dc53e7f10-original-pull-secret\") pod \"global-pull-secret-syncer-5bqrk\" (UID: \"248847de-48dc-4cb1-aa31-e48dc53e7f10\") " pod="kube-system/global-pull-secret-syncer-5bqrk"
May 28 14:53:02.459204 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.459186    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f3df342f-512f-410a-8b64-171bc7255a0e-ovnkube-script-lib\") pod \"ovnkube-node-ssv8l\" (UID: \"f3df342f-512f-410a-8b64-171bc7255a0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-ssv8l"
May 28 14:53:02.459396 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.459221    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/163ec1a8-e490-49fe-91c4-5536fe100364-host-run-k8s-cni-cncf-io\") pod \"multus-nldsr\" (UID: \"163ec1a8-e490-49fe-91c4-5536fe100364\") " pod="openshift-multus/multus-nldsr"
May 28 14:53:02.459396 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.459247    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/163ec1a8-e490-49fe-91c4-5536fe100364-host-run-netns\") pod \"multus-nldsr\" (UID: \"163ec1a8-e490-49fe-91c4-5536fe100364\") " pod="openshift-multus/multus-nldsr"
May 28 14:53:02.459396 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.459273    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/abda2870-be5c-44d4-8ba7-1d2d057e36df-socket-dir\") pod \"aws-ebs-csi-driver-node-k8rjj\" (UID: \"abda2870-be5c-44d4-8ba7-1d2d057e36df\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k8rjj"
May 28 14:53:02.459396 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.459298    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f3df342f-512f-410a-8b64-171bc7255a0e-run-systemd\") pod \"ovnkube-node-ssv8l\" (UID: \"f3df342f-512f-410a-8b64-171bc7255a0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-ssv8l"
May 28 14:53:02.459396 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.459314    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/163ec1a8-e490-49fe-91c4-5536fe100364-host-run-k8s-cni-cncf-io\") pod \"multus-nldsr\" (UID: \"163ec1a8-e490-49fe-91c4-5536fe100364\") " pod="openshift-multus/multus-nldsr"
May 28 14:53:02.459396 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.459320    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/163ec1a8-e490-49fe-91c4-5536fe100364-multus-daemon-config\") pod \"multus-nldsr\" (UID: \"163ec1a8-e490-49fe-91c4-5536fe100364\") " pod="openshift-multus/multus-nldsr"
May 28 14:53:02.459396 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.459346    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f3df342f-512f-410a-8b64-171bc7255a0e-host-cni-bin\") pod \"ovnkube-node-ssv8l\" (UID: \"f3df342f-512f-410a-8b64-171bc7255a0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-ssv8l"
May 28 14:53:02.459396 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.459369    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f3df342f-512f-410a-8b64-171bc7255a0e-host-cni-netd\") pod \"ovnkube-node-ssv8l\" (UID: \"f3df342f-512f-410a-8b64-171bc7255a0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-ssv8l"
May 28 14:53:02.459396 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.459394    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cpt2s\" (UniqueName: \"kubernetes.io/projected/f9b48604-9b1a-4e1d-96ce-b27af88be3ef-kube-api-access-cpt2s\") pod \"tuned-lj62g\" (UID: \"f9b48604-9b1a-4e1d-96ce-b27af88be3ef\") " pod="openshift-cluster-node-tuning-operator/tuned-lj62g"
May 28 14:53:02.459839 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.459399    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f3df342f-512f-410a-8b64-171bc7255a0e-run-systemd\") pod \"ovnkube-node-ssv8l\" (UID: \"f3df342f-512f-410a-8b64-171bc7255a0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-ssv8l"
May 28 14:53:02.459839 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.459417    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/163ec1a8-e490-49fe-91c4-5536fe100364-cni-binary-copy\") pod \"multus-nldsr\" (UID: \"163ec1a8-e490-49fe-91c4-5536fe100364\") " pod="openshift-multus/multus-nldsr"
May 28 14:53:02.459839 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.459442    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/163ec1a8-e490-49fe-91c4-5536fe100364-multus-conf-dir\") pod \"multus-nldsr\" (UID: \"163ec1a8-e490-49fe-91c4-5536fe100364\") " pod="openshift-multus/multus-nldsr"
May 28 14:53:02.459839 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.459446    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/abda2870-be5c-44d4-8ba7-1d2d057e36df-socket-dir\") pod \"aws-ebs-csi-driver-node-k8rjj\" (UID: \"abda2870-be5c-44d4-8ba7-1d2d057e36df\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k8rjj"
May 28 14:53:02.459839 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.459459    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/163ec1a8-e490-49fe-91c4-5536fe100364-host-run-netns\") pod \"multus-nldsr\" (UID: \"163ec1a8-e490-49fe-91c4-5536fe100364\") " pod="openshift-multus/multus-nldsr"
May 28 14:53:02.459839 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.459473    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lfw6g\" (UniqueName: \"kubernetes.io/projected/49117ec2-5908-41bd-a305-59ddea54b26d-kube-api-access-lfw6g\") pod \"network-check-target-zj7gq\" (UID: \"49117ec2-5908-41bd-a305-59ddea54b26d\") " pod="openshift-network-diagnostics/network-check-target-zj7gq"
May 28 14:53:02.459839 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.459496    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f3df342f-512f-410a-8b64-171bc7255a0e-host-cni-netd\") pod \"ovnkube-node-ssv8l\" (UID: \"f3df342f-512f-410a-8b64-171bc7255a0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-ssv8l"
May 28 14:53:02.459839 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.459502    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gbckd\" (UniqueName: \"kubernetes.io/projected/abda2870-be5c-44d4-8ba7-1d2d057e36df-kube-api-access-gbckd\") pod \"aws-ebs-csi-driver-node-k8rjj\" (UID: \"abda2870-be5c-44d4-8ba7-1d2d057e36df\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k8rjj"
May 28 14:53:02.459839 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.459526    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f9b48604-9b1a-4e1d-96ce-b27af88be3ef-lib-modules\") pod \"tuned-lj62g\" (UID: \"f9b48604-9b1a-4e1d-96ce-b27af88be3ef\") " pod="openshift-cluster-node-tuning-operator/tuned-lj62g"
May 28 14:53:02.459839 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.459551    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f9b48604-9b1a-4e1d-96ce-b27af88be3ef-etc-tuned\") pod \"tuned-lj62g\" (UID: \"f9b48604-9b1a-4e1d-96ce-b27af88be3ef\") " pod="openshift-cluster-node-tuning-operator/tuned-lj62g"
May 28 14:53:02.459839 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.459576    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/163ec1a8-e490-49fe-91c4-5536fe100364-host-var-lib-cni-bin\") pod \"multus-nldsr\" (UID: \"163ec1a8-e490-49fe-91c4-5536fe100364\") " pod="openshift-multus/multus-nldsr"
May 28 14:53:02.459839 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.459627    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f3df342f-512f-410a-8b64-171bc7255a0e-host-slash\") pod \"ovnkube-node-ssv8l\" (UID: \"f3df342f-512f-410a-8b64-171bc7255a0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-ssv8l"
May 28 14:53:02.459839 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.459651    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/abda2870-be5c-44d4-8ba7-1d2d057e36df-registration-dir\") pod \"aws-ebs-csi-driver-node-k8rjj\" (UID: \"abda2870-be5c-44d4-8ba7-1d2d057e36df\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k8rjj"
May 28 14:53:02.459839 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.459714    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9be2177d-67fc-4eec-aa1a-bbe5602495d5-os-release\") pod \"multus-additional-cni-plugins-l8h9g\" (UID: \"9be2177d-67fc-4eec-aa1a-bbe5602495d5\") " pod="openshift-multus/multus-additional-cni-plugins-l8h9g"
May 28 14:53:02.459839 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.459742    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/aeb6de40-615c-4781-981a-ff9fded37a6e-iptables-alerter-script\") pod \"iptables-alerter-khjnn\" (UID: \"aeb6de40-615c-4781-981a-ff9fded37a6e\") " pod="openshift-network-operator/iptables-alerter-khjnn"
May 28 14:53:02.459839 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.459774    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/18e17dc3-da42-4b11-8f21-5eb66227c6f7-serviceca\") pod \"node-ca-mh529\" (UID: \"18e17dc3-da42-4b11-8f21-5eb66227c6f7\") " pod="openshift-image-registry/node-ca-mh529"
May 28 14:53:02.459839 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.459782    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f3df342f-512f-410a-8b64-171bc7255a0e-host-cni-bin\") pod \"ovnkube-node-ssv8l\" (UID: \"f3df342f-512f-410a-8b64-171bc7255a0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-ssv8l"
May 28 14:53:02.460599 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.459799    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0595a2ba-deef-42af-aef6-ad8abc4fbfba-agent-certs\") pod \"konnectivity-agent-889lh\" (UID: \"0595a2ba-deef-42af-aef6-ad8abc4fbfba\") " pod="kube-system/konnectivity-agent-889lh"
May 28 14:53:02.460599 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.459825    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/abda2870-be5c-44d4-8ba7-1d2d057e36df-device-dir\") pod \"aws-ebs-csi-driver-node-k8rjj\" (UID: \"abda2870-be5c-44d4-8ba7-1d2d057e36df\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k8rjj"
May 28 14:53:02.460599 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.459869    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5e470d5c-c76c-452d-8add-a20856bab41f-hosts-file\") pod \"node-resolver-r8s4x\" (UID: \"5e470d5c-c76c-452d-8add-a20856bab41f\") " pod="openshift-dns/node-resolver-r8s4x"
May 28 14:53:02.460599 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.459894    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/163ec1a8-e490-49fe-91c4-5536fe100364-system-cni-dir\") pod \"multus-nldsr\" (UID: \"163ec1a8-e490-49fe-91c4-5536fe100364\") " pod="openshift-multus/multus-nldsr"
May 28 14:53:02.460599 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.459893    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f3df342f-512f-410a-8b64-171bc7255a0e-ovnkube-script-lib\") pod \"ovnkube-node-ssv8l\" (UID: \"f3df342f-512f-410a-8b64-171bc7255a0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-ssv8l"
May 28 14:53:02.460599 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.459921    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/163ec1a8-e490-49fe-91c4-5536fe100364-host-run-multus-certs\") pod \"multus-nldsr\" (UID: \"163ec1a8-e490-49fe-91c4-5536fe100364\") " pod="openshift-multus/multus-nldsr"
May 28 14:53:02.460599 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.459956    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p69k2\" (UniqueName: \"kubernetes.io/projected/163ec1a8-e490-49fe-91c4-5536fe100364-kube-api-access-p69k2\") pod \"multus-nldsr\" (UID: \"163ec1a8-e490-49fe-91c4-5536fe100364\") " pod="openshift-multus/multus-nldsr"
May 28 14:53:02.460599 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.459986    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b51f6e42-ac3f-47b9-8962-ec51c836ad35-metrics-certs\") pod \"network-metrics-daemon-v4dpk\" (UID: \"b51f6e42-ac3f-47b9-8962-ec51c836ad35\") " pod="openshift-multus/network-metrics-daemon-v4dpk"
May 28 14:53:02.460599 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.460013    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9be2177d-67fc-4eec-aa1a-bbe5602495d5-cni-binary-copy\") pod \"multus-additional-cni-plugins-l8h9g\" (UID: \"9be2177d-67fc-4eec-aa1a-bbe5602495d5\") " pod="openshift-multus/multus-additional-cni-plugins-l8h9g"
May 28 14:53:02.460599 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.460015    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/163ec1a8-e490-49fe-91c4-5536fe100364-multus-conf-dir\") pod \"multus-nldsr\" (UID: \"163ec1a8-e490-49fe-91c4-5536fe100364\") " pod="openshift-multus/multus-nldsr"
May 28 14:53:02.460599 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.460038    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f3df342f-512f-410a-8b64-171bc7255a0e-run-ovn\") pod \"ovnkube-node-ssv8l\" (UID: \"f3df342f-512f-410a-8b64-171bc7255a0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-ssv8l"
May 28 14:53:02.460599 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.460056    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/163ec1a8-e490-49fe-91c4-5536fe100364-multus-daemon-config\") pod \"multus-nldsr\" (UID: \"163ec1a8-e490-49fe-91c4-5536fe100364\") " pod="openshift-multus/multus-nldsr"
May 28 14:53:02.460599 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.460064    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/abda2870-be5c-44d4-8ba7-1d2d057e36df-etc-selinux\") pod \"aws-ebs-csi-driver-node-k8rjj\" (UID: \"abda2870-be5c-44d4-8ba7-1d2d057e36df\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k8rjj"
May 28 14:53:02.460599 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.460063    2563 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
May 28 14:53:02.460599 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.460088    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-656rp\" (UniqueName: \"kubernetes.io/projected/5e470d5c-c76c-452d-8add-a20856bab41f-kube-api-access-656rp\") pod \"node-resolver-r8s4x\" (UID: \"5e470d5c-c76c-452d-8add-a20856bab41f\") " pod="openshift-dns/node-resolver-r8s4x"
May 28 14:53:02.460599 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.460121    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/163ec1a8-e490-49fe-91c4-5536fe100364-host-var-lib-kubelet\") pod \"multus-nldsr\" (UID: \"163ec1a8-e490-49fe-91c4-5536fe100364\") " pod="openshift-multus/multus-nldsr"
May 28 14:53:02.460599 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.460154    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9be2177d-67fc-4eec-aa1a-bbe5602495d5-cnibin\") pod \"multus-additional-cni-plugins-l8h9g\" (UID: \"9be2177d-67fc-4eec-aa1a-bbe5602495d5\") " pod="openshift-multus/multus-additional-cni-plugins-l8h9g"
May 28 14:53:02.460599 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.460181    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zbxv9\" (UniqueName: \"kubernetes.io/projected/aeb6de40-615c-4781-981a-ff9fded37a6e-kube-api-access-zbxv9\") pod \"iptables-alerter-khjnn\" (UID: \"aeb6de40-615c-4781-981a-ff9fded37a6e\") " pod="openshift-network-operator/iptables-alerter-khjnn"
May 28 14:53:02.461460 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.460209    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f3df342f-512f-410a-8b64-171bc7255a0e-host-kubelet\") pod \"ovnkube-node-ssv8l\" (UID: \"f3df342f-512f-410a-8b64-171bc7255a0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-ssv8l"
May 28 14:53:02.461460 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.460253    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f3df342f-512f-410a-8b64-171bc7255a0e-etc-openvswitch\") pod \"ovnkube-node-ssv8l\" (UID: \"f3df342f-512f-410a-8b64-171bc7255a0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-ssv8l"
May 28 14:53:02.461460 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.460282    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f3df342f-512f-410a-8b64-171bc7255a0e-host-run-ovn-kubernetes\") pod \"ovnkube-node-ssv8l\" (UID: \"f3df342f-512f-410a-8b64-171bc7255a0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-ssv8l"
May 28 14:53:02.461460 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.460309    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f3df342f-512f-410a-8b64-171bc7255a0e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ssv8l\" (UID: \"f3df342f-512f-410a-8b64-171bc7255a0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-ssv8l"
May 28 14:53:02.461460 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.460313    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/163ec1a8-e490-49fe-91c4-5536fe100364-host-run-multus-certs\") pod \"multus-nldsr\" (UID: \"163ec1a8-e490-49fe-91c4-5536fe100364\") " pod="openshift-multus/multus-nldsr"
May 28 14:53:02.461460 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.460337    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/abda2870-be5c-44d4-8ba7-1d2d057e36df-sys-fs\") pod \"aws-ebs-csi-driver-node-k8rjj\" (UID: \"abda2870-be5c-44d4-8ba7-1d2d057e36df\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k8rjj"
May 28 14:53:02.461460 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.460363    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f9b48604-9b1a-4e1d-96ce-b27af88be3ef-etc-modprobe-d\") pod \"tuned-lj62g\" (UID: \"f9b48604-9b1a-4e1d-96ce-b27af88be3ef\") " pod="openshift-cluster-node-tuning-operator/tuned-lj62g"
May 28 14:53:02.461460 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.460371    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/163ec1a8-e490-49fe-91c4-5536fe100364-host-var-lib-cni-bin\") pod \"multus-nldsr\" (UID: \"163ec1a8-e490-49fe-91c4-5536fe100364\") " pod="openshift-multus/multus-nldsr"
May 28 14:53:02.461460 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.460388    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f9b48604-9b1a-4e1d-96ce-b27af88be3ef-etc-sysconfig\") pod \"tuned-lj62g\" (UID: \"f9b48604-9b1a-4e1d-96ce-b27af88be3ef\") " pod="openshift-cluster-node-tuning-operator/tuned-lj62g"
May 28 14:53:02.461460 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.460414    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f9b48604-9b1a-4e1d-96ce-b27af88be3ef-etc-systemd\") pod \"tuned-lj62g\" (UID: \"f9b48604-9b1a-4e1d-96ce-b27af88be3ef\") " pod="openshift-cluster-node-tuning-operator/tuned-lj62g"
May 28 14:53:02.461460 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.460416    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f3df342f-512f-410a-8b64-171bc7255a0e-host-slash\") pod \"ovnkube-node-ssv8l\" (UID: \"f3df342f-512f-410a-8b64-171bc7255a0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-ssv8l"
May 28 14:53:02.461460 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.460440    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-57bfr\" (UniqueName: \"kubernetes.io/projected/f3df342f-512f-410a-8b64-171bc7255a0e-kube-api-access-57bfr\") pod \"ovnkube-node-ssv8l\" (UID: \"f3df342f-512f-410a-8b64-171bc7255a0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-ssv8l"
May 28 14:53:02.461460 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.460467    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/abda2870-be5c-44d4-8ba7-1d2d057e36df-kubelet-dir\") pod \"aws-ebs-csi-driver-node-k8rjj\" (UID: \"abda2870-be5c-44d4-8ba7-1d2d057e36df\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k8rjj"
May 28 14:53:02.461460 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.460470    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/abda2870-be5c-44d4-8ba7-1d2d057e36df-registration-dir\") pod \"aws-ebs-csi-driver-node-k8rjj\" (UID: \"abda2870-be5c-44d4-8ba7-1d2d057e36df\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k8rjj"
May 28 14:53:02.461460 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.460477    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/163ec1a8-e490-49fe-91c4-5536fe100364-cni-binary-copy\") pod \"multus-nldsr\" (UID: \"163ec1a8-e490-49fe-91c4-5536fe100364\") " pod="openshift-multus/multus-nldsr"
May 28 14:53:02.461460 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.460495    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f3df342f-512f-410a-8b64-171bc7255a0e-host-run-netns\") pod \"ovnkube-node-ssv8l\" (UID: \"f3df342f-512f-410a-8b64-171bc7255a0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-ssv8l"
May 28 14:53:02.461460 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.460520    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f3df342f-512f-410a-8b64-171bc7255a0e-ovnkube-config\") pod \"ovnkube-node-ssv8l\" (UID: \"f3df342f-512f-410a-8b64-171bc7255a0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-ssv8l"
May 28 14:53:02.462058 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.460540    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f3df342f-512f-410a-8b64-171bc7255a0e-systemd-units\") pod \"ovnkube-node-ssv8l\" (UID: \"f3df342f-512f-410a-8b64-171bc7255a0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-ssv8l"
May 28 14:53:02.462058 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.460559    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f9b48604-9b1a-4e1d-96ce-b27af88be3ef-run\") pod \"tuned-lj62g\" (UID: \"f9b48604-9b1a-4e1d-96ce-b27af88be3ef\") " pod="openshift-cluster-node-tuning-operator/tuned-lj62g"
May 28 14:53:02.462058 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.460584    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0595a2ba-deef-42af-aef6-ad8abc4fbfba-konnectivity-ca\") pod \"konnectivity-agent-889lh\" (UID: \"0595a2ba-deef-42af-aef6-ad8abc4fbfba\") " pod="kube-system/konnectivity-agent-889lh"
May 28 14:53:02.462058 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.460612    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9be2177d-67fc-4eec-aa1a-bbe5602495d5-os-release\") pod \"multus-additional-cni-plugins-l8h9g\" (UID: \"9be2177d-67fc-4eec-aa1a-bbe5602495d5\") " pod="openshift-multus/multus-additional-cni-plugins-l8h9g"
May 28 14:53:02.462058 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.460613    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/163ec1a8-e490-49fe-91c4-5536fe100364-multus-cni-dir\") pod \"multus-nldsr\" (UID: \"163ec1a8-e490-49fe-91c4-5536fe100364\") " pod="openshift-multus/multus-nldsr"
May 28 14:53:02.462058 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.460653    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f3df342f-512f-410a-8b64-171bc7255a0e-ovn-node-metrics-cert\") pod \"ovnkube-node-ssv8l\" (UID: \"f3df342f-512f-410a-8b64-171bc7255a0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-ssv8l"
May 28 14:53:02.462058 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.460698    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/163ec1a8-e490-49fe-91c4-5536fe100364-hostroot\") pod \"multus-nldsr\" (UID: \"163ec1a8-e490-49fe-91c4-5536fe100364\") " pod="openshift-multus/multus-nldsr"
May 28 14:53:02.462058 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.460667    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/163ec1a8-e490-49fe-91c4-5536fe100364-multus-cni-dir\") pod \"multus-nldsr\" (UID: \"163ec1a8-e490-49fe-91c4-5536fe100364\") " pod="openshift-multus/multus-nldsr"
May 28 14:53:02.462058 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.460727    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9be2177d-67fc-4eec-aa1a-bbe5602495d5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-l8h9g\" (UID: \"9be2177d-67fc-4eec-aa1a-bbe5602495d5\") " pod="openshift-multus/multus-additional-cni-plugins-l8h9g"
May 28 14:53:02.462058 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.460847    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9be2177d-67fc-4eec-aa1a-bbe5602495d5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-l8h9g\" (UID: \"9be2177d-67fc-4eec-aa1a-bbe5602495d5\") " pod="openshift-multus/multus-additional-cni-plugins-l8h9g"
May 28 14:53:02.462058 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.460898    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/18e17dc3-da42-4b11-8f21-5eb66227c6f7-serviceca\") pod \"node-ca-mh529\" (UID: \"18e17dc3-da42-4b11-8f21-5eb66227c6f7\") " pod="openshift-image-registry/node-ca-mh529"
May 28 14:53:02.462058 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.461420    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9be2177d-67fc-4eec-aa1a-bbe5602495d5-cni-binary-copy\") pod \"multus-additional-cni-plugins-l8h9g\" (UID: \"9be2177d-67fc-4eec-aa1a-bbe5602495d5\") " pod="openshift-multus/multus-additional-cni-plugins-l8h9g"
May 28 14:53:02.462058 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.461461    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/163ec1a8-e490-49fe-91c4-5536fe100364-hostroot\") pod \"multus-nldsr\" (UID: \"163ec1a8-e490-49fe-91c4-5536fe100364\") " pod="openshift-multus/multus-nldsr"
May 28 14:53:02.462058 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:53:02.461503    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 14:53:02.462058 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:53:02.461650    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b51f6e42-ac3f-47b9-8962-ec51c836ad35-metrics-certs podName:b51f6e42-ac3f-47b9-8962-ec51c836ad35 nodeName:}" failed. No retries permitted until 2026-05-28 14:53:02.961619221 +0000 UTC m=+3.050835938 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b51f6e42-ac3f-47b9-8962-ec51c836ad35-metrics-certs") pod "network-metrics-daemon-v4dpk" (UID: "b51f6e42-ac3f-47b9-8962-ec51c836ad35") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 14:53:02.462058 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.461859    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f3df342f-512f-410a-8b64-171bc7255a0e-run-ovn\") pod \"ovnkube-node-ssv8l\" (UID: \"f3df342f-512f-410a-8b64-171bc7255a0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-ssv8l"
May 28 14:53:02.462058 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.461869    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/abda2870-be5c-44d4-8ba7-1d2d057e36df-device-dir\") pod \"aws-ebs-csi-driver-node-k8rjj\" (UID: \"abda2870-be5c-44d4-8ba7-1d2d057e36df\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k8rjj"
May 28 14:53:02.462533 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.461908    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5e470d5c-c76c-452d-8add-a20856bab41f-hosts-file\") pod \"node-resolver-r8s4x\" (UID: \"5e470d5c-c76c-452d-8add-a20856bab41f\") " pod="openshift-dns/node-resolver-r8s4x"
May 28 14:53:02.462533 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.461967    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/abda2870-be5c-44d4-8ba7-1d2d057e36df-etc-selinux\") pod \"aws-ebs-csi-driver-node-k8rjj\" (UID: \"abda2870-be5c-44d4-8ba7-1d2d057e36df\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k8rjj"
May 28 14:53:02.462533 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.462094    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/163ec1a8-e490-49fe-91c4-5536fe100364-host-var-lib-kubelet\") pod \"multus-nldsr\" (UID: \"163ec1a8-e490-49fe-91c4-5536fe100364\") " pod="openshift-multus/multus-nldsr"
May 28 14:53:02.462533 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.462144    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9be2177d-67fc-4eec-aa1a-bbe5602495d5-cnibin\") pod \"multus-additional-cni-plugins-l8h9g\" (UID: \"9be2177d-67fc-4eec-aa1a-bbe5602495d5\") " pod="openshift-multus/multus-additional-cni-plugins-l8h9g"
May 28 14:53:02.462533 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.462203    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/abda2870-be5c-44d4-8ba7-1d2d057e36df-kubelet-dir\") pod \"aws-ebs-csi-driver-node-k8rjj\" (UID: \"abda2870-be5c-44d4-8ba7-1d2d057e36df\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k8rjj"
May 28 14:53:02.462533 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.462224    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f9b48604-9b1a-4e1d-96ce-b27af88be3ef-etc-systemd\") pod \"tuned-lj62g\" (UID: \"f9b48604-9b1a-4e1d-96ce-b27af88be3ef\") " pod="openshift-cluster-node-tuning-operator/tuned-lj62g"
May 28 14:53:02.462533 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.462246    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f3df342f-512f-410a-8b64-171bc7255a0e-host-run-netns\") pod \"ovnkube-node-ssv8l\" (UID: \"f3df342f-512f-410a-8b64-171bc7255a0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-ssv8l"
May 28 14:53:02.462533 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.462473    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f3df342f-512f-410a-8b64-171bc7255a0e-host-kubelet\") pod \"ovnkube-node-ssv8l\" (UID: \"f3df342f-512f-410a-8b64-171bc7255a0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-ssv8l"
May 28 14:53:02.462533 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.462520    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f3df342f-512f-410a-8b64-171bc7255a0e-etc-openvswitch\") pod \"ovnkube-node-ssv8l\" (UID: \"f3df342f-512f-410a-8b64-171bc7255a0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-ssv8l"
May 28 14:53:02.462853 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.462562    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f3df342f-512f-410a-8b64-171bc7255a0e-host-run-ovn-kubernetes\") pod \"ovnkube-node-ssv8l\" (UID: \"f3df342f-512f-410a-8b64-171bc7255a0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-ssv8l"
May 28 14:53:02.462853 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.462607    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f3df342f-512f-410a-8b64-171bc7255a0e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ssv8l\" (UID: \"f3df342f-512f-410a-8b64-171bc7255a0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-ssv8l"
May 28 14:53:02.462853 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.462656    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/abda2870-be5c-44d4-8ba7-1d2d057e36df-sys-fs\") pod \"aws-ebs-csi-driver-node-k8rjj\" (UID: \"abda2870-be5c-44d4-8ba7-1d2d057e36df\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k8rjj"
May 28 14:53:02.462853 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.462713    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f9b48604-9b1a-4e1d-96ce-b27af88be3ef-etc-sysconfig\") pod \"tuned-lj62g\" (UID: \"f9b48604-9b1a-4e1d-96ce-b27af88be3ef\") " pod="openshift-cluster-node-tuning-operator/tuned-lj62g"
May 28 14:53:02.462853 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.462766    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/163ec1a8-e490-49fe-91c4-5536fe100364-system-cni-dir\") pod \"multus-nldsr\" (UID: \"163ec1a8-e490-49fe-91c4-5536fe100364\") " pod="openshift-multus/multus-nldsr"
May 28 14:53:02.462853 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.462784    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f9b48604-9b1a-4e1d-96ce-b27af88be3ef-lib-modules\") pod \"tuned-lj62g\" (UID: \"f9b48604-9b1a-4e1d-96ce-b27af88be3ef\") " pod="openshift-cluster-node-tuning-operator/tuned-lj62g"
May 28 14:53:02.462853 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.462802    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f9b48604-9b1a-4e1d-96ce-b27af88be3ef-etc-modprobe-d\") pod \"tuned-lj62g\" (UID: \"f9b48604-9b1a-4e1d-96ce-b27af88be3ef\") " pod="openshift-cluster-node-tuning-operator/tuned-lj62g"
May 28 14:53:02.462853 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.462828    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f3df342f-512f-410a-8b64-171bc7255a0e-systemd-units\") pod \"ovnkube-node-ssv8l\" (UID: \"f3df342f-512f-410a-8b64-171bc7255a0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-ssv8l"
May 28 14:53:02.462853 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.462838    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f9b48604-9b1a-4e1d-96ce-b27af88be3ef-run\") pod \"tuned-lj62g\" (UID: \"f9b48604-9b1a-4e1d-96ce-b27af88be3ef\") " pod="openshift-cluster-node-tuning-operator/tuned-lj62g"
May 28 14:53:02.463145 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.462864    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9be2177d-67fc-4eec-aa1a-bbe5602495d5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-l8h9g\" (UID: \"9be2177d-67fc-4eec-aa1a-bbe5602495d5\") " pod="openshift-multus/multus-additional-cni-plugins-l8h9g"
May 28 14:53:02.463145 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.462911    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f3df342f-512f-410a-8b64-171bc7255a0e-env-overrides\") pod \"ovnkube-node-ssv8l\" (UID: \"f3df342f-512f-410a-8b64-171bc7255a0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-ssv8l"
May 28 14:53:02.463145 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.462956    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ltsft\" (UniqueName: \"kubernetes.io/projected/b51f6e42-ac3f-47b9-8962-ec51c836ad35-kube-api-access-ltsft\") pod \"network-metrics-daemon-v4dpk\" (UID: \"b51f6e42-ac3f-47b9-8962-ec51c836ad35\") " pod="openshift-multus/network-metrics-daemon-v4dpk"
May 28 14:53:02.463145 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.462985    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jvwjp\" (UniqueName: \"kubernetes.io/projected/18e17dc3-da42-4b11-8f21-5eb66227c6f7-kube-api-access-jvwjp\") pod \"node-ca-mh529\" (UID: \"18e17dc3-da42-4b11-8f21-5eb66227c6f7\") " pod="openshift-image-registry/node-ca-mh529"
May 28 14:53:02.463145 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.463009    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f3df342f-512f-410a-8b64-171bc7255a0e-run-openvswitch\") pod \"ovnkube-node-ssv8l\" (UID: \"f3df342f-512f-410a-8b64-171bc7255a0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-ssv8l"
May 28 14:53:02.463145 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.463061    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f3df342f-512f-410a-8b64-171bc7255a0e-log-socket\") pod \"ovnkube-node-ssv8l\" (UID: \"f3df342f-512f-410a-8b64-171bc7255a0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-ssv8l"
May 28 14:53:02.463145 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.463096    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5e470d5c-c76c-452d-8add-a20856bab41f-tmp-dir\") pod \"node-resolver-r8s4x\" (UID: \"5e470d5c-c76c-452d-8add-a20856bab41f\") " pod="openshift-dns/node-resolver-r8s4x"
May 28 14:53:02.463145 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.463119    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f9b48604-9b1a-4e1d-96ce-b27af88be3ef-host\") pod \"tuned-lj62g\" (UID: \"f9b48604-9b1a-4e1d-96ce-b27af88be3ef\") " pod="openshift-cluster-node-tuning-operator/tuned-lj62g"
May 28 14:53:02.465337 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.463190    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f9b48604-9b1a-4e1d-96ce-b27af88be3ef-host\") pod \"tuned-lj62g\" (UID: \"f9b48604-9b1a-4e1d-96ce-b27af88be3ef\") " pod="openshift-cluster-node-tuning-operator/tuned-lj62g"
May 28 14:53:02.465337 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.463301    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f3df342f-512f-410a-8b64-171bc7255a0e-log-socket\") pod \"ovnkube-node-ssv8l\" (UID: \"f3df342f-512f-410a-8b64-171bc7255a0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-ssv8l"
May 28 14:53:02.465337 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.463354    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f3df342f-512f-410a-8b64-171bc7255a0e-run-openvswitch\") pod \"ovnkube-node-ssv8l\" (UID: \"f3df342f-512f-410a-8b64-171bc7255a0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-ssv8l"
May 28 14:53:02.465337 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.463440    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9be2177d-67fc-4eec-aa1a-bbe5602495d5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-l8h9g\" (UID: \"9be2177d-67fc-4eec-aa1a-bbe5602495d5\") " pod="openshift-multus/multus-additional-cni-plugins-l8h9g"
May 28 14:53:02.465337 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.463506    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/163ec1a8-e490-49fe-91c4-5536fe100364-os-release\") pod \"multus-nldsr\" (UID: \"163ec1a8-e490-49fe-91c4-5536fe100364\") " pod="openshift-multus/multus-nldsr"
May 28 14:53:02.465337 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.463582    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/163ec1a8-e490-49fe-91c4-5536fe100364-host-var-lib-cni-multus\") pod \"multus-nldsr\" (UID: \"163ec1a8-e490-49fe-91c4-5536fe100364\") " pod="openshift-multus/multus-nldsr"
May 28 14:53:02.465337 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.463613    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9be2177d-67fc-4eec-aa1a-bbe5602495d5-system-cni-dir\") pod \"multus-additional-cni-plugins-l8h9g\" (UID: \"9be2177d-67fc-4eec-aa1a-bbe5602495d5\") " pod="openshift-multus/multus-additional-cni-plugins-l8h9g"
May 28 14:53:02.465337 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.463640    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f9b48604-9b1a-4e1d-96ce-b27af88be3ef-tmp\") pod \"tuned-lj62g\" (UID: \"f9b48604-9b1a-4e1d-96ce-b27af88be3ef\") " pod="openshift-cluster-node-tuning-operator/tuned-lj62g"
May 28 14:53:02.465337 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.463641    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/163ec1a8-e490-49fe-91c4-5536fe100364-os-release\") pod \"multus-nldsr\" (UID: \"163ec1a8-e490-49fe-91c4-5536fe100364\") " pod="openshift-multus/multus-nldsr"
May 28 14:53:02.465337 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.463639    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f9b48604-9b1a-4e1d-96ce-b27af88be3ef-etc-tuned\") pod \"tuned-lj62g\" (UID: \"f9b48604-9b1a-4e1d-96ce-b27af88be3ef\") " pod="openshift-cluster-node-tuning-operator/tuned-lj62g"
May 28 14:53:02.465337 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.463687    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/163ec1a8-e490-49fe-91c4-5536fe100364-host-var-lib-cni-multus\") pod \"multus-nldsr\" (UID: \"163ec1a8-e490-49fe-91c4-5536fe100364\") " pod="openshift-multus/multus-nldsr"
May 28 14:53:02.465337 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.463567    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f3df342f-512f-410a-8b64-171bc7255a0e-env-overrides\") pod \"ovnkube-node-ssv8l\" (UID: \"f3df342f-512f-410a-8b64-171bc7255a0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-ssv8l"
May 28 14:53:02.465337 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.463691    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f3df342f-512f-410a-8b64-171bc7255a0e-ovnkube-config\") pod \"ovnkube-node-ssv8l\" (UID: \"f3df342f-512f-410a-8b64-171bc7255a0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-ssv8l"
May 28 14:53:02.465337 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.463710    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5e470d5c-c76c-452d-8add-a20856bab41f-tmp-dir\") pod \"node-resolver-r8s4x\" (UID: \"5e470d5c-c76c-452d-8add-a20856bab41f\") " pod="openshift-dns/node-resolver-r8s4x"
May 28 14:53:02.465337 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.463695    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/163ec1a8-e490-49fe-91c4-5536fe100364-multus-socket-dir-parent\") pod \"multus-nldsr\" (UID: \"163ec1a8-e490-49fe-91c4-5536fe100364\") " pod="openshift-multus/multus-nldsr"
May 28 14:53:02.465337 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.463737    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/163ec1a8-e490-49fe-91c4-5536fe100364-multus-socket-dir-parent\") pod \"multus-nldsr\" (UID: \"163ec1a8-e490-49fe-91c4-5536fe100364\") " pod="openshift-multus/multus-nldsr"
May 28 14:53:02.465337 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.463765    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/163ec1a8-e490-49fe-91c4-5536fe100364-etc-kubernetes\") pod \"multus-nldsr\" (UID: \"163ec1a8-e490-49fe-91c4-5536fe100364\") " pod="openshift-multus/multus-nldsr"
May 28 14:53:02.465337 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.463777    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9be2177d-67fc-4eec-aa1a-bbe5602495d5-system-cni-dir\") pod \"multus-additional-cni-plugins-l8h9g\" (UID: \"9be2177d-67fc-4eec-aa1a-bbe5602495d5\") " pod="openshift-multus/multus-additional-cni-plugins-l8h9g"
May 28 14:53:02.466195 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.463781    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f3df342f-512f-410a-8b64-171bc7255a0e-ovn-node-metrics-cert\") pod \"ovnkube-node-ssv8l\" (UID: \"f3df342f-512f-410a-8b64-171bc7255a0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-ssv8l"
May 28 14:53:02.466195 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.463792    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f3df342f-512f-410a-8b64-171bc7255a0e-var-lib-openvswitch\") pod \"ovnkube-node-ssv8l\" (UID: \"f3df342f-512f-410a-8b64-171bc7255a0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-ssv8l"
May 28 14:53:02.466195 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.463815    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/163ec1a8-e490-49fe-91c4-5536fe100364-etc-kubernetes\") pod \"multus-nldsr\" (UID: \"163ec1a8-e490-49fe-91c4-5536fe100364\") " pod="openshift-multus/multus-nldsr"
May 28 14:53:02.466195 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.463818    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f3df342f-512f-410a-8b64-171bc7255a0e-node-log\") pod \"ovnkube-node-ssv8l\" (UID: \"f3df342f-512f-410a-8b64-171bc7255a0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-ssv8l"
May 28 14:53:02.466195 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.463851    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f3df342f-512f-410a-8b64-171bc7255a0e-var-lib-openvswitch\") pod \"ovnkube-node-ssv8l\" (UID: \"f3df342f-512f-410a-8b64-171bc7255a0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-ssv8l"
May 28 14:53:02.466195 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.463856    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f9b48604-9b1a-4e1d-96ce-b27af88be3ef-etc-kubernetes\") pod \"tuned-lj62g\" (UID: \"f9b48604-9b1a-4e1d-96ce-b27af88be3ef\") " pod="openshift-cluster-node-tuning-operator/tuned-lj62g"
May 28 14:53:02.466195 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.463855    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f3df342f-512f-410a-8b64-171bc7255a0e-node-log\") pod \"ovnkube-node-ssv8l\" (UID: \"f3df342f-512f-410a-8b64-171bc7255a0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-ssv8l"
May 28 14:53:02.466195 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.463882    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f9b48604-9b1a-4e1d-96ce-b27af88be3ef-etc-sysctl-d\") pod \"tuned-lj62g\" (UID: \"f9b48604-9b1a-4e1d-96ce-b27af88be3ef\") " pod="openshift-cluster-node-tuning-operator/tuned-lj62g"
May 28 14:53:02.466195 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.463905    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f9b48604-9b1a-4e1d-96ce-b27af88be3ef-etc-sysctl-conf\") pod \"tuned-lj62g\" (UID: \"f9b48604-9b1a-4e1d-96ce-b27af88be3ef\") " pod="openshift-cluster-node-tuning-operator/tuned-lj62g"
May 28 14:53:02.466195 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.463943    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0595a2ba-deef-42af-aef6-ad8abc4fbfba-konnectivity-ca\") pod \"konnectivity-agent-889lh\" (UID: \"0595a2ba-deef-42af-aef6-ad8abc4fbfba\") " pod="kube-system/konnectivity-agent-889lh"
May 28 14:53:02.466195 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.463978    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f9b48604-9b1a-4e1d-96ce-b27af88be3ef-etc-kubernetes\") pod \"tuned-lj62g\" (UID: \"f9b48604-9b1a-4e1d-96ce-b27af88be3ef\") " pod="openshift-cluster-node-tuning-operator/tuned-lj62g"
May 28 14:53:02.466195 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.464024    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f9b48604-9b1a-4e1d-96ce-b27af88be3ef-etc-sysctl-d\") pod \"tuned-lj62g\" (UID: \"f9b48604-9b1a-4e1d-96ce-b27af88be3ef\") " pod="openshift-cluster-node-tuning-operator/tuned-lj62g"
May 28 14:53:02.466195 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.464054    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f9b48604-9b1a-4e1d-96ce-b27af88be3ef-sys\") pod \"tuned-lj62g\" (UID: \"f9b48604-9b1a-4e1d-96ce-b27af88be3ef\") " pod="openshift-cluster-node-tuning-operator/tuned-lj62g"
May 28 14:53:02.466195 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.464097    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f9b48604-9b1a-4e1d-96ce-b27af88be3ef-etc-sysctl-conf\") pod \"tuned-lj62g\" (UID: \"f9b48604-9b1a-4e1d-96ce-b27af88be3ef\") " pod="openshift-cluster-node-tuning-operator/tuned-lj62g"
May 28 14:53:02.466195 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.464114    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9be2177d-67fc-4eec-aa1a-bbe5602495d5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-l8h9g\" (UID: \"9be2177d-67fc-4eec-aa1a-bbe5602495d5\") " pod="openshift-multus/multus-additional-cni-plugins-l8h9g"
May 28 14:53:02.466195 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.464120    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f9b48604-9b1a-4e1d-96ce-b27af88be3ef-sys\") pod \"tuned-lj62g\" (UID: \"f9b48604-9b1a-4e1d-96ce-b27af88be3ef\") " pod="openshift-cluster-node-tuning-operator/tuned-lj62g"
May 28 14:53:02.466195 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.464145    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dg2qr\" (UniqueName: \"kubernetes.io/projected/9be2177d-67fc-4eec-aa1a-bbe5602495d5-kube-api-access-dg2qr\") pod \"multus-additional-cni-plugins-l8h9g\" (UID: \"9be2177d-67fc-4eec-aa1a-bbe5602495d5\") " pod="openshift-multus/multus-additional-cni-plugins-l8h9g"
May 28 14:53:02.466195 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.464163    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/18e17dc3-da42-4b11-8f21-5eb66227c6f7-host\") pod \"node-ca-mh529\" (UID: \"18e17dc3-da42-4b11-8f21-5eb66227c6f7\") " pod="openshift-image-registry/node-ca-mh529"
May 28 14:53:02.467032 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.464185    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f9b48604-9b1a-4e1d-96ce-b27af88be3ef-var-lib-kubelet\") pod \"tuned-lj62g\" (UID: \"f9b48604-9b1a-4e1d-96ce-b27af88be3ef\") " pod="openshift-cluster-node-tuning-operator/tuned-lj62g"
May 28 14:53:02.467032 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.464225    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/163ec1a8-e490-49fe-91c4-5536fe100364-cnibin\") pod \"multus-nldsr\" (UID: \"163ec1a8-e490-49fe-91c4-5536fe100364\") " pod="openshift-multus/multus-nldsr"
May 28 14:53:02.467032 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.464262    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/aeb6de40-615c-4781-981a-ff9fded37a6e-host-slash\") pod \"iptables-alerter-khjnn\" (UID: \"aeb6de40-615c-4781-981a-ff9fded37a6e\") " pod="openshift-network-operator/iptables-alerter-khjnn"
May 28 14:53:02.467032 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.464286    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/248847de-48dc-4cb1-aa31-e48dc53e7f10-kubelet-config\") pod \"global-pull-secret-syncer-5bqrk\" (UID: \"248847de-48dc-4cb1-aa31-e48dc53e7f10\") " pod="kube-system/global-pull-secret-syncer-5bqrk"
May 28 14:53:02.467032 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.464308    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/248847de-48dc-4cb1-aa31-e48dc53e7f10-dbus\") pod \"global-pull-secret-syncer-5bqrk\" (UID: \"248847de-48dc-4cb1-aa31-e48dc53e7f10\") " pod="kube-system/global-pull-secret-syncer-5bqrk"
May 28 14:53:02.467032 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.464413    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/18e17dc3-da42-4b11-8f21-5eb66227c6f7-host\") pod \"node-ca-mh529\" (UID: \"18e17dc3-da42-4b11-8f21-5eb66227c6f7\") " pod="openshift-image-registry/node-ca-mh529"
May 28 14:53:02.467032 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.464476    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/163ec1a8-e490-49fe-91c4-5536fe100364-cnibin\") pod \"multus-nldsr\" (UID: \"163ec1a8-e490-49fe-91c4-5536fe100364\") " pod="openshift-multus/multus-nldsr"
May 28 14:53:02.467032 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.464525    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f9b48604-9b1a-4e1d-96ce-b27af88be3ef-var-lib-kubelet\") pod \"tuned-lj62g\" (UID: \"f9b48604-9b1a-4e1d-96ce-b27af88be3ef\") " pod="openshift-cluster-node-tuning-operator/tuned-lj62g"
May 28 14:53:02.467032 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.464865    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0595a2ba-deef-42af-aef6-ad8abc4fbfba-agent-certs\") pod \"konnectivity-agent-889lh\" (UID: \"0595a2ba-deef-42af-aef6-ad8abc4fbfba\") " pod="kube-system/konnectivity-agent-889lh"
May 28 14:53:02.467032 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.465027    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9be2177d-67fc-4eec-aa1a-bbe5602495d5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-l8h9g\" (UID: \"9be2177d-67fc-4eec-aa1a-bbe5602495d5\") " pod="openshift-multus/multus-additional-cni-plugins-l8h9g"
May 28 14:53:02.467032 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.465909    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f9b48604-9b1a-4e1d-96ce-b27af88be3ef-tmp\") pod \"tuned-lj62g\" (UID: \"f9b48604-9b1a-4e1d-96ce-b27af88be3ef\") " pod="openshift-cluster-node-tuning-operator/tuned-lj62g"
May 28 14:53:02.468100 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.468070    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p69k2\" (UniqueName: \"kubernetes.io/projected/163ec1a8-e490-49fe-91c4-5536fe100364-kube-api-access-p69k2\") pod \"multus-nldsr\" (UID: \"163ec1a8-e490-49fe-91c4-5536fe100364\") " pod="openshift-multus/multus-nldsr"
May 28 14:53:02.471923 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.471901    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cpt2s\" (UniqueName: \"kubernetes.io/projected/f9b48604-9b1a-4e1d-96ce-b27af88be3ef-kube-api-access-cpt2s\") pod \"tuned-lj62g\" (UID: \"f9b48604-9b1a-4e1d-96ce-b27af88be3ef\") " pod="openshift-cluster-node-tuning-operator/tuned-lj62g"
May 28 14:53:02.473671 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.473645    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dg2qr\" (UniqueName: \"kubernetes.io/projected/9be2177d-67fc-4eec-aa1a-bbe5602495d5-kube-api-access-dg2qr\") pod \"multus-additional-cni-plugins-l8h9g\" (UID: \"9be2177d-67fc-4eec-aa1a-bbe5602495d5\") " pod="openshift-multus/multus-additional-cni-plugins-l8h9g"
May 28 14:53:02.473836 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.473785    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-656rp\" (UniqueName: \"kubernetes.io/projected/5e470d5c-c76c-452d-8add-a20856bab41f-kube-api-access-656rp\") pod \"node-resolver-r8s4x\" (UID: \"5e470d5c-c76c-452d-8add-a20856bab41f\") " pod="openshift-dns/node-resolver-r8s4x"
May 28 14:53:02.474146 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.474123    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-57bfr\" (UniqueName: \"kubernetes.io/projected/f3df342f-512f-410a-8b64-171bc7255a0e-kube-api-access-57bfr\") pod \"ovnkube-node-ssv8l\" (UID: \"f3df342f-512f-410a-8b64-171bc7255a0e\") " pod="openshift-ovn-kubernetes/ovnkube-node-ssv8l"
May 28 14:53:02.474516 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.474483    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ltsft\" (UniqueName: \"kubernetes.io/projected/b51f6e42-ac3f-47b9-8962-ec51c836ad35-kube-api-access-ltsft\") pod \"network-metrics-daemon-v4dpk\" (UID: \"b51f6e42-ac3f-47b9-8962-ec51c836ad35\") " pod="openshift-multus/network-metrics-daemon-v4dpk"
May 28 14:53:02.474597 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.474585    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gbckd\" (UniqueName: \"kubernetes.io/projected/abda2870-be5c-44d4-8ba7-1d2d057e36df-kube-api-access-gbckd\") pod \"aws-ebs-csi-driver-node-k8rjj\" (UID: \"abda2870-be5c-44d4-8ba7-1d2d057e36df\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k8rjj"
May 28 14:53:02.475461 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.475437    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jvwjp\" (UniqueName: \"kubernetes.io/projected/18e17dc3-da42-4b11-8f21-5eb66227c6f7-kube-api-access-jvwjp\") pod \"node-ca-mh529\" (UID: \"18e17dc3-da42-4b11-8f21-5eb66227c6f7\") " pod="openshift-image-registry/node-ca-mh529"
May 28 14:53:02.564864 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.564837    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lfw6g\" (UniqueName: \"kubernetes.io/projected/49117ec2-5908-41bd-a305-59ddea54b26d-kube-api-access-lfw6g\") pod \"network-check-target-zj7gq\" (UID: \"49117ec2-5908-41bd-a305-59ddea54b26d\") " pod="openshift-network-diagnostics/network-check-target-zj7gq"
May 28 14:53:02.564864 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.564869    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/aeb6de40-615c-4781-981a-ff9fded37a6e-iptables-alerter-script\") pod \"iptables-alerter-khjnn\" (UID: \"aeb6de40-615c-4781-981a-ff9fded37a6e\") " pod="openshift-network-operator/iptables-alerter-khjnn"
May 28 14:53:02.565088 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.564904    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zbxv9\" (UniqueName: \"kubernetes.io/projected/aeb6de40-615c-4781-981a-ff9fded37a6e-kube-api-access-zbxv9\") pod \"iptables-alerter-khjnn\" (UID: \"aeb6de40-615c-4781-981a-ff9fded37a6e\") " pod="openshift-network-operator/iptables-alerter-khjnn"
May 28 14:53:02.565088 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.564938    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/aeb6de40-615c-4781-981a-ff9fded37a6e-host-slash\") pod \"iptables-alerter-khjnn\" (UID: \"aeb6de40-615c-4781-981a-ff9fded37a6e\") " pod="openshift-network-operator/iptables-alerter-khjnn"
May 28 14:53:02.565088 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.564958    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/248847de-48dc-4cb1-aa31-e48dc53e7f10-kubelet-config\") pod \"global-pull-secret-syncer-5bqrk\" (UID: \"248847de-48dc-4cb1-aa31-e48dc53e7f10\") " pod="kube-system/global-pull-secret-syncer-5bqrk"
May 28 14:53:02.565088 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.564982    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/248847de-48dc-4cb1-aa31-e48dc53e7f10-dbus\") pod \"global-pull-secret-syncer-5bqrk\" (UID: \"248847de-48dc-4cb1-aa31-e48dc53e7f10\") " pod="kube-system/global-pull-secret-syncer-5bqrk"
May 28 14:53:02.565088 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.565004    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/248847de-48dc-4cb1-aa31-e48dc53e7f10-original-pull-secret\") pod \"global-pull-secret-syncer-5bqrk\" (UID: \"248847de-48dc-4cb1-aa31-e48dc53e7f10\") " pod="kube-system/global-pull-secret-syncer-5bqrk"
May 28 14:53:02.565088 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.565038    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/aeb6de40-615c-4781-981a-ff9fded37a6e-host-slash\") pod \"iptables-alerter-khjnn\" (UID: \"aeb6de40-615c-4781-981a-ff9fded37a6e\") " pod="openshift-network-operator/iptables-alerter-khjnn"
May 28 14:53:02.565351 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:53:02.565114    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 28 14:53:02.565351 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:53:02.565162    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/248847de-48dc-4cb1-aa31-e48dc53e7f10-original-pull-secret podName:248847de-48dc-4cb1-aa31-e48dc53e7f10 nodeName:}" failed. No retries permitted until 2026-05-28 14:53:03.065145088 +0000 UTC m=+3.154361792 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/248847de-48dc-4cb1-aa31-e48dc53e7f10-original-pull-secret") pod "global-pull-secret-syncer-5bqrk" (UID: "248847de-48dc-4cb1-aa31-e48dc53e7f10") : object "kube-system"/"original-pull-secret" not registered
May 28 14:53:02.565351 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.565197    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/248847de-48dc-4cb1-aa31-e48dc53e7f10-kubelet-config\") pod \"global-pull-secret-syncer-5bqrk\" (UID: \"248847de-48dc-4cb1-aa31-e48dc53e7f10\") " pod="kube-system/global-pull-secret-syncer-5bqrk"
May 28 14:53:02.565351 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.565267    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/248847de-48dc-4cb1-aa31-e48dc53e7f10-dbus\") pod \"global-pull-secret-syncer-5bqrk\" (UID: \"248847de-48dc-4cb1-aa31-e48dc53e7f10\") " pod="kube-system/global-pull-secret-syncer-5bqrk"
May 28 14:53:02.565489 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.565432    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/aeb6de40-615c-4781-981a-ff9fded37a6e-iptables-alerter-script\") pod \"iptables-alerter-khjnn\" (UID: \"aeb6de40-615c-4781-981a-ff9fded37a6e\") " pod="openshift-network-operator/iptables-alerter-khjnn"
May 28 14:53:02.573429 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:53:02.573410    2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 28 14:53:02.573429 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:53:02.573430    2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 28 14:53:02.573552 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:53:02.573441    2563 projected.go:194] Error preparing data for projected volume kube-api-access-lfw6g for pod openshift-network-diagnostics/network-check-target-zj7gq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 14:53:02.573552 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:53:02.573490    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/49117ec2-5908-41bd-a305-59ddea54b26d-kube-api-access-lfw6g podName:49117ec2-5908-41bd-a305-59ddea54b26d nodeName:}" failed. No retries permitted until 2026-05-28 14:53:03.07347764 +0000 UTC m=+3.162694353 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-lfw6g" (UniqueName: "kubernetes.io/projected/49117ec2-5908-41bd-a305-59ddea54b26d-kube-api-access-lfw6g") pod "network-check-target-zj7gq" (UID: "49117ec2-5908-41bd-a305-59ddea54b26d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 14:53:02.582961 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.582936    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zbxv9\" (UniqueName: \"kubernetes.io/projected/aeb6de40-615c-4781-981a-ff9fded37a6e-kube-api-access-zbxv9\") pod \"iptables-alerter-khjnn\" (UID: \"aeb6de40-615c-4781-981a-ff9fded37a6e\") " pod="openshift-network-operator/iptables-alerter-khjnn"
May 28 14:53:02.647783 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.647752    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-lj62g"
May 28 14:53:02.662474 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.662447    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-889lh"
May 28 14:53:02.671340 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.671320    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-nldsr"
May 28 14:53:02.676080 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.676056    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-ssv8l"
May 28 14:53:02.682660 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.682641    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k8rjj"
May 28 14:53:02.689245 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.689221    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-l8h9g"
May 28 14:53:02.695828 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.695812    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-mh529"
May 28 14:53:02.701421 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.701406    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-r8s4x"
May 28 14:53:02.707935 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.707913    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-khjnn"
May 28 14:53:02.824663 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.824559    2563 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
May 28 14:53:02.967567 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:02.967525    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b51f6e42-ac3f-47b9-8962-ec51c836ad35-metrics-certs\") pod \"network-metrics-daemon-v4dpk\" (UID: \"b51f6e42-ac3f-47b9-8962-ec51c836ad35\") " pod="openshift-multus/network-metrics-daemon-v4dpk"
May 28 14:53:02.967759 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:53:02.967665    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 14:53:02.967759 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:53:02.967746    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b51f6e42-ac3f-47b9-8962-ec51c836ad35-metrics-certs podName:b51f6e42-ac3f-47b9-8962-ec51c836ad35 nodeName:}" failed. No retries permitted until 2026-05-28 14:53:03.967728761 +0000 UTC m=+4.056945462 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b51f6e42-ac3f-47b9-8962-ec51c836ad35-metrics-certs") pod "network-metrics-daemon-v4dpk" (UID: "b51f6e42-ac3f-47b9-8962-ec51c836ad35") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 14:53:03.068932 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:03.068838    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/248847de-48dc-4cb1-aa31-e48dc53e7f10-original-pull-secret\") pod \"global-pull-secret-syncer-5bqrk\" (UID: \"248847de-48dc-4cb1-aa31-e48dc53e7f10\") " pod="kube-system/global-pull-secret-syncer-5bqrk"
May 28 14:53:03.069090 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:53:03.068979    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 28 14:53:03.069090 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:53:03.069056    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/248847de-48dc-4cb1-aa31-e48dc53e7f10-original-pull-secret podName:248847de-48dc-4cb1-aa31-e48dc53e7f10 nodeName:}" failed. No retries permitted until 2026-05-28 14:53:04.069038202 +0000 UTC m=+4.158254909 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/248847de-48dc-4cb1-aa31-e48dc53e7f10-original-pull-secret") pod "global-pull-secret-syncer-5bqrk" (UID: "248847de-48dc-4cb1-aa31-e48dc53e7f10") : object "kube-system"/"original-pull-secret" not registered
May 28 14:53:03.141112 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:03.141080    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18e17dc3_da42_4b11_8f21_5eb66227c6f7.slice/crio-a3bd057c69c532c6e27da056d2bf2801b5b5ec2fe5fec48ff9efcf16b82dc8ed WatchSource:0}: Error finding container a3bd057c69c532c6e27da056d2bf2801b5b5ec2fe5fec48ff9efcf16b82dc8ed: Status 404 returned error can't find the container with id a3bd057c69c532c6e27da056d2bf2801b5b5ec2fe5fec48ff9efcf16b82dc8ed
May 28 14:53:03.142290 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:03.142264    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod163ec1a8_e490_49fe_91c4_5536fe100364.slice/crio-7b7fa1bec327170ba15b14ec0dd26e715f6e5daf4a7e31663dc3efb3e52cbb9b WatchSource:0}: Error finding container 7b7fa1bec327170ba15b14ec0dd26e715f6e5daf4a7e31663dc3efb3e52cbb9b: Status 404 returned error can't find the container with id 7b7fa1bec327170ba15b14ec0dd26e715f6e5daf4a7e31663dc3efb3e52cbb9b
May 28 14:53:03.144175 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:03.144036    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9be2177d_67fc_4eec_aa1a_bbe5602495d5.slice/crio-34e82de18146465b90ca722a437def24bde2bf24ed4cde79218b8f3c06cdebcc WatchSource:0}: Error finding container 34e82de18146465b90ca722a437def24bde2bf24ed4cde79218b8f3c06cdebcc: Status 404 returned error can't find the container with id 34e82de18146465b90ca722a437def24bde2bf24ed4cde79218b8f3c06cdebcc
May 28 14:53:03.147003 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:03.146983    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e470d5c_c76c_452d_8add_a20856bab41f.slice/crio-b56b4a35c445771fbe407d8b328fccac51f400f31e442f6a7628339a49af78b8 WatchSource:0}: Error finding container b56b4a35c445771fbe407d8b328fccac51f400f31e442f6a7628339a49af78b8: Status 404 returned error can't find the container with id b56b4a35c445771fbe407d8b328fccac51f400f31e442f6a7628339a49af78b8
May 28 14:53:03.147825 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:03.147804    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podabda2870_be5c_44d4_8ba7_1d2d057e36df.slice/crio-874df83dbc4024dd052a42231a89b6f39042e4eec444e3e1414a7f4644115cd8 WatchSource:0}: Error finding container 874df83dbc4024dd052a42231a89b6f39042e4eec444e3e1414a7f4644115cd8: Status 404 returned error can't find the container with id 874df83dbc4024dd052a42231a89b6f39042e4eec444e3e1414a7f4644115cd8
May 28 14:53:03.149191 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:03.149132    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3df342f_512f_410a_8b64_171bc7255a0e.slice/crio-6a70e7bdc479b0ac28b63efa540636d4df320ecefa6af335b6d5f16190a9858a WatchSource:0}: Error finding container 6a70e7bdc479b0ac28b63efa540636d4df320ecefa6af335b6d5f16190a9858a: Status 404 returned error can't find the container with id 6a70e7bdc479b0ac28b63efa540636d4df320ecefa6af335b6d5f16190a9858a
May 28 14:53:03.150330 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:03.150107    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaeb6de40_615c_4781_981a_ff9fded37a6e.slice/crio-2fc635f9ffb1ebdaca5531e8731eeb0a0b59fca9992204bdfff744944e036913 WatchSource:0}: Error finding container 2fc635f9ffb1ebdaca5531e8731eeb0a0b59fca9992204bdfff744944e036913: Status 404 returned error can't find the container with id 2fc635f9ffb1ebdaca5531e8731eeb0a0b59fca9992204bdfff744944e036913
May 28 14:53:03.150909 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:03.150819    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9b48604_9b1a_4e1d_96ce_b27af88be3ef.slice/crio-f4b3cd5933852596f5a6476672ca09ac82c5b98af1dccbf406df722e830d0dee WatchSource:0}: Error finding container f4b3cd5933852596f5a6476672ca09ac82c5b98af1dccbf406df722e830d0dee: Status 404 returned error can't find the container with id f4b3cd5933852596f5a6476672ca09ac82c5b98af1dccbf406df722e830d0dee
May 28 14:53:03.153366 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:03.153091    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0595a2ba_deef_42af_aef6_ad8abc4fbfba.slice/crio-270a17b36c5d1d5d3ba1925f9709b9bd15938b2a5613a662ea92acfa4c762d62 WatchSource:0}: Error finding container 270a17b36c5d1d5d3ba1925f9709b9bd15938b2a5613a662ea92acfa4c762d62: Status 404 returned error can't find the container with id 270a17b36c5d1d5d3ba1925f9709b9bd15938b2a5613a662ea92acfa4c762d62
May 28 14:53:03.169116 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:03.169091    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lfw6g\" (UniqueName: \"kubernetes.io/projected/49117ec2-5908-41bd-a305-59ddea54b26d-kube-api-access-lfw6g\") pod \"network-check-target-zj7gq\" (UID: \"49117ec2-5908-41bd-a305-59ddea54b26d\") " pod="openshift-network-diagnostics/network-check-target-zj7gq"
May 28 14:53:03.169266 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:53:03.169248    2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 28 14:53:03.169334 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:53:03.169274    2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 28 14:53:03.169334 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:53:03.169288    2563 projected.go:194] Error preparing data for projected volume kube-api-access-lfw6g for pod openshift-network-diagnostics/network-check-target-zj7gq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 14:53:03.169419 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:53:03.169347    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/49117ec2-5908-41bd-a305-59ddea54b26d-kube-api-access-lfw6g podName:49117ec2-5908-41bd-a305-59ddea54b26d nodeName:}" failed. No retries permitted until 2026-05-28 14:53:04.169327079 +0000 UTC m=+4.258543798 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-lfw6g" (UniqueName: "kubernetes.io/projected/49117ec2-5908-41bd-a305-59ddea54b26d-kube-api-access-lfw6g") pod "network-check-target-zj7gq" (UID: "49117ec2-5908-41bd-a305-59ddea54b26d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 14:53:03.389663 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:03.389566    2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-27 14:48:01 +0000 UTC" deadline="2028-01-17 03:51:53.823169205 +0000 UTC"
May 28 14:53:03.389663 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:03.389606    2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14364h58m50.433566951s"
May 28 14:53:03.477246 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:03.477222    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v4dpk"
May 28 14:53:03.477519 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:53:03.477446    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v4dpk" podUID="b51f6e42-ac3f-47b9-8962-ec51c836ad35"
May 28 14:53:03.480790 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:03.480767    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-r8s4x" event={"ID":"5e470d5c-c76c-452d-8add-a20856bab41f","Type":"ContainerStarted","Data":"b56b4a35c445771fbe407d8b328fccac51f400f31e442f6a7628339a49af78b8"}
May 28 14:53:03.481722 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:03.481700    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-nldsr" event={"ID":"163ec1a8-e490-49fe-91c4-5536fe100364","Type":"ContainerStarted","Data":"7b7fa1bec327170ba15b14ec0dd26e715f6e5daf4a7e31663dc3efb3e52cbb9b"}
May 28 14:53:03.482634 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:03.482614    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-889lh" event={"ID":"0595a2ba-deef-42af-aef6-ad8abc4fbfba","Type":"ContainerStarted","Data":"270a17b36c5d1d5d3ba1925f9709b9bd15938b2a5613a662ea92acfa4c762d62"}
May 28 14:53:03.483561 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:03.483538    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-khjnn" event={"ID":"aeb6de40-615c-4781-981a-ff9fded37a6e","Type":"ContainerStarted","Data":"2fc635f9ffb1ebdaca5531e8731eeb0a0b59fca9992204bdfff744944e036913"}
May 28 14:53:03.484459 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:03.484442    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k8rjj" event={"ID":"abda2870-be5c-44d4-8ba7-1d2d057e36df","Type":"ContainerStarted","Data":"874df83dbc4024dd052a42231a89b6f39042e4eec444e3e1414a7f4644115cd8"}
May 28 14:53:03.485477 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:03.485454    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l8h9g" event={"ID":"9be2177d-67fc-4eec-aa1a-bbe5602495d5","Type":"ContainerStarted","Data":"34e82de18146465b90ca722a437def24bde2bf24ed4cde79218b8f3c06cdebcc"}
May 28 14:53:03.486317 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:03.486299    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-mh529" event={"ID":"18e17dc3-da42-4b11-8f21-5eb66227c6f7","Type":"ContainerStarted","Data":"a3bd057c69c532c6e27da056d2bf2801b5b5ec2fe5fec48ff9efcf16b82dc8ed"}
May 28 14:53:03.488810 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:03.488792    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-84.ec2.internal" event={"ID":"5826301e72f9d56159e32c558dac538c","Type":"ContainerStarted","Data":"24655be6af5f17d8fa2a8ebe3d39fbf06f4daa3c4aacbde635a29f1330243a0a"}
May 28 14:53:03.489760 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:03.489741    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-lj62g" event={"ID":"f9b48604-9b1a-4e1d-96ce-b27af88be3ef","Type":"ContainerStarted","Data":"f4b3cd5933852596f5a6476672ca09ac82c5b98af1dccbf406df722e830d0dee"}
May 28 14:53:03.490600 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:03.490583    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ssv8l" event={"ID":"f3df342f-512f-410a-8b64-171bc7255a0e","Type":"ContainerStarted","Data":"6a70e7bdc479b0ac28b63efa540636d4df320ecefa6af335b6d5f16190a9858a"}
May 28 14:53:03.513959 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:03.513900    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-84.ec2.internal" podStartSLOduration=2.513881763 podStartE2EDuration="2.513881763s" podCreationTimestamp="2026-05-28 14:53:01 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 14:53:03.512943066 +0000 UTC m=+3.602159790" watchObservedRunningTime="2026-05-28 14:53:03.513881763 +0000 UTC m=+3.603098489"
May 28 14:53:03.975722 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:03.975684    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b51f6e42-ac3f-47b9-8962-ec51c836ad35-metrics-certs\") pod \"network-metrics-daemon-v4dpk\" (UID: \"b51f6e42-ac3f-47b9-8962-ec51c836ad35\") " pod="openshift-multus/network-metrics-daemon-v4dpk"
May 28 14:53:03.975896 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:53:03.975872    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 14:53:03.975959 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:53:03.975947    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b51f6e42-ac3f-47b9-8962-ec51c836ad35-metrics-certs podName:b51f6e42-ac3f-47b9-8962-ec51c836ad35 nodeName:}" failed. No retries permitted until 2026-05-28 14:53:05.97592265 +0000 UTC m=+6.065139357 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b51f6e42-ac3f-47b9-8962-ec51c836ad35-metrics-certs") pod "network-metrics-daemon-v4dpk" (UID: "b51f6e42-ac3f-47b9-8962-ec51c836ad35") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 14:53:04.076848 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:04.076801    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/248847de-48dc-4cb1-aa31-e48dc53e7f10-original-pull-secret\") pod \"global-pull-secret-syncer-5bqrk\" (UID: \"248847de-48dc-4cb1-aa31-e48dc53e7f10\") " pod="kube-system/global-pull-secret-syncer-5bqrk"
May 28 14:53:04.077016 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:53:04.076973    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 28 14:53:04.077097 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:53:04.077048    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/248847de-48dc-4cb1-aa31-e48dc53e7f10-original-pull-secret podName:248847de-48dc-4cb1-aa31-e48dc53e7f10 nodeName:}" failed. No retries permitted until 2026-05-28 14:53:06.077027382 +0000 UTC m=+6.166244106 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/248847de-48dc-4cb1-aa31-e48dc53e7f10-original-pull-secret") pod "global-pull-secret-syncer-5bqrk" (UID: "248847de-48dc-4cb1-aa31-e48dc53e7f10") : object "kube-system"/"original-pull-secret" not registered
May 28 14:53:04.177321 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:04.177276    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lfw6g\" (UniqueName: \"kubernetes.io/projected/49117ec2-5908-41bd-a305-59ddea54b26d-kube-api-access-lfw6g\") pod \"network-check-target-zj7gq\" (UID: \"49117ec2-5908-41bd-a305-59ddea54b26d\") " pod="openshift-network-diagnostics/network-check-target-zj7gq"
May 28 14:53:04.177514 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:53:04.177455    2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 28 14:53:04.177514 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:53:04.177475    2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 28 14:53:04.177514 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:53:04.177487    2563 projected.go:194] Error preparing data for projected volume kube-api-access-lfw6g for pod openshift-network-diagnostics/network-check-target-zj7gq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 14:53:04.177671 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:53:04.177544    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/49117ec2-5908-41bd-a305-59ddea54b26d-kube-api-access-lfw6g podName:49117ec2-5908-41bd-a305-59ddea54b26d nodeName:}" failed. No retries permitted until 2026-05-28 14:53:06.177527256 +0000 UTC m=+6.266743971 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-lfw6g" (UniqueName: "kubernetes.io/projected/49117ec2-5908-41bd-a305-59ddea54b26d-kube-api-access-lfw6g") pod "network-check-target-zj7gq" (UID: "49117ec2-5908-41bd-a305-59ddea54b26d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 14:53:04.475879 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:04.475827    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5bqrk"
May 28 14:53:04.476328 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:53:04.475957    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5bqrk" podUID="248847de-48dc-4cb1-aa31-e48dc53e7f10"
May 28 14:53:04.478759 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:04.478516    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zj7gq"
May 28 14:53:04.478759 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:53:04.478611    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zj7gq" podUID="49117ec2-5908-41bd-a305-59ddea54b26d"
May 28 14:53:04.506002 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:04.505971    2563 generic.go:358] "Generic (PLEG): container finished" podID="c495a4962e3de6b293414ea1b7e89480" containerID="07f6d9ffccb899df1e475b3a7fea4447eb210bf308a32d5d05e7f8609d928893" exitCode=0
May 28 14:53:04.506451 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:04.506429    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-84.ec2.internal" event={"ID":"c495a4962e3de6b293414ea1b7e89480","Type":"ContainerDied","Data":"07f6d9ffccb899df1e475b3a7fea4447eb210bf308a32d5d05e7f8609d928893"}
May 28 14:53:05.475149 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:05.475113    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v4dpk"
May 28 14:53:05.475333 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:53:05.475239    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v4dpk" podUID="b51f6e42-ac3f-47b9-8962-ec51c836ad35"
May 28 14:53:05.525231 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:05.525194    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-84.ec2.internal" event={"ID":"c495a4962e3de6b293414ea1b7e89480","Type":"ContainerStarted","Data":"ef0c7d993a1f2212ff5b77954359f0630f578d7286ec90b2f07137fb496a6b77"}
May 28 14:53:05.540607 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:05.539748    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-84.ec2.internal" podStartSLOduration=4.539730007 podStartE2EDuration="4.539730007s" podCreationTimestamp="2026-05-28 14:53:01 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 14:53:05.539346653 +0000 UTC m=+5.628563376" watchObservedRunningTime="2026-05-28 14:53:05.539730007 +0000 UTC m=+5.628946731"
May 28 14:53:05.992329 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:05.992292    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b51f6e42-ac3f-47b9-8962-ec51c836ad35-metrics-certs\") pod \"network-metrics-daemon-v4dpk\" (UID: \"b51f6e42-ac3f-47b9-8962-ec51c836ad35\") " pod="openshift-multus/network-metrics-daemon-v4dpk"
May 28 14:53:05.992541 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:53:05.992521    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 14:53:05.992618 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:53:05.992595    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b51f6e42-ac3f-47b9-8962-ec51c836ad35-metrics-certs podName:b51f6e42-ac3f-47b9-8962-ec51c836ad35 nodeName:}" failed. No retries permitted until 2026-05-28 14:53:09.992575446 +0000 UTC m=+10.081792161 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b51f6e42-ac3f-47b9-8962-ec51c836ad35-metrics-certs") pod "network-metrics-daemon-v4dpk" (UID: "b51f6e42-ac3f-47b9-8962-ec51c836ad35") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 14:53:06.094397 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:06.093806    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/248847de-48dc-4cb1-aa31-e48dc53e7f10-original-pull-secret\") pod \"global-pull-secret-syncer-5bqrk\" (UID: \"248847de-48dc-4cb1-aa31-e48dc53e7f10\") " pod="kube-system/global-pull-secret-syncer-5bqrk"
May 28 14:53:06.094397 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:53:06.093994    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 28 14:53:06.094397 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:53:06.094055    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/248847de-48dc-4cb1-aa31-e48dc53e7f10-original-pull-secret podName:248847de-48dc-4cb1-aa31-e48dc53e7f10 nodeName:}" failed. No retries permitted until 2026-05-28 14:53:10.094038119 +0000 UTC m=+10.183254826 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/248847de-48dc-4cb1-aa31-e48dc53e7f10-original-pull-secret") pod "global-pull-secret-syncer-5bqrk" (UID: "248847de-48dc-4cb1-aa31-e48dc53e7f10") : object "kube-system"/"original-pull-secret" not registered
May 28 14:53:06.195467 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:06.194800    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lfw6g\" (UniqueName: \"kubernetes.io/projected/49117ec2-5908-41bd-a305-59ddea54b26d-kube-api-access-lfw6g\") pod \"network-check-target-zj7gq\" (UID: \"49117ec2-5908-41bd-a305-59ddea54b26d\") " pod="openshift-network-diagnostics/network-check-target-zj7gq"
May 28 14:53:06.195467 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:53:06.195033    2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 28 14:53:06.195467 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:53:06.195054    2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 28 14:53:06.195467 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:53:06.195065    2563 projected.go:194] Error preparing data for projected volume kube-api-access-lfw6g for pod openshift-network-diagnostics/network-check-target-zj7gq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 14:53:06.195467 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:53:06.195126    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/49117ec2-5908-41bd-a305-59ddea54b26d-kube-api-access-lfw6g podName:49117ec2-5908-41bd-a305-59ddea54b26d nodeName:}" failed. No retries permitted until 2026-05-28 14:53:10.195107271 +0000 UTC m=+10.284323992 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-lfw6g" (UniqueName: "kubernetes.io/projected/49117ec2-5908-41bd-a305-59ddea54b26d-kube-api-access-lfw6g") pod "network-check-target-zj7gq" (UID: "49117ec2-5908-41bd-a305-59ddea54b26d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 14:53:06.475907 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:06.475818    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zj7gq"
May 28 14:53:06.475907 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:06.475845    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5bqrk"
May 28 14:53:06.476121 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:53:06.475973    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zj7gq" podUID="49117ec2-5908-41bd-a305-59ddea54b26d"
May 28 14:53:06.476121 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:53:06.476076    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5bqrk" podUID="248847de-48dc-4cb1-aa31-e48dc53e7f10"
May 28 14:53:07.475850 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:07.475815    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v4dpk"
May 28 14:53:07.476261 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:53:07.475970    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v4dpk" podUID="b51f6e42-ac3f-47b9-8962-ec51c836ad35"
May 28 14:53:08.475242 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:08.475212    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5bqrk"
May 28 14:53:08.475411 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:53:08.475341    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5bqrk" podUID="248847de-48dc-4cb1-aa31-e48dc53e7f10"
May 28 14:53:08.476156 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:08.476116    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zj7gq"
May 28 14:53:08.476517 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:53:08.476254    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zj7gq" podUID="49117ec2-5908-41bd-a305-59ddea54b26d"
May 28 14:53:09.475049 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:09.475018    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v4dpk"
May 28 14:53:09.475240 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:53:09.475160    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v4dpk" podUID="b51f6e42-ac3f-47b9-8962-ec51c836ad35"
May 28 14:53:10.036483 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:10.036443    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b51f6e42-ac3f-47b9-8962-ec51c836ad35-metrics-certs\") pod \"network-metrics-daemon-v4dpk\" (UID: \"b51f6e42-ac3f-47b9-8962-ec51c836ad35\") " pod="openshift-multus/network-metrics-daemon-v4dpk"
May 28 14:53:10.036852 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:53:10.036607    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 14:53:10.036852 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:53:10.036696    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b51f6e42-ac3f-47b9-8962-ec51c836ad35-metrics-certs podName:b51f6e42-ac3f-47b9-8962-ec51c836ad35 nodeName:}" failed. No retries permitted until 2026-05-28 14:53:18.036655191 +0000 UTC m=+18.125871903 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b51f6e42-ac3f-47b9-8962-ec51c836ad35-metrics-certs") pod "network-metrics-daemon-v4dpk" (UID: "b51f6e42-ac3f-47b9-8962-ec51c836ad35") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 14:53:10.136898 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:10.136855    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/248847de-48dc-4cb1-aa31-e48dc53e7f10-original-pull-secret\") pod \"global-pull-secret-syncer-5bqrk\" (UID: \"248847de-48dc-4cb1-aa31-e48dc53e7f10\") " pod="kube-system/global-pull-secret-syncer-5bqrk"
May 28 14:53:10.137119 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:53:10.137100    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 28 14:53:10.137183 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:53:10.137172    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/248847de-48dc-4cb1-aa31-e48dc53e7f10-original-pull-secret podName:248847de-48dc-4cb1-aa31-e48dc53e7f10 nodeName:}" failed. No retries permitted until 2026-05-28 14:53:18.137154234 +0000 UTC m=+18.226370951 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/248847de-48dc-4cb1-aa31-e48dc53e7f10-original-pull-secret") pod "global-pull-secret-syncer-5bqrk" (UID: "248847de-48dc-4cb1-aa31-e48dc53e7f10") : object "kube-system"/"original-pull-secret" not registered
May 28 14:53:10.237707 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:10.237654    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lfw6g\" (UniqueName: \"kubernetes.io/projected/49117ec2-5908-41bd-a305-59ddea54b26d-kube-api-access-lfw6g\") pod \"network-check-target-zj7gq\" (UID: \"49117ec2-5908-41bd-a305-59ddea54b26d\") " pod="openshift-network-diagnostics/network-check-target-zj7gq"
May 28 14:53:10.237868 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:53:10.237838    2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 28 14:53:10.237868 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:53:10.237857    2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 28 14:53:10.237868 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:53:10.237869    2563 projected.go:194] Error preparing data for projected volume kube-api-access-lfw6g for pod openshift-network-diagnostics/network-check-target-zj7gq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 14:53:10.238048 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:53:10.237926    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/49117ec2-5908-41bd-a305-59ddea54b26d-kube-api-access-lfw6g podName:49117ec2-5908-41bd-a305-59ddea54b26d nodeName:}" failed. No retries permitted until 2026-05-28 14:53:18.237908288 +0000 UTC m=+18.327125005 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-lfw6g" (UniqueName: "kubernetes.io/projected/49117ec2-5908-41bd-a305-59ddea54b26d-kube-api-access-lfw6g") pod "network-check-target-zj7gq" (UID: "49117ec2-5908-41bd-a305-59ddea54b26d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 14:53:10.476331 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:10.476248    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5bqrk"
May 28 14:53:10.476331 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:10.476259    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zj7gq"
May 28 14:53:10.476540 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:53:10.476368    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5bqrk" podUID="248847de-48dc-4cb1-aa31-e48dc53e7f10"
May 28 14:53:10.476540 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:53:10.476464    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zj7gq" podUID="49117ec2-5908-41bd-a305-59ddea54b26d"
May 28 14:53:11.475630 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:11.475584    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v4dpk"
May 28 14:53:11.476096 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:53:11.475748    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v4dpk" podUID="b51f6e42-ac3f-47b9-8962-ec51c836ad35"
May 28 14:53:12.475503 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:12.475469    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zj7gq"
May 28 14:53:12.475671 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:12.475474    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5bqrk"
May 28 14:53:12.475671 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:53:12.475602    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zj7gq" podUID="49117ec2-5908-41bd-a305-59ddea54b26d"
May 28 14:53:12.476077 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:53:12.475690    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5bqrk" podUID="248847de-48dc-4cb1-aa31-e48dc53e7f10"
May 28 14:53:13.474930 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:13.474852    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v4dpk"
May 28 14:53:13.475074 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:53:13.474974    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v4dpk" podUID="b51f6e42-ac3f-47b9-8962-ec51c836ad35"
May 28 14:53:14.475928 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:14.475893    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zj7gq"
May 28 14:53:14.476362 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:53:14.476020    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zj7gq" podUID="49117ec2-5908-41bd-a305-59ddea54b26d"
May 28 14:53:14.476448 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:14.475893    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5bqrk"
May 28 14:53:14.476538 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:53:14.476517    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5bqrk" podUID="248847de-48dc-4cb1-aa31-e48dc53e7f10"
May 28 14:53:15.475048 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:15.475019    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v4dpk"
May 28 14:53:15.475202 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:53:15.475123    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v4dpk" podUID="b51f6e42-ac3f-47b9-8962-ec51c836ad35"
May 28 14:53:16.475592 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:16.475343    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5bqrk"
May 28 14:53:16.476032 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:16.475400    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zj7gq"
May 28 14:53:16.476032 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:53:16.475717    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5bqrk" podUID="248847de-48dc-4cb1-aa31-e48dc53e7f10"
May 28 14:53:16.476032 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:53:16.475794    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zj7gq" podUID="49117ec2-5908-41bd-a305-59ddea54b26d"
May 28 14:53:17.475936 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:17.475904    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v4dpk"
May 28 14:53:17.476297 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:53:17.476028    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v4dpk" podUID="b51f6e42-ac3f-47b9-8962-ec51c836ad35"
May 28 14:53:18.098395 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:18.098351    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b51f6e42-ac3f-47b9-8962-ec51c836ad35-metrics-certs\") pod \"network-metrics-daemon-v4dpk\" (UID: \"b51f6e42-ac3f-47b9-8962-ec51c836ad35\") " pod="openshift-multus/network-metrics-daemon-v4dpk"
May 28 14:53:18.098570 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:53:18.098523    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 14:53:18.098645 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:53:18.098604    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b51f6e42-ac3f-47b9-8962-ec51c836ad35-metrics-certs podName:b51f6e42-ac3f-47b9-8962-ec51c836ad35 nodeName:}" failed. No retries permitted until 2026-05-28 14:53:34.09858259 +0000 UTC m=+34.187799299 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b51f6e42-ac3f-47b9-8962-ec51c836ad35-metrics-certs") pod "network-metrics-daemon-v4dpk" (UID: "b51f6e42-ac3f-47b9-8962-ec51c836ad35") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 14:53:18.199730 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:18.199690    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/248847de-48dc-4cb1-aa31-e48dc53e7f10-original-pull-secret\") pod \"global-pull-secret-syncer-5bqrk\" (UID: \"248847de-48dc-4cb1-aa31-e48dc53e7f10\") " pod="kube-system/global-pull-secret-syncer-5bqrk"
May 28 14:53:18.199898 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:53:18.199788    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 28 14:53:18.199898 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:53:18.199864    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/248847de-48dc-4cb1-aa31-e48dc53e7f10-original-pull-secret podName:248847de-48dc-4cb1-aa31-e48dc53e7f10 nodeName:}" failed. No retries permitted until 2026-05-28 14:53:34.199848974 +0000 UTC m=+34.289065680 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/248847de-48dc-4cb1-aa31-e48dc53e7f10-original-pull-secret") pod "global-pull-secret-syncer-5bqrk" (UID: "248847de-48dc-4cb1-aa31-e48dc53e7f10") : object "kube-system"/"original-pull-secret" not registered
May 28 14:53:18.300955 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:18.300911    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lfw6g\" (UniqueName: \"kubernetes.io/projected/49117ec2-5908-41bd-a305-59ddea54b26d-kube-api-access-lfw6g\") pod \"network-check-target-zj7gq\" (UID: \"49117ec2-5908-41bd-a305-59ddea54b26d\") " pod="openshift-network-diagnostics/network-check-target-zj7gq"
May 28 14:53:18.301147 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:53:18.301123    2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 28 14:53:18.301213 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:53:18.301152    2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 28 14:53:18.301213 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:53:18.301167    2563 projected.go:194] Error preparing data for projected volume kube-api-access-lfw6g for pod openshift-network-diagnostics/network-check-target-zj7gq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 14:53:18.301305 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:53:18.301235    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/49117ec2-5908-41bd-a305-59ddea54b26d-kube-api-access-lfw6g podName:49117ec2-5908-41bd-a305-59ddea54b26d nodeName:}" failed. No retries permitted until 2026-05-28 14:53:34.301216115 +0000 UTC m=+34.390432842 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-lfw6g" (UniqueName: "kubernetes.io/projected/49117ec2-5908-41bd-a305-59ddea54b26d-kube-api-access-lfw6g") pod "network-check-target-zj7gq" (UID: "49117ec2-5908-41bd-a305-59ddea54b26d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 14:53:18.475172 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:18.475085    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5bqrk"
May 28 14:53:18.475333 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:53:18.475207    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5bqrk" podUID="248847de-48dc-4cb1-aa31-e48dc53e7f10"
May 28 14:53:18.475333 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:18.475260    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zj7gq"
May 28 14:53:18.475447 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:53:18.475361    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zj7gq" podUID="49117ec2-5908-41bd-a305-59ddea54b26d"
May 28 14:53:19.475258 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:19.475224    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v4dpk"
May 28 14:53:19.475635 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:53:19.475354    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v4dpk" podUID="b51f6e42-ac3f-47b9-8962-ec51c836ad35"
May 28 14:53:20.476376 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:20.476344    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zj7gq"
May 28 14:53:20.476857 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:53:20.476447    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zj7gq" podUID="49117ec2-5908-41bd-a305-59ddea54b26d"
May 28 14:53:20.476857 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:20.476520    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5bqrk"
May 28 14:53:20.476857 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:53:20.476598    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5bqrk" podUID="248847de-48dc-4cb1-aa31-e48dc53e7f10"
May 28 14:53:21.475752 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:21.475555    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v4dpk"
May 28 14:53:21.475883 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:53:21.475864    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v4dpk" podUID="b51f6e42-ac3f-47b9-8962-ec51c836ad35"
May 28 14:53:21.554229 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:21.554198    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-lj62g" event={"ID":"f9b48604-9b1a-4e1d-96ce-b27af88be3ef","Type":"ContainerStarted","Data":"7a94bcf63c26d2ca55eaa7e97b1cce867ef1da54ce2494be86470ccd7a1d6923"}
May 28 14:53:21.558633 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:21.558605    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ssv8l_f3df342f-512f-410a-8b64-171bc7255a0e/ovn-acl-logging/0.log"
May 28 14:53:21.558943 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:21.558921    2563 generic.go:358] "Generic (PLEG): container finished" podID="f3df342f-512f-410a-8b64-171bc7255a0e" containerID="e3fa3a4785e1c04c389a71207d5d63c9088129345d45bd2cb7289f6841a32b38" exitCode=1
May 28 14:53:21.559039 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:21.558979    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ssv8l" event={"ID":"f3df342f-512f-410a-8b64-171bc7255a0e","Type":"ContainerStarted","Data":"c31777f692dc16fb0b28bfe342bb5d8e297ee82aea511a0b817b64ed325ef098"}
May 28 14:53:21.559039 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:21.558999    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ssv8l" event={"ID":"f3df342f-512f-410a-8b64-171bc7255a0e","Type":"ContainerDied","Data":"e3fa3a4785e1c04c389a71207d5d63c9088129345d45bd2cb7289f6841a32b38"}
May 28 14:53:21.559039 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:21.559015    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ssv8l" event={"ID":"f3df342f-512f-410a-8b64-171bc7255a0e","Type":"ContainerStarted","Data":"dd7113ffcaed7ddd6a7ab43aba772c03c01302f0b4aceccd11415e0713a71023"}
May 28 14:53:21.560240 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:21.560221    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-r8s4x" event={"ID":"5e470d5c-c76c-452d-8add-a20856bab41f","Type":"ContainerStarted","Data":"a5e65d09f3bc4e10717499ef2766c9e55503defb69e565d02617de44b24402ec"}
May 28 14:53:21.561531 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:21.561510    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-nldsr" event={"ID":"163ec1a8-e490-49fe-91c4-5536fe100364","Type":"ContainerStarted","Data":"46be624749089fa7768a8946dbdb05258a17d5303a1d713c4e0ef52c3bc3bd79"}
May 28 14:53:21.562847 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:21.562822    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-889lh" event={"ID":"0595a2ba-deef-42af-aef6-ad8abc4fbfba","Type":"ContainerStarted","Data":"c9a6a91264511ef9576da786ed0489d920859c1dbc351d6aada15e23f0ae008f"}
May 28 14:53:21.564186 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:21.564167    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k8rjj" event={"ID":"abda2870-be5c-44d4-8ba7-1d2d057e36df","Type":"ContainerStarted","Data":"603821047d25a3b9d5432095de1905ca72730026a90404726781eb1e60fed86d"}
May 28 14:53:21.566219 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:21.566198    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l8h9g" event={"ID":"9be2177d-67fc-4eec-aa1a-bbe5602495d5","Type":"ContainerStarted","Data":"cb655ea1966b83d0eaa6b187be4ca2170a97fb53b72099a2c768b8fe04cb76cd"}
May 28 14:53:21.567699 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:21.567459    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-mh529" event={"ID":"18e17dc3-da42-4b11-8f21-5eb66227c6f7","Type":"ContainerStarted","Data":"051f3f1a1f94c0bada446cf8f07e67f690bc0bca7cdbb28ed5ece1a510d88c2b"}
May 28 14:53:21.571455 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:21.571410    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-lj62g" podStartSLOduration=3.626569942 podStartE2EDuration="21.571394119s" podCreationTimestamp="2026-05-28 14:53:00 +0000 UTC" firstStartedPulling="2026-05-28 14:53:03.154541968 +0000 UTC m=+3.243758675" lastFinishedPulling="2026-05-28 14:53:21.099366147 +0000 UTC m=+21.188582852" observedRunningTime="2026-05-28 14:53:21.570745793 +0000 UTC m=+21.659962518" watchObservedRunningTime="2026-05-28 14:53:21.571394119 +0000 UTC m=+21.660610843"
May 28 14:53:21.583491 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:21.583455    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-889lh" podStartSLOduration=7.505764872 podStartE2EDuration="21.583444483s" podCreationTimestamp="2026-05-28 14:53:00 +0000 UTC" firstStartedPulling="2026-05-28 14:53:03.156088656 +0000 UTC m=+3.245305357" lastFinishedPulling="2026-05-28 14:53:17.233768264 +0000 UTC m=+17.322984968" observedRunningTime="2026-05-28 14:53:21.583405297 +0000 UTC m=+21.672622021" watchObservedRunningTime="2026-05-28 14:53:21.583444483 +0000 UTC m=+21.672661205"
May 28 14:53:21.585629 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:21.585611    2563 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-889lh"
May 28 14:53:21.586480 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:21.586460    2563 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-889lh"
May 28 14:53:21.600751 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:21.600710    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-nldsr" podStartSLOduration=3.610107658 podStartE2EDuration="21.600696689s" podCreationTimestamp="2026-05-28 14:53:00 +0000 UTC" firstStartedPulling="2026-05-28 14:53:03.144327688 +0000 UTC m=+3.233544403" lastFinishedPulling="2026-05-28 14:53:21.13491673 +0000 UTC m=+21.224133434" observedRunningTime="2026-05-28 14:53:21.600611834 +0000 UTC m=+21.689828563" watchObservedRunningTime="2026-05-28 14:53:21.600696689 +0000 UTC m=+21.689913411"
May 28 14:53:21.632516 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:21.632464    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-mh529" podStartSLOduration=3.679266981 podStartE2EDuration="21.632447285s" podCreationTimestamp="2026-05-28 14:53:00 +0000 UTC" firstStartedPulling="2026-05-28 14:53:03.142735885 +0000 UTC m=+3.231952586" lastFinishedPulling="2026-05-28 14:53:21.095916174 +0000 UTC m=+21.185132890" observedRunningTime="2026-05-28 14:53:21.632341155 +0000 UTC m=+21.721557883" watchObservedRunningTime="2026-05-28 14:53:21.632447285 +0000 UTC m=+21.721664009"
May 28 14:53:21.663230 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:21.663190    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-r8s4x" podStartSLOduration=3.716239157 podStartE2EDuration="21.663175536s" podCreationTimestamp="2026-05-28 14:53:00 +0000 UTC" firstStartedPulling="2026-05-28 14:53:03.149304898 +0000 UTC m=+3.238521599" lastFinishedPulling="2026-05-28 14:53:21.096241262 +0000 UTC m=+21.185457978" observedRunningTime="2026-05-28 14:53:21.648523641 +0000 UTC m=+21.737740395" watchObservedRunningTime="2026-05-28 14:53:21.663175536 +0000 UTC m=+21.752392298"
May 28 14:53:22.475110 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:22.475079    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zj7gq"
May 28 14:53:22.475296 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:22.475079    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5bqrk"
May 28 14:53:22.475296 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:53:22.475211    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zj7gq" podUID="49117ec2-5908-41bd-a305-59ddea54b26d"
May 28 14:53:22.475296 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:53:22.475287    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5bqrk" podUID="248847de-48dc-4cb1-aa31-e48dc53e7f10"
May 28 14:53:22.532880 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:22.532840    2563 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
May 28 14:53:22.571142 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:22.571107    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-khjnn" event={"ID":"aeb6de40-615c-4781-981a-ff9fded37a6e","Type":"ContainerStarted","Data":"722cb5c59173a10bf768093ac34fa1f27853447fc4449cd14880ffde4bc41d5f"}
May 28 14:53:22.572884 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:22.572852    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k8rjj" event={"ID":"abda2870-be5c-44d4-8ba7-1d2d057e36df","Type":"ContainerStarted","Data":"9a0a9923781662a05bdb63010407cb9e9f5c4071505ac8a48e42bdf060f340cb"}
May 28 14:53:22.574310 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:22.574283    2563 generic.go:358] "Generic (PLEG): container finished" podID="9be2177d-67fc-4eec-aa1a-bbe5602495d5" containerID="cb655ea1966b83d0eaa6b187be4ca2170a97fb53b72099a2c768b8fe04cb76cd" exitCode=0
May 28 14:53:22.574423 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:22.574356    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l8h9g" event={"ID":"9be2177d-67fc-4eec-aa1a-bbe5602495d5","Type":"ContainerDied","Data":"cb655ea1966b83d0eaa6b187be4ca2170a97fb53b72099a2c768b8fe04cb76cd"}
May 28 14:53:22.576945 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:22.576928    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ssv8l_f3df342f-512f-410a-8b64-171bc7255a0e/ovn-acl-logging/0.log"
May 28 14:53:22.577352 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:22.577331    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ssv8l" event={"ID":"f3df342f-512f-410a-8b64-171bc7255a0e","Type":"ContainerStarted","Data":"8f1c0f0d67a20b44629f9706b3ede0c0d6362747ed3ea84913fe1cdf634419e2"}
May 28 14:53:22.577447 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:22.577366    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ssv8l" event={"ID":"f3df342f-512f-410a-8b64-171bc7255a0e","Type":"ContainerStarted","Data":"d929b86b144db4c19d1c3c35cf09ae398ecff6fc3637e83ffa68f95f0e8b8336"}
May 28 14:53:22.577447 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:22.577383    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ssv8l" event={"ID":"f3df342f-512f-410a-8b64-171bc7255a0e","Type":"ContainerStarted","Data":"8f6e1720c63e5e235f89240ee5817c6c5175a63c873c3983bcf21574965e8a5a"}
May 28 14:53:22.577621 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:22.577606    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-889lh"
May 28 14:53:22.578085 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:22.578066    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-889lh"
May 28 14:53:22.588382 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:22.588336    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-khjnn" podStartSLOduration=4.646023266 podStartE2EDuration="22.588324969s" podCreationTimestamp="2026-05-28 14:53:00 +0000 UTC" firstStartedPulling="2026-05-28 14:53:03.154223568 +0000 UTC m=+3.243440270" lastFinishedPulling="2026-05-28 14:53:21.096525269 +0000 UTC m=+21.185741973" observedRunningTime="2026-05-28 14:53:22.587715532 +0000 UTC m=+22.676932256" watchObservedRunningTime="2026-05-28 14:53:22.588324969 +0000 UTC m=+22.677541693"
May 28 14:53:23.418839 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:23.418668    2563 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-28T14:53:22.532864482Z","UUID":"0be81205-5c4c-407e-98c7-b6a0466b40e2","Handler":null,"Name":"","Endpoint":""}
May 28 14:53:23.420730 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:23.420711    2563 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
May 28 14:53:23.420856 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:23.420737    2563 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
May 28 14:53:23.475252 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:23.475217    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v4dpk"
May 28 14:53:23.475434 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:53:23.475360    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v4dpk" podUID="b51f6e42-ac3f-47b9-8962-ec51c836ad35"
May 28 14:53:24.475468 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:24.475434    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zj7gq"
May 28 14:53:24.475468 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:24.475461    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5bqrk"
May 28 14:53:24.476081 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:53:24.475561    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zj7gq" podUID="49117ec2-5908-41bd-a305-59ddea54b26d"
May 28 14:53:24.476081 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:53:24.475711    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5bqrk" podUID="248847de-48dc-4cb1-aa31-e48dc53e7f10"
May 28 14:53:24.583256 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:24.583226    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ssv8l_f3df342f-512f-410a-8b64-171bc7255a0e/ovn-acl-logging/0.log"
May 28 14:53:24.583542 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:24.583511    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ssv8l" event={"ID":"f3df342f-512f-410a-8b64-171bc7255a0e","Type":"ContainerStarted","Data":"a335b35be69370ee55c11a61a5251447cc926b6f3ec9ce089cef7af96b2e3b00"}
May 28 14:53:24.585215 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:24.585190    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k8rjj" event={"ID":"abda2870-be5c-44d4-8ba7-1d2d057e36df","Type":"ContainerStarted","Data":"25e20550d0df402269bdc6835f701965611ffd8ee2cd29b1103121ab4c850fc5"}
May 28 14:53:24.602060 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:24.602021    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k8rjj" podStartSLOduration=4.156788628 podStartE2EDuration="24.60199335s" podCreationTimestamp="2026-05-28 14:53:00 +0000 UTC" firstStartedPulling="2026-05-28 14:53:03.15031945 +0000 UTC m=+3.239536161" lastFinishedPulling="2026-05-28 14:53:23.595524182 +0000 UTC m=+23.684740883" observedRunningTime="2026-05-28 14:53:24.601211654 +0000 UTC m=+24.690428377" watchObservedRunningTime="2026-05-28 14:53:24.60199335 +0000 UTC m=+24.691210113"
May 28 14:53:25.475120 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:25.475080    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v4dpk"
May 28 14:53:25.475287 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:53:25.475199    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v4dpk" podUID="b51f6e42-ac3f-47b9-8962-ec51c836ad35"
May 28 14:53:26.474980 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:26.474898    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zj7gq"
May 28 14:53:26.475524 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:53:26.475013    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zj7gq" podUID="49117ec2-5908-41bd-a305-59ddea54b26d"
May 28 14:53:26.475524 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:26.475071    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5bqrk"
May 28 14:53:26.475524 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:53:26.475187    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5bqrk" podUID="248847de-48dc-4cb1-aa31-e48dc53e7f10"
May 28 14:53:27.475864 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:27.475664    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v4dpk"
May 28 14:53:27.476310 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:53:27.475947    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v4dpk" podUID="b51f6e42-ac3f-47b9-8962-ec51c836ad35"
May 28 14:53:27.592512 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:27.592487    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ssv8l_f3df342f-512f-410a-8b64-171bc7255a0e/ovn-acl-logging/0.log"
May 28 14:53:27.592812 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:27.592782    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ssv8l" event={"ID":"f3df342f-512f-410a-8b64-171bc7255a0e","Type":"ContainerStarted","Data":"d5ea5bb9d9f348f74d4efa2121b15483b6c2c233f1f2b6fe26ed49d9d38b98d7"}
May 28 14:53:27.593196 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:27.593177    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ssv8l"
May 28 14:53:27.593196 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:27.593214    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ssv8l"
May 28 14:53:27.593360 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:27.593228    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ssv8l"
May 28 14:53:27.593360 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:27.593237    2563 scope.go:117] "RemoveContainer" containerID="e3fa3a4785e1c04c389a71207d5d63c9088129345d45bd2cb7289f6841a32b38"
May 28 14:53:27.594651 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:27.594629    2563 generic.go:358] "Generic (PLEG): container finished" podID="9be2177d-67fc-4eec-aa1a-bbe5602495d5" containerID="2daaa8a94bd75f70ac6941af35f55ffc83a56c0dda7dd3cdedb8506a4b4932a9" exitCode=0
May 28 14:53:27.594749 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:27.594668    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l8h9g" event={"ID":"9be2177d-67fc-4eec-aa1a-bbe5602495d5","Type":"ContainerDied","Data":"2daaa8a94bd75f70ac6941af35f55ffc83a56c0dda7dd3cdedb8506a4b4932a9"}
May 28 14:53:27.610060 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:27.610044    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ssv8l"
May 28 14:53:27.610720 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:27.610707    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ssv8l"
May 28 14:53:28.475825 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:28.475587    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zj7gq"
May 28 14:53:28.475973 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:28.475642    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5bqrk"
May 28 14:53:28.475973 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:53:28.475932    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zj7gq" podUID="49117ec2-5908-41bd-a305-59ddea54b26d"
May 28 14:53:28.476350 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:53:28.476017    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5bqrk" podUID="248847de-48dc-4cb1-aa31-e48dc53e7f10"
May 28 14:53:28.599778 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:28.599720    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ssv8l_f3df342f-512f-410a-8b64-171bc7255a0e/ovn-acl-logging/0.log"
May 28 14:53:28.600093 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:28.600071    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ssv8l" event={"ID":"f3df342f-512f-410a-8b64-171bc7255a0e","Type":"ContainerStarted","Data":"1e4d734f415ff1687897059ec6c59c9e813a169e85ce869807c3b5c3128d6853"}
May 28 14:53:28.601784 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:28.601762    2563 generic.go:358] "Generic (PLEG): container finished" podID="9be2177d-67fc-4eec-aa1a-bbe5602495d5" containerID="8b58cc6facb41768b2715a6af8f210d6da1a81cb2d97c7f4eb1bbd759f500fe3" exitCode=0
May 28 14:53:28.601908 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:28.601792    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l8h9g" event={"ID":"9be2177d-67fc-4eec-aa1a-bbe5602495d5","Type":"ContainerDied","Data":"8b58cc6facb41768b2715a6af8f210d6da1a81cb2d97c7f4eb1bbd759f500fe3"}
May 28 14:53:28.648264 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:28.648217    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-ssv8l" podStartSLOduration=10.680898067 podStartE2EDuration="28.648205268s" podCreationTimestamp="2026-05-28 14:53:00 +0000 UTC" firstStartedPulling="2026-05-28 14:53:03.151813472 +0000 UTC m=+3.241030179" lastFinishedPulling="2026-05-28 14:53:21.119120676 +0000 UTC m=+21.208337380" observedRunningTime="2026-05-28 14:53:28.643175033 +0000 UTC m=+28.732391780" watchObservedRunningTime="2026-05-28 14:53:28.648205268 +0000 UTC m=+28.737421991"
May 28 14:53:28.686407 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:28.686381    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-5bqrk"]
May 28 14:53:28.686519 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:28.686476    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5bqrk"
May 28 14:53:28.686581 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:53:28.686566    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5bqrk" podUID="248847de-48dc-4cb1-aa31-e48dc53e7f10"
May 28 14:53:28.689713 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:28.689686    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-zj7gq"]
May 28 14:53:28.689832 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:28.689789    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zj7gq"
May 28 14:53:28.689893 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:53:28.689874    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zj7gq" podUID="49117ec2-5908-41bd-a305-59ddea54b26d"
May 28 14:53:28.690391 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:28.690368    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-v4dpk"]
May 28 14:53:28.690501 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:28.690488    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v4dpk"
May 28 14:53:28.690631 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:53:28.690607    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v4dpk" podUID="b51f6e42-ac3f-47b9-8962-ec51c836ad35"
May 28 14:53:29.606053 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:29.605968    2563 generic.go:358] "Generic (PLEG): container finished" podID="9be2177d-67fc-4eec-aa1a-bbe5602495d5" containerID="97cb44b3ca5047fe61d3c23d4dc5e5ce52c66adf5b100a13ab8aea06c5bacbda" exitCode=0
May 28 14:53:29.606053 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:29.606042    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l8h9g" event={"ID":"9be2177d-67fc-4eec-aa1a-bbe5602495d5","Type":"ContainerDied","Data":"97cb44b3ca5047fe61d3c23d4dc5e5ce52c66adf5b100a13ab8aea06c5bacbda"}
May 28 14:53:30.476350 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:30.476247    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v4dpk"
May 28 14:53:30.476482 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:30.476359    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zj7gq"
May 28 14:53:30.476482 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:30.476390    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5bqrk"
May 28 14:53:30.476482 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:53:30.476420    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v4dpk" podUID="b51f6e42-ac3f-47b9-8962-ec51c836ad35"
May 28 14:53:30.476482 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:53:30.476458    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5bqrk" podUID="248847de-48dc-4cb1-aa31-e48dc53e7f10"
May 28 14:53:30.476654 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:53:30.476523    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zj7gq" podUID="49117ec2-5908-41bd-a305-59ddea54b26d"
May 28 14:53:32.475113 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:32.475076    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5bqrk"
May 28 14:53:32.475113 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:32.475109    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zj7gq"
May 28 14:53:32.475855 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:53:32.475211    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5bqrk" podUID="248847de-48dc-4cb1-aa31-e48dc53e7f10"
May 28 14:53:32.475855 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:53:32.475274    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zj7gq" podUID="49117ec2-5908-41bd-a305-59ddea54b26d"
May 28 14:53:32.475855 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:32.475326    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v4dpk"
May 28 14:53:32.475855 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:53:32.475431    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v4dpk" podUID="b51f6e42-ac3f-47b9-8962-ec51c836ad35"
May 28 14:53:34.117563 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:34.117444    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b51f6e42-ac3f-47b9-8962-ec51c836ad35-metrics-certs\") pod \"network-metrics-daemon-v4dpk\" (UID: \"b51f6e42-ac3f-47b9-8962-ec51c836ad35\") " pod="openshift-multus/network-metrics-daemon-v4dpk"
May 28 14:53:34.118283 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:53:34.117576    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 14:53:34.118283 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:53:34.117643    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b51f6e42-ac3f-47b9-8962-ec51c836ad35-metrics-certs podName:b51f6e42-ac3f-47b9-8962-ec51c836ad35 nodeName:}" failed. No retries permitted until 2026-05-28 14:54:06.117623945 +0000 UTC m=+66.206840664 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b51f6e42-ac3f-47b9-8962-ec51c836ad35-metrics-certs") pod "network-metrics-daemon-v4dpk" (UID: "b51f6e42-ac3f-47b9-8962-ec51c836ad35") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 14:53:34.218078 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:34.218045    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/248847de-48dc-4cb1-aa31-e48dc53e7f10-original-pull-secret\") pod \"global-pull-secret-syncer-5bqrk\" (UID: \"248847de-48dc-4cb1-aa31-e48dc53e7f10\") " pod="kube-system/global-pull-secret-syncer-5bqrk"
May 28 14:53:34.218267 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:53:34.218223    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 28 14:53:34.218328 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:53:34.218293    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/248847de-48dc-4cb1-aa31-e48dc53e7f10-original-pull-secret podName:248847de-48dc-4cb1-aa31-e48dc53e7f10 nodeName:}" failed. No retries permitted until 2026-05-28 14:54:06.218274976 +0000 UTC m=+66.307491696 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/248847de-48dc-4cb1-aa31-e48dc53e7f10-original-pull-secret") pod "global-pull-secret-syncer-5bqrk" (UID: "248847de-48dc-4cb1-aa31-e48dc53e7f10") : object "kube-system"/"original-pull-secret" not registered
May 28 14:53:34.319119 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:34.319077    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lfw6g\" (UniqueName: \"kubernetes.io/projected/49117ec2-5908-41bd-a305-59ddea54b26d-kube-api-access-lfw6g\") pod \"network-check-target-zj7gq\" (UID: \"49117ec2-5908-41bd-a305-59ddea54b26d\") " pod="openshift-network-diagnostics/network-check-target-zj7gq"
May 28 14:53:34.319300 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:53:34.319282    2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 28 14:53:34.319366 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:53:34.319308    2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 28 14:53:34.319366 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:53:34.319324    2563 projected.go:194] Error preparing data for projected volume kube-api-access-lfw6g for pod openshift-network-diagnostics/network-check-target-zj7gq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 14:53:34.319458 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:53:34.319393    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/49117ec2-5908-41bd-a305-59ddea54b26d-kube-api-access-lfw6g podName:49117ec2-5908-41bd-a305-59ddea54b26d nodeName:}" failed. No retries permitted until 2026-05-28 14:54:06.319371873 +0000 UTC m=+66.408588589 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-lfw6g" (UniqueName: "kubernetes.io/projected/49117ec2-5908-41bd-a305-59ddea54b26d-kube-api-access-lfw6g") pod "network-check-target-zj7gq" (UID: "49117ec2-5908-41bd-a305-59ddea54b26d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 14:53:34.475365 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:34.475281    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5bqrk"
May 28 14:53:34.475516 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:34.475281    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zj7gq"
May 28 14:53:34.475516 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:53:34.475432    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5bqrk" podUID="248847de-48dc-4cb1-aa31-e48dc53e7f10"
May 28 14:53:34.475516 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:34.475281    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v4dpk"
May 28 14:53:34.475516 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:53:34.475472    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zj7gq" podUID="49117ec2-5908-41bd-a305-59ddea54b26d"
May 28 14:53:34.475746 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:53:34.475584    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v4dpk" podUID="b51f6e42-ac3f-47b9-8962-ec51c836ad35"
May 28 14:53:35.266471 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:35.266445    2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-84.ec2.internal" event="NodeReady"
May 28 14:53:35.266999 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:35.266585    2563 kubelet_node_status.go:550] "Fast updating node status as it just became ready"
May 28 14:53:35.311702 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:35.311648    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-zctlp"]
May 28 14:53:35.323423 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:35.323399    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-jwwzh"]
May 28 14:53:35.323570 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:35.323550    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-zctlp"
May 28 14:53:35.325970 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:35.325950    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
May 28 14:53:35.326090 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:35.326036    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
May 28 14:53:35.326194 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:35.326176    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-gqk5j\""
May 28 14:53:35.338515 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:35.338497    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-jwwzh"]
May 28 14:53:35.338623 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:35.338522    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-zctlp"]
May 28 14:53:35.338697 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:35.338623    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-jwwzh"
May 28 14:53:35.341217 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:35.341199    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
May 28 14:53:35.341320 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:35.341255    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
May 28 14:53:35.341320 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:35.341282    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
May 28 14:53:35.341569 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:35.341554    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-znwr4\""
May 28 14:53:35.427797 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:35.427768    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/bdc2b7e1-35af-42c7-8ec3-742be0e080fa-config-volume\") pod \"dns-default-zctlp\" (UID: \"bdc2b7e1-35af-42c7-8ec3-742be0e080fa\") " pod="openshift-dns/dns-default-zctlp"
May 28 14:53:35.427797 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:35.427797    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bdc2b7e1-35af-42c7-8ec3-742be0e080fa-metrics-tls\") pod \"dns-default-zctlp\" (UID: \"bdc2b7e1-35af-42c7-8ec3-742be0e080fa\") " pod="openshift-dns/dns-default-zctlp"
May 28 14:53:35.428023 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:35.427872    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-88xcv\" (UniqueName: \"kubernetes.io/projected/2879a5eb-fff7-4733-b061-ce7d4f8016e7-kube-api-access-88xcv\") pod \"ingress-canary-jwwzh\" (UID: \"2879a5eb-fff7-4733-b061-ce7d4f8016e7\") " pod="openshift-ingress-canary/ingress-canary-jwwzh"
May 28 14:53:35.428023 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:35.427931    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bdc2b7e1-35af-42c7-8ec3-742be0e080fa-tmp-dir\") pod \"dns-default-zctlp\" (UID: \"bdc2b7e1-35af-42c7-8ec3-742be0e080fa\") " pod="openshift-dns/dns-default-zctlp"
May 28 14:53:35.428023 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:35.427989    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2879a5eb-fff7-4733-b061-ce7d4f8016e7-cert\") pod \"ingress-canary-jwwzh\" (UID: \"2879a5eb-fff7-4733-b061-ce7d4f8016e7\") " pod="openshift-ingress-canary/ingress-canary-jwwzh"
May 28 14:53:35.428023 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:35.428010    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x76j6\" (UniqueName: \"kubernetes.io/projected/bdc2b7e1-35af-42c7-8ec3-742be0e080fa-kube-api-access-x76j6\") pod \"dns-default-zctlp\" (UID: \"bdc2b7e1-35af-42c7-8ec3-742be0e080fa\") " pod="openshift-dns/dns-default-zctlp"
May 28 14:53:35.528741 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:35.528656    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/bdc2b7e1-35af-42c7-8ec3-742be0e080fa-config-volume\") pod \"dns-default-zctlp\" (UID: \"bdc2b7e1-35af-42c7-8ec3-742be0e080fa\") " pod="openshift-dns/dns-default-zctlp"
May 28 14:53:35.528741 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:35.528703    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bdc2b7e1-35af-42c7-8ec3-742be0e080fa-metrics-tls\") pod \"dns-default-zctlp\" (UID: \"bdc2b7e1-35af-42c7-8ec3-742be0e080fa\") " pod="openshift-dns/dns-default-zctlp"
May 28 14:53:35.528993 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:35.528751    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-88xcv\" (UniqueName: \"kubernetes.io/projected/2879a5eb-fff7-4733-b061-ce7d4f8016e7-kube-api-access-88xcv\") pod \"ingress-canary-jwwzh\" (UID: \"2879a5eb-fff7-4733-b061-ce7d4f8016e7\") " pod="openshift-ingress-canary/ingress-canary-jwwzh"
May 28 14:53:35.528993 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:35.528768    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bdc2b7e1-35af-42c7-8ec3-742be0e080fa-tmp-dir\") pod \"dns-default-zctlp\" (UID: \"bdc2b7e1-35af-42c7-8ec3-742be0e080fa\") " pod="openshift-dns/dns-default-zctlp"
May 28 14:53:35.528993 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:35.528793    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2879a5eb-fff7-4733-b061-ce7d4f8016e7-cert\") pod \"ingress-canary-jwwzh\" (UID: \"2879a5eb-fff7-4733-b061-ce7d4f8016e7\") " pod="openshift-ingress-canary/ingress-canary-jwwzh"
May 28 14:53:35.528993 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:35.528811    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-x76j6\" (UniqueName: \"kubernetes.io/projected/bdc2b7e1-35af-42c7-8ec3-742be0e080fa-kube-api-access-x76j6\") pod \"dns-default-zctlp\" (UID: \"bdc2b7e1-35af-42c7-8ec3-742be0e080fa\") " pod="openshift-dns/dns-default-zctlp"
May 28 14:53:35.528993 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:53:35.528912    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 28 14:53:35.528993 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:53:35.528966    2563 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 28 14:53:35.528993 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:53:35.528980    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bdc2b7e1-35af-42c7-8ec3-742be0e080fa-metrics-tls podName:bdc2b7e1-35af-42c7-8ec3-742be0e080fa nodeName:}" failed. No retries permitted until 2026-05-28 14:53:36.028958078 +0000 UTC m=+36.118174829 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bdc2b7e1-35af-42c7-8ec3-742be0e080fa-metrics-tls") pod "dns-default-zctlp" (UID: "bdc2b7e1-35af-42c7-8ec3-742be0e080fa") : secret "dns-default-metrics-tls" not found
May 28 14:53:35.529263 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:53:35.529034    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2879a5eb-fff7-4733-b061-ce7d4f8016e7-cert podName:2879a5eb-fff7-4733-b061-ce7d4f8016e7 nodeName:}" failed. No retries permitted until 2026-05-28 14:53:36.029014674 +0000 UTC m=+36.118231383 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/2879a5eb-fff7-4733-b061-ce7d4f8016e7-cert") pod "ingress-canary-jwwzh" (UID: "2879a5eb-fff7-4733-b061-ce7d4f8016e7") : secret "canary-serving-cert" not found
May 28 14:53:35.529263 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:35.529097    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bdc2b7e1-35af-42c7-8ec3-742be0e080fa-tmp-dir\") pod \"dns-default-zctlp\" (UID: \"bdc2b7e1-35af-42c7-8ec3-742be0e080fa\") " pod="openshift-dns/dns-default-zctlp"
May 28 14:53:35.529332 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:35.529265    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/bdc2b7e1-35af-42c7-8ec3-742be0e080fa-config-volume\") pod \"dns-default-zctlp\" (UID: \"bdc2b7e1-35af-42c7-8ec3-742be0e080fa\") " pod="openshift-dns/dns-default-zctlp"
May 28 14:53:35.539148 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:35.539026    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x76j6\" (UniqueName: \"kubernetes.io/projected/bdc2b7e1-35af-42c7-8ec3-742be0e080fa-kube-api-access-x76j6\") pod \"dns-default-zctlp\" (UID: \"bdc2b7e1-35af-42c7-8ec3-742be0e080fa\") " pod="openshift-dns/dns-default-zctlp"
May 28 14:53:35.539280 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:35.539121    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-88xcv\" (UniqueName: \"kubernetes.io/projected/2879a5eb-fff7-4733-b061-ce7d4f8016e7-kube-api-access-88xcv\") pod \"ingress-canary-jwwzh\" (UID: \"2879a5eb-fff7-4733-b061-ce7d4f8016e7\") " pod="openshift-ingress-canary/ingress-canary-jwwzh"
May 28 14:53:36.033304 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:36.033267    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bdc2b7e1-35af-42c7-8ec3-742be0e080fa-metrics-tls\") pod \"dns-default-zctlp\" (UID: \"bdc2b7e1-35af-42c7-8ec3-742be0e080fa\") " pod="openshift-dns/dns-default-zctlp"
May 28 14:53:36.033529 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:36.033343    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2879a5eb-fff7-4733-b061-ce7d4f8016e7-cert\") pod \"ingress-canary-jwwzh\" (UID: \"2879a5eb-fff7-4733-b061-ce7d4f8016e7\") " pod="openshift-ingress-canary/ingress-canary-jwwzh"
May 28 14:53:36.033529 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:53:36.033421    2563 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 28 14:53:36.033529 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:53:36.033430    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 28 14:53:36.033529 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:53:36.033470    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2879a5eb-fff7-4733-b061-ce7d4f8016e7-cert podName:2879a5eb-fff7-4733-b061-ce7d4f8016e7 nodeName:}" failed. No retries permitted until 2026-05-28 14:53:37.033456928 +0000 UTC m=+37.122673628 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/2879a5eb-fff7-4733-b061-ce7d4f8016e7-cert") pod "ingress-canary-jwwzh" (UID: "2879a5eb-fff7-4733-b061-ce7d4f8016e7") : secret "canary-serving-cert" not found
May 28 14:53:36.033529 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:53:36.033495    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bdc2b7e1-35af-42c7-8ec3-742be0e080fa-metrics-tls podName:bdc2b7e1-35af-42c7-8ec3-742be0e080fa nodeName:}" failed. No retries permitted until 2026-05-28 14:53:37.033475973 +0000 UTC m=+37.122692690 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bdc2b7e1-35af-42c7-8ec3-742be0e080fa-metrics-tls") pod "dns-default-zctlp" (UID: "bdc2b7e1-35af-42c7-8ec3-742be0e080fa") : secret "dns-default-metrics-tls" not found
May 28 14:53:36.475334 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:36.475300    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zj7gq"
May 28 14:53:36.475813 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:36.475408    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5bqrk"
May 28 14:53:36.475813 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:36.475432    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v4dpk"
May 28 14:53:36.478266 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:36.478247    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 28 14:53:36.479275 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:36.479250    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 28 14:53:36.479384 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:36.479285    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-4kpj5\""
May 28 14:53:36.479384 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:36.479351    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 28 14:53:36.479384 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:36.479351    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
May 28 14:53:36.479592 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:36.479578    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-ckjfk\""
May 28 14:53:36.624496 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:36.624459    2563 generic.go:358] "Generic (PLEG): container finished" podID="9be2177d-67fc-4eec-aa1a-bbe5602495d5" containerID="a3b981947911fdd58691d84e5377d3a0eeaf346e1a1f5172cba8984bd12fc74a" exitCode=0
May 28 14:53:36.624654 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:36.624515    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l8h9g" event={"ID":"9be2177d-67fc-4eec-aa1a-bbe5602495d5","Type":"ContainerDied","Data":"a3b981947911fdd58691d84e5377d3a0eeaf346e1a1f5172cba8984bd12fc74a"}
May 28 14:53:37.042150 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:37.042115    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2879a5eb-fff7-4733-b061-ce7d4f8016e7-cert\") pod \"ingress-canary-jwwzh\" (UID: \"2879a5eb-fff7-4733-b061-ce7d4f8016e7\") " pod="openshift-ingress-canary/ingress-canary-jwwzh"
May 28 14:53:37.042316 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:37.042163    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bdc2b7e1-35af-42c7-8ec3-742be0e080fa-metrics-tls\") pod \"dns-default-zctlp\" (UID: \"bdc2b7e1-35af-42c7-8ec3-742be0e080fa\") " pod="openshift-dns/dns-default-zctlp"
May 28 14:53:37.042316 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:53:37.042285    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 28 14:53:37.042316 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:53:37.042292    2563 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 28 14:53:37.042429 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:53:37.042337    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bdc2b7e1-35af-42c7-8ec3-742be0e080fa-metrics-tls podName:bdc2b7e1-35af-42c7-8ec3-742be0e080fa nodeName:}" failed. No retries permitted until 2026-05-28 14:53:39.042322165 +0000 UTC m=+39.131538866 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bdc2b7e1-35af-42c7-8ec3-742be0e080fa-metrics-tls") pod "dns-default-zctlp" (UID: "bdc2b7e1-35af-42c7-8ec3-742be0e080fa") : secret "dns-default-metrics-tls" not found
May 28 14:53:37.042429 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:53:37.042361    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2879a5eb-fff7-4733-b061-ce7d4f8016e7-cert podName:2879a5eb-fff7-4733-b061-ce7d4f8016e7 nodeName:}" failed. No retries permitted until 2026-05-28 14:53:39.042345314 +0000 UTC m=+39.131562031 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/2879a5eb-fff7-4733-b061-ce7d4f8016e7-cert") pod "ingress-canary-jwwzh" (UID: "2879a5eb-fff7-4733-b061-ce7d4f8016e7") : secret "canary-serving-cert" not found
May 28 14:53:37.628774 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:37.628738    2563 generic.go:358] "Generic (PLEG): container finished" podID="9be2177d-67fc-4eec-aa1a-bbe5602495d5" containerID="cb8065bbd3b13758c2c02c5b8b37c499344463455478fa9ef3eb935b6d0ac9ee" exitCode=0
May 28 14:53:37.628774 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:37.628777    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l8h9g" event={"ID":"9be2177d-67fc-4eec-aa1a-bbe5602495d5","Type":"ContainerDied","Data":"cb8065bbd3b13758c2c02c5b8b37c499344463455478fa9ef3eb935b6d0ac9ee"}
May 28 14:53:38.633078 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:38.633042    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l8h9g" event={"ID":"9be2177d-67fc-4eec-aa1a-bbe5602495d5","Type":"ContainerStarted","Data":"eae1c9ec7fbe7fb3e7ae25f07ae097cc69eea7c22a343bd16bb6a2dc1549d8a7"}
May 28 14:53:38.656497 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:38.656416    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-l8h9g" podStartSLOduration=6.213953174 podStartE2EDuration="38.656401798s" podCreationTimestamp="2026-05-28 14:53:00 +0000 UTC" firstStartedPulling="2026-05-28 14:53:03.146310649 +0000 UTC m=+3.235527354" lastFinishedPulling="2026-05-28 14:53:35.588759268 +0000 UTC m=+35.677975978" observedRunningTime="2026-05-28 14:53:38.655305883 +0000 UTC m=+38.744522607" watchObservedRunningTime="2026-05-28 14:53:38.656401798 +0000 UTC m=+38.745618512"
May 28 14:53:39.056206 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:39.056166    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2879a5eb-fff7-4733-b061-ce7d4f8016e7-cert\") pod \"ingress-canary-jwwzh\" (UID: \"2879a5eb-fff7-4733-b061-ce7d4f8016e7\") " pod="openshift-ingress-canary/ingress-canary-jwwzh"
May 28 14:53:39.056390 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:39.056229    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bdc2b7e1-35af-42c7-8ec3-742be0e080fa-metrics-tls\") pod \"dns-default-zctlp\" (UID: \"bdc2b7e1-35af-42c7-8ec3-742be0e080fa\") " pod="openshift-dns/dns-default-zctlp"
May 28 14:53:39.056390 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:53:39.056324    2563 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 28 14:53:39.056390 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:53:39.056347    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 28 14:53:39.056390 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:53:39.056391    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2879a5eb-fff7-4733-b061-ce7d4f8016e7-cert podName:2879a5eb-fff7-4733-b061-ce7d4f8016e7 nodeName:}" failed. No retries permitted until 2026-05-28 14:53:43.056374799 +0000 UTC m=+43.145591512 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/2879a5eb-fff7-4733-b061-ce7d4f8016e7-cert") pod "ingress-canary-jwwzh" (UID: "2879a5eb-fff7-4733-b061-ce7d4f8016e7") : secret "canary-serving-cert" not found
May 28 14:53:39.056554 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:53:39.056406    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bdc2b7e1-35af-42c7-8ec3-742be0e080fa-metrics-tls podName:bdc2b7e1-35af-42c7-8ec3-742be0e080fa nodeName:}" failed. No retries permitted until 2026-05-28 14:53:43.05639921 +0000 UTC m=+43.145615910 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bdc2b7e1-35af-42c7-8ec3-742be0e080fa-metrics-tls") pod "dns-default-zctlp" (UID: "bdc2b7e1-35af-42c7-8ec3-742be0e080fa") : secret "dns-default-metrics-tls" not found
May 28 14:53:41.809146 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:41.809113    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-d67d65db-rl7ch"]
May 28 14:53:41.819232 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:41.819204    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-d67d65db-rl7ch"]
May 28 14:53:41.819381 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:41.819308    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-d67d65db-rl7ch"
May 28 14:53:41.822988 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:41.822963    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
May 28 14:53:41.822988 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:41.822986    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
May 28 14:53:41.823171 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:41.822962    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-kpwb8\""
May 28 14:53:41.823171 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:41.822963    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
May 28 14:53:41.823317 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:41.822983    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
May 28 14:53:41.976623 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:41.976583    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7077bec9-9618-44f2-bc0f-99d7d6a31a14-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-d67d65db-rl7ch\" (UID: \"7077bec9-9618-44f2-bc0f-99d7d6a31a14\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-d67d65db-rl7ch"
May 28 14:53:41.976809 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:41.976705    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-scnw2\" (UniqueName: \"kubernetes.io/projected/7077bec9-9618-44f2-bc0f-99d7d6a31a14-kube-api-access-scnw2\") pod \"managed-serviceaccount-addon-agent-d67d65db-rl7ch\" (UID: \"7077bec9-9618-44f2-bc0f-99d7d6a31a14\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-d67d65db-rl7ch"
May 28 14:53:42.077995 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:42.077901    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-scnw2\" (UniqueName: \"kubernetes.io/projected/7077bec9-9618-44f2-bc0f-99d7d6a31a14-kube-api-access-scnw2\") pod \"managed-serviceaccount-addon-agent-d67d65db-rl7ch\" (UID: \"7077bec9-9618-44f2-bc0f-99d7d6a31a14\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-d67d65db-rl7ch"
May 28 14:53:42.077995 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:42.077970    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7077bec9-9618-44f2-bc0f-99d7d6a31a14-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-d67d65db-rl7ch\" (UID: \"7077bec9-9618-44f2-bc0f-99d7d6a31a14\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-d67d65db-rl7ch"
May 28 14:53:42.081688 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:42.081657    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7077bec9-9618-44f2-bc0f-99d7d6a31a14-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-d67d65db-rl7ch\" (UID: \"7077bec9-9618-44f2-bc0f-99d7d6a31a14\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-d67d65db-rl7ch"
May 28 14:53:42.086528 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:42.086504    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-scnw2\" (UniqueName: \"kubernetes.io/projected/7077bec9-9618-44f2-bc0f-99d7d6a31a14-kube-api-access-scnw2\") pod \"managed-serviceaccount-addon-agent-d67d65db-rl7ch\" (UID: \"7077bec9-9618-44f2-bc0f-99d7d6a31a14\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-d67d65db-rl7ch"
May 28 14:53:42.140499 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:42.140457    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-d67d65db-rl7ch"
May 28 14:53:42.271381 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:42.271325    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-d67d65db-rl7ch"]
May 28 14:53:42.275968 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:53:42.275941    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7077bec9_9618_44f2_bc0f_99d7d6a31a14.slice/crio-2c2be9623f41893c6f87b6718f272c2fa5417f2d0167aa38ca74e9347dd3b12d WatchSource:0}: Error finding container 2c2be9623f41893c6f87b6718f272c2fa5417f2d0167aa38ca74e9347dd3b12d: Status 404 returned error can't find the container with id 2c2be9623f41893c6f87b6718f272c2fa5417f2d0167aa38ca74e9347dd3b12d
May 28 14:53:42.641462 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:42.641425    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-d67d65db-rl7ch" event={"ID":"7077bec9-9618-44f2-bc0f-99d7d6a31a14","Type":"ContainerStarted","Data":"2c2be9623f41893c6f87b6718f272c2fa5417f2d0167aa38ca74e9347dd3b12d"}
May 28 14:53:43.085522 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:43.085484    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2879a5eb-fff7-4733-b061-ce7d4f8016e7-cert\") pod \"ingress-canary-jwwzh\" (UID: \"2879a5eb-fff7-4733-b061-ce7d4f8016e7\") " pod="openshift-ingress-canary/ingress-canary-jwwzh"
May 28 14:53:43.085969 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:43.085556    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bdc2b7e1-35af-42c7-8ec3-742be0e080fa-metrics-tls\") pod \"dns-default-zctlp\" (UID: \"bdc2b7e1-35af-42c7-8ec3-742be0e080fa\") " pod="openshift-dns/dns-default-zctlp"
May 28 14:53:43.085969 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:53:43.085587    2563 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 28 14:53:43.085969 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:53:43.085662    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2879a5eb-fff7-4733-b061-ce7d4f8016e7-cert podName:2879a5eb-fff7-4733-b061-ce7d4f8016e7 nodeName:}" failed. No retries permitted until 2026-05-28 14:53:51.085640828 +0000 UTC m=+51.174857539 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/2879a5eb-fff7-4733-b061-ce7d4f8016e7-cert") pod "ingress-canary-jwwzh" (UID: "2879a5eb-fff7-4733-b061-ce7d4f8016e7") : secret "canary-serving-cert" not found
May 28 14:53:43.085969 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:53:43.085668    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 28 14:53:43.085969 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:53:43.085734    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bdc2b7e1-35af-42c7-8ec3-742be0e080fa-metrics-tls podName:bdc2b7e1-35af-42c7-8ec3-742be0e080fa nodeName:}" failed. No retries permitted until 2026-05-28 14:53:51.085717812 +0000 UTC m=+51.174934521 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bdc2b7e1-35af-42c7-8ec3-742be0e080fa-metrics-tls") pod "dns-default-zctlp" (UID: "bdc2b7e1-35af-42c7-8ec3-742be0e080fa") : secret "dns-default-metrics-tls" not found
May 28 14:53:44.646249 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:44.646217    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-d67d65db-rl7ch" event={"ID":"7077bec9-9618-44f2-bc0f-99d7d6a31a14","Type":"ContainerStarted","Data":"7dabf813857327406ce66cf90a25467c6af2d08d87cccf112aa1596ff60bb32a"}
May 28 14:53:44.662717 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:44.660992    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-d67d65db-rl7ch" podStartSLOduration=1.367769869 podStartE2EDuration="3.660974199s" podCreationTimestamp="2026-05-28 14:53:41 +0000 UTC" firstStartedPulling="2026-05-28 14:53:42.27787654 +0000 UTC m=+42.367093241" lastFinishedPulling="2026-05-28 14:53:44.571080869 +0000 UTC m=+44.660297571" observedRunningTime="2026-05-28 14:53:44.659694683 +0000 UTC m=+44.748911398" watchObservedRunningTime="2026-05-28 14:53:44.660974199 +0000 UTC m=+44.750190924"
May 28 14:53:51.142822 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:51.142781    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2879a5eb-fff7-4733-b061-ce7d4f8016e7-cert\") pod \"ingress-canary-jwwzh\" (UID: \"2879a5eb-fff7-4733-b061-ce7d4f8016e7\") " pod="openshift-ingress-canary/ingress-canary-jwwzh"
May 28 14:53:51.143194 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:51.142835    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bdc2b7e1-35af-42c7-8ec3-742be0e080fa-metrics-tls\") pod \"dns-default-zctlp\" (UID: \"bdc2b7e1-35af-42c7-8ec3-742be0e080fa\") " pod="openshift-dns/dns-default-zctlp"
May 28 14:53:51.143194 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:53:51.142922    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 28 14:53:51.143194 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:53:51.142923    2563 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 28 14:53:51.143194 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:53:51.142984    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bdc2b7e1-35af-42c7-8ec3-742be0e080fa-metrics-tls podName:bdc2b7e1-35af-42c7-8ec3-742be0e080fa nodeName:}" failed. No retries permitted until 2026-05-28 14:54:07.142970987 +0000 UTC m=+67.232187688 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bdc2b7e1-35af-42c7-8ec3-742be0e080fa-metrics-tls") pod "dns-default-zctlp" (UID: "bdc2b7e1-35af-42c7-8ec3-742be0e080fa") : secret "dns-default-metrics-tls" not found
May 28 14:53:51.143194 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:53:51.142998    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2879a5eb-fff7-4733-b061-ce7d4f8016e7-cert podName:2879a5eb-fff7-4733-b061-ce7d4f8016e7 nodeName:}" failed. No retries permitted until 2026-05-28 14:54:07.14299258 +0000 UTC m=+67.232209281 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/2879a5eb-fff7-4733-b061-ce7d4f8016e7-cert") pod "ingress-canary-jwwzh" (UID: "2879a5eb-fff7-4733-b061-ce7d4f8016e7") : secret "canary-serving-cert" not found
May 28 14:53:59.616281 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:53:59.616254    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ssv8l"
May 28 14:54:06.150711 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:54:06.150651    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b51f6e42-ac3f-47b9-8962-ec51c836ad35-metrics-certs\") pod \"network-metrics-daemon-v4dpk\" (UID: \"b51f6e42-ac3f-47b9-8962-ec51c836ad35\") " pod="openshift-multus/network-metrics-daemon-v4dpk"
May 28 14:54:06.153485 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:54:06.153465    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 28 14:54:06.161631 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:54:06.161615    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
May 28 14:54:06.161693 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:54:06.161668    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b51f6e42-ac3f-47b9-8962-ec51c836ad35-metrics-certs podName:b51f6e42-ac3f-47b9-8962-ec51c836ad35 nodeName:}" failed. No retries permitted until 2026-05-28 14:55:10.161652058 +0000 UTC m=+130.250868764 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b51f6e42-ac3f-47b9-8962-ec51c836ad35-metrics-certs") pod "network-metrics-daemon-v4dpk" (UID: "b51f6e42-ac3f-47b9-8962-ec51c836ad35") : secret "metrics-daemon-secret" not found
May 28 14:54:06.251514 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:54:06.251483    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/248847de-48dc-4cb1-aa31-e48dc53e7f10-original-pull-secret\") pod \"global-pull-secret-syncer-5bqrk\" (UID: \"248847de-48dc-4cb1-aa31-e48dc53e7f10\") " pod="kube-system/global-pull-secret-syncer-5bqrk"
May 28 14:54:06.254386 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:54:06.254366    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
May 28 14:54:06.264526 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:54:06.264505    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/248847de-48dc-4cb1-aa31-e48dc53e7f10-original-pull-secret\") pod \"global-pull-secret-syncer-5bqrk\" (UID: \"248847de-48dc-4cb1-aa31-e48dc53e7f10\") " pod="kube-system/global-pull-secret-syncer-5bqrk"
May 28 14:54:06.352538 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:54:06.352500    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lfw6g\" (UniqueName: \"kubernetes.io/projected/49117ec2-5908-41bd-a305-59ddea54b26d-kube-api-access-lfw6g\") pod \"network-check-target-zj7gq\" (UID: \"49117ec2-5908-41bd-a305-59ddea54b26d\") " pod="openshift-network-diagnostics/network-check-target-zj7gq"
May 28 14:54:06.355231 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:54:06.355214    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 28 14:54:06.365721 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:54:06.365694    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 28 14:54:06.376071 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:54:06.376034    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lfw6g\" (UniqueName: \"kubernetes.io/projected/49117ec2-5908-41bd-a305-59ddea54b26d-kube-api-access-lfw6g\") pod \"network-check-target-zj7gq\" (UID: \"49117ec2-5908-41bd-a305-59ddea54b26d\") " pod="openshift-network-diagnostics/network-check-target-zj7gq"
May 28 14:54:06.487219 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:54:06.487149    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-ckjfk\""
May 28 14:54:06.490293 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:54:06.490277    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5bqrk"
May 28 14:54:06.494810 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:54:06.494796    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zj7gq"
May 28 14:54:06.636873 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:54:06.636845    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-5bqrk"]
May 28 14:54:06.639887 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:54:06.639858    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod248847de_48dc_4cb1_aa31_e48dc53e7f10.slice/crio-b531d73870565ec1ea9583c72f22820170343719e2128d667104fee77428bf38 WatchSource:0}: Error finding container b531d73870565ec1ea9583c72f22820170343719e2128d667104fee77428bf38: Status 404 returned error can't find the container with id b531d73870565ec1ea9583c72f22820170343719e2128d667104fee77428bf38
May 28 14:54:06.654007 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:54:06.653981    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-zj7gq"]
May 28 14:54:06.656871 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:54:06.656847    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49117ec2_5908_41bd_a305_59ddea54b26d.slice/crio-e41bfe91d3048b41f2747310c6c4a231ef958568a41dce958c2b194d9426552f WatchSource:0}: Error finding container e41bfe91d3048b41f2747310c6c4a231ef958568a41dce958c2b194d9426552f: Status 404 returned error can't find the container with id e41bfe91d3048b41f2747310c6c4a231ef958568a41dce958c2b194d9426552f
May 28 14:54:06.686948 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:54:06.686921    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-5bqrk" event={"ID":"248847de-48dc-4cb1-aa31-e48dc53e7f10","Type":"ContainerStarted","Data":"b531d73870565ec1ea9583c72f22820170343719e2128d667104fee77428bf38"}
May 28 14:54:06.687800 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:54:06.687779    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-zj7gq" event={"ID":"49117ec2-5908-41bd-a305-59ddea54b26d","Type":"ContainerStarted","Data":"e41bfe91d3048b41f2747310c6c4a231ef958568a41dce958c2b194d9426552f"}
May 28 14:54:07.160229 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:54:07.160183    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2879a5eb-fff7-4733-b061-ce7d4f8016e7-cert\") pod \"ingress-canary-jwwzh\" (UID: \"2879a5eb-fff7-4733-b061-ce7d4f8016e7\") " pod="openshift-ingress-canary/ingress-canary-jwwzh"
May 28 14:54:07.160643 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:54:07.160255    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bdc2b7e1-35af-42c7-8ec3-742be0e080fa-metrics-tls\") pod \"dns-default-zctlp\" (UID: \"bdc2b7e1-35af-42c7-8ec3-742be0e080fa\") " pod="openshift-dns/dns-default-zctlp"
May 28 14:54:07.160643 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:54:07.160333    2563 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 28 14:54:07.160643 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:54:07.160384    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 28 14:54:07.160643 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:54:07.160398    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2879a5eb-fff7-4733-b061-ce7d4f8016e7-cert podName:2879a5eb-fff7-4733-b061-ce7d4f8016e7 nodeName:}" failed. No retries permitted until 2026-05-28 14:54:39.160382972 +0000 UTC m=+99.249599673 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/2879a5eb-fff7-4733-b061-ce7d4f8016e7-cert") pod "ingress-canary-jwwzh" (UID: "2879a5eb-fff7-4733-b061-ce7d4f8016e7") : secret "canary-serving-cert" not found
May 28 14:54:07.160643 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:54:07.160440    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bdc2b7e1-35af-42c7-8ec3-742be0e080fa-metrics-tls podName:bdc2b7e1-35af-42c7-8ec3-742be0e080fa nodeName:}" failed. No retries permitted until 2026-05-28 14:54:39.160422473 +0000 UTC m=+99.249639178 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bdc2b7e1-35af-42c7-8ec3-742be0e080fa-metrics-tls") pod "dns-default-zctlp" (UID: "bdc2b7e1-35af-42c7-8ec3-742be0e080fa") : secret "dns-default-metrics-tls" not found
May 28 14:54:11.698870 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:54:11.698835    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-zj7gq" event={"ID":"49117ec2-5908-41bd-a305-59ddea54b26d","Type":"ContainerStarted","Data":"f37d7416d4364a7bb65ed7e551e849f3d824a037fd740273999afd38db7d1da3"}
May 28 14:54:11.699251 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:54:11.699044    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-zj7gq"
May 28 14:54:11.700452 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:54:11.700426    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-5bqrk" event={"ID":"248847de-48dc-4cb1-aa31-e48dc53e7f10","Type":"ContainerStarted","Data":"07962764bf0c25ff762d042f9b0d3218a0364025556ec7719a5fd1902760d332"}
May 28 14:54:11.714691 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:54:11.714627    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-zj7gq" podStartSLOduration=67.365002608 podStartE2EDuration="1m11.714609862s" podCreationTimestamp="2026-05-28 14:53:00 +0000 UTC" firstStartedPulling="2026-05-28 14:54:06.658625183 +0000 UTC m=+66.747841885" lastFinishedPulling="2026-05-28 14:54:11.008232431 +0000 UTC m=+71.097449139" observedRunningTime="2026-05-28 14:54:11.714020593 +0000 UTC m=+71.803237331" watchObservedRunningTime="2026-05-28 14:54:11.714609862 +0000 UTC m=+71.803826586"
May 28 14:54:11.727633 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:54:11.727594    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-5bqrk" podStartSLOduration=66.326293328 podStartE2EDuration="1m10.727580364s" podCreationTimestamp="2026-05-28 14:53:01 +0000 UTC" firstStartedPulling="2026-05-28 14:54:06.641694654 +0000 UTC m=+66.730911371" lastFinishedPulling="2026-05-28 14:54:11.042981704 +0000 UTC m=+71.132198407" observedRunningTime="2026-05-28 14:54:11.727230987 +0000 UTC m=+71.816447710" watchObservedRunningTime="2026-05-28 14:54:11.727580364 +0000 UTC m=+71.816797087"
May 28 14:54:39.188639 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:54:39.188604    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2879a5eb-fff7-4733-b061-ce7d4f8016e7-cert\") pod \"ingress-canary-jwwzh\" (UID: \"2879a5eb-fff7-4733-b061-ce7d4f8016e7\") " pod="openshift-ingress-canary/ingress-canary-jwwzh"
May 28 14:54:39.188639 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:54:39.188652    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bdc2b7e1-35af-42c7-8ec3-742be0e080fa-metrics-tls\") pod \"dns-default-zctlp\" (UID: \"bdc2b7e1-35af-42c7-8ec3-742be0e080fa\") " pod="openshift-dns/dns-default-zctlp"
May 28 14:54:39.189110 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:54:39.188771    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 28 14:54:39.189110 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:54:39.188823    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bdc2b7e1-35af-42c7-8ec3-742be0e080fa-metrics-tls podName:bdc2b7e1-35af-42c7-8ec3-742be0e080fa nodeName:}" failed. No retries permitted until 2026-05-28 14:55:43.188810291 +0000 UTC m=+163.278026991 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bdc2b7e1-35af-42c7-8ec3-742be0e080fa-metrics-tls") pod "dns-default-zctlp" (UID: "bdc2b7e1-35af-42c7-8ec3-742be0e080fa") : secret "dns-default-metrics-tls" not found
May 28 14:54:39.189110 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:54:39.188772    2563 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 28 14:54:39.189110 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:54:39.188892    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2879a5eb-fff7-4733-b061-ce7d4f8016e7-cert podName:2879a5eb-fff7-4733-b061-ce7d4f8016e7 nodeName:}" failed. No retries permitted until 2026-05-28 14:55:43.188878671 +0000 UTC m=+163.278095371 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/2879a5eb-fff7-4733-b061-ce7d4f8016e7-cert") pod "ingress-canary-jwwzh" (UID: "2879a5eb-fff7-4733-b061-ce7d4f8016e7") : secret "canary-serving-cert" not found
May 28 14:54:42.717879 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:54:42.717850    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-zj7gq"
May 28 14:54:49.165265 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:54:49.165225    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-86zbj"]
May 28 14:54:49.168102 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:54:49.168083    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-79544c6ccf-st9tg"]
May 28 14:54:49.168239 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:54:49.168219    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-76dff48d59-86zbj"
May 28 14:54:49.169759 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:54:49.169740    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-79544c6ccf-st9tg"
May 28 14:54:49.171790 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:54:49.171771    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-qbq8w\""
May 28 14:54:49.172096 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:54:49.172076    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
May 28 14:54:49.172096 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:54:49.172092    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
May 28 14:54:49.172743 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:54:49.172727    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-ss6jl\""
May 28 14:54:49.173469 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:54:49.173455    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
May 28 14:54:49.173743 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:54:49.173725    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
May 28 14:54:49.174086 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:54:49.173917    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
May 28 14:54:49.174086 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:54:49.173950    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
May 28 14:54:49.174086 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:54:49.174045    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
May 28 14:54:49.180247 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:54:49.180228    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
May 28 14:54:49.180965 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:54:49.180947    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
May 28 14:54:49.185278 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:54:49.185257    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-86zbj"]
May 28 14:54:49.185947 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:54:49.185929    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-79544c6ccf-st9tg"]
May 28 14:54:49.253304 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:54:49.253269    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-sht78"]
May 28 14:54:49.253518 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:54:49.253497    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2e54aa3c-c7d9-4e5c-90d9-2d25d71de4a2-image-registry-private-configuration\") pod \"image-registry-79544c6ccf-st9tg\" (UID: \"2e54aa3c-c7d9-4e5c-90d9-2d25d71de4a2\") " pod="openshift-image-registry/image-registry-79544c6ccf-st9tg"
May 28 14:54:49.253564 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:54:49.253529    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2e54aa3c-c7d9-4e5c-90d9-2d25d71de4a2-trusted-ca\") pod \"image-registry-79544c6ccf-st9tg\" (UID: \"2e54aa3c-c7d9-4e5c-90d9-2d25d71de4a2\") " pod="openshift-image-registry/image-registry-79544c6ccf-st9tg"
May 28 14:54:49.253564 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:54:49.253554    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2e54aa3c-c7d9-4e5c-90d9-2d25d71de4a2-ca-trust-extracted\") pod \"image-registry-79544c6ccf-st9tg\" (UID: \"2e54aa3c-c7d9-4e5c-90d9-2d25d71de4a2\") " pod="openshift-image-registry/image-registry-79544c6ccf-st9tg"
May 28 14:54:49.253628 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:54:49.253573    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8d769c1c-5bf7-49c6-bf05-531b243e935e-trusted-ca\") pod \"console-operator-76dff48d59-86zbj\" (UID: \"8d769c1c-5bf7-49c6-bf05-531b243e935e\") " pod="openshift-console-operator/console-operator-76dff48d59-86zbj"
May 28 14:54:49.253663 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:54:49.253636    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2e54aa3c-c7d9-4e5c-90d9-2d25d71de4a2-registry-tls\") pod \"image-registry-79544c6ccf-st9tg\" (UID: \"2e54aa3c-c7d9-4e5c-90d9-2d25d71de4a2\") " pod="openshift-image-registry/image-registry-79544c6ccf-st9tg"
May 28 14:54:49.253733 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:54:49.253700    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2e54aa3c-c7d9-4e5c-90d9-2d25d71de4a2-bound-sa-token\") pod \"image-registry-79544c6ccf-st9tg\" (UID: \"2e54aa3c-c7d9-4e5c-90d9-2d25d71de4a2\") " pod="openshift-image-registry/image-registry-79544c6ccf-st9tg"
May 28 14:54:49.253777 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:54:49.253746    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qfhxj\" (UniqueName: \"kubernetes.io/projected/2e54aa3c-c7d9-4e5c-90d9-2d25d71de4a2-kube-api-access-qfhxj\") pod \"image-registry-79544c6ccf-st9tg\" (UID: \"2e54aa3c-c7d9-4e5c-90d9-2d25d71de4a2\") " pod="openshift-image-registry/image-registry-79544c6ccf-st9tg"
May 28 14:54:49.253811 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:54:49.253779    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2e54aa3c-c7d9-4e5c-90d9-2d25d71de4a2-installation-pull-secrets\") pod \"image-registry-79544c6ccf-st9tg\" (UID: \"2e54aa3c-c7d9-4e5c-90d9-2d25d71de4a2\") " pod="openshift-image-registry/image-registry-79544c6ccf-st9tg"
May 28 14:54:49.253851 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:54:49.253814    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8d769c1c-5bf7-49c6-bf05-531b243e935e-serving-cert\") pod \"console-operator-76dff48d59-86zbj\" (UID: \"8d769c1c-5bf7-49c6-bf05-531b243e935e\") " pod="openshift-console-operator/console-operator-76dff48d59-86zbj"
May 28 14:54:49.253851 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:54:49.253832    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gcxrn\" (UniqueName: \"kubernetes.io/projected/8d769c1c-5bf7-49c6-bf05-531b243e935e-kube-api-access-gcxrn\") pod \"console-operator-76dff48d59-86zbj\" (UID: \"8d769c1c-5bf7-49c6-bf05-531b243e935e\") " pod="openshift-console-operator/console-operator-76dff48d59-86zbj"
May 28 14:54:49.253923 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:54:49.253854    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2e54aa3c-c7d9-4e5c-90d9-2d25d71de4a2-registry-certificates\") pod \"image-registry-79544c6ccf-st9tg\" (UID: \"2e54aa3c-c7d9-4e5c-90d9-2d25d71de4a2\") " pod="openshift-image-registry/image-registry-79544c6ccf-st9tg"
May 28 14:54:49.253923 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:54:49.253893    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8d769c1c-5bf7-49c6-bf05-531b243e935e-config\") pod \"console-operator-76dff48d59-86zbj\" (UID: \"8d769c1c-5bf7-49c6-bf05-531b243e935e\") " pod="openshift-console-operator/console-operator-76dff48d59-86zbj"
May 28 14:54:49.255160 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:54:49.255146    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-sht78"
May 28 14:54:49.257613 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:54:49.257590    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
May 28 14:54:49.257613 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:54:49.257606    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-t4t9l\""
May 28 14:54:49.257841 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:54:49.257628    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
May 28 14:54:49.257841 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:54:49.257609    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
May 28 14:54:49.257841 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:54:49.257710    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
May 28 14:54:49.266269 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:54:49.266247    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-sht78"]
May 28 14:54:49.354746 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:54:49.354706    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8d769c1c-5bf7-49c6-bf05-531b243e935e-config\") pod \"console-operator-76dff48d59-86zbj\" (UID: \"8d769c1c-5bf7-49c6-bf05-531b243e935e\") " pod="openshift-console-operator/console-operator-76dff48d59-86zbj"
May 28 14:54:49.354746 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:54:49.354750    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cp8f9\" (UniqueName: \"kubernetes.io/projected/831ffb2b-e2df-4e8b-b88a-3d4ba6e1a02d-kube-api-access-cp8f9\") pod \"service-ca-operator-57b5b68b8-sht78\" (UID: \"831ffb2b-e2df-4e8b-b88a-3d4ba6e1a02d\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-sht78"
May 28 14:54:49.355003 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:54:49.354780    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2e54aa3c-c7d9-4e5c-90d9-2d25d71de4a2-image-registry-private-configuration\") pod \"image-registry-79544c6ccf-st9tg\" (UID: \"2e54aa3c-c7d9-4e5c-90d9-2d25d71de4a2\") " pod="openshift-image-registry/image-registry-79544c6ccf-st9tg"
May 28 14:54:49.355003 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:54:49.354796    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2e54aa3c-c7d9-4e5c-90d9-2d25d71de4a2-trusted-ca\") pod \"image-registry-79544c6ccf-st9tg\" (UID: \"2e54aa3c-c7d9-4e5c-90d9-2d25d71de4a2\") " pod="openshift-image-registry/image-registry-79544c6ccf-st9tg"
May 28 14:54:49.355003 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:54:49.354820    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2e54aa3c-c7d9-4e5c-90d9-2d25d71de4a2-ca-trust-extracted\") pod \"image-registry-79544c6ccf-st9tg\" (UID: \"2e54aa3c-c7d9-4e5c-90d9-2d25d71de4a2\") " pod="openshift-image-registry/image-registry-79544c6ccf-st9tg"
May 28 14:54:49.355003 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:54:49.354838    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8d769c1c-5bf7-49c6-bf05-531b243e935e-trusted-ca\") pod \"console-operator-76dff48d59-86zbj\" (UID: \"8d769c1c-5bf7-49c6-bf05-531b243e935e\") " pod="openshift-console-operator/console-operator-76dff48d59-86zbj"
May 28 14:54:49.355003 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:54:49.354859    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/831ffb2b-e2df-4e8b-b88a-3d4ba6e1a02d-serving-cert\") pod \"service-ca-operator-57b5b68b8-sht78\" (UID: \"831ffb2b-e2df-4e8b-b88a-3d4ba6e1a02d\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-sht78"
May 28 14:54:49.355003 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:54:49.354884    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/831ffb2b-e2df-4e8b-b88a-3d4ba6e1a02d-config\") pod \"service-ca-operator-57b5b68b8-sht78\" (UID: \"831ffb2b-e2df-4e8b-b88a-3d4ba6e1a02d\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-sht78"
May 28 14:54:49.355003 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:54:49.354913    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2e54aa3c-c7d9-4e5c-90d9-2d25d71de4a2-registry-tls\") pod \"image-registry-79544c6ccf-st9tg\" (UID: \"2e54aa3c-c7d9-4e5c-90d9-2d25d71de4a2\") " pod="openshift-image-registry/image-registry-79544c6ccf-st9tg"
May 28 14:54:49.355003 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:54:49.354996    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2e54aa3c-c7d9-4e5c-90d9-2d25d71de4a2-bound-sa-token\") pod \"image-registry-79544c6ccf-st9tg\" (UID: \"2e54aa3c-c7d9-4e5c-90d9-2d25d71de4a2\") " pod="openshift-image-registry/image-registry-79544c6ccf-st9tg"
May 28 14:54:49.355380 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:54:49.355027    2563 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 28 14:54:49.355380 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:54:49.355045    2563 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-79544c6ccf-st9tg: secret "image-registry-tls" not found
May 28 14:54:49.355380 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:54:49.355118    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2e54aa3c-c7d9-4e5c-90d9-2d25d71de4a2-registry-tls podName:2e54aa3c-c7d9-4e5c-90d9-2d25d71de4a2 nodeName:}" failed. No retries permitted until 2026-05-28 14:54:49.855096866 +0000 UTC m=+109.944313568 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2e54aa3c-c7d9-4e5c-90d9-2d25d71de4a2-registry-tls") pod "image-registry-79544c6ccf-st9tg" (UID: "2e54aa3c-c7d9-4e5c-90d9-2d25d71de4a2") : secret "image-registry-tls" not found
May 28 14:54:49.355380 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:54:49.355041    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qfhxj\" (UniqueName: \"kubernetes.io/projected/2e54aa3c-c7d9-4e5c-90d9-2d25d71de4a2-kube-api-access-qfhxj\") pod \"image-registry-79544c6ccf-st9tg\" (UID: \"2e54aa3c-c7d9-4e5c-90d9-2d25d71de4a2\") " pod="openshift-image-registry/image-registry-79544c6ccf-st9tg"
May 28 14:54:49.355380 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:54:49.355181    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2e54aa3c-c7d9-4e5c-90d9-2d25d71de4a2-installation-pull-secrets\") pod \"image-registry-79544c6ccf-st9tg\" (UID: \"2e54aa3c-c7d9-4e5c-90d9-2d25d71de4a2\") " pod="openshift-image-registry/image-registry-79544c6ccf-st9tg"
May 28 14:54:49.355380 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:54:49.355231    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8d769c1c-5bf7-49c6-bf05-531b243e935e-serving-cert\") pod \"console-operator-76dff48d59-86zbj\" (UID: \"8d769c1c-5bf7-49c6-bf05-531b243e935e\") " pod="openshift-console-operator/console-operator-76dff48d59-86zbj"
May 28 14:54:49.355380 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:54:49.355253    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2e54aa3c-c7d9-4e5c-90d9-2d25d71de4a2-ca-trust-extracted\") pod \"image-registry-79544c6ccf-st9tg\" (UID: \"2e54aa3c-c7d9-4e5c-90d9-2d25d71de4a2\") " pod="openshift-image-registry/image-registry-79544c6ccf-st9tg"
May 28 14:54:49.355380 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:54:49.355258    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gcxrn\" (UniqueName: \"kubernetes.io/projected/8d769c1c-5bf7-49c6-bf05-531b243e935e-kube-api-access-gcxrn\") pod \"console-operator-76dff48d59-86zbj\" (UID: \"8d769c1c-5bf7-49c6-bf05-531b243e935e\") " pod="openshift-console-operator/console-operator-76dff48d59-86zbj"
May 28 14:54:49.355380 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:54:49.355282    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2e54aa3c-c7d9-4e5c-90d9-2d25d71de4a2-registry-certificates\") pod \"image-registry-79544c6ccf-st9tg\" (UID: \"2e54aa3c-c7d9-4e5c-90d9-2d25d71de4a2\") " pod="openshift-image-registry/image-registry-79544c6ccf-st9tg"
May 28 14:54:49.355828 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:54:49.355511    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8d769c1c-5bf7-49c6-bf05-531b243e935e-config\") pod \"console-operator-76dff48d59-86zbj\" (UID: \"8d769c1c-5bf7-49c6-bf05-531b243e935e\") " pod="openshift-console-operator/console-operator-76dff48d59-86zbj"
May 28 14:54:49.355828 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:54:49.355800    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2e54aa3c-c7d9-4e5c-90d9-2d25d71de4a2-registry-certificates\") pod \"image-registry-79544c6ccf-st9tg\" (UID: \"2e54aa3c-c7d9-4e5c-90d9-2d25d71de4a2\") " pod="openshift-image-registry/image-registry-79544c6ccf-st9tg"
May 28 14:54:49.355828 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:54:49.355814    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8d769c1c-5bf7-49c6-bf05-531b243e935e-trusted-ca\") pod \"console-operator-76dff48d59-86zbj\" (UID: \"8d769c1c-5bf7-49c6-bf05-531b243e935e\") " pod="openshift-console-operator/console-operator-76dff48d59-86zbj"
May 28 14:54:49.356282 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:54:49.356257    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2e54aa3c-c7d9-4e5c-90d9-2d25d71de4a2-trusted-ca\") pod \"image-registry-79544c6ccf-st9tg\" (UID: \"2e54aa3c-c7d9-4e5c-90d9-2d25d71de4a2\") " pod="openshift-image-registry/image-registry-79544c6ccf-st9tg"
May 28 14:54:49.357608 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:54:49.357589    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8d769c1c-5bf7-49c6-bf05-531b243e935e-serving-cert\") pod \"console-operator-76dff48d59-86zbj\" (UID: \"8d769c1c-5bf7-49c6-bf05-531b243e935e\") " pod="openshift-console-operator/console-operator-76dff48d59-86zbj"
May 28 14:54:49.357792 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:54:49.357775    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2e54aa3c-c7d9-4e5c-90d9-2d25d71de4a2-installation-pull-secrets\") pod \"image-registry-79544c6ccf-st9tg\" (UID: \"2e54aa3c-c7d9-4e5c-90d9-2d25d71de4a2\") " pod="openshift-image-registry/image-registry-79544c6ccf-st9tg"
May 28 14:54:49.357860 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:54:49.357797    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2e54aa3c-c7d9-4e5c-90d9-2d25d71de4a2-image-registry-private-configuration\") pod \"image-registry-79544c6ccf-st9tg\" (UID: \"2e54aa3c-c7d9-4e5c-90d9-2d25d71de4a2\") " pod="openshift-image-registry/image-registry-79544c6ccf-st9tg"
May 28 14:54:49.364163 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:54:49.364132    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qfhxj\" (UniqueName: \"kubernetes.io/projected/2e54aa3c-c7d9-4e5c-90d9-2d25d71de4a2-kube-api-access-qfhxj\") pod \"image-registry-79544c6ccf-st9tg\" (UID: \"2e54aa3c-c7d9-4e5c-90d9-2d25d71de4a2\") " pod="openshift-image-registry/image-registry-79544c6ccf-st9tg"
May 28 14:54:49.364331 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:54:49.364314    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2e54aa3c-c7d9-4e5c-90d9-2d25d71de4a2-bound-sa-token\") pod \"image-registry-79544c6ccf-st9tg\" (UID: \"2e54aa3c-c7d9-4e5c-90d9-2d25d71de4a2\") " pod="openshift-image-registry/image-registry-79544c6ccf-st9tg"
May 28 14:54:49.364614 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:54:49.364592    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gcxrn\" (UniqueName: \"kubernetes.io/projected/8d769c1c-5bf7-49c6-bf05-531b243e935e-kube-api-access-gcxrn\") pod \"console-operator-76dff48d59-86zbj\" (UID: \"8d769c1c-5bf7-49c6-bf05-531b243e935e\") " pod="openshift-console-operator/console-operator-76dff48d59-86zbj"
May 28 14:54:49.456657 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:54:49.456569    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cp8f9\" (UniqueName: \"kubernetes.io/projected/831ffb2b-e2df-4e8b-b88a-3d4ba6e1a02d-kube-api-access-cp8f9\") pod \"service-ca-operator-57b5b68b8-sht78\" (UID: \"831ffb2b-e2df-4e8b-b88a-3d4ba6e1a02d\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-sht78"
May 28 14:54:49.456657 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:54:49.456618    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/831ffb2b-e2df-4e8b-b88a-3d4ba6e1a02d-serving-cert\") pod \"service-ca-operator-57b5b68b8-sht78\" (UID: \"831ffb2b-e2df-4e8b-b88a-3d4ba6e1a02d\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-sht78"
May 28 14:54:49.456657 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:54:49.456634    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/831ffb2b-e2df-4e8b-b88a-3d4ba6e1a02d-config\") pod \"service-ca-operator-57b5b68b8-sht78\" (UID: \"831ffb2b-e2df-4e8b-b88a-3d4ba6e1a02d\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-sht78"
May 28 14:54:49.457136 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:54:49.457119    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/831ffb2b-e2df-4e8b-b88a-3d4ba6e1a02d-config\") pod \"service-ca-operator-57b5b68b8-sht78\" (UID: \"831ffb2b-e2df-4e8b-b88a-3d4ba6e1a02d\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-sht78"
May 28 14:54:49.458793 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:54:49.458774    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/831ffb2b-e2df-4e8b-b88a-3d4ba6e1a02d-serving-cert\") pod \"service-ca-operator-57b5b68b8-sht78\" (UID: \"831ffb2b-e2df-4e8b-b88a-3d4ba6e1a02d\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-sht78"
May 28 14:54:49.465371 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:54:49.465344    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cp8f9\" (UniqueName: \"kubernetes.io/projected/831ffb2b-e2df-4e8b-b88a-3d4ba6e1a02d-kube-api-access-cp8f9\") pod \"service-ca-operator-57b5b68b8-sht78\" (UID: \"831ffb2b-e2df-4e8b-b88a-3d4ba6e1a02d\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-sht78"
May 28 14:54:49.479117 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:54:49.479099    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-76dff48d59-86zbj"
May 28 14:54:49.564163 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:54:49.564131    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-sht78"
May 28 14:54:49.598738 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:54:49.598698    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-86zbj"]
May 28 14:54:49.601644 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:54:49.601608    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d769c1c_5bf7_49c6_bf05_531b243e935e.slice/crio-9b6be08b2211254ba78f410e5bc1476f9936949e8466b4a76b6861f5602606fd WatchSource:0}: Error finding container 9b6be08b2211254ba78f410e5bc1476f9936949e8466b4a76b6861f5602606fd: Status 404 returned error can't find the container with id 9b6be08b2211254ba78f410e5bc1476f9936949e8466b4a76b6861f5602606fd
May 28 14:54:49.686647 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:54:49.686613    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-sht78"]
May 28 14:54:49.690148 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:54:49.690114    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod831ffb2b_e2df_4e8b_b88a_3d4ba6e1a02d.slice/crio-5d5deefcd82d01e5c3d90ba22e2c5541e37086aa121df3e5c70b2cd5823a3632 WatchSource:0}: Error finding container 5d5deefcd82d01e5c3d90ba22e2c5541e37086aa121df3e5c70b2cd5823a3632: Status 404 returned error can't find the container with id 5d5deefcd82d01e5c3d90ba22e2c5541e37086aa121df3e5c70b2cd5823a3632
May 28 14:54:49.772976 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:54:49.772938    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-86zbj" event={"ID":"8d769c1c-5bf7-49c6-bf05-531b243e935e","Type":"ContainerStarted","Data":"9b6be08b2211254ba78f410e5bc1476f9936949e8466b4a76b6861f5602606fd"}
May 28 14:54:49.773817 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:54:49.773794    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-sht78" event={"ID":"831ffb2b-e2df-4e8b-b88a-3d4ba6e1a02d","Type":"ContainerStarted","Data":"5d5deefcd82d01e5c3d90ba22e2c5541e37086aa121df3e5c70b2cd5823a3632"}
May 28 14:54:49.859822 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:54:49.859790    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2e54aa3c-c7d9-4e5c-90d9-2d25d71de4a2-registry-tls\") pod \"image-registry-79544c6ccf-st9tg\" (UID: \"2e54aa3c-c7d9-4e5c-90d9-2d25d71de4a2\") " pod="openshift-image-registry/image-registry-79544c6ccf-st9tg"
May 28 14:54:49.859977 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:54:49.859938    2563 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 28 14:54:49.859977 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:54:49.859954    2563 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-79544c6ccf-st9tg: secret "image-registry-tls" not found
May 28 14:54:49.860044 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:54:49.860024    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2e54aa3c-c7d9-4e5c-90d9-2d25d71de4a2-registry-tls podName:2e54aa3c-c7d9-4e5c-90d9-2d25d71de4a2 nodeName:}" failed. No retries permitted until 2026-05-28 14:54:50.860008333 +0000 UTC m=+110.949225048 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2e54aa3c-c7d9-4e5c-90d9-2d25d71de4a2-registry-tls") pod "image-registry-79544c6ccf-st9tg" (UID: "2e54aa3c-c7d9-4e5c-90d9-2d25d71de4a2") : secret "image-registry-tls" not found
May 28 14:54:50.867539 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:54:50.867505    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2e54aa3c-c7d9-4e5c-90d9-2d25d71de4a2-registry-tls\") pod \"image-registry-79544c6ccf-st9tg\" (UID: \"2e54aa3c-c7d9-4e5c-90d9-2d25d71de4a2\") " pod="openshift-image-registry/image-registry-79544c6ccf-st9tg"
May 28 14:54:50.867940 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:54:50.867693    2563 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 28 14:54:50.867940 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:54:50.867717    2563 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-79544c6ccf-st9tg: secret "image-registry-tls" not found
May 28 14:54:50.867940 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:54:50.867785    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2e54aa3c-c7d9-4e5c-90d9-2d25d71de4a2-registry-tls podName:2e54aa3c-c7d9-4e5c-90d9-2d25d71de4a2 nodeName:}" failed. No retries permitted until 2026-05-28 14:54:52.867763412 +0000 UTC m=+112.956980117 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2e54aa3c-c7d9-4e5c-90d9-2d25d71de4a2-registry-tls") pod "image-registry-79544c6ccf-st9tg" (UID: "2e54aa3c-c7d9-4e5c-90d9-2d25d71de4a2") : secret "image-registry-tls" not found
May 28 14:54:52.781693 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:54:52.781652    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-86zbj_8d769c1c-5bf7-49c6-bf05-531b243e935e/console-operator/0.log"
May 28 14:54:52.782151 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:54:52.781709    2563 generic.go:358] "Generic (PLEG): container finished" podID="8d769c1c-5bf7-49c6-bf05-531b243e935e" containerID="a94fa087ab12e8edc1a533e9b0baaa17f24f4f8f997c773317c406da4202acce" exitCode=255
May 28 14:54:52.782151 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:54:52.781784    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-86zbj" event={"ID":"8d769c1c-5bf7-49c6-bf05-531b243e935e","Type":"ContainerDied","Data":"a94fa087ab12e8edc1a533e9b0baaa17f24f4f8f997c773317c406da4202acce"}
May 28 14:54:52.782151 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:54:52.782046    2563 scope.go:117] "RemoveContainer" containerID="a94fa087ab12e8edc1a533e9b0baaa17f24f4f8f997c773317c406da4202acce"
May 28 14:54:52.783191 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:54:52.783157    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-sht78" event={"ID":"831ffb2b-e2df-4e8b-b88a-3d4ba6e1a02d","Type":"ContainerStarted","Data":"a74ed040ebf0eb723f65c2108026db3ea5ff1806bdc22ecb457394400df95fdc"}
May 28 14:54:52.811146 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:54:52.811098    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-sht78" podStartSLOduration=1.584708849 podStartE2EDuration="3.811083762s" podCreationTimestamp="2026-05-28 14:54:49 +0000 UTC" firstStartedPulling="2026-05-28 14:54:49.691839962 +0000 UTC m=+109.781056662" lastFinishedPulling="2026-05-28 14:54:51.918214859 +0000 UTC m=+112.007431575" observedRunningTime="2026-05-28 14:54:52.810707116 +0000 UTC m=+112.899923839" watchObservedRunningTime="2026-05-28 14:54:52.811083762 +0000 UTC m=+112.900300485"
May 28 14:54:52.884116 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:54:52.884080    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2e54aa3c-c7d9-4e5c-90d9-2d25d71de4a2-registry-tls\") pod \"image-registry-79544c6ccf-st9tg\" (UID: \"2e54aa3c-c7d9-4e5c-90d9-2d25d71de4a2\") " pod="openshift-image-registry/image-registry-79544c6ccf-st9tg"
May 28 14:54:52.884265 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:54:52.884228    2563 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 28 14:54:52.884265 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:54:52.884246    2563 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-79544c6ccf-st9tg: secret "image-registry-tls" not found
May 28 14:54:52.884369 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:54:52.884312    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2e54aa3c-c7d9-4e5c-90d9-2d25d71de4a2-registry-tls podName:2e54aa3c-c7d9-4e5c-90d9-2d25d71de4a2 nodeName:}" failed. No retries permitted until 2026-05-28 14:54:56.884291984 +0000 UTC m=+116.973508691 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2e54aa3c-c7d9-4e5c-90d9-2d25d71de4a2-registry-tls") pod "image-registry-79544c6ccf-st9tg" (UID: "2e54aa3c-c7d9-4e5c-90d9-2d25d71de4a2") : secret "image-registry-tls" not found
May 28 14:54:53.786533 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:54:53.786505    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-86zbj_8d769c1c-5bf7-49c6-bf05-531b243e935e/console-operator/1.log"
May 28 14:54:53.786942 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:54:53.786858    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-86zbj_8d769c1c-5bf7-49c6-bf05-531b243e935e/console-operator/0.log"
May 28 14:54:53.786942 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:54:53.786889    2563 generic.go:358] "Generic (PLEG): container finished" podID="8d769c1c-5bf7-49c6-bf05-531b243e935e" containerID="4f100b52bf6268f4c91f8b764669bb488c0d6bafdeec099d5cf3047ed4a52a9a" exitCode=255
May 28 14:54:53.786942 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:54:53.786921    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-86zbj" event={"ID":"8d769c1c-5bf7-49c6-bf05-531b243e935e","Type":"ContainerDied","Data":"4f100b52bf6268f4c91f8b764669bb488c0d6bafdeec099d5cf3047ed4a52a9a"}
May 28 14:54:53.787062 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:54:53.786966    2563 scope.go:117] "RemoveContainer" containerID="a94fa087ab12e8edc1a533e9b0baaa17f24f4f8f997c773317c406da4202acce"
May 28 14:54:53.787223 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:54:53.787202    2563 scope.go:117] "RemoveContainer" containerID="4f100b52bf6268f4c91f8b764669bb488c0d6bafdeec099d5cf3047ed4a52a9a"
May 28 14:54:53.787398 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:54:53.787381    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-86zbj_openshift-console-operator(8d769c1c-5bf7-49c6-bf05-531b243e935e)\"" pod="openshift-console-operator/console-operator-76dff48d59-86zbj" podUID="8d769c1c-5bf7-49c6-bf05-531b243e935e"
May 28 14:54:54.790868 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:54:54.790840    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-86zbj_8d769c1c-5bf7-49c6-bf05-531b243e935e/console-operator/1.log"
May 28 14:54:54.791227 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:54:54.791179    2563 scope.go:117] "RemoveContainer" containerID="4f100b52bf6268f4c91f8b764669bb488c0d6bafdeec099d5cf3047ed4a52a9a"
May 28 14:54:54.791359 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:54:54.791341    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-86zbj_openshift-console-operator(8d769c1c-5bf7-49c6-bf05-531b243e935e)\"" pod="openshift-console-operator/console-operator-76dff48d59-86zbj" podUID="8d769c1c-5bf7-49c6-bf05-531b243e935e"
May 28 14:54:55.790430 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:54:55.790393    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-l288j"]
May 28 14:54:55.792874 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:54:55.792858    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-67d667c7d-l288j"
May 28 14:54:55.795580 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:54:55.795555    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
May 28 14:54:55.796411 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:54:55.796375    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
May 28 14:54:55.796411 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:54:55.796394    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-bnvp7\""
May 28 14:54:55.796411 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:54:55.796397    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
May 28 14:54:55.796578 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:54:55.796444    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
May 28 14:54:55.805562 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:54:55.805540    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-l288j"]
May 28 14:54:55.905480 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:54:55.905445    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-828sk\" (UniqueName: \"kubernetes.io/projected/363fb6f8-49a8-4f37-8a66-34a10bad574a-kube-api-access-828sk\") pod \"service-ca-67d667c7d-l288j\" (UID: \"363fb6f8-49a8-4f37-8a66-34a10bad574a\") " pod="openshift-service-ca/service-ca-67d667c7d-l288j"
May 28 14:54:55.905641 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:54:55.905529    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/363fb6f8-49a8-4f37-8a66-34a10bad574a-signing-key\") pod \"service-ca-67d667c7d-l288j\" (UID: \"363fb6f8-49a8-4f37-8a66-34a10bad574a\") " pod="openshift-service-ca/service-ca-67d667c7d-l288j"
May 28 14:54:55.905641 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:54:55.905549    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/363fb6f8-49a8-4f37-8a66-34a10bad574a-signing-cabundle\") pod \"service-ca-67d667c7d-l288j\" (UID: \"363fb6f8-49a8-4f37-8a66-34a10bad574a\") " pod="openshift-service-ca/service-ca-67d667c7d-l288j"
May 28 14:54:56.006851 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:54:56.006817    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/363fb6f8-49a8-4f37-8a66-34a10bad574a-signing-key\") pod \"service-ca-67d667c7d-l288j\" (UID: \"363fb6f8-49a8-4f37-8a66-34a10bad574a\") " pod="openshift-service-ca/service-ca-67d667c7d-l288j"
May 28 14:54:56.007011 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:54:56.006864    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/363fb6f8-49a8-4f37-8a66-34a10bad574a-signing-cabundle\") pod \"service-ca-67d667c7d-l288j\" (UID: \"363fb6f8-49a8-4f37-8a66-34a10bad574a\") " pod="openshift-service-ca/service-ca-67d667c7d-l288j"
May 28 14:54:56.007050 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:54:56.007016    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-828sk\" (UniqueName: \"kubernetes.io/projected/363fb6f8-49a8-4f37-8a66-34a10bad574a-kube-api-access-828sk\") pod \"service-ca-67d667c7d-l288j\" (UID: \"363fb6f8-49a8-4f37-8a66-34a10bad574a\") " pod="openshift-service-ca/service-ca-67d667c7d-l288j"
May 28 14:54:56.007550 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:54:56.007528    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/363fb6f8-49a8-4f37-8a66-34a10bad574a-signing-cabundle\") pod \"service-ca-67d667c7d-l288j\" (UID: \"363fb6f8-49a8-4f37-8a66-34a10bad574a\") " pod="openshift-service-ca/service-ca-67d667c7d-l288j"
May 28 14:54:56.009312 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:54:56.009287    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/363fb6f8-49a8-4f37-8a66-34a10bad574a-signing-key\") pod \"service-ca-67d667c7d-l288j\" (UID: \"363fb6f8-49a8-4f37-8a66-34a10bad574a\") " pod="openshift-service-ca/service-ca-67d667c7d-l288j"
May 28 14:54:56.017799 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:54:56.017778    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-828sk\" (UniqueName: \"kubernetes.io/projected/363fb6f8-49a8-4f37-8a66-34a10bad574a-kube-api-access-828sk\") pod \"service-ca-67d667c7d-l288j\" (UID: \"363fb6f8-49a8-4f37-8a66-34a10bad574a\") " pod="openshift-service-ca/service-ca-67d667c7d-l288j"
May 28 14:54:56.102263 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:54:56.102170    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-67d667c7d-l288j"
May 28 14:54:56.217909 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:54:56.217881    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-l288j"]
May 28 14:54:56.220751 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:54:56.220721    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod363fb6f8_49a8_4f37_8a66_34a10bad574a.slice/crio-46d472981bebd6e996853ba2ea5cc74972051a139592e370047511b94f3456fc WatchSource:0}: Error finding container 46d472981bebd6e996853ba2ea5cc74972051a139592e370047511b94f3456fc: Status 404 returned error can't find the container with id 46d472981bebd6e996853ba2ea5cc74972051a139592e370047511b94f3456fc
May 28 14:54:56.797198 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:54:56.797162    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-67d667c7d-l288j" event={"ID":"363fb6f8-49a8-4f37-8a66-34a10bad574a","Type":"ContainerStarted","Data":"f321cfa55dad0ca6401a08311c7e0446c6a21db83ce75f8a5d366e06ec0fcc5a"}
May 28 14:54:56.797198 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:54:56.797199    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-67d667c7d-l288j" event={"ID":"363fb6f8-49a8-4f37-8a66-34a10bad574a","Type":"ContainerStarted","Data":"46d472981bebd6e996853ba2ea5cc74972051a139592e370047511b94f3456fc"}
May 28 14:54:56.813977 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:54:56.813934    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca/service-ca-67d667c7d-l288j" podStartSLOduration=1.813922362 podStartE2EDuration="1.813922362s" podCreationTimestamp="2026-05-28 14:54:55 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 14:54:56.813137399 +0000 UTC m=+116.902354124" watchObservedRunningTime="2026-05-28 14:54:56.813922362 +0000 UTC m=+116.903139085"
May 28 14:54:56.913877 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:54:56.913849    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2e54aa3c-c7d9-4e5c-90d9-2d25d71de4a2-registry-tls\") pod \"image-registry-79544c6ccf-st9tg\" (UID: \"2e54aa3c-c7d9-4e5c-90d9-2d25d71de4a2\") " pod="openshift-image-registry/image-registry-79544c6ccf-st9tg"
May 28 14:54:56.914037 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:54:56.913985    2563 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 28 14:54:56.914037 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:54:56.914003    2563 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-79544c6ccf-st9tg: secret "image-registry-tls" not found
May 28 14:54:56.914141 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:54:56.914056    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2e54aa3c-c7d9-4e5c-90d9-2d25d71de4a2-registry-tls podName:2e54aa3c-c7d9-4e5c-90d9-2d25d71de4a2 nodeName:}" failed. No retries permitted until 2026-05-28 14:55:04.914040604 +0000 UTC m=+125.003257306 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2e54aa3c-c7d9-4e5c-90d9-2d25d71de4a2-registry-tls") pod "image-registry-79544c6ccf-st9tg" (UID: "2e54aa3c-c7d9-4e5c-90d9-2d25d71de4a2") : secret "image-registry-tls" not found
May 28 14:54:56.978499 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:54:56.978473    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-r8s4x_5e470d5c-c76c-452d-8add-a20856bab41f/dns-node-resolver/0.log"
May 28 14:54:57.978009 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:54:57.977980    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-mh529_18e17dc3-da42-4b11-8f21-5eb66227c6f7/node-ca/0.log"
May 28 14:54:59.480123 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:54:59.480078    2563 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-76dff48d59-86zbj"
May 28 14:54:59.480123 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:54:59.480124    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-76dff48d59-86zbj"
May 28 14:54:59.480666 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:54:59.480561    2563 scope.go:117] "RemoveContainer" containerID="4f100b52bf6268f4c91f8b764669bb488c0d6bafdeec099d5cf3047ed4a52a9a"
May 28 14:54:59.480834 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:54:59.480814    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-86zbj_openshift-console-operator(8d769c1c-5bf7-49c6-bf05-531b243e935e)\"" pod="openshift-console-operator/console-operator-76dff48d59-86zbj" podUID="8d769c1c-5bf7-49c6-bf05-531b243e935e"
May 28 14:55:04.979645 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:04.979609    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2e54aa3c-c7d9-4e5c-90d9-2d25d71de4a2-registry-tls\") pod \"image-registry-79544c6ccf-st9tg\" (UID: \"2e54aa3c-c7d9-4e5c-90d9-2d25d71de4a2\") " pod="openshift-image-registry/image-registry-79544c6ccf-st9tg"
May 28 14:55:04.982067 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:04.982037    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2e54aa3c-c7d9-4e5c-90d9-2d25d71de4a2-registry-tls\") pod \"image-registry-79544c6ccf-st9tg\" (UID: \"2e54aa3c-c7d9-4e5c-90d9-2d25d71de4a2\") " pod="openshift-image-registry/image-registry-79544c6ccf-st9tg"
May 28 14:55:05.085996 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:05.085964    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-qbq8w\""
May 28 14:55:05.094112 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:05.094081    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-79544c6ccf-st9tg"
May 28 14:55:05.216099 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:05.216066    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-79544c6ccf-st9tg"]
May 28 14:55:05.219040 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:55:05.219004    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e54aa3c_c7d9_4e5c_90d9_2d25d71de4a2.slice/crio-bdf02d7efe8e3c6912dbcc98c68e4e8383451dcc65a9a908c8f268704d5152d2 WatchSource:0}: Error finding container bdf02d7efe8e3c6912dbcc98c68e4e8383451dcc65a9a908c8f268704d5152d2: Status 404 returned error can't find the container with id bdf02d7efe8e3c6912dbcc98c68e4e8383451dcc65a9a908c8f268704d5152d2
May 28 14:55:05.819850 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:05.819815    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-79544c6ccf-st9tg" event={"ID":"2e54aa3c-c7d9-4e5c-90d9-2d25d71de4a2","Type":"ContainerStarted","Data":"bdba328be05dfe4bed1b429b165e45a70d77ed18b462c9a26849df3591470042"}
May 28 14:55:05.819850 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:05.819852    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-79544c6ccf-st9tg" event={"ID":"2e54aa3c-c7d9-4e5c-90d9-2d25d71de4a2","Type":"ContainerStarted","Data":"bdf02d7efe8e3c6912dbcc98c68e4e8383451dcc65a9a908c8f268704d5152d2"}
May 28 14:55:05.820188 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:05.819919    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-79544c6ccf-st9tg"
May 28 14:55:05.840885 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:05.840842    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-79544c6ccf-st9tg" podStartSLOduration=16.840828971 podStartE2EDuration="16.840828971s" podCreationTimestamp="2026-05-28 14:54:49 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 14:55:05.840319155 +0000 UTC m=+125.929535878" watchObservedRunningTime="2026-05-28 14:55:05.840828971 +0000 UTC m=+125.930045728"
May 28 14:55:10.223260 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:10.223223    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b51f6e42-ac3f-47b9-8962-ec51c836ad35-metrics-certs\") pod \"network-metrics-daemon-v4dpk\" (UID: \"b51f6e42-ac3f-47b9-8962-ec51c836ad35\") " pod="openshift-multus/network-metrics-daemon-v4dpk"
May 28 14:55:10.225409 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:10.225390    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b51f6e42-ac3f-47b9-8962-ec51c836ad35-metrics-certs\") pod \"network-metrics-daemon-v4dpk\" (UID: \"b51f6e42-ac3f-47b9-8962-ec51c836ad35\") " pod="openshift-multus/network-metrics-daemon-v4dpk"
May 28 14:55:10.399589 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:10.399556    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-4kpj5\""
May 28 14:55:10.405975 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:10.405956    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v4dpk"
May 28 14:55:10.529188 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:10.529159    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-v4dpk"]
May 28 14:55:10.532295 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:55:10.532264    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb51f6e42_ac3f_47b9_8962_ec51c836ad35.slice/crio-bdc095fd16c1d563d2fbf5097f5fbd0aaa364aa8015d92c19a0f2d1e145a7cb6 WatchSource:0}: Error finding container bdc095fd16c1d563d2fbf5097f5fbd0aaa364aa8015d92c19a0f2d1e145a7cb6: Status 404 returned error can't find the container with id bdc095fd16c1d563d2fbf5097f5fbd0aaa364aa8015d92c19a0f2d1e145a7cb6
May 28 14:55:10.833046 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:10.833010    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-v4dpk" event={"ID":"b51f6e42-ac3f-47b9-8962-ec51c836ad35","Type":"ContainerStarted","Data":"bdc095fd16c1d563d2fbf5097f5fbd0aaa364aa8015d92c19a0f2d1e145a7cb6"}
May 28 14:55:11.837874 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:11.837844    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-v4dpk" event={"ID":"b51f6e42-ac3f-47b9-8962-ec51c836ad35","Type":"ContainerStarted","Data":"8d9ebe18ca43da5f1717d0ec06f8838cc7ca1a534320fe2679a783265a54e26b"}
May 28 14:55:11.837874 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:11.837877    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-v4dpk" event={"ID":"b51f6e42-ac3f-47b9-8962-ec51c836ad35","Type":"ContainerStarted","Data":"df1241bb235221d1368bc2496559e01b2bbbd0b6c89c4a3be75f230c24e43f7f"}
May 28 14:55:11.852514 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:11.852468    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-v4dpk" podStartSLOduration=130.726818235 podStartE2EDuration="2m11.852454972s" podCreationTimestamp="2026-05-28 14:53:00 +0000 UTC" firstStartedPulling="2026-05-28 14:55:10.534156588 +0000 UTC m=+130.623373291" lastFinishedPulling="2026-05-28 14:55:11.659793324 +0000 UTC m=+131.749010028" observedRunningTime="2026-05-28 14:55:11.852426512 +0000 UTC m=+131.941643235" watchObservedRunningTime="2026-05-28 14:55:11.852454972 +0000 UTC m=+131.941671742"
May 28 14:55:14.476248 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:14.476210    2563 scope.go:117] "RemoveContainer" containerID="4f100b52bf6268f4c91f8b764669bb488c0d6bafdeec099d5cf3047ed4a52a9a"
May 28 14:55:14.846866 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:14.846837    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-86zbj_8d769c1c-5bf7-49c6-bf05-531b243e935e/console-operator/2.log"
May 28 14:55:14.847211 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:14.847194    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-86zbj_8d769c1c-5bf7-49c6-bf05-531b243e935e/console-operator/1.log"
May 28 14:55:14.847307 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:14.847233    2563 generic.go:358] "Generic (PLEG): container finished" podID="8d769c1c-5bf7-49c6-bf05-531b243e935e" containerID="7fbc8d2d98a13c93a76ff03c0a049c86708f6b7a012d022a920a546cb5091885" exitCode=255
May 28 14:55:14.847307 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:14.847289    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-86zbj" event={"ID":"8d769c1c-5bf7-49c6-bf05-531b243e935e","Type":"ContainerDied","Data":"7fbc8d2d98a13c93a76ff03c0a049c86708f6b7a012d022a920a546cb5091885"}
May 28 14:55:14.847410 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:14.847331    2563 scope.go:117] "RemoveContainer" containerID="4f100b52bf6268f4c91f8b764669bb488c0d6bafdeec099d5cf3047ed4a52a9a"
May 28 14:55:14.847703 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:14.847664    2563 scope.go:117] "RemoveContainer" containerID="7fbc8d2d98a13c93a76ff03c0a049c86708f6b7a012d022a920a546cb5091885"
May 28 14:55:14.847864 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:55:14.847848    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-76dff48d59-86zbj_openshift-console-operator(8d769c1c-5bf7-49c6-bf05-531b243e935e)\"" pod="openshift-console-operator/console-operator-76dff48d59-86zbj" podUID="8d769c1c-5bf7-49c6-bf05-531b243e935e"
May 28 14:55:15.851302 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:15.851274    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-86zbj_8d769c1c-5bf7-49c6-bf05-531b243e935e/console-operator/2.log"
May 28 14:55:19.479214 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:19.479164    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-76dff48d59-86zbj"
May 28 14:55:19.479214 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:19.479221    2563 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-76dff48d59-86zbj"
May 28 14:55:19.479631 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:19.479545    2563 scope.go:117] "RemoveContainer" containerID="7fbc8d2d98a13c93a76ff03c0a049c86708f6b7a012d022a920a546cb5091885"
May 28 14:55:19.479776 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:55:19.479746    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-76dff48d59-86zbj_openshift-console-operator(8d769c1c-5bf7-49c6-bf05-531b243e935e)\"" pod="openshift-console-operator/console-operator-76dff48d59-86zbj" podUID="8d769c1c-5bf7-49c6-bf05-531b243e935e"
May 28 14:55:19.553042 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:19.553001    2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-79544c6ccf-st9tg"]
May 28 14:55:19.580963 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:19.580934    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-tqpl4"]
May 28 14:55:19.584892 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:19.584873    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-tqpl4"
May 28 14:55:19.587797 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:19.587780    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-qv7th\""
May 28 14:55:19.587914 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:19.587780    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
May 28 14:55:19.590360 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:19.590336    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7fa67c32-1825-4c11-ab7c-17a5d35ff70a-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-tqpl4\" (UID: \"7fa67c32-1825-4c11-ab7c-17a5d35ff70a\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-tqpl4"
May 28 14:55:19.590455 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:19.590426    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/7fa67c32-1825-4c11-ab7c-17a5d35ff70a-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-tqpl4\" (UID: \"7fa67c32-1825-4c11-ab7c-17a5d35ff70a\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-tqpl4"
May 28 14:55:19.590610 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:19.590594    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
May 28 14:55:19.605849 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:19.605821    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-tqpl4"]
May 28 14:55:19.689427 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:19.689396    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-55b856b77f-lrgn5"]
May 28 14:55:19.690790 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:19.690760    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7fa67c32-1825-4c11-ab7c-17a5d35ff70a-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-tqpl4\" (UID: \"7fa67c32-1825-4c11-ab7c-17a5d35ff70a\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-tqpl4"
May 28 14:55:19.690942 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:19.690860    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/7fa67c32-1825-4c11-ab7c-17a5d35ff70a-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-tqpl4\" (UID: \"7fa67c32-1825-4c11-ab7c-17a5d35ff70a\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-tqpl4"
May 28 14:55:19.691533 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:19.691506    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/7fa67c32-1825-4c11-ab7c-17a5d35ff70a-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-tqpl4\" (UID: \"7fa67c32-1825-4c11-ab7c-17a5d35ff70a\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-tqpl4"
May 28 14:55:19.692387 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:19.692372    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-55b856b77f-lrgn5"
May 28 14:55:19.693393 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:19.693372    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7fa67c32-1825-4c11-ab7c-17a5d35ff70a-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-tqpl4\" (UID: \"7fa67c32-1825-4c11-ab7c-17a5d35ff70a\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-tqpl4"
May 28 14:55:19.714223 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:19.714200    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-hrhzw"]
May 28 14:55:19.717265 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:19.717250    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-hrhzw"
May 28 14:55:19.719533 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:19.719512    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-m4jwb\""
May 28 14:55:19.719667 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:19.719657    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
May 28 14:55:19.720124 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:19.720103    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
May 28 14:55:19.720226 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:19.720139    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
May 28 14:55:19.720440 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:19.720421    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-55b856b77f-lrgn5"]
May 28 14:55:19.720960 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:19.720943    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
May 28 14:55:19.754859 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:19.754833    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-hrhzw"]
May 28 14:55:19.791933 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:19.791907    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3817f2d6-18e4-4c46-81d5-e610b568bcf1-ca-trust-extracted\") pod \"image-registry-55b856b77f-lrgn5\" (UID: \"3817f2d6-18e4-4c46-81d5-e610b568bcf1\") " pod="openshift-image-registry/image-registry-55b856b77f-lrgn5"
May 28 14:55:19.792105 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:19.791943    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3817f2d6-18e4-4c46-81d5-e610b568bcf1-registry-tls\") pod \"image-registry-55b856b77f-lrgn5\" (UID: \"3817f2d6-18e4-4c46-81d5-e610b568bcf1\") " pod="openshift-image-registry/image-registry-55b856b77f-lrgn5"
May 28 14:55:19.792105 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:19.791978    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3817f2d6-18e4-4c46-81d5-e610b568bcf1-registry-certificates\") pod \"image-registry-55b856b77f-lrgn5\" (UID: \"3817f2d6-18e4-4c46-81d5-e610b568bcf1\") " pod="openshift-image-registry/image-registry-55b856b77f-lrgn5"
May 28 14:55:19.792105 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:19.791995    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3817f2d6-18e4-4c46-81d5-e610b568bcf1-installation-pull-secrets\") pod \"image-registry-55b856b77f-lrgn5\" (UID: \"3817f2d6-18e4-4c46-81d5-e610b568bcf1\") " pod="openshift-image-registry/image-registry-55b856b77f-lrgn5"
May 28 14:55:19.792105 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:19.792018    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2b173979-adf9-4e10-a9f2-58ba12012b73-crio-socket\") pod \"insights-runtime-extractor-hrhzw\" (UID: \"2b173979-adf9-4e10-a9f2-58ba12012b73\") " pod="openshift-insights/insights-runtime-extractor-hrhzw"
May 28 14:55:19.792283 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:19.792108    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sk4pt\" (UniqueName: \"kubernetes.io/projected/3817f2d6-18e4-4c46-81d5-e610b568bcf1-kube-api-access-sk4pt\") pod \"image-registry-55b856b77f-lrgn5\" (UID: \"3817f2d6-18e4-4c46-81d5-e610b568bcf1\") " pod="openshift-image-registry/image-registry-55b856b77f-lrgn5"
May 28 14:55:19.792283 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:19.792137    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3817f2d6-18e4-4c46-81d5-e610b568bcf1-image-registry-private-configuration\") pod \"image-registry-55b856b77f-lrgn5\" (UID: \"3817f2d6-18e4-4c46-81d5-e610b568bcf1\") " pod="openshift-image-registry/image-registry-55b856b77f-lrgn5"
May 28 14:55:19.792283 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:19.792157    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3817f2d6-18e4-4c46-81d5-e610b568bcf1-bound-sa-token\") pod \"image-registry-55b856b77f-lrgn5\" (UID: \"3817f2d6-18e4-4c46-81d5-e610b568bcf1\") " pod="openshift-image-registry/image-registry-55b856b77f-lrgn5"
May 28 14:55:19.792283 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:19.792173    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2b173979-adf9-4e10-a9f2-58ba12012b73-data-volume\") pod \"insights-runtime-extractor-hrhzw\" (UID: \"2b173979-adf9-4e10-a9f2-58ba12012b73\") " pod="openshift-insights/insights-runtime-extractor-hrhzw"
May 28 14:55:19.792283 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:19.792196    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sssr6\" (UniqueName: \"kubernetes.io/projected/2b173979-adf9-4e10-a9f2-58ba12012b73-kube-api-access-sssr6\") pod \"insights-runtime-extractor-hrhzw\" (UID: \"2b173979-adf9-4e10-a9f2-58ba12012b73\") " pod="openshift-insights/insights-runtime-extractor-hrhzw"
May 28 14:55:19.792283 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:19.792213    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2b173979-adf9-4e10-a9f2-58ba12012b73-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hrhzw\" (UID: \"2b173979-adf9-4e10-a9f2-58ba12012b73\") " pod="openshift-insights/insights-runtime-extractor-hrhzw"
May 28 14:55:19.792283 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:19.792246    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2b173979-adf9-4e10-a9f2-58ba12012b73-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hrhzw\" (UID: \"2b173979-adf9-4e10-a9f2-58ba12012b73\") " pod="openshift-insights/insights-runtime-extractor-hrhzw"
May 28 14:55:19.792283 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:19.792275    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3817f2d6-18e4-4c46-81d5-e610b568bcf1-trusted-ca\") pod \"image-registry-55b856b77f-lrgn5\" (UID: \"3817f2d6-18e4-4c46-81d5-e610b568bcf1\") " pod="openshift-image-registry/image-registry-55b856b77f-lrgn5"
May 28 14:55:19.893380 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:19.893344    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-tqpl4"
May 28 14:55:19.893568 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:19.893474    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3817f2d6-18e4-4c46-81d5-e610b568bcf1-ca-trust-extracted\") pod \"image-registry-55b856b77f-lrgn5\" (UID: \"3817f2d6-18e4-4c46-81d5-e610b568bcf1\") " pod="openshift-image-registry/image-registry-55b856b77f-lrgn5"
May 28 14:55:19.893568 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:19.893517    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3817f2d6-18e4-4c46-81d5-e610b568bcf1-registry-tls\") pod \"image-registry-55b856b77f-lrgn5\" (UID: \"3817f2d6-18e4-4c46-81d5-e610b568bcf1\") " pod="openshift-image-registry/image-registry-55b856b77f-lrgn5"
May 28 14:55:19.893568 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:19.893560    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3817f2d6-18e4-4c46-81d5-e610b568bcf1-registry-certificates\") pod \"image-registry-55b856b77f-lrgn5\" (UID: \"3817f2d6-18e4-4c46-81d5-e610b568bcf1\") " pod="openshift-image-registry/image-registry-55b856b77f-lrgn5"
May 28 14:55:19.893765 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:19.893584    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3817f2d6-18e4-4c46-81d5-e610b568bcf1-installation-pull-secrets\") pod \"image-registry-55b856b77f-lrgn5\" (UID: \"3817f2d6-18e4-4c46-81d5-e610b568bcf1\") " pod="openshift-image-registry/image-registry-55b856b77f-lrgn5"
May 28 14:55:19.893765 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:19.893611    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2b173979-adf9-4e10-a9f2-58ba12012b73-crio-socket\") pod \"insights-runtime-extractor-hrhzw\" (UID: \"2b173979-adf9-4e10-a9f2-58ba12012b73\") " pod="openshift-insights/insights-runtime-extractor-hrhzw"
May 28 14:55:19.893765 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:19.893660    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sk4pt\" (UniqueName: \"kubernetes.io/projected/3817f2d6-18e4-4c46-81d5-e610b568bcf1-kube-api-access-sk4pt\") pod \"image-registry-55b856b77f-lrgn5\" (UID: \"3817f2d6-18e4-4c46-81d5-e610b568bcf1\") " pod="openshift-image-registry/image-registry-55b856b77f-lrgn5"
May 28 14:55:19.893765 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:19.893721    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3817f2d6-18e4-4c46-81d5-e610b568bcf1-image-registry-private-configuration\") pod \"image-registry-55b856b77f-lrgn5\" (UID: \"3817f2d6-18e4-4c46-81d5-e610b568bcf1\") " pod="openshift-image-registry/image-registry-55b856b77f-lrgn5"
May 28 14:55:19.893956 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:19.893769    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2b173979-adf9-4e10-a9f2-58ba12012b73-crio-socket\") pod \"insights-runtime-extractor-hrhzw\" (UID: \"2b173979-adf9-4e10-a9f2-58ba12012b73\") " pod="openshift-insights/insights-runtime-extractor-hrhzw"
May 28 14:55:19.893956 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:19.893897    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3817f2d6-18e4-4c46-81d5-e610b568bcf1-ca-trust-extracted\") pod \"image-registry-55b856b77f-lrgn5\" (UID: \"3817f2d6-18e4-4c46-81d5-e610b568bcf1\") " pod="openshift-image-registry/image-registry-55b856b77f-lrgn5"
May 28 14:55:19.894449 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:19.894177    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3817f2d6-18e4-4c46-81d5-e610b568bcf1-bound-sa-token\") pod \"image-registry-55b856b77f-lrgn5\" (UID: \"3817f2d6-18e4-4c46-81d5-e610b568bcf1\") " pod="openshift-image-registry/image-registry-55b856b77f-lrgn5"
May 28 14:55:19.894449 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:19.894218    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2b173979-adf9-4e10-a9f2-58ba12012b73-data-volume\") pod \"insights-runtime-extractor-hrhzw\" (UID: \"2b173979-adf9-4e10-a9f2-58ba12012b73\") " pod="openshift-insights/insights-runtime-extractor-hrhzw"
May 28 14:55:19.894449 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:19.894259    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sssr6\" (UniqueName: \"kubernetes.io/projected/2b173979-adf9-4e10-a9f2-58ba12012b73-kube-api-access-sssr6\") pod \"insights-runtime-extractor-hrhzw\" (UID: \"2b173979-adf9-4e10-a9f2-58ba12012b73\") " pod="openshift-insights/insights-runtime-extractor-hrhzw"
May 28 14:55:19.894449 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:19.894291    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2b173979-adf9-4e10-a9f2-58ba12012b73-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hrhzw\" (UID: \"2b173979-adf9-4e10-a9f2-58ba12012b73\") " pod="openshift-insights/insights-runtime-extractor-hrhzw"
May 28 14:55:19.894449 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:19.894319    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2b173979-adf9-4e10-a9f2-58ba12012b73-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hrhzw\" (UID: \"2b173979-adf9-4e10-a9f2-58ba12012b73\") " pod="openshift-insights/insights-runtime-extractor-hrhzw"
May 28 14:55:19.894449 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:19.894353    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3817f2d6-18e4-4c46-81d5-e610b568bcf1-trusted-ca\") pod \"image-registry-55b856b77f-lrgn5\" (UID: \"3817f2d6-18e4-4c46-81d5-e610b568bcf1\") " pod="openshift-image-registry/image-registry-55b856b77f-lrgn5"
May 28 14:55:19.894774 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:19.894501    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3817f2d6-18e4-4c46-81d5-e610b568bcf1-registry-certificates\") pod \"image-registry-55b856b77f-lrgn5\" (UID: \"3817f2d6-18e4-4c46-81d5-e610b568bcf1\") " pod="openshift-image-registry/image-registry-55b856b77f-lrgn5"
May 28 14:55:19.894774 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:19.894548    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2b173979-adf9-4e10-a9f2-58ba12012b73-data-volume\") pod \"insights-runtime-extractor-hrhzw\" (UID: \"2b173979-adf9-4e10-a9f2-58ba12012b73\") " pod="openshift-insights/insights-runtime-extractor-hrhzw"
May 28 14:55:19.895041 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:19.895011    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2b173979-adf9-4e10-a9f2-58ba12012b73-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hrhzw\" (UID: \"2b173979-adf9-4e10-a9f2-58ba12012b73\") " pod="openshift-insights/insights-runtime-extractor-hrhzw"
May 28 14:55:19.895571 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:19.895547    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3817f2d6-18e4-4c46-81d5-e610b568bcf1-trusted-ca\") pod \"image-registry-55b856b77f-lrgn5\" (UID: \"3817f2d6-18e4-4c46-81d5-e610b568bcf1\") " pod="openshift-image-registry/image-registry-55b856b77f-lrgn5"
May 28 14:55:19.896581 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:19.896562    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3817f2d6-18e4-4c46-81d5-e610b568bcf1-installation-pull-secrets\") pod \"image-registry-55b856b77f-lrgn5\" (UID: \"3817f2d6-18e4-4c46-81d5-e610b568bcf1\") " pod="openshift-image-registry/image-registry-55b856b77f-lrgn5"
May 28 14:55:19.896704 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:19.896690    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3817f2d6-18e4-4c46-81d5-e610b568bcf1-registry-tls\") pod \"image-registry-55b856b77f-lrgn5\" (UID: \"3817f2d6-18e4-4c46-81d5-e610b568bcf1\") " pod="openshift-image-registry/image-registry-55b856b77f-lrgn5"
May 28 14:55:19.897109 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:19.897086    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3817f2d6-18e4-4c46-81d5-e610b568bcf1-image-registry-private-configuration\") pod \"image-registry-55b856b77f-lrgn5\" (UID: \"3817f2d6-18e4-4c46-81d5-e610b568bcf1\") " pod="openshift-image-registry/image-registry-55b856b77f-lrgn5"
May 28 14:55:19.897190 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:19.897133    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2b173979-adf9-4e10-a9f2-58ba12012b73-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hrhzw\" (UID: \"2b173979-adf9-4e10-a9f2-58ba12012b73\") " pod="openshift-insights/insights-runtime-extractor-hrhzw"
May 28 14:55:19.903639 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:19.903620    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sk4pt\" (UniqueName: \"kubernetes.io/projected/3817f2d6-18e4-4c46-81d5-e610b568bcf1-kube-api-access-sk4pt\") pod \"image-registry-55b856b77f-lrgn5\" (UID: \"3817f2d6-18e4-4c46-81d5-e610b568bcf1\") " pod="openshift-image-registry/image-registry-55b856b77f-lrgn5"
May 28 14:55:19.903639 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:19.903631    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3817f2d6-18e4-4c46-81d5-e610b568bcf1-bound-sa-token\") pod \"image-registry-55b856b77f-lrgn5\" (UID: \"3817f2d6-18e4-4c46-81d5-e610b568bcf1\") " pod="openshift-image-registry/image-registry-55b856b77f-lrgn5"
May 28 14:55:19.903779 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:19.903648    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sssr6\" (UniqueName: \"kubernetes.io/projected/2b173979-adf9-4e10-a9f2-58ba12012b73-kube-api-access-sssr6\") pod \"insights-runtime-extractor-hrhzw\" (UID: \"2b173979-adf9-4e10-a9f2-58ba12012b73\") " pod="openshift-insights/insights-runtime-extractor-hrhzw"
May 28 14:55:20.006474 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:20.006405    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-55b856b77f-lrgn5"
May 28 14:55:20.019026 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:20.018995    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-tqpl4"]
May 28 14:55:20.023604 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:55:20.023575    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7fa67c32_1825_4c11_ab7c_17a5d35ff70a.slice/crio-17c5d22c341318410fc93647f9ba8c874cba8f2a4fc7649f4152b3f8d1ff9bbc WatchSource:0}: Error finding container 17c5d22c341318410fc93647f9ba8c874cba8f2a4fc7649f4152b3f8d1ff9bbc: Status 404 returned error can't find the container with id 17c5d22c341318410fc93647f9ba8c874cba8f2a4fc7649f4152b3f8d1ff9bbc
May 28 14:55:20.025959 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:20.025923    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-hrhzw"
May 28 14:55:20.142470 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:20.142426    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-55b856b77f-lrgn5"]
May 28 14:55:20.145521 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:55:20.145491    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3817f2d6_18e4_4c46_81d5_e610b568bcf1.slice/crio-1b890cf50322f99da4b3d17036a3af85e3fbc2205fc083293c3c05619b594225 WatchSource:0}: Error finding container 1b890cf50322f99da4b3d17036a3af85e3fbc2205fc083293c3c05619b594225: Status 404 returned error can't find the container with id 1b890cf50322f99da4b3d17036a3af85e3fbc2205fc083293c3c05619b594225
May 28 14:55:20.158486 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:20.158458    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-hrhzw"]
May 28 14:55:20.160961 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:55:20.160940    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b173979_adf9_4e10_a9f2_58ba12012b73.slice/crio-b9dc7b071eb8f83e4ebe89b1d84ad9b82f5b87312763dab81ab424967bcc00f2 WatchSource:0}: Error finding container b9dc7b071eb8f83e4ebe89b1d84ad9b82f5b87312763dab81ab424967bcc00f2: Status 404 returned error can't find the container with id b9dc7b071eb8f83e4ebe89b1d84ad9b82f5b87312763dab81ab424967bcc00f2
May 28 14:55:20.867849 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:20.867818    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hrhzw" event={"ID":"2b173979-adf9-4e10-a9f2-58ba12012b73","Type":"ContainerStarted","Data":"163690821e959a15e36765c38926117545d4360af58e76cb668340b505be358d"}
May 28 14:55:20.868213 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:20.867861    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hrhzw" event={"ID":"2b173979-adf9-4e10-a9f2-58ba12012b73","Type":"ContainerStarted","Data":"b9dc7b071eb8f83e4ebe89b1d84ad9b82f5b87312763dab81ab424967bcc00f2"}
May 28 14:55:20.869262 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:20.869233    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-55b856b77f-lrgn5" event={"ID":"3817f2d6-18e4-4c46-81d5-e610b568bcf1","Type":"ContainerStarted","Data":"d9e72d321f9bf98df7780f22b013c08311eefdd75a43cb880d5c5202b3a353bf"}
May 28 14:55:20.869376 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:20.869267    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-55b856b77f-lrgn5" event={"ID":"3817f2d6-18e4-4c46-81d5-e610b568bcf1","Type":"ContainerStarted","Data":"1b890cf50322f99da4b3d17036a3af85e3fbc2205fc083293c3c05619b594225"}
May 28 14:55:20.869453 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:20.869436    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-55b856b77f-lrgn5"
May 28 14:55:20.870408 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:20.870385    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-tqpl4" event={"ID":"7fa67c32-1825-4c11-ab7c-17a5d35ff70a","Type":"ContainerStarted","Data":"17c5d22c341318410fc93647f9ba8c874cba8f2a4fc7649f4152b3f8d1ff9bbc"}
May 28 14:55:20.889873 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:20.889786    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-55b856b77f-lrgn5" podStartSLOduration=1.889769424 podStartE2EDuration="1.889769424s" podCreationTimestamp="2026-05-28 14:55:19 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 14:55:20.888262897 +0000 UTC m=+140.977479620" watchObservedRunningTime="2026-05-28 14:55:20.889769424 +0000 UTC m=+140.978986148"
May 28 14:55:21.874464 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:21.874431    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hrhzw" event={"ID":"2b173979-adf9-4e10-a9f2-58ba12012b73","Type":"ContainerStarted","Data":"fca2173123d33e7c0dc318034ced7f9df48c618633852eb97efdcfc7b8b76572"}
May 28 14:55:21.875889 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:21.875857    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-tqpl4" event={"ID":"7fa67c32-1825-4c11-ab7c-17a5d35ff70a","Type":"ContainerStarted","Data":"08f4478a4f41b17639b3f27515d0ea656486e7ac97822feede669cc831960bfa"}
May 28 14:55:21.892201 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:21.892145    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-tqpl4" podStartSLOduration=1.654719246 podStartE2EDuration="2.892127332s" podCreationTimestamp="2026-05-28 14:55:19 +0000 UTC" firstStartedPulling="2026-05-28 14:55:20.025714047 +0000 UTC m=+140.114930748" lastFinishedPulling="2026-05-28 14:55:21.26312213 +0000 UTC m=+141.352338834" observedRunningTime="2026-05-28 14:55:21.890851781 +0000 UTC m=+141.980068505" watchObservedRunningTime="2026-05-28 14:55:21.892127332 +0000 UTC m=+141.981344054"
May 28 14:55:22.880090 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:22.880052    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hrhzw" event={"ID":"2b173979-adf9-4e10-a9f2-58ba12012b73","Type":"ContainerStarted","Data":"fad829032f426b2a55a4e46a268895f5adea7c95ef8c6efba45518e4a0a28154"}
May 28 14:55:22.898598 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:22.898536    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-hrhzw" podStartSLOduration=1.900180675 podStartE2EDuration="3.898518529s" podCreationTimestamp="2026-05-28 14:55:19 +0000 UTC" firstStartedPulling="2026-05-28 14:55:20.206122232 +0000 UTC m=+140.295338933" lastFinishedPulling="2026-05-28 14:55:22.204460083 +0000 UTC m=+142.293676787" observedRunningTime="2026-05-28 14:55:22.896821032 +0000 UTC m=+142.986037755" watchObservedRunningTime="2026-05-28 14:55:22.898518529 +0000 UTC m=+142.987735253"
May 28 14:55:27.035691 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:27.035643    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-hkslr"]
May 28 14:55:27.038666 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:27.038649    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7779bbdd78-hkslr"
May 28 14:55:27.042101 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:27.041912    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
May 28 14:55:27.042101 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:27.041948    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
May 28 14:55:27.042101 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:27.041952    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
May 28 14:55:27.042101 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:27.042025    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
May 28 14:55:27.042101 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:27.041916    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-mhvl7\""
May 28 14:55:27.042101 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:27.042054    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
May 28 14:55:27.046549 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:27.046402    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-hkslr"]
May 28 14:55:27.058643 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:27.058621    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/ae3cc6d4-0748-46b7-afda-657acd5a79c6-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-hkslr\" (UID: \"ae3cc6d4-0748-46b7-afda-657acd5a79c6\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-hkslr"
May 28 14:55:27.058762 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:27.058657    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ae3cc6d4-0748-46b7-afda-657acd5a79c6-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-hkslr\" (UID: \"ae3cc6d4-0748-46b7-afda-657acd5a79c6\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-hkslr"
May 28 14:55:27.058762 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:27.058693    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vmtjt\" (UniqueName: \"kubernetes.io/projected/ae3cc6d4-0748-46b7-afda-657acd5a79c6-kube-api-access-vmtjt\") pod \"prometheus-operator-7779bbdd78-hkslr\" (UID: \"ae3cc6d4-0748-46b7-afda-657acd5a79c6\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-hkslr"
May 28 14:55:27.058836 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:27.058812    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ae3cc6d4-0748-46b7-afda-657acd5a79c6-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-hkslr\" (UID: \"ae3cc6d4-0748-46b7-afda-657acd5a79c6\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-hkslr"
May 28 14:55:27.159349 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:27.159318    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/ae3cc6d4-0748-46b7-afda-657acd5a79c6-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-hkslr\" (UID: \"ae3cc6d4-0748-46b7-afda-657acd5a79c6\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-hkslr"
May 28 14:55:27.159519 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:27.159362    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ae3cc6d4-0748-46b7-afda-657acd5a79c6-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-hkslr\" (UID: \"ae3cc6d4-0748-46b7-afda-657acd5a79c6\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-hkslr"
May 28 14:55:27.159519 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:27.159388    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vmtjt\" (UniqueName: \"kubernetes.io/projected/ae3cc6d4-0748-46b7-afda-657acd5a79c6-kube-api-access-vmtjt\") pod \"prometheus-operator-7779bbdd78-hkslr\" (UID: \"ae3cc6d4-0748-46b7-afda-657acd5a79c6\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-hkslr"
May 28 14:55:27.159519 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:27.159433    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ae3cc6d4-0748-46b7-afda-657acd5a79c6-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-hkslr\" (UID: \"ae3cc6d4-0748-46b7-afda-657acd5a79c6\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-hkslr"
May 28 14:55:27.159519 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:55:27.159476    2563 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
May 28 14:55:27.159776 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:55:27.159555    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae3cc6d4-0748-46b7-afda-657acd5a79c6-prometheus-operator-tls podName:ae3cc6d4-0748-46b7-afda-657acd5a79c6 nodeName:}" failed. No retries permitted until 2026-05-28 14:55:27.659538208 +0000 UTC m=+147.748754946 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/ae3cc6d4-0748-46b7-afda-657acd5a79c6-prometheus-operator-tls") pod "prometheus-operator-7779bbdd78-hkslr" (UID: "ae3cc6d4-0748-46b7-afda-657acd5a79c6") : secret "prometheus-operator-tls" not found
May 28 14:55:27.160160 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:27.160144    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ae3cc6d4-0748-46b7-afda-657acd5a79c6-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-hkslr\" (UID: \"ae3cc6d4-0748-46b7-afda-657acd5a79c6\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-hkslr"
May 28 14:55:27.161772 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:27.161740    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ae3cc6d4-0748-46b7-afda-657acd5a79c6-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-hkslr\" (UID: \"ae3cc6d4-0748-46b7-afda-657acd5a79c6\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-hkslr"
May 28 14:55:27.168794 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:27.168767    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vmtjt\" (UniqueName: \"kubernetes.io/projected/ae3cc6d4-0748-46b7-afda-657acd5a79c6-kube-api-access-vmtjt\") pod \"prometheus-operator-7779bbdd78-hkslr\" (UID: \"ae3cc6d4-0748-46b7-afda-657acd5a79c6\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-hkslr"
May 28 14:55:27.663345 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:27.663314    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/ae3cc6d4-0748-46b7-afda-657acd5a79c6-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-hkslr\" (UID: \"ae3cc6d4-0748-46b7-afda-657acd5a79c6\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-hkslr"
May 28 14:55:27.665622 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:27.665600    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/ae3cc6d4-0748-46b7-afda-657acd5a79c6-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-hkslr\" (UID: \"ae3cc6d4-0748-46b7-afda-657acd5a79c6\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-hkslr"
May 28 14:55:27.949310 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:27.949212    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7779bbdd78-hkslr"
May 28 14:55:28.072201 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:28.072091    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-hkslr"]
May 28 14:55:28.075740 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:55:28.075711    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae3cc6d4_0748_46b7_afda_657acd5a79c6.slice/crio-f19dbd0f9b128c1f68bf1824f50ec1232e66614a791877eb3a5ed36248361324 WatchSource:0}: Error finding container f19dbd0f9b128c1f68bf1824f50ec1232e66614a791877eb3a5ed36248361324: Status 404 returned error can't find the container with id f19dbd0f9b128c1f68bf1824f50ec1232e66614a791877eb3a5ed36248361324
May 28 14:55:28.897190 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:28.897152    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-hkslr" event={"ID":"ae3cc6d4-0748-46b7-afda-657acd5a79c6","Type":"ContainerStarted","Data":"f19dbd0f9b128c1f68bf1824f50ec1232e66614a791877eb3a5ed36248361324"}
May 28 14:55:29.558607 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:29.558561    2563 patch_prober.go:28] interesting pod/image-registry-79544c6ccf-st9tg container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
May 28 14:55:29.559008 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:29.558633    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-79544c6ccf-st9tg" podUID="2e54aa3c-c7d9-4e5c-90d9-2d25d71de4a2" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 28 14:55:29.900628 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:29.900544    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-hkslr" event={"ID":"ae3cc6d4-0748-46b7-afda-657acd5a79c6","Type":"ContainerStarted","Data":"9584c257919a3b194023b92bef1ec4372184c37dee4a317cf1c53b9600f5f88c"}
May 28 14:55:29.900628 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:29.900587    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-hkslr" event={"ID":"ae3cc6d4-0748-46b7-afda-657acd5a79c6","Type":"ContainerStarted","Data":"9f5e084dd13d19f50da1f0e01cd07cc88c4b99bee3cec3d2ed10c57f45a93b0c"}
May 28 14:55:29.916463 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:29.916404    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7779bbdd78-hkslr" podStartSLOduration=1.814498406 podStartE2EDuration="2.916391104s" podCreationTimestamp="2026-05-28 14:55:27 +0000 UTC" firstStartedPulling="2026-05-28 14:55:28.077558839 +0000 UTC m=+148.166775544" lastFinishedPulling="2026-05-28 14:55:29.179451537 +0000 UTC m=+149.268668242" observedRunningTime="2026-05-28 14:55:29.915705781 +0000 UTC m=+150.004922503" watchObservedRunningTime="2026-05-28 14:55:29.916391104 +0000 UTC m=+150.005607826"
May 28 14:55:31.369877 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:31.369834    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-dmsps"]
May 28 14:55:31.373059 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:31.373031    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-dmsps"
May 28 14:55:31.375417 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:31.375380    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
May 28 14:55:31.375581 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:31.375385    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
May 28 14:55:31.375736 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:31.375716    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-mw2v6\""
May 28 14:55:31.375817 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:31.375717    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
May 28 14:55:31.391015 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:31.390990    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f0d4089f-9f1b-43cb-be91-b5820f788ca4-metrics-client-ca\") pod \"node-exporter-dmsps\" (UID: \"f0d4089f-9f1b-43cb-be91-b5820f788ca4\") " pod="openshift-monitoring/node-exporter-dmsps"
May 28 14:55:31.391108 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:31.391030    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f0d4089f-9f1b-43cb-be91-b5820f788ca4-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-dmsps\" (UID: \"f0d4089f-9f1b-43cb-be91-b5820f788ca4\") " pod="openshift-monitoring/node-exporter-dmsps"
May 28 14:55:31.391108 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:31.391089    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f7z2w\" (UniqueName: \"kubernetes.io/projected/f0d4089f-9f1b-43cb-be91-b5820f788ca4-kube-api-access-f7z2w\") pod \"node-exporter-dmsps\" (UID: \"f0d4089f-9f1b-43cb-be91-b5820f788ca4\") " pod="openshift-monitoring/node-exporter-dmsps"
May 28 14:55:31.391188 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:31.391140    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f0d4089f-9f1b-43cb-be91-b5820f788ca4-root\") pod \"node-exporter-dmsps\" (UID: \"f0d4089f-9f1b-43cb-be91-b5820f788ca4\") " pod="openshift-monitoring/node-exporter-dmsps"
May 28 14:55:31.391188 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:31.391167    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f0d4089f-9f1b-43cb-be91-b5820f788ca4-node-exporter-tls\") pod \"node-exporter-dmsps\" (UID: \"f0d4089f-9f1b-43cb-be91-b5820f788ca4\") " pod="openshift-monitoring/node-exporter-dmsps"
May 28 14:55:31.391250 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:31.391197    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f0d4089f-9f1b-43cb-be91-b5820f788ca4-node-exporter-wtmp\") pod \"node-exporter-dmsps\" (UID: \"f0d4089f-9f1b-43cb-be91-b5820f788ca4\") " pod="openshift-monitoring/node-exporter-dmsps"
May 28 14:55:31.391250 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:31.391229    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f0d4089f-9f1b-43cb-be91-b5820f788ca4-sys\") pod \"node-exporter-dmsps\" (UID: \"f0d4089f-9f1b-43cb-be91-b5820f788ca4\") " pod="openshift-monitoring/node-exporter-dmsps"
May 28 14:55:31.391327 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:31.391306    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f0d4089f-9f1b-43cb-be91-b5820f788ca4-node-exporter-textfile\") pod \"node-exporter-dmsps\" (UID: \"f0d4089f-9f1b-43cb-be91-b5820f788ca4\") " pod="openshift-monitoring/node-exporter-dmsps"
May 28 14:55:31.391376 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:31.391360    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f0d4089f-9f1b-43cb-be91-b5820f788ca4-node-exporter-accelerators-collector-config\") pod \"node-exporter-dmsps\" (UID: \"f0d4089f-9f1b-43cb-be91-b5820f788ca4\") " pod="openshift-monitoring/node-exporter-dmsps"
May 28 14:55:31.475765 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:31.475738    2563 scope.go:117] "RemoveContainer" containerID="7fbc8d2d98a13c93a76ff03c0a049c86708f6b7a012d022a920a546cb5091885"
May 28 14:55:31.475921 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:55:31.475908    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-76dff48d59-86zbj_openshift-console-operator(8d769c1c-5bf7-49c6-bf05-531b243e935e)\"" pod="openshift-console-operator/console-operator-76dff48d59-86zbj" podUID="8d769c1c-5bf7-49c6-bf05-531b243e935e"
May 28 14:55:31.492301 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:31.492277    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f0d4089f-9f1b-43cb-be91-b5820f788ca4-node-exporter-textfile\") pod \"node-exporter-dmsps\" (UID: \"f0d4089f-9f1b-43cb-be91-b5820f788ca4\") " pod="openshift-monitoring/node-exporter-dmsps"
May 28 14:55:31.492433 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:31.492312    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f0d4089f-9f1b-43cb-be91-b5820f788ca4-node-exporter-accelerators-collector-config\") pod \"node-exporter-dmsps\" (UID: \"f0d4089f-9f1b-43cb-be91-b5820f788ca4\") " pod="openshift-monitoring/node-exporter-dmsps"
May 28 14:55:31.492433 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:31.492368    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f0d4089f-9f1b-43cb-be91-b5820f788ca4-metrics-client-ca\") pod \"node-exporter-dmsps\" (UID: \"f0d4089f-9f1b-43cb-be91-b5820f788ca4\") " pod="openshift-monitoring/node-exporter-dmsps"
May 28 14:55:31.492433 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:31.492391    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f0d4089f-9f1b-43cb-be91-b5820f788ca4-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-dmsps\" (UID: \"f0d4089f-9f1b-43cb-be91-b5820f788ca4\") " pod="openshift-monitoring/node-exporter-dmsps"
May 28 14:55:31.492433 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:31.492418    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-f7z2w\" (UniqueName: \"kubernetes.io/projected/f0d4089f-9f1b-43cb-be91-b5820f788ca4-kube-api-access-f7z2w\") pod \"node-exporter-dmsps\" (UID: \"f0d4089f-9f1b-43cb-be91-b5820f788ca4\") " pod="openshift-monitoring/node-exporter-dmsps"
May 28 14:55:31.492714 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:31.492671    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f0d4089f-9f1b-43cb-be91-b5820f788ca4-node-exporter-textfile\") pod \"node-exporter-dmsps\" (UID: \"f0d4089f-9f1b-43cb-be91-b5820f788ca4\") " pod="openshift-monitoring/node-exporter-dmsps"
May 28 14:55:31.492714 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:31.492709    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f0d4089f-9f1b-43cb-be91-b5820f788ca4-root\") pod \"node-exporter-dmsps\" (UID: \"f0d4089f-9f1b-43cb-be91-b5820f788ca4\") " pod="openshift-monitoring/node-exporter-dmsps"
May 28 14:55:31.492854 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:31.492750    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f0d4089f-9f1b-43cb-be91-b5820f788ca4-node-exporter-tls\") pod \"node-exporter-dmsps\" (UID: \"f0d4089f-9f1b-43cb-be91-b5820f788ca4\") " pod="openshift-monitoring/node-exporter-dmsps"
May 28 14:55:31.492854 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:31.492760    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f0d4089f-9f1b-43cb-be91-b5820f788ca4-root\") pod \"node-exporter-dmsps\" (UID: \"f0d4089f-9f1b-43cb-be91-b5820f788ca4\") " pod="openshift-monitoring/node-exporter-dmsps"
May 28 14:55:31.492854 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:31.492779    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f0d4089f-9f1b-43cb-be91-b5820f788ca4-node-exporter-wtmp\") pod \"node-exporter-dmsps\" (UID: \"f0d4089f-9f1b-43cb-be91-b5820f788ca4\") " pod="openshift-monitoring/node-exporter-dmsps"
May 28 14:55:31.492854 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:31.492811    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f0d4089f-9f1b-43cb-be91-b5820f788ca4-sys\") pod \"node-exporter-dmsps\" (UID: \"f0d4089f-9f1b-43cb-be91-b5820f788ca4\") " pod="openshift-monitoring/node-exporter-dmsps"
May 28 14:55:31.492854 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:55:31.492842    2563 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
May 28 14:55:31.493101 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:31.492878    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f0d4089f-9f1b-43cb-be91-b5820f788ca4-sys\") pod \"node-exporter-dmsps\" (UID: \"f0d4089f-9f1b-43cb-be91-b5820f788ca4\") " pod="openshift-monitoring/node-exporter-dmsps"
May 28 14:55:31.493101 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:55:31.492889    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f0d4089f-9f1b-43cb-be91-b5820f788ca4-node-exporter-tls podName:f0d4089f-9f1b-43cb-be91-b5820f788ca4 nodeName:}" failed. No retries permitted until 2026-05-28 14:55:31.992871931 +0000 UTC m=+152.082088647 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/f0d4089f-9f1b-43cb-be91-b5820f788ca4-node-exporter-tls") pod "node-exporter-dmsps" (UID: "f0d4089f-9f1b-43cb-be91-b5820f788ca4") : secret "node-exporter-tls" not found
May 28 14:55:31.493101 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:31.492992    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f0d4089f-9f1b-43cb-be91-b5820f788ca4-node-exporter-wtmp\") pod \"node-exporter-dmsps\" (UID: \"f0d4089f-9f1b-43cb-be91-b5820f788ca4\") " pod="openshift-monitoring/node-exporter-dmsps"
May 28 14:55:31.493101 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:31.493026    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f0d4089f-9f1b-43cb-be91-b5820f788ca4-metrics-client-ca\") pod \"node-exporter-dmsps\" (UID: \"f0d4089f-9f1b-43cb-be91-b5820f788ca4\") " pod="openshift-monitoring/node-exporter-dmsps"
May 28 14:55:31.493101 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:31.493086    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f0d4089f-9f1b-43cb-be91-b5820f788ca4-node-exporter-accelerators-collector-config\") pod \"node-exporter-dmsps\" (UID: \"f0d4089f-9f1b-43cb-be91-b5820f788ca4\") " pod="openshift-monitoring/node-exporter-dmsps"
May 28 14:55:31.495276 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:31.495250    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f0d4089f-9f1b-43cb-be91-b5820f788ca4-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-dmsps\" (UID: \"f0d4089f-9f1b-43cb-be91-b5820f788ca4\") " pod="openshift-monitoring/node-exporter-dmsps"
May 28 14:55:31.502279 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:31.502256    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f7z2w\" (UniqueName: \"kubernetes.io/projected/f0d4089f-9f1b-43cb-be91-b5820f788ca4-kube-api-access-f7z2w\") pod \"node-exporter-dmsps\" (UID: \"f0d4089f-9f1b-43cb-be91-b5820f788ca4\") " pod="openshift-monitoring/node-exporter-dmsps"
May 28 14:55:31.997480 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:31.997449    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f0d4089f-9f1b-43cb-be91-b5820f788ca4-node-exporter-tls\") pod \"node-exporter-dmsps\" (UID: \"f0d4089f-9f1b-43cb-be91-b5820f788ca4\") " pod="openshift-monitoring/node-exporter-dmsps"
May 28 14:55:31.999703 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:31.999662    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f0d4089f-9f1b-43cb-be91-b5820f788ca4-node-exporter-tls\") pod \"node-exporter-dmsps\" (UID: \"f0d4089f-9f1b-43cb-be91-b5820f788ca4\") " pod="openshift-monitoring/node-exporter-dmsps"
May 28 14:55:32.284514 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:32.284420    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-dmsps"
May 28 14:55:32.292183 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:55:32.292157    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0d4089f_9f1b_43cb_be91_b5820f788ca4.slice/crio-bbe20928aa8ee0849ad1ace32f6cbdfa9b4fbf4a489d4d7bb98eebc7bce27ff6 WatchSource:0}: Error finding container bbe20928aa8ee0849ad1ace32f6cbdfa9b4fbf4a489d4d7bb98eebc7bce27ff6: Status 404 returned error can't find the container with id bbe20928aa8ee0849ad1ace32f6cbdfa9b4fbf4a489d4d7bb98eebc7bce27ff6
May 28 14:55:32.466984 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:32.466951    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 28 14:55:32.470333 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:32.470313    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 28 14:55:32.472726 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:32.472703    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
May 28 14:55:32.472984 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:32.472968    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
May 28 14:55:32.473059 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:32.472990    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
May 28 14:55:32.473255 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:32.473240    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
May 28 14:55:32.473662 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:32.473647    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-fhhht\""
May 28 14:55:32.473861 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:32.473848    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
May 28 14:55:32.474020 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:32.474006    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
May 28 14:55:32.475934 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:32.475050    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
May 28 14:55:32.475934 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:32.475326    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
May 28 14:55:32.475934 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:32.475524    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
May 28 14:55:32.489648 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:32.489625    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 28 14:55:32.501298 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:32.501271    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/31fd180e-595d-483c-9933-c7329c8481af-config-volume\") pod \"alertmanager-main-0\" (UID: \"31fd180e-595d-483c-9933-c7329c8481af\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 14:55:32.501387 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:32.501322    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/31fd180e-595d-483c-9933-c7329c8481af-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"31fd180e-595d-483c-9933-c7329c8481af\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 14:55:32.501461 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:32.501384    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/31fd180e-595d-483c-9933-c7329c8481af-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"31fd180e-595d-483c-9933-c7329c8481af\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 14:55:32.501461 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:32.501433    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/31fd180e-595d-483c-9933-c7329c8481af-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"31fd180e-595d-483c-9933-c7329c8481af\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 14:55:32.501568 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:32.501458    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/31fd180e-595d-483c-9933-c7329c8481af-web-config\") pod \"alertmanager-main-0\" (UID: \"31fd180e-595d-483c-9933-c7329c8481af\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 14:55:32.501568 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:32.501492    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/31fd180e-595d-483c-9933-c7329c8481af-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"31fd180e-595d-483c-9933-c7329c8481af\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 14:55:32.501568 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:32.501515    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/31fd180e-595d-483c-9933-c7329c8481af-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"31fd180e-595d-483c-9933-c7329c8481af\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 14:55:32.501726 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:32.501600    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/31fd180e-595d-483c-9933-c7329c8481af-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"31fd180e-595d-483c-9933-c7329c8481af\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 14:55:32.501726 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:32.501625    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/31fd180e-595d-483c-9933-c7329c8481af-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"31fd180e-595d-483c-9933-c7329c8481af\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 14:55:32.501726 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:32.501649    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/31fd180e-595d-483c-9933-c7329c8481af-tls-assets\") pod \"alertmanager-main-0\" (UID: \"31fd180e-595d-483c-9933-c7329c8481af\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 14:55:32.501869 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:32.501729    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/31fd180e-595d-483c-9933-c7329c8481af-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"31fd180e-595d-483c-9933-c7329c8481af\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 14:55:32.501869 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:32.501778    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/31fd180e-595d-483c-9933-c7329c8481af-config-out\") pod \"alertmanager-main-0\" (UID: \"31fd180e-595d-483c-9933-c7329c8481af\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 14:55:32.501869 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:32.501804    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2kptq\" (UniqueName: \"kubernetes.io/projected/31fd180e-595d-483c-9933-c7329c8481af-kube-api-access-2kptq\") pod \"alertmanager-main-0\" (UID: \"31fd180e-595d-483c-9933-c7329c8481af\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 14:55:32.602368 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:32.602284    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/31fd180e-595d-483c-9933-c7329c8481af-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"31fd180e-595d-483c-9933-c7329c8481af\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 14:55:32.602368 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:32.602318    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/31fd180e-595d-483c-9933-c7329c8481af-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"31fd180e-595d-483c-9933-c7329c8481af\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 14:55:32.602368 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:32.602339    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/31fd180e-595d-483c-9933-c7329c8481af-tls-assets\") pod \"alertmanager-main-0\" (UID: \"31fd180e-595d-483c-9933-c7329c8481af\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 14:55:32.602635 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:32.602370    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/31fd180e-595d-483c-9933-c7329c8481af-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"31fd180e-595d-483c-9933-c7329c8481af\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 14:55:32.602635 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:32.602401    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/31fd180e-595d-483c-9933-c7329c8481af-config-out\") pod \"alertmanager-main-0\" (UID: \"31fd180e-595d-483c-9933-c7329c8481af\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 14:55:32.602635 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:32.602429    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2kptq\" (UniqueName: \"kubernetes.io/projected/31fd180e-595d-483c-9933-c7329c8481af-kube-api-access-2kptq\") pod \"alertmanager-main-0\" (UID: \"31fd180e-595d-483c-9933-c7329c8481af\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 14:55:32.602635 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:55:32.602467    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/31fd180e-595d-483c-9933-c7329c8481af-alertmanager-trusted-ca-bundle podName:31fd180e-595d-483c-9933-c7329c8481af nodeName:}" failed. No retries permitted until 2026-05-28 14:55:33.10244888 +0000 UTC m=+153.191665581 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/31fd180e-595d-483c-9933-c7329c8481af-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "31fd180e-595d-483c-9933-c7329c8481af") : configmap references non-existent config key: ca-bundle.crt
May 28 14:55:32.602635 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:32.602524    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/31fd180e-595d-483c-9933-c7329c8481af-config-volume\") pod \"alertmanager-main-0\" (UID: \"31fd180e-595d-483c-9933-c7329c8481af\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 14:55:32.602635 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:32.602573    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/31fd180e-595d-483c-9933-c7329c8481af-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"31fd180e-595d-483c-9933-c7329c8481af\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 14:55:32.602635 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:32.602597    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/31fd180e-595d-483c-9933-c7329c8481af-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"31fd180e-595d-483c-9933-c7329c8481af\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 14:55:32.602635 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:32.602636    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/31fd180e-595d-483c-9933-c7329c8481af-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"31fd180e-595d-483c-9933-c7329c8481af\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 14:55:32.603118 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:32.602661    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/31fd180e-595d-483c-9933-c7329c8481af-web-config\") pod \"alertmanager-main-0\" (UID: \"31fd180e-595d-483c-9933-c7329c8481af\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 14:55:32.603118 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:32.602713    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/31fd180e-595d-483c-9933-c7329c8481af-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"31fd180e-595d-483c-9933-c7329c8481af\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 14:55:32.603118 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:32.602735    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/31fd180e-595d-483c-9933-c7329c8481af-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"31fd180e-595d-483c-9933-c7329c8481af\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 14:55:32.603270 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:32.603137    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/31fd180e-595d-483c-9933-c7329c8481af-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"31fd180e-595d-483c-9933-c7329c8481af\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 14:55:32.605340 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:32.605311    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/31fd180e-595d-483c-9933-c7329c8481af-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"31fd180e-595d-483c-9933-c7329c8481af\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 14:55:32.605476 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:32.605451    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/31fd180e-595d-483c-9933-c7329c8481af-config-out\") pod \"alertmanager-main-0\" (UID: \"31fd180e-595d-483c-9933-c7329c8481af\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 14:55:32.606070 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:32.605633    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/31fd180e-595d-483c-9933-c7329c8481af-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"31fd180e-595d-483c-9933-c7329c8481af\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 14:55:32.606070 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:32.605660    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/31fd180e-595d-483c-9933-c7329c8481af-tls-assets\") pod \"alertmanager-main-0\" (UID: \"31fd180e-595d-483c-9933-c7329c8481af\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 14:55:32.606070 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:32.605891    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/31fd180e-595d-483c-9933-c7329c8481af-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"31fd180e-595d-483c-9933-c7329c8481af\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 14:55:32.606070 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:32.605996    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/31fd180e-595d-483c-9933-c7329c8481af-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"31fd180e-595d-483c-9933-c7329c8481af\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 14:55:32.606070 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:32.606022    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/31fd180e-595d-483c-9933-c7329c8481af-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"31fd180e-595d-483c-9933-c7329c8481af\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 14:55:32.606364 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:32.606085    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/31fd180e-595d-483c-9933-c7329c8481af-config-volume\") pod \"alertmanager-main-0\" (UID: \"31fd180e-595d-483c-9933-c7329c8481af\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 14:55:32.606364 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:32.606348    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/31fd180e-595d-483c-9933-c7329c8481af-web-config\") pod \"alertmanager-main-0\" (UID: \"31fd180e-595d-483c-9933-c7329c8481af\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 14:55:32.607005 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:32.606986    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/31fd180e-595d-483c-9933-c7329c8481af-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"31fd180e-595d-483c-9933-c7329c8481af\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 14:55:32.610155 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:32.610127    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2kptq\" (UniqueName: \"kubernetes.io/projected/31fd180e-595d-483c-9933-c7329c8481af-kube-api-access-2kptq\") pod \"alertmanager-main-0\" (UID: \"31fd180e-595d-483c-9933-c7329c8481af\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 14:55:32.909428 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:32.909345    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dmsps" event={"ID":"f0d4089f-9f1b-43cb-be91-b5820f788ca4","Type":"ContainerStarted","Data":"bbe20928aa8ee0849ad1ace32f6cbdfa9b4fbf4a489d4d7bb98eebc7bce27ff6"}
May 28 14:55:33.107656 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:33.107621    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/31fd180e-595d-483c-9933-c7329c8481af-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"31fd180e-595d-483c-9933-c7329c8481af\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 14:55:33.108330 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:33.108309    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/31fd180e-595d-483c-9933-c7329c8481af-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"31fd180e-595d-483c-9933-c7329c8481af\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 14:55:33.381454 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:33.381425    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 28 14:55:33.514088 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:33.514059    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 28 14:55:33.521538 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:55:33.521511    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31fd180e_595d_483c_9933_c7329c8481af.slice/crio-ee4c1a2398791820539470f4994574f0d2fb637bb45d138b24676ee1c1a17de4 WatchSource:0}: Error finding container ee4c1a2398791820539470f4994574f0d2fb637bb45d138b24676ee1c1a17de4: Status 404 returned error can't find the container with id ee4c1a2398791820539470f4994574f0d2fb637bb45d138b24676ee1c1a17de4
May 28 14:55:33.914452 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:33.914366    2563 generic.go:358] "Generic (PLEG): container finished" podID="f0d4089f-9f1b-43cb-be91-b5820f788ca4" containerID="c52ef508a744852339eca65badf68c703820e352761a3714a6d2c58a30549926" exitCode=0
May 28 14:55:33.914595 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:33.914462    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dmsps" event={"ID":"f0d4089f-9f1b-43cb-be91-b5820f788ca4","Type":"ContainerDied","Data":"c52ef508a744852339eca65badf68c703820e352761a3714a6d2c58a30549926"}
May 28 14:55:33.915600 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:33.915577    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"31fd180e-595d-483c-9933-c7329c8481af","Type":"ContainerStarted","Data":"ee4c1a2398791820539470f4994574f0d2fb637bb45d138b24676ee1c1a17de4"}
May 28 14:55:34.925135 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:34.925093    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dmsps" event={"ID":"f0d4089f-9f1b-43cb-be91-b5820f788ca4","Type":"ContainerStarted","Data":"f083f4d103bee082953b32479d2ed6707e9fb5bcaecb71d56829dd85b17fe37d"}
May 28 14:55:34.925577 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:34.925143    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dmsps" event={"ID":"f0d4089f-9f1b-43cb-be91-b5820f788ca4","Type":"ContainerStarted","Data":"fa272c7a6979551b63b7c68c9fd38c914f6c5f87009e55159fd61ffd78116bf7"}
May 28 14:55:34.926916 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:34.926889    2563 generic.go:358] "Generic (PLEG): container finished" podID="31fd180e-595d-483c-9933-c7329c8481af" containerID="87abeaa8fb656658cf6936b2cb62409b3388837cdacbbfbc2f959d258d2df842" exitCode=0
May 28 14:55:34.927036 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:34.926925    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"31fd180e-595d-483c-9933-c7329c8481af","Type":"ContainerDied","Data":"87abeaa8fb656658cf6936b2cb62409b3388837cdacbbfbc2f959d258d2df842"}
May 28 14:55:34.947405 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:34.947362    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-dmsps" podStartSLOduration=2.930771054 podStartE2EDuration="3.947349622s" podCreationTimestamp="2026-05-28 14:55:31 +0000 UTC" firstStartedPulling="2026-05-28 14:55:32.293718369 +0000 UTC m=+152.382935070" lastFinishedPulling="2026-05-28 14:55:33.310296923 +0000 UTC m=+153.399513638" observedRunningTime="2026-05-28 14:55:34.945325231 +0000 UTC m=+155.034541955" watchObservedRunningTime="2026-05-28 14:55:34.947349622 +0000 UTC m=+155.036566344"
May 28 14:55:36.934085 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:36.934056    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"31fd180e-595d-483c-9933-c7329c8481af","Type":"ContainerStarted","Data":"72cf5192677db55c3dcb40f779988a1ea61fe6e970328f49e33eef8ff1572467"}
May 28 14:55:36.934085 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:36.934091    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"31fd180e-595d-483c-9933-c7329c8481af","Type":"ContainerStarted","Data":"54cf45b5bdc3451c0603ebfb35cd046c57918821f0420cf992b06e430341fde9"}
May 28 14:55:36.934469 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:36.934101    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"31fd180e-595d-483c-9933-c7329c8481af","Type":"ContainerStarted","Data":"d6e7880ec6128eeda8851915b10da322217919f62b3fdfd77fa2834ed0c1a68b"}
May 28 14:55:36.934469 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:36.934109    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"31fd180e-595d-483c-9933-c7329c8481af","Type":"ContainerStarted","Data":"89afc94ea7b1719744b9109a08a42fd2e728fcdaea0ba3cef1f8c9cc08390ad7"}
May 28 14:55:36.934469 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:36.934116    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"31fd180e-595d-483c-9933-c7329c8481af","Type":"ContainerStarted","Data":"dfd2778eb9bee59404141b536ebd3c6de51dbbc718641788f0edc378c92a424f"}
May 28 14:55:37.940281 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:37.940189    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"31fd180e-595d-483c-9933-c7329c8481af","Type":"ContainerStarted","Data":"5e2232a1ab057f160b811ee91e557acfa0449028212e8c6b65cc5614a6ea65cd"}
May 28 14:55:37.969271 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:37.969213    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=1.997512086 podStartE2EDuration="5.969198441s" podCreationTimestamp="2026-05-28 14:55:32 +0000 UTC" firstStartedPulling="2026-05-28 14:55:33.523534423 +0000 UTC m=+153.612751125" lastFinishedPulling="2026-05-28 14:55:37.495220774 +0000 UTC m=+157.584437480" observedRunningTime="2026-05-28 14:55:37.966978673 +0000 UTC m=+158.056195392" watchObservedRunningTime="2026-05-28 14:55:37.969198441 +0000 UTC m=+158.058415163"
May 28 14:55:38.334562 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:55:38.334524    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-zctlp" podUID="bdc2b7e1-35af-42c7-8ec3-742be0e080fa"
May 28 14:55:38.346713 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:55:38.346665    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-jwwzh" podUID="2879a5eb-fff7-4733-b061-ce7d4f8016e7"
May 28 14:55:38.947336 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:38.945229    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-zctlp"
May 28 14:55:39.557350 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:39.557283    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-79544c6ccf-st9tg"
May 28 14:55:41.879609 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:41.879580    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-55b856b77f-lrgn5"
May 28 14:55:43.191718 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:43.191652    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2879a5eb-fff7-4733-b061-ce7d4f8016e7-cert\") pod \"ingress-canary-jwwzh\" (UID: \"2879a5eb-fff7-4733-b061-ce7d4f8016e7\") " pod="openshift-ingress-canary/ingress-canary-jwwzh"
May 28 14:55:43.191718 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:43.191723    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bdc2b7e1-35af-42c7-8ec3-742be0e080fa-metrics-tls\") pod \"dns-default-zctlp\" (UID: \"bdc2b7e1-35af-42c7-8ec3-742be0e080fa\") " pod="openshift-dns/dns-default-zctlp"
May 28 14:55:43.194027 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:43.194000    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bdc2b7e1-35af-42c7-8ec3-742be0e080fa-metrics-tls\") pod \"dns-default-zctlp\" (UID: \"bdc2b7e1-35af-42c7-8ec3-742be0e080fa\") " pod="openshift-dns/dns-default-zctlp"
May 28 14:55:43.194120 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:43.194081    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2879a5eb-fff7-4733-b061-ce7d4f8016e7-cert\") pod \"ingress-canary-jwwzh\" (UID: \"2879a5eb-fff7-4733-b061-ce7d4f8016e7\") " pod="openshift-ingress-canary/ingress-canary-jwwzh"
May 28 14:55:43.450988 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:43.450904    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-gqk5j\""
May 28 14:55:43.456485 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:43.456468    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-zctlp"
May 28 14:55:43.581661 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:43.581631    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-zctlp"]
May 28 14:55:43.583979 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:55:43.583950    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbdc2b7e1_35af_42c7_8ec3_742be0e080fa.slice/crio-7d879475a2d69a01fdce70d879413b2e9734112e6b1a0dbf8025ac658f6a9eac WatchSource:0}: Error finding container 7d879475a2d69a01fdce70d879413b2e9734112e6b1a0dbf8025ac658f6a9eac: Status 404 returned error can't find the container with id 7d879475a2d69a01fdce70d879413b2e9734112e6b1a0dbf8025ac658f6a9eac
May 28 14:55:43.957890 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:43.957855    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zctlp" event={"ID":"bdc2b7e1-35af-42c7-8ec3-742be0e080fa","Type":"ContainerStarted","Data":"7d879475a2d69a01fdce70d879413b2e9734112e6b1a0dbf8025ac658f6a9eac"}
May 28 14:55:44.476201 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:44.476171    2563 scope.go:117] "RemoveContainer" containerID="7fbc8d2d98a13c93a76ff03c0a049c86708f6b7a012d022a920a546cb5091885"
May 28 14:55:44.571512 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:44.571442    2563 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-image-registry/image-registry-79544c6ccf-st9tg" podUID="2e54aa3c-c7d9-4e5c-90d9-2d25d71de4a2" containerName="registry" containerID="cri-o://bdba328be05dfe4bed1b429b165e45a70d77ed18b462c9a26849df3591470042" gracePeriod=30
May 28 14:55:44.961233 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:44.961202    2563 generic.go:358] "Generic (PLEG): container finished" podID="2e54aa3c-c7d9-4e5c-90d9-2d25d71de4a2" containerID="bdba328be05dfe4bed1b429b165e45a70d77ed18b462c9a26849df3591470042" exitCode=0
May 28 14:55:44.961356 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:44.961274    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-79544c6ccf-st9tg" event={"ID":"2e54aa3c-c7d9-4e5c-90d9-2d25d71de4a2","Type":"ContainerDied","Data":"bdba328be05dfe4bed1b429b165e45a70d77ed18b462c9a26849df3591470042"}
May 28 14:55:44.961356 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:44.961315    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-79544c6ccf-st9tg" event={"ID":"2e54aa3c-c7d9-4e5c-90d9-2d25d71de4a2","Type":"ContainerDied","Data":"bdf02d7efe8e3c6912dbcc98c68e4e8383451dcc65a9a908c8f268704d5152d2"}
May 28 14:55:44.961356 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:44.961328    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bdf02d7efe8e3c6912dbcc98c68e4e8383451dcc65a9a908c8f268704d5152d2"
May 28 14:55:44.962853 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:44.962837    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-86zbj_8d769c1c-5bf7-49c6-bf05-531b243e935e/console-operator/2.log"
May 28 14:55:44.962940 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:44.962879    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-86zbj" event={"ID":"8d769c1c-5bf7-49c6-bf05-531b243e935e","Type":"ContainerStarted","Data":"abafc0f7797052d1eabc9691de65e616c8ebbd42f49d69ea56afc1185677ac9c"}
May 28 14:55:44.963132 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:44.963110    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-76dff48d59-86zbj"
May 28 14:55:44.966987 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:44.966970    2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-79544c6ccf-st9tg"
May 28 14:55:44.981461 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:44.981409    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console-operator/console-operator-76dff48d59-86zbj" podStartSLOduration=53.668650456 podStartE2EDuration="55.981394474s" podCreationTimestamp="2026-05-28 14:54:49 +0000 UTC" firstStartedPulling="2026-05-28 14:54:49.603413351 +0000 UTC m=+109.692630052" lastFinishedPulling="2026-05-28 14:54:51.916157367 +0000 UTC m=+112.005374070" observedRunningTime="2026-05-28 14:55:44.979451892 +0000 UTC m=+165.068668615" watchObservedRunningTime="2026-05-28 14:55:44.981394474 +0000 UTC m=+165.070611201"
May 28 14:55:45.006787 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:45.006264    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2e54aa3c-c7d9-4e5c-90d9-2d25d71de4a2-ca-trust-extracted\") pod \"2e54aa3c-c7d9-4e5c-90d9-2d25d71de4a2\" (UID: \"2e54aa3c-c7d9-4e5c-90d9-2d25d71de4a2\") "
May 28 14:55:45.006787 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:45.006316    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qfhxj\" (UniqueName: \"kubernetes.io/projected/2e54aa3c-c7d9-4e5c-90d9-2d25d71de4a2-kube-api-access-qfhxj\") pod \"2e54aa3c-c7d9-4e5c-90d9-2d25d71de4a2\" (UID: \"2e54aa3c-c7d9-4e5c-90d9-2d25d71de4a2\") "
May 28 14:55:45.006787 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:45.006341    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2e54aa3c-c7d9-4e5c-90d9-2d25d71de4a2-installation-pull-secrets\") pod \"2e54aa3c-c7d9-4e5c-90d9-2d25d71de4a2\" (UID: \"2e54aa3c-c7d9-4e5c-90d9-2d25d71de4a2\") "
May 28 14:55:45.006787 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:45.006374    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2e54aa3c-c7d9-4e5c-90d9-2d25d71de4a2-image-registry-private-configuration\") pod \"2e54aa3c-c7d9-4e5c-90d9-2d25d71de4a2\" (UID: \"2e54aa3c-c7d9-4e5c-90d9-2d25d71de4a2\") "
May 28 14:55:45.006787 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:45.006420    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2e54aa3c-c7d9-4e5c-90d9-2d25d71de4a2-registry-certificates\") pod \"2e54aa3c-c7d9-4e5c-90d9-2d25d71de4a2\" (UID: \"2e54aa3c-c7d9-4e5c-90d9-2d25d71de4a2\") "
May 28 14:55:45.006787 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:45.006462    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2e54aa3c-c7d9-4e5c-90d9-2d25d71de4a2-registry-tls\") pod \"2e54aa3c-c7d9-4e5c-90d9-2d25d71de4a2\" (UID: \"2e54aa3c-c7d9-4e5c-90d9-2d25d71de4a2\") "
May 28 14:55:45.006787 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:45.006499    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2e54aa3c-c7d9-4e5c-90d9-2d25d71de4a2-bound-sa-token\") pod \"2e54aa3c-c7d9-4e5c-90d9-2d25d71de4a2\" (UID: \"2e54aa3c-c7d9-4e5c-90d9-2d25d71de4a2\") "
May 28 14:55:45.006787 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:45.006533    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2e54aa3c-c7d9-4e5c-90d9-2d25d71de4a2-trusted-ca\") pod \"2e54aa3c-c7d9-4e5c-90d9-2d25d71de4a2\" (UID: \"2e54aa3c-c7d9-4e5c-90d9-2d25d71de4a2\") "
May 28 14:55:45.008743 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:45.008693    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2e54aa3c-c7d9-4e5c-90d9-2d25d71de4a2-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "2e54aa3c-c7d9-4e5c-90d9-2d25d71de4a2" (UID: "2e54aa3c-c7d9-4e5c-90d9-2d25d71de4a2"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 14:55:45.009053 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:45.009022    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2e54aa3c-c7d9-4e5c-90d9-2d25d71de4a2-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "2e54aa3c-c7d9-4e5c-90d9-2d25d71de4a2" (UID: "2e54aa3c-c7d9-4e5c-90d9-2d25d71de4a2"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 14:55:45.009566 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:45.009538    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e54aa3c-c7d9-4e5c-90d9-2d25d71de4a2-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "2e54aa3c-c7d9-4e5c-90d9-2d25d71de4a2" (UID: "2e54aa3c-c7d9-4e5c-90d9-2d25d71de4a2"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 14:55:45.010246 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:45.010200    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e54aa3c-c7d9-4e5c-90d9-2d25d71de4a2-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "2e54aa3c-c7d9-4e5c-90d9-2d25d71de4a2" (UID: "2e54aa3c-c7d9-4e5c-90d9-2d25d71de4a2"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 14:55:45.012077 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:45.012035    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2e54aa3c-c7d9-4e5c-90d9-2d25d71de4a2-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "2e54aa3c-c7d9-4e5c-90d9-2d25d71de4a2" (UID: "2e54aa3c-c7d9-4e5c-90d9-2d25d71de4a2"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 14:55:45.012443 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:45.012223    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2e54aa3c-c7d9-4e5c-90d9-2d25d71de4a2-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "2e54aa3c-c7d9-4e5c-90d9-2d25d71de4a2" (UID: "2e54aa3c-c7d9-4e5c-90d9-2d25d71de4a2"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 14:55:45.013097 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:45.013063    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e54aa3c-c7d9-4e5c-90d9-2d25d71de4a2-kube-api-access-qfhxj" (OuterVolumeSpecName: "kube-api-access-qfhxj") pod "2e54aa3c-c7d9-4e5c-90d9-2d25d71de4a2" (UID: "2e54aa3c-c7d9-4e5c-90d9-2d25d71de4a2"). InnerVolumeSpecName "kube-api-access-qfhxj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 14:55:45.023509 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:45.023479    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e54aa3c-c7d9-4e5c-90d9-2d25d71de4a2-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "2e54aa3c-c7d9-4e5c-90d9-2d25d71de4a2" (UID: "2e54aa3c-c7d9-4e5c-90d9-2d25d71de4a2"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 14:55:45.108020 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:45.107991    2563 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2e54aa3c-c7d9-4e5c-90d9-2d25d71de4a2-registry-tls\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
May 28 14:55:45.108020 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:45.108019    2563 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2e54aa3c-c7d9-4e5c-90d9-2d25d71de4a2-bound-sa-token\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
May 28 14:55:45.108193 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:45.108035    2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2e54aa3c-c7d9-4e5c-90d9-2d25d71de4a2-trusted-ca\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
May 28 14:55:45.108193 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:45.108044    2563 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2e54aa3c-c7d9-4e5c-90d9-2d25d71de4a2-ca-trust-extracted\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
May 28 14:55:45.108193 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:45.108054    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qfhxj\" (UniqueName: \"kubernetes.io/projected/2e54aa3c-c7d9-4e5c-90d9-2d25d71de4a2-kube-api-access-qfhxj\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
May 28 14:55:45.108193 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:45.108064    2563 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2e54aa3c-c7d9-4e5c-90d9-2d25d71de4a2-installation-pull-secrets\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
May 28 14:55:45.108193 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:45.108075    2563 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2e54aa3c-c7d9-4e5c-90d9-2d25d71de4a2-image-registry-private-configuration\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
May 28 14:55:45.108193 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:45.108091    2563 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2e54aa3c-c7d9-4e5c-90d9-2d25d71de4a2-registry-certificates\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
May 28 14:55:45.437919 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:45.437850    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-76dff48d59-86zbj"
May 28 14:55:45.608565 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:45.608528    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-57bd96b888-6pnmc"]
May 28 14:55:45.608933 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:45.608812    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e54aa3c-c7d9-4e5c-90d9-2d25d71de4a2" containerName="registry"
May 28 14:55:45.608933 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:45.608824    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e54aa3c-c7d9-4e5c-90d9-2d25d71de4a2" containerName="registry"
May 28 14:55:45.608933 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:45.608881    2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="2e54aa3c-c7d9-4e5c-90d9-2d25d71de4a2" containerName="registry"
May 28 14:55:45.611915 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:45.611894    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-57bd96b888-6pnmc"
May 28 14:55:45.614648 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:45.614627    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-lmvsv\""
May 28 14:55:45.614901 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:45.614880    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
May 28 14:55:45.614990 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:45.614912    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
May 28 14:55:45.622131 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:45.622110    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-57bd96b888-6pnmc"]
May 28 14:55:45.712019 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:45.711923    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kmzkt\" (UniqueName: \"kubernetes.io/projected/9cb12218-75dd-4501-af0c-45a08fe2d93f-kube-api-access-kmzkt\") pod \"downloads-57bd96b888-6pnmc\" (UID: \"9cb12218-75dd-4501-af0c-45a08fe2d93f\") " pod="openshift-console/downloads-57bd96b888-6pnmc"
May 28 14:55:45.812766 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:45.812732    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kmzkt\" (UniqueName: \"kubernetes.io/projected/9cb12218-75dd-4501-af0c-45a08fe2d93f-kube-api-access-kmzkt\") pod \"downloads-57bd96b888-6pnmc\" (UID: \"9cb12218-75dd-4501-af0c-45a08fe2d93f\") " pod="openshift-console/downloads-57bd96b888-6pnmc"
May 28 14:55:45.821188 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:45.821150    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kmzkt\" (UniqueName: \"kubernetes.io/projected/9cb12218-75dd-4501-af0c-45a08fe2d93f-kube-api-access-kmzkt\") pod \"downloads-57bd96b888-6pnmc\" (UID: \"9cb12218-75dd-4501-af0c-45a08fe2d93f\") " pod="openshift-console/downloads-57bd96b888-6pnmc"
May 28 14:55:45.921959 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:45.921921    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-57bd96b888-6pnmc"
May 28 14:55:45.967220 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:45.967141    2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-79544c6ccf-st9tg"
May 28 14:55:45.967220 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:45.967140    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zctlp" event={"ID":"bdc2b7e1-35af-42c7-8ec3-742be0e080fa","Type":"ContainerStarted","Data":"fa31f81a3dc9cb7a0fa63aa6d499bee67701c3c33190a0b6670e2f8e4830da05"}
May 28 14:55:45.967220 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:45.967185    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zctlp" event={"ID":"bdc2b7e1-35af-42c7-8ec3-742be0e080fa","Type":"ContainerStarted","Data":"8cf3fd90a9a62f2b8906e32920994e51118f09d68ed80d73fd090691b15e8517"}
May 28 14:55:45.967463 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:45.967387    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-zctlp"
May 28 14:55:45.986043 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:45.985999    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-zctlp" podStartSLOduration=129.701253195 podStartE2EDuration="2m10.985983916s" podCreationTimestamp="2026-05-28 14:53:35 +0000 UTC" firstStartedPulling="2026-05-28 14:55:43.585880657 +0000 UTC m=+163.675097361" lastFinishedPulling="2026-05-28 14:55:44.870611371 +0000 UTC m=+164.959828082" observedRunningTime="2026-05-28 14:55:45.983862271 +0000 UTC m=+166.073078992" watchObservedRunningTime="2026-05-28 14:55:45.985983916 +0000 UTC m=+166.075200674"
May 28 14:55:45.998355 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:45.998327    2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-79544c6ccf-st9tg"]
May 28 14:55:46.003838 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:46.003809    2563 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-79544c6ccf-st9tg"]
May 28 14:55:46.049177 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:46.049138    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-57bd96b888-6pnmc"]
May 28 14:55:46.051814 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:55:46.051784    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9cb12218_75dd_4501_af0c_45a08fe2d93f.slice/crio-925d1af9b9be5a2161d4b08cd9555d5d7141a06ee527c0903284c4481b9f7e2f WatchSource:0}: Error finding container 925d1af9b9be5a2161d4b08cd9555d5d7141a06ee527c0903284c4481b9f7e2f: Status 404 returned error can't find the container with id 925d1af9b9be5a2161d4b08cd9555d5d7141a06ee527c0903284c4481b9f7e2f
May 28 14:55:46.479500 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:46.479459    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2e54aa3c-c7d9-4e5c-90d9-2d25d71de4a2" path="/var/lib/kubelet/pods/2e54aa3c-c7d9-4e5c-90d9-2d25d71de4a2/volumes"
May 28 14:55:46.971325 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:46.971286    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-57bd96b888-6pnmc" event={"ID":"9cb12218-75dd-4501-af0c-45a08fe2d93f","Type":"ContainerStarted","Data":"925d1af9b9be5a2161d4b08cd9555d5d7141a06ee527c0903284c4481b9f7e2f"}
May 28 14:55:50.480309 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:50.480276    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-jwwzh"
May 28 14:55:50.482846 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:50.482823    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-znwr4\""
May 28 14:55:50.491659 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:50.491636    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-jwwzh"
May 28 14:55:50.628923 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:50.628855    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-jwwzh"]
May 28 14:55:50.632118 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:55:50.632085    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2879a5eb_fff7_4733_b061_ce7d4f8016e7.slice/crio-491024b6a81791b360e836c3975293bcd76bf3959f3e551262001cd5ccba107a WatchSource:0}: Error finding container 491024b6a81791b360e836c3975293bcd76bf3959f3e551262001cd5ccba107a: Status 404 returned error can't find the container with id 491024b6a81791b360e836c3975293bcd76bf3959f3e551262001cd5ccba107a
May 28 14:55:50.987188 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:50.987152    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-jwwzh" event={"ID":"2879a5eb-fff7-4733-b061-ce7d4f8016e7","Type":"ContainerStarted","Data":"491024b6a81791b360e836c3975293bcd76bf3959f3e551262001cd5ccba107a"}
May 28 14:55:52.996026 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:52.995982    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-jwwzh" event={"ID":"2879a5eb-fff7-4733-b061-ce7d4f8016e7","Type":"ContainerStarted","Data":"8dd1fda124fa146c3c225fcde4f543291cbcac89ff95b907929e2f99e48df485"}
May 28 14:55:53.011880 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:53.011806    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-jwwzh" podStartSLOduration=135.829564617 podStartE2EDuration="2m18.011787318s" podCreationTimestamp="2026-05-28 14:53:35 +0000 UTC" firstStartedPulling="2026-05-28 14:55:50.63431355 +0000 UTC m=+170.723530252" lastFinishedPulling="2026-05-28 14:55:52.816536233 +0000 UTC m=+172.905752953" observedRunningTime="2026-05-28 14:55:53.009983087 +0000 UTC m=+173.099199836" watchObservedRunningTime="2026-05-28 14:55:53.011787318 +0000 UTC m=+173.101004046"
May 28 14:55:55.531145 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:55.531107    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-6765fff99b-hwk4q"]
May 28 14:55:55.534794 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:55.534770    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6765fff99b-hwk4q"
May 28 14:55:55.537369 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:55.537345    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
May 28 14:55:55.537522 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:55.537499    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-gvt85\""
May 28 14:55:55.537594 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:55.537504    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
May 28 14:55:55.537669 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:55.537578    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
May 28 14:55:55.538356 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:55.538334    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
May 28 14:55:55.538442 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:55.538377    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
May 28 14:55:55.545069 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:55.545044    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6765fff99b-hwk4q"]
May 28 14:55:55.597478 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:55.597443    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gj454\" (UniqueName: \"kubernetes.io/projected/5b50ef1d-66dd-4399-a62f-37cdc88be08c-kube-api-access-gj454\") pod \"console-6765fff99b-hwk4q\" (UID: \"5b50ef1d-66dd-4399-a62f-37cdc88be08c\") " pod="openshift-console/console-6765fff99b-hwk4q"
May 28 14:55:55.597720 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:55.597495    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5b50ef1d-66dd-4399-a62f-37cdc88be08c-console-oauth-config\") pod \"console-6765fff99b-hwk4q\" (UID: \"5b50ef1d-66dd-4399-a62f-37cdc88be08c\") " pod="openshift-console/console-6765fff99b-hwk4q"
May 28 14:55:55.597720 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:55.597618    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5b50ef1d-66dd-4399-a62f-37cdc88be08c-service-ca\") pod \"console-6765fff99b-hwk4q\" (UID: \"5b50ef1d-66dd-4399-a62f-37cdc88be08c\") " pod="openshift-console/console-6765fff99b-hwk4q"
May 28 14:55:55.597720 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:55.597696    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5b50ef1d-66dd-4399-a62f-37cdc88be08c-oauth-serving-cert\") pod \"console-6765fff99b-hwk4q\" (UID: \"5b50ef1d-66dd-4399-a62f-37cdc88be08c\") " pod="openshift-console/console-6765fff99b-hwk4q"
May 28 14:55:55.597900 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:55.597737    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5b50ef1d-66dd-4399-a62f-37cdc88be08c-console-config\") pod \"console-6765fff99b-hwk4q\" (UID: \"5b50ef1d-66dd-4399-a62f-37cdc88be08c\") " pod="openshift-console/console-6765fff99b-hwk4q"
May 28 14:55:55.597900 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:55.597797    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5b50ef1d-66dd-4399-a62f-37cdc88be08c-console-serving-cert\") pod \"console-6765fff99b-hwk4q\" (UID: \"5b50ef1d-66dd-4399-a62f-37cdc88be08c\") " pod="openshift-console/console-6765fff99b-hwk4q"
May 28 14:55:55.698758 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:55.698721    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gj454\" (UniqueName: \"kubernetes.io/projected/5b50ef1d-66dd-4399-a62f-37cdc88be08c-kube-api-access-gj454\") pod \"console-6765fff99b-hwk4q\" (UID: \"5b50ef1d-66dd-4399-a62f-37cdc88be08c\") " pod="openshift-console/console-6765fff99b-hwk4q"
May 28 14:55:55.698758 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:55.698765    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5b50ef1d-66dd-4399-a62f-37cdc88be08c-console-oauth-config\") pod \"console-6765fff99b-hwk4q\" (UID: \"5b50ef1d-66dd-4399-a62f-37cdc88be08c\") " pod="openshift-console/console-6765fff99b-hwk4q"
May 28 14:55:55.698997 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:55.698812    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5b50ef1d-66dd-4399-a62f-37cdc88be08c-service-ca\") pod \"console-6765fff99b-hwk4q\" (UID: \"5b50ef1d-66dd-4399-a62f-37cdc88be08c\") " pod="openshift-console/console-6765fff99b-hwk4q"
May 28 14:55:55.698997 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:55.698852    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5b50ef1d-66dd-4399-a62f-37cdc88be08c-oauth-serving-cert\") pod \"console-6765fff99b-hwk4q\" (UID: \"5b50ef1d-66dd-4399-a62f-37cdc88be08c\") " pod="openshift-console/console-6765fff99b-hwk4q"
May 28 14:55:55.698997 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:55.698878    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5b50ef1d-66dd-4399-a62f-37cdc88be08c-console-config\") pod \"console-6765fff99b-hwk4q\" (UID: \"5b50ef1d-66dd-4399-a62f-37cdc88be08c\") " pod="openshift-console/console-6765fff99b-hwk4q"
May 28 14:55:55.698997 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:55.698918    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5b50ef1d-66dd-4399-a62f-37cdc88be08c-console-serving-cert\") pod \"console-6765fff99b-hwk4q\" (UID: \"5b50ef1d-66dd-4399-a62f-37cdc88be08c\") " pod="openshift-console/console-6765fff99b-hwk4q"
May 28 14:55:55.699746 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:55.699718    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5b50ef1d-66dd-4399-a62f-37cdc88be08c-service-ca\") pod \"console-6765fff99b-hwk4q\" (UID: \"5b50ef1d-66dd-4399-a62f-37cdc88be08c\") " pod="openshift-console/console-6765fff99b-hwk4q"
May 28 14:55:55.699887 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:55.699754    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5b50ef1d-66dd-4399-a62f-37cdc88be08c-oauth-serving-cert\") pod \"console-6765fff99b-hwk4q\" (UID: \"5b50ef1d-66dd-4399-a62f-37cdc88be08c\") " pod="openshift-console/console-6765fff99b-hwk4q"
May 28 14:55:55.699887 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:55.699793    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5b50ef1d-66dd-4399-a62f-37cdc88be08c-console-config\") pod \"console-6765fff99b-hwk4q\" (UID: \"5b50ef1d-66dd-4399-a62f-37cdc88be08c\") " pod="openshift-console/console-6765fff99b-hwk4q"
May 28 14:55:55.701653 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:55.701630    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5b50ef1d-66dd-4399-a62f-37cdc88be08c-console-serving-cert\") pod \"console-6765fff99b-hwk4q\" (UID: \"5b50ef1d-66dd-4399-a62f-37cdc88be08c\") " pod="openshift-console/console-6765fff99b-hwk4q"
May 28 14:55:55.701757 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:55.701671    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5b50ef1d-66dd-4399-a62f-37cdc88be08c-console-oauth-config\") pod \"console-6765fff99b-hwk4q\" (UID: \"5b50ef1d-66dd-4399-a62f-37cdc88be08c\") " pod="openshift-console/console-6765fff99b-hwk4q"
May 28 14:55:55.712486 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:55.712416    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gj454\" (UniqueName: \"kubernetes.io/projected/5b50ef1d-66dd-4399-a62f-37cdc88be08c-kube-api-access-gj454\") pod \"console-6765fff99b-hwk4q\" (UID: \"5b50ef1d-66dd-4399-a62f-37cdc88be08c\") " pod="openshift-console/console-6765fff99b-hwk4q"
May 28 14:55:55.846994 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:55.846898    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6765fff99b-hwk4q"
May 28 14:55:55.973844 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:55:55.973810    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-zctlp"
May 28 14:56:02.106234 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:02.106208    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6765fff99b-hwk4q"]
May 28 14:56:02.115900 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:56:02.115872    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b50ef1d_66dd_4399_a62f_37cdc88be08c.slice/crio-9460e94bd86e272141df3121c55a628e17c087a67d2c06d3be64e88141113f1d WatchSource:0}: Error finding container 9460e94bd86e272141df3121c55a628e17c087a67d2c06d3be64e88141113f1d: Status 404 returned error can't find the container with id 9460e94bd86e272141df3121c55a628e17c087a67d2c06d3be64e88141113f1d
May 28 14:56:03.031533 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:03.031488    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6765fff99b-hwk4q" event={"ID":"5b50ef1d-66dd-4399-a62f-37cdc88be08c","Type":"ContainerStarted","Data":"9460e94bd86e272141df3121c55a628e17c087a67d2c06d3be64e88141113f1d"}
May 28 14:56:03.033732 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:03.033694    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-57bd96b888-6pnmc" event={"ID":"9cb12218-75dd-4501-af0c-45a08fe2d93f","Type":"ContainerStarted","Data":"ce9339eb2f0ab2e7fce2a51b8995be81b300b61018f1b2f6c51c10bd7739d3d0"}
May 28 14:56:03.034267 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:03.034246    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-57bd96b888-6pnmc"
May 28 14:56:03.044238 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:03.044198    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-57bd96b888-6pnmc"
May 28 14:56:03.051736 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:03.051320    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/downloads-57bd96b888-6pnmc" podStartSLOduration=2.027890316 podStartE2EDuration="18.051302784s" podCreationTimestamp="2026-05-28 14:55:45 +0000 UTC" firstStartedPulling="2026-05-28 14:55:46.053690178 +0000 UTC m=+166.142906878" lastFinishedPulling="2026-05-28 14:56:02.077102629 +0000 UTC m=+182.166319346" observedRunningTime="2026-05-28 14:56:03.048811495 +0000 UTC m=+183.138028221" watchObservedRunningTime="2026-05-28 14:56:03.051302784 +0000 UTC m=+183.140519506"
May 28 14:56:06.044639 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:06.044594    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6765fff99b-hwk4q" event={"ID":"5b50ef1d-66dd-4399-a62f-37cdc88be08c","Type":"ContainerStarted","Data":"eb388051bb26cf170baa4f56ccecc45b0e60c444fad0556dd1bccc653d426ae9"}
May 28 14:56:06.061099 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:06.061050    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-6765fff99b-hwk4q" podStartSLOduration=7.457961417 podStartE2EDuration="11.061036541s" podCreationTimestamp="2026-05-28 14:55:55 +0000 UTC" firstStartedPulling="2026-05-28 14:56:02.123467433 +0000 UTC m=+182.212684147" lastFinishedPulling="2026-05-28 14:56:05.726542564 +0000 UTC m=+185.815759271" observedRunningTime="2026-05-28 14:56:06.059732004 +0000 UTC m=+186.148948728" watchObservedRunningTime="2026-05-28 14:56:06.061036541 +0000 UTC m=+186.150253265"
May 28 14:56:13.798218 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:13.798179    2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6765fff99b-hwk4q"]
May 28 14:56:15.847161 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:15.847121    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6765fff99b-hwk4q"
May 28 14:56:18.079333 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:18.079297    2563 generic.go:358] "Generic (PLEG): container finished" podID="831ffb2b-e2df-4e8b-b88a-3d4ba6e1a02d" containerID="a74ed040ebf0eb723f65c2108026db3ea5ff1806bdc22ecb457394400df95fdc" exitCode=0
May 28 14:56:18.079704 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:18.079369    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-sht78" event={"ID":"831ffb2b-e2df-4e8b-b88a-3d4ba6e1a02d","Type":"ContainerDied","Data":"a74ed040ebf0eb723f65c2108026db3ea5ff1806bdc22ecb457394400df95fdc"}
May 28 14:56:18.079749 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:18.079718    2563 scope.go:117] "RemoveContainer" containerID="a74ed040ebf0eb723f65c2108026db3ea5ff1806bdc22ecb457394400df95fdc"
May 28 14:56:19.083293 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:19.083264    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-sht78" event={"ID":"831ffb2b-e2df-4e8b-b88a-3d4ba6e1a02d","Type":"ContainerStarted","Data":"50569f8cff99885cb2400fd03fcd8c14f1afb0b48105f8420beb78fdbd279055"}
May 28 14:56:38.817424 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:38.817359    2563 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-6765fff99b-hwk4q" podUID="5b50ef1d-66dd-4399-a62f-37cdc88be08c" containerName="console" containerID="cri-o://eb388051bb26cf170baa4f56ccecc45b0e60c444fad0556dd1bccc653d426ae9" gracePeriod=15
May 28 14:56:39.064201 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:39.064173    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6765fff99b-hwk4q_5b50ef1d-66dd-4399-a62f-37cdc88be08c/console/0.log"
May 28 14:56:39.064315 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:39.064238    2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6765fff99b-hwk4q"
May 28 14:56:39.138619 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:39.138544    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6765fff99b-hwk4q_5b50ef1d-66dd-4399-a62f-37cdc88be08c/console/0.log"
May 28 14:56:39.138619 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:39.138587    2563 generic.go:358] "Generic (PLEG): container finished" podID="5b50ef1d-66dd-4399-a62f-37cdc88be08c" containerID="eb388051bb26cf170baa4f56ccecc45b0e60c444fad0556dd1bccc653d426ae9" exitCode=2
May 28 14:56:39.138814 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:39.138661    2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6765fff99b-hwk4q"
May 28 14:56:39.138814 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:39.138690    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6765fff99b-hwk4q" event={"ID":"5b50ef1d-66dd-4399-a62f-37cdc88be08c","Type":"ContainerDied","Data":"eb388051bb26cf170baa4f56ccecc45b0e60c444fad0556dd1bccc653d426ae9"}
May 28 14:56:39.138814 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:39.138731    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6765fff99b-hwk4q" event={"ID":"5b50ef1d-66dd-4399-a62f-37cdc88be08c","Type":"ContainerDied","Data":"9460e94bd86e272141df3121c55a628e17c087a67d2c06d3be64e88141113f1d"}
May 28 14:56:39.138814 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:39.138750    2563 scope.go:117] "RemoveContainer" containerID="eb388051bb26cf170baa4f56ccecc45b0e60c444fad0556dd1bccc653d426ae9"
May 28 14:56:39.156578 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:39.156548    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5b50ef1d-66dd-4399-a62f-37cdc88be08c-console-config\") pod \"5b50ef1d-66dd-4399-a62f-37cdc88be08c\" (UID: \"5b50ef1d-66dd-4399-a62f-37cdc88be08c\") "
May 28 14:56:39.156814 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:39.156591    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5b50ef1d-66dd-4399-a62f-37cdc88be08c-oauth-serving-cert\") pod \"5b50ef1d-66dd-4399-a62f-37cdc88be08c\" (UID: \"5b50ef1d-66dd-4399-a62f-37cdc88be08c\") "
May 28 14:56:39.156814 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:39.156618    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5b50ef1d-66dd-4399-a62f-37cdc88be08c-console-serving-cert\") pod \"5b50ef1d-66dd-4399-a62f-37cdc88be08c\" (UID: \"5b50ef1d-66dd-4399-a62f-37cdc88be08c\") "
May 28 14:56:39.156814 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:39.156659    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gj454\" (UniqueName: \"kubernetes.io/projected/5b50ef1d-66dd-4399-a62f-37cdc88be08c-kube-api-access-gj454\") pod \"5b50ef1d-66dd-4399-a62f-37cdc88be08c\" (UID: \"5b50ef1d-66dd-4399-a62f-37cdc88be08c\") "
May 28 14:56:39.156814 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:39.156719    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5b50ef1d-66dd-4399-a62f-37cdc88be08c-console-oauth-config\") pod \"5b50ef1d-66dd-4399-a62f-37cdc88be08c\" (UID: \"5b50ef1d-66dd-4399-a62f-37cdc88be08c\") "
May 28 14:56:39.157041 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:39.156930    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5b50ef1d-66dd-4399-a62f-37cdc88be08c-service-ca\") pod \"5b50ef1d-66dd-4399-a62f-37cdc88be08c\" (UID: \"5b50ef1d-66dd-4399-a62f-37cdc88be08c\") "
May 28 14:56:39.157098 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:39.157036    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5b50ef1d-66dd-4399-a62f-37cdc88be08c-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "5b50ef1d-66dd-4399-a62f-37cdc88be08c" (UID: "5b50ef1d-66dd-4399-a62f-37cdc88be08c"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 14:56:39.157098 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:39.157052    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5b50ef1d-66dd-4399-a62f-37cdc88be08c-console-config" (OuterVolumeSpecName: "console-config") pod "5b50ef1d-66dd-4399-a62f-37cdc88be08c" (UID: "5b50ef1d-66dd-4399-a62f-37cdc88be08c"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 14:56:39.157309 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:39.157284    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5b50ef1d-66dd-4399-a62f-37cdc88be08c-service-ca" (OuterVolumeSpecName: "service-ca") pod "5b50ef1d-66dd-4399-a62f-37cdc88be08c" (UID: "5b50ef1d-66dd-4399-a62f-37cdc88be08c"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 14:56:39.157520 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:39.157500    2563 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5b50ef1d-66dd-4399-a62f-37cdc88be08c-service-ca\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
May 28 14:56:39.157645 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:39.157585    2563 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5b50ef1d-66dd-4399-a62f-37cdc88be08c-console-config\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
May 28 14:56:39.157645 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:39.157614    2563 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5b50ef1d-66dd-4399-a62f-37cdc88be08c-oauth-serving-cert\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
May 28 14:56:39.159131 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:39.159102    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5b50ef1d-66dd-4399-a62f-37cdc88be08c-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "5b50ef1d-66dd-4399-a62f-37cdc88be08c" (UID: "5b50ef1d-66dd-4399-a62f-37cdc88be08c"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 14:56:39.159131 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:39.159117    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5b50ef1d-66dd-4399-a62f-37cdc88be08c-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "5b50ef1d-66dd-4399-a62f-37cdc88be08c" (UID: "5b50ef1d-66dd-4399-a62f-37cdc88be08c"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 14:56:39.159303 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:39.159220    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5b50ef1d-66dd-4399-a62f-37cdc88be08c-kube-api-access-gj454" (OuterVolumeSpecName: "kube-api-access-gj454") pod "5b50ef1d-66dd-4399-a62f-37cdc88be08c" (UID: "5b50ef1d-66dd-4399-a62f-37cdc88be08c"). InnerVolumeSpecName "kube-api-access-gj454". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 14:56:39.159428 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:39.159335    2563 scope.go:117] "RemoveContainer" containerID="eb388051bb26cf170baa4f56ccecc45b0e60c444fad0556dd1bccc653d426ae9"
May 28 14:56:39.159643 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:56:39.159621    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eb388051bb26cf170baa4f56ccecc45b0e60c444fad0556dd1bccc653d426ae9\": container with ID starting with eb388051bb26cf170baa4f56ccecc45b0e60c444fad0556dd1bccc653d426ae9 not found: ID does not exist" containerID="eb388051bb26cf170baa4f56ccecc45b0e60c444fad0556dd1bccc653d426ae9"
May 28 14:56:39.159757 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:39.159650    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb388051bb26cf170baa4f56ccecc45b0e60c444fad0556dd1bccc653d426ae9"} err="failed to get container status \"eb388051bb26cf170baa4f56ccecc45b0e60c444fad0556dd1bccc653d426ae9\": rpc error: code = NotFound desc = could not find container \"eb388051bb26cf170baa4f56ccecc45b0e60c444fad0556dd1bccc653d426ae9\": container with ID starting with eb388051bb26cf170baa4f56ccecc45b0e60c444fad0556dd1bccc653d426ae9 not found: ID does not exist"
May 28 14:56:39.258940 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:39.258902    2563 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5b50ef1d-66dd-4399-a62f-37cdc88be08c-console-serving-cert\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
May 28 14:56:39.258940 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:39.258934    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gj454\" (UniqueName: \"kubernetes.io/projected/5b50ef1d-66dd-4399-a62f-37cdc88be08c-kube-api-access-gj454\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
May 28 14:56:39.258940 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:39.258945    2563 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5b50ef1d-66dd-4399-a62f-37cdc88be08c-console-oauth-config\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
May 28 14:56:39.462482 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:39.462448    2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6765fff99b-hwk4q"]
May 28 14:56:39.466252 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:39.466223    2563 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6765fff99b-hwk4q"]
May 28 14:56:40.479388 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:40.479341    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5b50ef1d-66dd-4399-a62f-37cdc88be08c" path="/var/lib/kubelet/pods/5b50ef1d-66dd-4399-a62f-37cdc88be08c/volumes"
May 28 14:56:51.590606 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:51.590571    2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 28 14:56:51.591213 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:51.591182    2563 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="31fd180e-595d-483c-9933-c7329c8481af" containerName="alertmanager" containerID="cri-o://dfd2778eb9bee59404141b536ebd3c6de51dbbc718641788f0edc378c92a424f" gracePeriod=120
May 28 14:56:51.591281 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:51.591229    2563 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="31fd180e-595d-483c-9933-c7329c8481af" containerName="kube-rbac-proxy-metric" containerID="cri-o://72cf5192677db55c3dcb40f779988a1ea61fe6e970328f49e33eef8ff1572467" gracePeriod=120
May 28 14:56:51.591340 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:51.591245    2563 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="31fd180e-595d-483c-9933-c7329c8481af" containerName="kube-rbac-proxy-web" containerID="cri-o://d6e7880ec6128eeda8851915b10da322217919f62b3fdfd77fa2834ed0c1a68b" gracePeriod=120
May 28 14:56:51.591340 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:51.591260    2563 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="31fd180e-595d-483c-9933-c7329c8481af" containerName="kube-rbac-proxy" containerID="cri-o://54cf45b5bdc3451c0603ebfb35cd046c57918821f0420cf992b06e430341fde9" gracePeriod=120
May 28 14:56:51.591438 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:51.591299    2563 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="31fd180e-595d-483c-9933-c7329c8481af" containerName="config-reloader" containerID="cri-o://89afc94ea7b1719744b9109a08a42fd2e728fcdaea0ba3cef1f8c9cc08390ad7" gracePeriod=120
May 28 14:56:51.591438 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:51.591316    2563 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="31fd180e-595d-483c-9933-c7329c8481af" containerName="prom-label-proxy" containerID="cri-o://5e2232a1ab057f160b811ee91e557acfa0449028212e8c6b65cc5614a6ea65cd" gracePeriod=120
May 28 14:56:52.179078 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:52.179048    2563 generic.go:358] "Generic (PLEG): container finished" podID="31fd180e-595d-483c-9933-c7329c8481af" containerID="5e2232a1ab057f160b811ee91e557acfa0449028212e8c6b65cc5614a6ea65cd" exitCode=0
May 28 14:56:52.179078 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:52.179075    2563 generic.go:358] "Generic (PLEG): container finished" podID="31fd180e-595d-483c-9933-c7329c8481af" containerID="54cf45b5bdc3451c0603ebfb35cd046c57918821f0420cf992b06e430341fde9" exitCode=0
May 28 14:56:52.179078 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:52.179081    2563 generic.go:358] "Generic (PLEG): container finished" podID="31fd180e-595d-483c-9933-c7329c8481af" containerID="89afc94ea7b1719744b9109a08a42fd2e728fcdaea0ba3cef1f8c9cc08390ad7" exitCode=0
May 28 14:56:52.179078 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:52.179087    2563 generic.go:358] "Generic (PLEG): container finished" podID="31fd180e-595d-483c-9933-c7329c8481af" containerID="dfd2778eb9bee59404141b536ebd3c6de51dbbc718641788f0edc378c92a424f" exitCode=0
May 28 14:56:52.179359 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:52.179127    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"31fd180e-595d-483c-9933-c7329c8481af","Type":"ContainerDied","Data":"5e2232a1ab057f160b811ee91e557acfa0449028212e8c6b65cc5614a6ea65cd"}
May 28 14:56:52.179359 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:52.179167    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"31fd180e-595d-483c-9933-c7329c8481af","Type":"ContainerDied","Data":"54cf45b5bdc3451c0603ebfb35cd046c57918821f0420cf992b06e430341fde9"}
May 28 14:56:52.179359 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:52.179183    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"31fd180e-595d-483c-9933-c7329c8481af","Type":"ContainerDied","Data":"89afc94ea7b1719744b9109a08a42fd2e728fcdaea0ba3cef1f8c9cc08390ad7"}
May 28 14:56:52.179359 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:52.179195    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"31fd180e-595d-483c-9933-c7329c8481af","Type":"ContainerDied","Data":"dfd2778eb9bee59404141b536ebd3c6de51dbbc718641788f0edc378c92a424f"}
May 28 14:56:52.838111 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:52.838088    2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 28 14:56:52.969104 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:52.969008    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/31fd180e-595d-483c-9933-c7329c8481af-cluster-tls-config\") pod \"31fd180e-595d-483c-9933-c7329c8481af\" (UID: \"31fd180e-595d-483c-9933-c7329c8481af\") "
May 28 14:56:52.969104 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:52.969069    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/31fd180e-595d-483c-9933-c7329c8481af-secret-alertmanager-kube-rbac-proxy\") pod \"31fd180e-595d-483c-9933-c7329c8481af\" (UID: \"31fd180e-595d-483c-9933-c7329c8481af\") "
May 28 14:56:52.969104 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:52.969099    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/31fd180e-595d-483c-9933-c7329c8481af-secret-alertmanager-kube-rbac-proxy-metric\") pod \"31fd180e-595d-483c-9933-c7329c8481af\" (UID: \"31fd180e-595d-483c-9933-c7329c8481af\") "
May 28 14:56:52.969371 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:52.969117    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/31fd180e-595d-483c-9933-c7329c8481af-secret-alertmanager-kube-rbac-proxy-web\") pod \"31fd180e-595d-483c-9933-c7329c8481af\" (UID: \"31fd180e-595d-483c-9933-c7329c8481af\") "
May 28 14:56:52.969371 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:52.969148    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2kptq\" (UniqueName: \"kubernetes.io/projected/31fd180e-595d-483c-9933-c7329c8481af-kube-api-access-2kptq\") pod \"31fd180e-595d-483c-9933-c7329c8481af\" (UID: \"31fd180e-595d-483c-9933-c7329c8481af\") "
May 28 14:56:52.969371 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:52.969171    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/31fd180e-595d-483c-9933-c7329c8481af-tls-assets\") pod \"31fd180e-595d-483c-9933-c7329c8481af\" (UID: \"31fd180e-595d-483c-9933-c7329c8481af\") "
May 28 14:56:52.969371 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:52.969280    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/31fd180e-595d-483c-9933-c7329c8481af-alertmanager-main-db\") pod \"31fd180e-595d-483c-9933-c7329c8481af\" (UID: \"31fd180e-595d-483c-9933-c7329c8481af\") "
May 28 14:56:52.969371 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:52.969332    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/31fd180e-595d-483c-9933-c7329c8481af-web-config\") pod \"31fd180e-595d-483c-9933-c7329c8481af\" (UID: \"31fd180e-595d-483c-9933-c7329c8481af\") "
May 28 14:56:52.969371 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:52.969365    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/31fd180e-595d-483c-9933-c7329c8481af-alertmanager-trusted-ca-bundle\") pod \"31fd180e-595d-483c-9933-c7329c8481af\" (UID: \"31fd180e-595d-483c-9933-c7329c8481af\") "
May 28 14:56:52.969669 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:52.969400    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/31fd180e-595d-483c-9933-c7329c8481af-secret-alertmanager-main-tls\") pod \"31fd180e-595d-483c-9933-c7329c8481af\" (UID: \"31fd180e-595d-483c-9933-c7329c8481af\") "
May 28 14:56:52.969669 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:52.969457    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/31fd180e-595d-483c-9933-c7329c8481af-config-volume\") pod \"31fd180e-595d-483c-9933-c7329c8481af\" (UID: \"31fd180e-595d-483c-9933-c7329c8481af\") "
May 28 14:56:52.969669 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:52.969489    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/31fd180e-595d-483c-9933-c7329c8481af-config-out\") pod \"31fd180e-595d-483c-9933-c7329c8481af\" (UID: \"31fd180e-595d-483c-9933-c7329c8481af\") "
May 28 14:56:52.969669 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:52.969526    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/31fd180e-595d-483c-9933-c7329c8481af-metrics-client-ca\") pod \"31fd180e-595d-483c-9933-c7329c8481af\" (UID: \"31fd180e-595d-483c-9933-c7329c8481af\") "
May 28 14:56:52.969669 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:52.969650    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31fd180e-595d-483c-9933-c7329c8481af-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "31fd180e-595d-483c-9933-c7329c8481af" (UID: "31fd180e-595d-483c-9933-c7329c8481af"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 14:56:52.969944 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:52.969791    2563 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/31fd180e-595d-483c-9933-c7329c8481af-alertmanager-main-db\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
May 28 14:56:52.970051 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:52.970031    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/31fd180e-595d-483c-9933-c7329c8481af-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "31fd180e-595d-483c-9933-c7329c8481af" (UID: "31fd180e-595d-483c-9933-c7329c8481af"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 14:56:52.970555 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:52.970519    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/31fd180e-595d-483c-9933-c7329c8481af-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "31fd180e-595d-483c-9933-c7329c8481af" (UID: "31fd180e-595d-483c-9933-c7329c8481af"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 14:56:52.971988 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:52.971943    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/31fd180e-595d-483c-9933-c7329c8481af-kube-api-access-2kptq" (OuterVolumeSpecName: "kube-api-access-2kptq") pod "31fd180e-595d-483c-9933-c7329c8481af" (UID: "31fd180e-595d-483c-9933-c7329c8481af"). InnerVolumeSpecName "kube-api-access-2kptq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 14:56:52.972721 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:52.972664    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/31fd180e-595d-483c-9933-c7329c8481af-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "31fd180e-595d-483c-9933-c7329c8481af" (UID: "31fd180e-595d-483c-9933-c7329c8481af"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 14:56:52.972893 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:52.972865    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/31fd180e-595d-483c-9933-c7329c8481af-config-volume" (OuterVolumeSpecName: "config-volume") pod "31fd180e-595d-483c-9933-c7329c8481af" (UID: "31fd180e-595d-483c-9933-c7329c8481af"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 14:56:52.973033 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:52.973008    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/31fd180e-595d-483c-9933-c7329c8481af-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "31fd180e-595d-483c-9933-c7329c8481af" (UID: "31fd180e-595d-483c-9933-c7329c8481af"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 14:56:52.973125 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:52.973094    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/31fd180e-595d-483c-9933-c7329c8481af-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "31fd180e-595d-483c-9933-c7329c8481af" (UID: "31fd180e-595d-483c-9933-c7329c8481af"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 14:56:52.973267 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:52.973241    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31fd180e-595d-483c-9933-c7329c8481af-config-out" (OuterVolumeSpecName: "config-out") pod "31fd180e-595d-483c-9933-c7329c8481af" (UID: "31fd180e-595d-483c-9933-c7329c8481af"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 14:56:52.973746 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:52.973719    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/31fd180e-595d-483c-9933-c7329c8481af-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "31fd180e-595d-483c-9933-c7329c8481af" (UID: "31fd180e-595d-483c-9933-c7329c8481af"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 14:56:52.973886 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:52.973865    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/31fd180e-595d-483c-9933-c7329c8481af-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "31fd180e-595d-483c-9933-c7329c8481af" (UID: "31fd180e-595d-483c-9933-c7329c8481af"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 14:56:52.977390 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:52.977283    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/31fd180e-595d-483c-9933-c7329c8481af-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "31fd180e-595d-483c-9933-c7329c8481af" (UID: "31fd180e-595d-483c-9933-c7329c8481af"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 14:56:52.982860 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:52.982838    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/31fd180e-595d-483c-9933-c7329c8481af-web-config" (OuterVolumeSpecName: "web-config") pod "31fd180e-595d-483c-9933-c7329c8481af" (UID: "31fd180e-595d-483c-9933-c7329c8481af"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 14:56:53.070393 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:53.070353    2563 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/31fd180e-595d-483c-9933-c7329c8481af-metrics-client-ca\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
May 28 14:56:53.070393 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:53.070386    2563 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/31fd180e-595d-483c-9933-c7329c8481af-cluster-tls-config\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
May 28 14:56:53.070393 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:53.070397    2563 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/31fd180e-595d-483c-9933-c7329c8481af-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
May 28 14:56:53.070618 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:53.070407    2563 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/31fd180e-595d-483c-9933-c7329c8481af-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
May 28 14:56:53.070618 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:53.070419    2563 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/31fd180e-595d-483c-9933-c7329c8481af-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
May 28 14:56:53.070618 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:53.070428    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2kptq\" (UniqueName: \"kubernetes.io/projected/31fd180e-595d-483c-9933-c7329c8481af-kube-api-access-2kptq\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
May 28 14:56:53.070618 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:53.070437    2563 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/31fd180e-595d-483c-9933-c7329c8481af-tls-assets\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
May 28 14:56:53.070618 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:53.070446    2563 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/31fd180e-595d-483c-9933-c7329c8481af-web-config\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
May 28 14:56:53.070618 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:53.070454    2563 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/31fd180e-595d-483c-9933-c7329c8481af-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
May 28 14:56:53.070618 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:53.070463    2563 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/31fd180e-595d-483c-9933-c7329c8481af-secret-alertmanager-main-tls\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
May 28 14:56:53.070618 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:53.070471    2563 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/31fd180e-595d-483c-9933-c7329c8481af-config-volume\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
May 28 14:56:53.070618 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:53.070480    2563 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/31fd180e-595d-483c-9933-c7329c8481af-config-out\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
May 28 14:56:53.184803 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:53.184771    2563 generic.go:358] "Generic (PLEG): container finished" podID="31fd180e-595d-483c-9933-c7329c8481af" containerID="72cf5192677db55c3dcb40f779988a1ea61fe6e970328f49e33eef8ff1572467" exitCode=0
May 28 14:56:53.184803 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:53.184795    2563 generic.go:358] "Generic (PLEG): container finished" podID="31fd180e-595d-483c-9933-c7329c8481af" containerID="d6e7880ec6128eeda8851915b10da322217919f62b3fdfd77fa2834ed0c1a68b" exitCode=0
May 28 14:56:53.184988 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:53.184821    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"31fd180e-595d-483c-9933-c7329c8481af","Type":"ContainerDied","Data":"72cf5192677db55c3dcb40f779988a1ea61fe6e970328f49e33eef8ff1572467"}
May 28 14:56:53.184988 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:53.184863    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"31fd180e-595d-483c-9933-c7329c8481af","Type":"ContainerDied","Data":"d6e7880ec6128eeda8851915b10da322217919f62b3fdfd77fa2834ed0c1a68b"}
May 28 14:56:53.184988 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:53.184874    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"31fd180e-595d-483c-9933-c7329c8481af","Type":"ContainerDied","Data":"ee4c1a2398791820539470f4994574f0d2fb637bb45d138b24676ee1c1a17de4"}
May 28 14:56:53.184988 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:53.184889    2563 scope.go:117] "RemoveContainer" containerID="5e2232a1ab057f160b811ee91e557acfa0449028212e8c6b65cc5614a6ea65cd"
May 28 14:56:53.184988 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:53.184887    2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 28 14:56:53.192261 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:53.192246    2563 scope.go:117] "RemoveContainer" containerID="72cf5192677db55c3dcb40f779988a1ea61fe6e970328f49e33eef8ff1572467"
May 28 14:56:53.199558 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:53.199537    2563 scope.go:117] "RemoveContainer" containerID="54cf45b5bdc3451c0603ebfb35cd046c57918821f0420cf992b06e430341fde9"
May 28 14:56:53.205995 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:53.205978    2563 scope.go:117] "RemoveContainer" containerID="d6e7880ec6128eeda8851915b10da322217919f62b3fdfd77fa2834ed0c1a68b"
May 28 14:56:53.208709 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:53.208670    2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 28 14:56:53.212313 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:53.212286    2563 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 28 14:56:53.213306 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:53.213283    2563 scope.go:117] "RemoveContainer" containerID="89afc94ea7b1719744b9109a08a42fd2e728fcdaea0ba3cef1f8c9cc08390ad7"
May 28 14:56:53.219694 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:53.219657    2563 scope.go:117] "RemoveContainer" containerID="dfd2778eb9bee59404141b536ebd3c6de51dbbc718641788f0edc378c92a424f"
May 28 14:56:53.226076 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:53.226060    2563 scope.go:117] "RemoveContainer" containerID="87abeaa8fb656658cf6936b2cb62409b3388837cdacbbfbc2f959d258d2df842"
May 28 14:56:53.232471 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:53.232454    2563 scope.go:117] "RemoveContainer" containerID="5e2232a1ab057f160b811ee91e557acfa0449028212e8c6b65cc5614a6ea65cd"
May 28 14:56:53.232766 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:56:53.232748    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5e2232a1ab057f160b811ee91e557acfa0449028212e8c6b65cc5614a6ea65cd\": container with ID starting with 5e2232a1ab057f160b811ee91e557acfa0449028212e8c6b65cc5614a6ea65cd not found: ID does not exist" containerID="5e2232a1ab057f160b811ee91e557acfa0449028212e8c6b65cc5614a6ea65cd"
May 28 14:56:53.232839 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:53.232782    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5e2232a1ab057f160b811ee91e557acfa0449028212e8c6b65cc5614a6ea65cd"} err="failed to get container status \"5e2232a1ab057f160b811ee91e557acfa0449028212e8c6b65cc5614a6ea65cd\": rpc error: code = NotFound desc = could not find container \"5e2232a1ab057f160b811ee91e557acfa0449028212e8c6b65cc5614a6ea65cd\": container with ID starting with 5e2232a1ab057f160b811ee91e557acfa0449028212e8c6b65cc5614a6ea65cd not found: ID does not exist"
May 28 14:56:53.232839 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:53.232811    2563 scope.go:117] "RemoveContainer" containerID="72cf5192677db55c3dcb40f779988a1ea61fe6e970328f49e33eef8ff1572467"
May 28 14:56:53.233059 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:56:53.233042    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"72cf5192677db55c3dcb40f779988a1ea61fe6e970328f49e33eef8ff1572467\": container with ID starting with 72cf5192677db55c3dcb40f779988a1ea61fe6e970328f49e33eef8ff1572467 not found: ID does not exist" containerID="72cf5192677db55c3dcb40f779988a1ea61fe6e970328f49e33eef8ff1572467"
May 28 14:56:53.233098 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:53.233065    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"72cf5192677db55c3dcb40f779988a1ea61fe6e970328f49e33eef8ff1572467"} err="failed to get container status \"72cf5192677db55c3dcb40f779988a1ea61fe6e970328f49e33eef8ff1572467\": rpc error: code = NotFound desc = could not find container \"72cf5192677db55c3dcb40f779988a1ea61fe6e970328f49e33eef8ff1572467\": container with ID starting with 72cf5192677db55c3dcb40f779988a1ea61fe6e970328f49e33eef8ff1572467 not found: ID does not exist"
May 28 14:56:53.233098 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:53.233082    2563 scope.go:117] "RemoveContainer" containerID="54cf45b5bdc3451c0603ebfb35cd046c57918821f0420cf992b06e430341fde9"
May 28 14:56:53.233289 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:56:53.233271    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"54cf45b5bdc3451c0603ebfb35cd046c57918821f0420cf992b06e430341fde9\": container with ID starting with 54cf45b5bdc3451c0603ebfb35cd046c57918821f0420cf992b06e430341fde9 not found: ID does not exist" containerID="54cf45b5bdc3451c0603ebfb35cd046c57918821f0420cf992b06e430341fde9"
May 28 14:56:53.233327 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:53.233296    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"54cf45b5bdc3451c0603ebfb35cd046c57918821f0420cf992b06e430341fde9"} err="failed to get container status \"54cf45b5bdc3451c0603ebfb35cd046c57918821f0420cf992b06e430341fde9\": rpc error: code = NotFound desc = could not find container \"54cf45b5bdc3451c0603ebfb35cd046c57918821f0420cf992b06e430341fde9\": container with ID starting with 54cf45b5bdc3451c0603ebfb35cd046c57918821f0420cf992b06e430341fde9 not found: ID does not exist"
May 28 14:56:53.233366 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:53.233326    2563 scope.go:117] "RemoveContainer" containerID="d6e7880ec6128eeda8851915b10da322217919f62b3fdfd77fa2834ed0c1a68b"
May 28 14:56:53.233545 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:56:53.233525    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d6e7880ec6128eeda8851915b10da322217919f62b3fdfd77fa2834ed0c1a68b\": container with ID starting with d6e7880ec6128eeda8851915b10da322217919f62b3fdfd77fa2834ed0c1a68b not found: ID does not exist" containerID="d6e7880ec6128eeda8851915b10da322217919f62b3fdfd77fa2834ed0c1a68b"
May 28 14:56:53.233608 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:53.233554    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d6e7880ec6128eeda8851915b10da322217919f62b3fdfd77fa2834ed0c1a68b"} err="failed to get container status \"d6e7880ec6128eeda8851915b10da322217919f62b3fdfd77fa2834ed0c1a68b\": rpc error: code = NotFound desc = could not find container \"d6e7880ec6128eeda8851915b10da322217919f62b3fdfd77fa2834ed0c1a68b\": container with ID starting with d6e7880ec6128eeda8851915b10da322217919f62b3fdfd77fa2834ed0c1a68b not found: ID does not exist"
May 28 14:56:53.233608 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:53.233576    2563 scope.go:117] "RemoveContainer" containerID="89afc94ea7b1719744b9109a08a42fd2e728fcdaea0ba3cef1f8c9cc08390ad7"
May 28 14:56:53.233852 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:56:53.233836    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"89afc94ea7b1719744b9109a08a42fd2e728fcdaea0ba3cef1f8c9cc08390ad7\": container with ID starting with 89afc94ea7b1719744b9109a08a42fd2e728fcdaea0ba3cef1f8c9cc08390ad7 not found: ID does not exist" containerID="89afc94ea7b1719744b9109a08a42fd2e728fcdaea0ba3cef1f8c9cc08390ad7"
May 28 14:56:53.233920 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:53.233858    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"89afc94ea7b1719744b9109a08a42fd2e728fcdaea0ba3cef1f8c9cc08390ad7"} err="failed to get container status \"89afc94ea7b1719744b9109a08a42fd2e728fcdaea0ba3cef1f8c9cc08390ad7\": rpc error: code = NotFound desc = could not find container \"89afc94ea7b1719744b9109a08a42fd2e728fcdaea0ba3cef1f8c9cc08390ad7\": container with ID starting with 89afc94ea7b1719744b9109a08a42fd2e728fcdaea0ba3cef1f8c9cc08390ad7 not found: ID does not exist"
May 28 14:56:53.233920 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:53.233877    2563 scope.go:117] "RemoveContainer" containerID="dfd2778eb9bee59404141b536ebd3c6de51dbbc718641788f0edc378c92a424f"
May 28 14:56:53.234099 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:56:53.234083    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dfd2778eb9bee59404141b536ebd3c6de51dbbc718641788f0edc378c92a424f\": container with ID starting with dfd2778eb9bee59404141b536ebd3c6de51dbbc718641788f0edc378c92a424f not found: ID does not exist" containerID="dfd2778eb9bee59404141b536ebd3c6de51dbbc718641788f0edc378c92a424f"
May 28 14:56:53.234155 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:53.234104    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dfd2778eb9bee59404141b536ebd3c6de51dbbc718641788f0edc378c92a424f"} err="failed to get container status \"dfd2778eb9bee59404141b536ebd3c6de51dbbc718641788f0edc378c92a424f\": rpc error: code = NotFound desc = could not find container \"dfd2778eb9bee59404141b536ebd3c6de51dbbc718641788f0edc378c92a424f\": container with ID starting with dfd2778eb9bee59404141b536ebd3c6de51dbbc718641788f0edc378c92a424f not found: ID does not exist"
May 28 14:56:53.234155 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:53.234122    2563 scope.go:117] "RemoveContainer" containerID="87abeaa8fb656658cf6936b2cb62409b3388837cdacbbfbc2f959d258d2df842"
May 28 14:56:53.234339 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:56:53.234323    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"87abeaa8fb656658cf6936b2cb62409b3388837cdacbbfbc2f959d258d2df842\": container with ID starting with 87abeaa8fb656658cf6936b2cb62409b3388837cdacbbfbc2f959d258d2df842 not found: ID does not exist" containerID="87abeaa8fb656658cf6936b2cb62409b3388837cdacbbfbc2f959d258d2df842"
May 28 14:56:53.234373 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:53.234345    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"87abeaa8fb656658cf6936b2cb62409b3388837cdacbbfbc2f959d258d2df842"} err="failed to get container status \"87abeaa8fb656658cf6936b2cb62409b3388837cdacbbfbc2f959d258d2df842\": rpc error: code = NotFound desc = could not find container \"87abeaa8fb656658cf6936b2cb62409b3388837cdacbbfbc2f959d258d2df842\": container with ID starting with 87abeaa8fb656658cf6936b2cb62409b3388837cdacbbfbc2f959d258d2df842 not found: ID does not exist"
May 28 14:56:53.234373 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:53.234363    2563 scope.go:117] "RemoveContainer" containerID="5e2232a1ab057f160b811ee91e557acfa0449028212e8c6b65cc5614a6ea65cd"
May 28 14:56:53.234547 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:53.234532    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5e2232a1ab057f160b811ee91e557acfa0449028212e8c6b65cc5614a6ea65cd"} err="failed to get container status \"5e2232a1ab057f160b811ee91e557acfa0449028212e8c6b65cc5614a6ea65cd\": rpc error: code = NotFound desc = could not find container \"5e2232a1ab057f160b811ee91e557acfa0449028212e8c6b65cc5614a6ea65cd\": container with ID starting with 5e2232a1ab057f160b811ee91e557acfa0449028212e8c6b65cc5614a6ea65cd not found: ID does not exist"
May 28 14:56:53.234547 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:53.234547    2563 scope.go:117] "RemoveContainer" containerID="72cf5192677db55c3dcb40f779988a1ea61fe6e970328f49e33eef8ff1572467"
May 28 14:56:53.234782 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:53.234762    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"72cf5192677db55c3dcb40f779988a1ea61fe6e970328f49e33eef8ff1572467"} err="failed to get container status \"72cf5192677db55c3dcb40f779988a1ea61fe6e970328f49e33eef8ff1572467\": rpc error: code = NotFound desc = could not find container \"72cf5192677db55c3dcb40f779988a1ea61fe6e970328f49e33eef8ff1572467\": container with ID starting with 72cf5192677db55c3dcb40f779988a1ea61fe6e970328f49e33eef8ff1572467 not found: ID does not exist"
May 28 14:56:53.234843 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:53.234786    2563 scope.go:117] "RemoveContainer" containerID="54cf45b5bdc3451c0603ebfb35cd046c57918821f0420cf992b06e430341fde9"
May 28 14:56:53.235018 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:53.234999    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"54cf45b5bdc3451c0603ebfb35cd046c57918821f0420cf992b06e430341fde9"} err="failed to get container status \"54cf45b5bdc3451c0603ebfb35cd046c57918821f0420cf992b06e430341fde9\": rpc error: code = NotFound desc = could not find container \"54cf45b5bdc3451c0603ebfb35cd046c57918821f0420cf992b06e430341fde9\": container with ID starting with 54cf45b5bdc3451c0603ebfb35cd046c57918821f0420cf992b06e430341fde9 not found: ID does not exist"
May 28 14:56:53.235018 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:53.235017    2563 scope.go:117] "RemoveContainer" containerID="d6e7880ec6128eeda8851915b10da322217919f62b3fdfd77fa2834ed0c1a68b"
May 28 14:56:53.235232 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:53.235209    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d6e7880ec6128eeda8851915b10da322217919f62b3fdfd77fa2834ed0c1a68b"} err="failed to get container status \"d6e7880ec6128eeda8851915b10da322217919f62b3fdfd77fa2834ed0c1a68b\": rpc error: code = NotFound desc = could not find container \"d6e7880ec6128eeda8851915b10da322217919f62b3fdfd77fa2834ed0c1a68b\": container with ID starting with d6e7880ec6128eeda8851915b10da322217919f62b3fdfd77fa2834ed0c1a68b not found: ID does not exist"
May 28 14:56:53.235306 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:53.235234    2563 scope.go:117] "RemoveContainer" containerID="89afc94ea7b1719744b9109a08a42fd2e728fcdaea0ba3cef1f8c9cc08390ad7"
May 28 14:56:53.235451 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:53.235433    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"89afc94ea7b1719744b9109a08a42fd2e728fcdaea0ba3cef1f8c9cc08390ad7"} err="failed to get container status \"89afc94ea7b1719744b9109a08a42fd2e728fcdaea0ba3cef1f8c9cc08390ad7\": rpc error: code = NotFound desc = could not find container \"89afc94ea7b1719744b9109a08a42fd2e728fcdaea0ba3cef1f8c9cc08390ad7\": container with ID starting with 89afc94ea7b1719744b9109a08a42fd2e728fcdaea0ba3cef1f8c9cc08390ad7 not found: ID does not exist"
May 28 14:56:53.235499 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:53.235451    2563 scope.go:117] "RemoveContainer" containerID="dfd2778eb9bee59404141b536ebd3c6de51dbbc718641788f0edc378c92a424f"
May 28 14:56:53.235661 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:53.235633    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dfd2778eb9bee59404141b536ebd3c6de51dbbc718641788f0edc378c92a424f"} err="failed to get container status \"dfd2778eb9bee59404141b536ebd3c6de51dbbc718641788f0edc378c92a424f\": rpc error: code = NotFound desc = could not find container \"dfd2778eb9bee59404141b536ebd3c6de51dbbc718641788f0edc378c92a424f\": container with ID starting with dfd2778eb9bee59404141b536ebd3c6de51dbbc718641788f0edc378c92a424f not found: ID does not exist"
May 28 14:56:53.235721 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:53.235662    2563 scope.go:117] "RemoveContainer" containerID="87abeaa8fb656658cf6936b2cb62409b3388837cdacbbfbc2f959d258d2df842"
May 28 14:56:53.235918 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:53.235900    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"87abeaa8fb656658cf6936b2cb62409b3388837cdacbbfbc2f959d258d2df842"} err="failed to get container status \"87abeaa8fb656658cf6936b2cb62409b3388837cdacbbfbc2f959d258d2df842\": rpc error: code = NotFound desc = could not find container \"87abeaa8fb656658cf6936b2cb62409b3388837cdacbbfbc2f959d258d2df842\": container with ID starting with 87abeaa8fb656658cf6936b2cb62409b3388837cdacbbfbc2f959d258d2df842 not found: ID does not exist"
May 28 14:56:53.243010 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:53.242981    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 28 14:56:53.243282 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:53.243267    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31fd180e-595d-483c-9933-c7329c8481af" containerName="init-config-reloader"
May 28 14:56:53.243361 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:53.243284    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="31fd180e-595d-483c-9933-c7329c8481af" containerName="init-config-reloader"
May 28 14:56:53.243361 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:53.243295    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31fd180e-595d-483c-9933-c7329c8481af" containerName="kube-rbac-proxy-metric"
May 28 14:56:53.243361 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:53.243300    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="31fd180e-595d-483c-9933-c7329c8481af" containerName="kube-rbac-proxy-metric"
May 28 14:56:53.243361 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:53.243312    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31fd180e-595d-483c-9933-c7329c8481af" containerName="prom-label-proxy"
May 28 14:56:53.243361 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:53.243320    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="31fd180e-595d-483c-9933-c7329c8481af" containerName="prom-label-proxy"
May 28 14:56:53.243361 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:53.243331    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31fd180e-595d-483c-9933-c7329c8481af" containerName="kube-rbac-proxy-web"
May 28 14:56:53.243361 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:53.243341    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="31fd180e-595d-483c-9933-c7329c8481af" containerName="kube-rbac-proxy-web"
May 28 14:56:53.243361 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:53.243349    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31fd180e-595d-483c-9933-c7329c8481af" containerName="alertmanager"
May 28 14:56:53.243361 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:53.243354    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="31fd180e-595d-483c-9933-c7329c8481af" containerName="alertmanager"
May 28 14:56:53.243361 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:53.243361    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5b50ef1d-66dd-4399-a62f-37cdc88be08c" containerName="console"
May 28 14:56:53.243361 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:53.243366    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b50ef1d-66dd-4399-a62f-37cdc88be08c" containerName="console"
May 28 14:56:53.243767 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:53.243375    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31fd180e-595d-483c-9933-c7329c8481af" containerName="kube-rbac-proxy"
May 28 14:56:53.243767 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:53.243380    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="31fd180e-595d-483c-9933-c7329c8481af" containerName="kube-rbac-proxy"
May 28 14:56:53.243767 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:53.243387    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31fd180e-595d-483c-9933-c7329c8481af" containerName="config-reloader"
May 28 14:56:53.243767 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:53.243392    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="31fd180e-595d-483c-9933-c7329c8481af" containerName="config-reloader"
May 28 14:56:53.243767 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:53.243446    2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="31fd180e-595d-483c-9933-c7329c8481af" containerName="alertmanager"
May 28 14:56:53.243767 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:53.243453    2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="31fd180e-595d-483c-9933-c7329c8481af" containerName="config-reloader"
May 28 14:56:53.243767 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:53.243460    2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="31fd180e-595d-483c-9933-c7329c8481af" containerName="kube-rbac-proxy-web"
May 28 14:56:53.243767 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:53.243466    2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="5b50ef1d-66dd-4399-a62f-37cdc88be08c" containerName="console"
May 28 14:56:53.243767 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:53.243472    2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="31fd180e-595d-483c-9933-c7329c8481af" containerName="prom-label-proxy"
May 28 14:56:53.243767 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:53.243478    2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="31fd180e-595d-483c-9933-c7329c8481af" containerName="kube-rbac-proxy"
May 28 14:56:53.243767 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:53.243487    2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="31fd180e-595d-483c-9933-c7329c8481af" containerName="kube-rbac-proxy-metric"
May 28 14:56:53.247757 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:53.247740    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 28 14:56:53.250171 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:53.250153    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
May 28 14:56:53.250261 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:53.250210    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
May 28 14:56:53.250392 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:53.250364    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
May 28 14:56:53.250557 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:53.250538    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-fhhht\""
May 28 14:56:53.250650 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:53.250592    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
May 28 14:56:53.250809 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:53.250794    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
May 28 14:56:53.251015 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:53.251001    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
May 28 14:56:53.251384 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:53.251367    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
May 28 14:56:53.251463 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:53.251397    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
May 28 14:56:53.255414 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:53.255393    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
May 28 14:56:53.259627 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:53.259606    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 28 14:56:53.372352 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:53.372311    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/00557239-3c49-4666-9ffd-ecddc3405ac7-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"00557239-3c49-4666-9ffd-ecddc3405ac7\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 14:56:53.372519 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:53.372366    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/00557239-3c49-4666-9ffd-ecddc3405ac7-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"00557239-3c49-4666-9ffd-ecddc3405ac7\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 14:56:53.372519 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:53.372395    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/00557239-3c49-4666-9ffd-ecddc3405ac7-config-volume\") pod \"alertmanager-main-0\" (UID: \"00557239-3c49-4666-9ffd-ecddc3405ac7\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 14:56:53.372519 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:53.372412    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/00557239-3c49-4666-9ffd-ecddc3405ac7-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"00557239-3c49-4666-9ffd-ecddc3405ac7\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 14:56:53.372519 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:53.372455    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/00557239-3c49-4666-9ffd-ecddc3405ac7-web-config\") pod \"alertmanager-main-0\" (UID: \"00557239-3c49-4666-9ffd-ecddc3405ac7\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 14:56:53.372519 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:53.372476    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/00557239-3c49-4666-9ffd-ecddc3405ac7-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"00557239-3c49-4666-9ffd-ecddc3405ac7\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 14:56:53.372519 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:53.372517    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/00557239-3c49-4666-9ffd-ecddc3405ac7-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"00557239-3c49-4666-9ffd-ecddc3405ac7\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 14:56:53.372758 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:53.372537    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/00557239-3c49-4666-9ffd-ecddc3405ac7-config-out\") pod \"alertmanager-main-0\" (UID: \"00557239-3c49-4666-9ffd-ecddc3405ac7\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 14:56:53.372758 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:53.372556    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/00557239-3c49-4666-9ffd-ecddc3405ac7-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"00557239-3c49-4666-9ffd-ecddc3405ac7\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 14:56:53.372758 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:53.372575    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/00557239-3c49-4666-9ffd-ecddc3405ac7-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"00557239-3c49-4666-9ffd-ecddc3405ac7\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 14:56:53.372758 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:53.372590    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/00557239-3c49-4666-9ffd-ecddc3405ac7-tls-assets\") pod \"alertmanager-main-0\" (UID: \"00557239-3c49-4666-9ffd-ecddc3405ac7\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 14:56:53.372758 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:53.372605    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/00557239-3c49-4666-9ffd-ecddc3405ac7-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"00557239-3c49-4666-9ffd-ecddc3405ac7\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 14:56:53.372758 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:53.372622    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5qsbv\" (UniqueName: \"kubernetes.io/projected/00557239-3c49-4666-9ffd-ecddc3405ac7-kube-api-access-5qsbv\") pod \"alertmanager-main-0\" (UID: \"00557239-3c49-4666-9ffd-ecddc3405ac7\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 14:56:53.473867 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:53.473766    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/00557239-3c49-4666-9ffd-ecddc3405ac7-web-config\") pod \"alertmanager-main-0\" (UID: \"00557239-3c49-4666-9ffd-ecddc3405ac7\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 14:56:53.473867 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:53.473816    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/00557239-3c49-4666-9ffd-ecddc3405ac7-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"00557239-3c49-4666-9ffd-ecddc3405ac7\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 14:56:53.473867 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:53.473857    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/00557239-3c49-4666-9ffd-ecddc3405ac7-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"00557239-3c49-4666-9ffd-ecddc3405ac7\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 14:56:53.474144 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:53.473885    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/00557239-3c49-4666-9ffd-ecddc3405ac7-config-out\") pod \"alertmanager-main-0\" (UID: \"00557239-3c49-4666-9ffd-ecddc3405ac7\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 14:56:53.474144 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:53.473914    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/00557239-3c49-4666-9ffd-ecddc3405ac7-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"00557239-3c49-4666-9ffd-ecddc3405ac7\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 14:56:53.474144 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:53.473936    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/00557239-3c49-4666-9ffd-ecddc3405ac7-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"00557239-3c49-4666-9ffd-ecddc3405ac7\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 14:56:53.474144 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:53.473960    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/00557239-3c49-4666-9ffd-ecddc3405ac7-tls-assets\") pod \"alertmanager-main-0\" (UID: \"00557239-3c49-4666-9ffd-ecddc3405ac7\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 14:56:53.474144 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:53.474000    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/00557239-3c49-4666-9ffd-ecddc3405ac7-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"00557239-3c49-4666-9ffd-ecddc3405ac7\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 14:56:53.474434 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:53.474028    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5qsbv\" (UniqueName: \"kubernetes.io/projected/00557239-3c49-4666-9ffd-ecddc3405ac7-kube-api-access-5qsbv\") pod \"alertmanager-main-0\" (UID: \"00557239-3c49-4666-9ffd-ecddc3405ac7\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 14:56:53.474592 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:53.474573    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/00557239-3c49-4666-9ffd-ecddc3405ac7-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"00557239-3c49-4666-9ffd-ecddc3405ac7\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 14:56:53.474756 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:53.474737    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/00557239-3c49-4666-9ffd-ecddc3405ac7-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"00557239-3c49-4666-9ffd-ecddc3405ac7\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 14:56:53.474915 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:53.474898    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/00557239-3c49-4666-9ffd-ecddc3405ac7-config-volume\") pod \"alertmanager-main-0\" (UID: \"00557239-3c49-4666-9ffd-ecddc3405ac7\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 14:56:53.475024 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:53.475009    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/00557239-3c49-4666-9ffd-ecddc3405ac7-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"00557239-3c49-4666-9ffd-ecddc3405ac7\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 14:56:53.476027 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:53.476002    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/00557239-3c49-4666-9ffd-ecddc3405ac7-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"00557239-3c49-4666-9ffd-ecddc3405ac7\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 14:56:53.476395 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:53.476379    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/00557239-3c49-4666-9ffd-ecddc3405ac7-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"00557239-3c49-4666-9ffd-ecddc3405ac7\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 14:56:53.476854 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:53.476824    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/00557239-3c49-4666-9ffd-ecddc3405ac7-config-out\") pod \"alertmanager-main-0\" (UID: \"00557239-3c49-4666-9ffd-ecddc3405ac7\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 14:56:53.476960 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:53.476861    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/00557239-3c49-4666-9ffd-ecddc3405ac7-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"00557239-3c49-4666-9ffd-ecddc3405ac7\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 14:56:53.476960 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:53.476862    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/00557239-3c49-4666-9ffd-ecddc3405ac7-web-config\") pod \"alertmanager-main-0\" (UID: \"00557239-3c49-4666-9ffd-ecddc3405ac7\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 14:56:53.477074 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:53.477012    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/00557239-3c49-4666-9ffd-ecddc3405ac7-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"00557239-3c49-4666-9ffd-ecddc3405ac7\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 14:56:53.477127 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:53.477087    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/00557239-3c49-4666-9ffd-ecddc3405ac7-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"00557239-3c49-4666-9ffd-ecddc3405ac7\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 14:56:53.477163 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:53.477138    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/00557239-3c49-4666-9ffd-ecddc3405ac7-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"00557239-3c49-4666-9ffd-ecddc3405ac7\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 14:56:53.477342 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:53.477321    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/00557239-3c49-4666-9ffd-ecddc3405ac7-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"00557239-3c49-4666-9ffd-ecddc3405ac7\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 14:56:53.477429 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:53.477409    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/00557239-3c49-4666-9ffd-ecddc3405ac7-tls-assets\") pod \"alertmanager-main-0\" (UID: \"00557239-3c49-4666-9ffd-ecddc3405ac7\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 14:56:53.478756 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:53.478737    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/00557239-3c49-4666-9ffd-ecddc3405ac7-config-volume\") pod \"alertmanager-main-0\" (UID: \"00557239-3c49-4666-9ffd-ecddc3405ac7\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 14:56:53.478899 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:53.478882    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/00557239-3c49-4666-9ffd-ecddc3405ac7-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"00557239-3c49-4666-9ffd-ecddc3405ac7\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 14:56:53.484052 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:53.484030    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5qsbv\" (UniqueName: \"kubernetes.io/projected/00557239-3c49-4666-9ffd-ecddc3405ac7-kube-api-access-5qsbv\") pod \"alertmanager-main-0\" (UID: \"00557239-3c49-4666-9ffd-ecddc3405ac7\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 14:56:53.557944 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:53.557906    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 28 14:56:53.694941 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:53.694903    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 28 14:56:53.698981 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:56:53.698950    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00557239_3c49_4666_9ffd_ecddc3405ac7.slice/crio-b941569a2381a7adccab033e0d75da870840383db17010bf47d1e9fa67f121c0 WatchSource:0}: Error finding container b941569a2381a7adccab033e0d75da870840383db17010bf47d1e9fa67f121c0: Status 404 returned error can't find the container with id b941569a2381a7adccab033e0d75da870840383db17010bf47d1e9fa67f121c0
May 28 14:56:54.189513 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:54.189477    2563 generic.go:358] "Generic (PLEG): container finished" podID="00557239-3c49-4666-9ffd-ecddc3405ac7" containerID="7e372ffb5fa50ed1764e84a9a084c96ad77a32b5690a8f42da5ac0cc133172f0" exitCode=0
May 28 14:56:54.189985 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:54.189567    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"00557239-3c49-4666-9ffd-ecddc3405ac7","Type":"ContainerDied","Data":"7e372ffb5fa50ed1764e84a9a084c96ad77a32b5690a8f42da5ac0cc133172f0"}
May 28 14:56:54.189985 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:54.189609    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"00557239-3c49-4666-9ffd-ecddc3405ac7","Type":"ContainerStarted","Data":"b941569a2381a7adccab033e0d75da870840383db17010bf47d1e9fa67f121c0"}
May 28 14:56:54.479509 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:54.479480    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="31fd180e-595d-483c-9933-c7329c8481af" path="/var/lib/kubelet/pods/31fd180e-595d-483c-9933-c7329c8481af/volumes"
May 28 14:56:55.196000 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:55.195966    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"00557239-3c49-4666-9ffd-ecddc3405ac7","Type":"ContainerStarted","Data":"04f3767242082e649d65f4e36030d0b99413f30898643821f5b019032ec7bc47"}
May 28 14:56:55.196000 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:55.196000    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"00557239-3c49-4666-9ffd-ecddc3405ac7","Type":"ContainerStarted","Data":"e669bce17f6ddd094bd0b96531d696a741596f10b5be4185205df32f22bee49d"}
May 28 14:56:55.196408 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:55.196013    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"00557239-3c49-4666-9ffd-ecddc3405ac7","Type":"ContainerStarted","Data":"ad79afaf21ac1261d312694c8a4e7fb0164a3732e79884a16a31dd75c328b0ec"}
May 28 14:56:55.196408 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:55.196022    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"00557239-3c49-4666-9ffd-ecddc3405ac7","Type":"ContainerStarted","Data":"440201db74534bc763eceb38e659ef65d0cbf868c6d073e919a25ec3d7a10e4c"}
May 28 14:56:55.196408 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:55.196029    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"00557239-3c49-4666-9ffd-ecddc3405ac7","Type":"ContainerStarted","Data":"6994ab8cdbc44661d76cc3df8884fa64c6c5b482a65a5d1dfc719a85e33e7849"}
May 28 14:56:55.196408 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:55.196037    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"00557239-3c49-4666-9ffd-ecddc3405ac7","Type":"ContainerStarted","Data":"dd8eb4d7c76adafbdd59dc4e17e424ae9c0e8233c1aa5122c6531d3a9d63741d"}
May 28 14:56:55.220451 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:55.220404    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.220391122 podStartE2EDuration="2.220391122s" podCreationTimestamp="2026-05-28 14:56:53 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 14:56:55.218945137 +0000 UTC m=+235.308161860" watchObservedRunningTime="2026-05-28 14:56:55.220391122 +0000 UTC m=+235.309607844"
May 28 14:56:55.634426 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:55.634377    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-7c76cf6fdb-stfkf"]
May 28 14:56:55.637386 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:55.637364    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7c76cf6fdb-stfkf"
May 28 14:56:55.641418 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:55.639943    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
May 28 14:56:55.641418 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:55.640198    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
May 28 14:56:55.641418 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:55.640941    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
May 28 14:56:55.641418 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:55.641164    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-sw97j\""
May 28 14:56:55.641418 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:55.641268    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
May 28 14:56:55.641721 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:55.641468    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
May 28 14:56:55.645936 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:55.645913    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
May 28 14:56:55.654646 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:55.654613    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7c76cf6fdb-stfkf"]
May 28 14:56:55.693208 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:55.693171    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/84e22d9e-8392-479a-8c67-1b02ef240f90-serving-certs-ca-bundle\") pod \"telemeter-client-7c76cf6fdb-stfkf\" (UID: \"84e22d9e-8392-479a-8c67-1b02ef240f90\") " pod="openshift-monitoring/telemeter-client-7c76cf6fdb-stfkf"
May 28 14:56:55.693208 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:55.693216    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/84e22d9e-8392-479a-8c67-1b02ef240f90-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7c76cf6fdb-stfkf\" (UID: \"84e22d9e-8392-479a-8c67-1b02ef240f90\") " pod="openshift-monitoring/telemeter-client-7c76cf6fdb-stfkf"
May 28 14:56:55.693441 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:55.693299    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2l8hd\" (UniqueName: \"kubernetes.io/projected/84e22d9e-8392-479a-8c67-1b02ef240f90-kube-api-access-2l8hd\") pod \"telemeter-client-7c76cf6fdb-stfkf\" (UID: \"84e22d9e-8392-479a-8c67-1b02ef240f90\") " pod="openshift-monitoring/telemeter-client-7c76cf6fdb-stfkf"
May 28 14:56:55.693441 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:55.693365    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/84e22d9e-8392-479a-8c67-1b02ef240f90-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7c76cf6fdb-stfkf\" (UID: \"84e22d9e-8392-479a-8c67-1b02ef240f90\") " pod="openshift-monitoring/telemeter-client-7c76cf6fdb-stfkf"
May 28 14:56:55.693441 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:55.693401    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/84e22d9e-8392-479a-8c67-1b02ef240f90-secret-telemeter-client\") pod \"telemeter-client-7c76cf6fdb-stfkf\" (UID: \"84e22d9e-8392-479a-8c67-1b02ef240f90\") " pod="openshift-monitoring/telemeter-client-7c76cf6fdb-stfkf"
May 28 14:56:55.693441 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:55.693427    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/84e22d9e-8392-479a-8c67-1b02ef240f90-federate-client-tls\") pod \"telemeter-client-7c76cf6fdb-stfkf\" (UID: \"84e22d9e-8392-479a-8c67-1b02ef240f90\") " pod="openshift-monitoring/telemeter-client-7c76cf6fdb-stfkf"
May 28 14:56:55.693653 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:55.693497    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/84e22d9e-8392-479a-8c67-1b02ef240f90-metrics-client-ca\") pod \"telemeter-client-7c76cf6fdb-stfkf\" (UID: \"84e22d9e-8392-479a-8c67-1b02ef240f90\") " pod="openshift-monitoring/telemeter-client-7c76cf6fdb-stfkf"
May 28 14:56:55.693653 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:55.693527    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/84e22d9e-8392-479a-8c67-1b02ef240f90-telemeter-client-tls\") pod \"telemeter-client-7c76cf6fdb-stfkf\" (UID: \"84e22d9e-8392-479a-8c67-1b02ef240f90\") " pod="openshift-monitoring/telemeter-client-7c76cf6fdb-stfkf"
May 28 14:56:55.794670 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:55.794619    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/84e22d9e-8392-479a-8c67-1b02ef240f90-serving-certs-ca-bundle\") pod \"telemeter-client-7c76cf6fdb-stfkf\" (UID: \"84e22d9e-8392-479a-8c67-1b02ef240f90\") " pod="openshift-monitoring/telemeter-client-7c76cf6fdb-stfkf"
May 28 14:56:55.794670 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:55.794665    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/84e22d9e-8392-479a-8c67-1b02ef240f90-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7c76cf6fdb-stfkf\" (UID: \"84e22d9e-8392-479a-8c67-1b02ef240f90\") " pod="openshift-monitoring/telemeter-client-7c76cf6fdb-stfkf"
May 28 14:56:55.794949 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:55.794752    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2l8hd\" (UniqueName: \"kubernetes.io/projected/84e22d9e-8392-479a-8c67-1b02ef240f90-kube-api-access-2l8hd\") pod \"telemeter-client-7c76cf6fdb-stfkf\" (UID: \"84e22d9e-8392-479a-8c67-1b02ef240f90\") " pod="openshift-monitoring/telemeter-client-7c76cf6fdb-stfkf"
May 28 14:56:55.794949 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:55.794828    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/84e22d9e-8392-479a-8c67-1b02ef240f90-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7c76cf6fdb-stfkf\" (UID: \"84e22d9e-8392-479a-8c67-1b02ef240f90\") " pod="openshift-monitoring/telemeter-client-7c76cf6fdb-stfkf"
May 28 14:56:55.794949 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:55.794866    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/84e22d9e-8392-479a-8c67-1b02ef240f90-secret-telemeter-client\") pod \"telemeter-client-7c76cf6fdb-stfkf\" (UID: \"84e22d9e-8392-479a-8c67-1b02ef240f90\") " pod="openshift-monitoring/telemeter-client-7c76cf6fdb-stfkf"
May 28 14:56:55.794949 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:55.794906    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/84e22d9e-8392-479a-8c67-1b02ef240f90-federate-client-tls\") pod \"telemeter-client-7c76cf6fdb-stfkf\" (UID: \"84e22d9e-8392-479a-8c67-1b02ef240f90\") " pod="openshift-monitoring/telemeter-client-7c76cf6fdb-stfkf"
May 28 14:56:55.794949 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:55.794941    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/84e22d9e-8392-479a-8c67-1b02ef240f90-metrics-client-ca\") pod \"telemeter-client-7c76cf6fdb-stfkf\" (UID: \"84e22d9e-8392-479a-8c67-1b02ef240f90\") " pod="openshift-monitoring/telemeter-client-7c76cf6fdb-stfkf"
May 28 14:56:55.795213 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:55.794966    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/84e22d9e-8392-479a-8c67-1b02ef240f90-telemeter-client-tls\") pod \"telemeter-client-7c76cf6fdb-stfkf\" (UID: \"84e22d9e-8392-479a-8c67-1b02ef240f90\") " pod="openshift-monitoring/telemeter-client-7c76cf6fdb-stfkf"
May 28 14:56:55.795619 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:55.795590    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/84e22d9e-8392-479a-8c67-1b02ef240f90-serving-certs-ca-bundle\") pod \"telemeter-client-7c76cf6fdb-stfkf\" (UID: \"84e22d9e-8392-479a-8c67-1b02ef240f90\") " pod="openshift-monitoring/telemeter-client-7c76cf6fdb-stfkf"
May 28 14:56:55.795781 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:55.795758    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/84e22d9e-8392-479a-8c67-1b02ef240f90-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7c76cf6fdb-stfkf\" (UID: \"84e22d9e-8392-479a-8c67-1b02ef240f90\") " pod="openshift-monitoring/telemeter-client-7c76cf6fdb-stfkf"
May 28 14:56:55.795900 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:55.795869    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/84e22d9e-8392-479a-8c67-1b02ef240f90-metrics-client-ca\") pod \"telemeter-client-7c76cf6fdb-stfkf\" (UID: \"84e22d9e-8392-479a-8c67-1b02ef240f90\") " pod="openshift-monitoring/telemeter-client-7c76cf6fdb-stfkf"
May 28 14:56:55.797855 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:55.797810    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/84e22d9e-8392-479a-8c67-1b02ef240f90-telemeter-client-tls\") pod \"telemeter-client-7c76cf6fdb-stfkf\" (UID: \"84e22d9e-8392-479a-8c67-1b02ef240f90\") " pod="openshift-monitoring/telemeter-client-7c76cf6fdb-stfkf"
May 28 14:56:55.797855 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:55.797832    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/84e22d9e-8392-479a-8c67-1b02ef240f90-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7c76cf6fdb-stfkf\" (UID: \"84e22d9e-8392-479a-8c67-1b02ef240f90\") " pod="openshift-monitoring/telemeter-client-7c76cf6fdb-stfkf"
May 28 14:56:55.798314 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:55.798290    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/84e22d9e-8392-479a-8c67-1b02ef240f90-federate-client-tls\") pod \"telemeter-client-7c76cf6fdb-stfkf\" (UID: \"84e22d9e-8392-479a-8c67-1b02ef240f90\") " pod="openshift-monitoring/telemeter-client-7c76cf6fdb-stfkf"
May 28 14:56:55.800115 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:55.800087    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/84e22d9e-8392-479a-8c67-1b02ef240f90-secret-telemeter-client\") pod \"telemeter-client-7c76cf6fdb-stfkf\" (UID: \"84e22d9e-8392-479a-8c67-1b02ef240f90\") " pod="openshift-monitoring/telemeter-client-7c76cf6fdb-stfkf"
May 28 14:56:55.802335 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:55.802314    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2l8hd\" (UniqueName: \"kubernetes.io/projected/84e22d9e-8392-479a-8c67-1b02ef240f90-kube-api-access-2l8hd\") pod \"telemeter-client-7c76cf6fdb-stfkf\" (UID: \"84e22d9e-8392-479a-8c67-1b02ef240f90\") " pod="openshift-monitoring/telemeter-client-7c76cf6fdb-stfkf"
May 28 14:56:55.949974 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:55.949895    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7c76cf6fdb-stfkf"
May 28 14:56:56.103197 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:56.102466    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7c76cf6fdb-stfkf"]
May 28 14:56:56.106043 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:56:56.106017    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84e22d9e_8392_479a_8c67_1b02ef240f90.slice/crio-cbbda189a7df8c5d611711d598f94f555091eca5b45496b7b1b4919b10dd6290 WatchSource:0}: Error finding container cbbda189a7df8c5d611711d598f94f555091eca5b45496b7b1b4919b10dd6290: Status 404 returned error can't find the container with id cbbda189a7df8c5d611711d598f94f555091eca5b45496b7b1b4919b10dd6290
May 28 14:56:56.200618 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:56.200540    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7c76cf6fdb-stfkf" event={"ID":"84e22d9e-8392-479a-8c67-1b02ef240f90","Type":"ContainerStarted","Data":"cbbda189a7df8c5d611711d598f94f555091eca5b45496b7b1b4919b10dd6290"}
May 28 14:56:58.208120 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:58.208026    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7c76cf6fdb-stfkf" event={"ID":"84e22d9e-8392-479a-8c67-1b02ef240f90","Type":"ContainerStarted","Data":"ccb8d8770e2fc7cac78f32e5e4899a4afe6250423f07fdc18334b5ca4f68ceb5"}
May 28 14:56:58.208120 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:58.208075    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7c76cf6fdb-stfkf" event={"ID":"84e22d9e-8392-479a-8c67-1b02ef240f90","Type":"ContainerStarted","Data":"45e20b43e3deb993d3c2fe09b1b333bfbef45dcc7663a60cb4112e0bfb2269ce"}
May 28 14:56:58.208120 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:58.208090    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7c76cf6fdb-stfkf" event={"ID":"84e22d9e-8392-479a-8c67-1b02ef240f90","Type":"ContainerStarted","Data":"1a7357bdcb4df2dd3d455445834804805ebd46018047c0d35efd9b067bc3ea73"}
May 28 14:56:58.230110 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:58.230059    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-7c76cf6fdb-stfkf" podStartSLOduration=1.521286878 podStartE2EDuration="3.230042854s" podCreationTimestamp="2026-05-28 14:56:55 +0000 UTC" firstStartedPulling="2026-05-28 14:56:56.1083806 +0000 UTC m=+236.197597302" lastFinishedPulling="2026-05-28 14:56:57.817136563 +0000 UTC m=+237.906353278" observedRunningTime="2026-05-28 14:56:58.229194407 +0000 UTC m=+238.318411131" watchObservedRunningTime="2026-05-28 14:56:58.230042854 +0000 UTC m=+238.319259576"
May 28 14:56:59.040776 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:59.040744    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-557b84cc57-2nhsl"]
May 28 14:56:59.043385 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:59.043360    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-557b84cc57-2nhsl"
May 28 14:56:59.045922 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:59.045902    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-gvt85\""
May 28 14:56:59.046970 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:59.046944    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
May 28 14:56:59.047103 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:59.046971    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
May 28 14:56:59.047103 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:59.046958    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
May 28 14:56:59.047103 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:59.047003    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
May 28 14:56:59.047103 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:59.046948    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
May 28 14:56:59.051893 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:59.051859    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
May 28 14:56:59.053288 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:59.053267    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-557b84cc57-2nhsl"]
May 28 14:56:59.124003 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:59.123964    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/41e4b13e-548c-4690-8562-590f60dadf1b-console-serving-cert\") pod \"console-557b84cc57-2nhsl\" (UID: \"41e4b13e-548c-4690-8562-590f60dadf1b\") " pod="openshift-console/console-557b84cc57-2nhsl"
May 28 14:56:59.124197 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:59.124032    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/41e4b13e-548c-4690-8562-590f60dadf1b-console-config\") pod \"console-557b84cc57-2nhsl\" (UID: \"41e4b13e-548c-4690-8562-590f60dadf1b\") " pod="openshift-console/console-557b84cc57-2nhsl"
May 28 14:56:59.124197 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:59.124086    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/41e4b13e-548c-4690-8562-590f60dadf1b-console-oauth-config\") pod \"console-557b84cc57-2nhsl\" (UID: \"41e4b13e-548c-4690-8562-590f60dadf1b\") " pod="openshift-console/console-557b84cc57-2nhsl"
May 28 14:56:59.124197 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:59.124108    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/41e4b13e-548c-4690-8562-590f60dadf1b-oauth-serving-cert\") pod \"console-557b84cc57-2nhsl\" (UID: \"41e4b13e-548c-4690-8562-590f60dadf1b\") " pod="openshift-console/console-557b84cc57-2nhsl"
May 28 14:56:59.124197 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:59.124148    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nwfhw\" (UniqueName: \"kubernetes.io/projected/41e4b13e-548c-4690-8562-590f60dadf1b-kube-api-access-nwfhw\") pod \"console-557b84cc57-2nhsl\" (UID: \"41e4b13e-548c-4690-8562-590f60dadf1b\") " pod="openshift-console/console-557b84cc57-2nhsl"
May 28 14:56:59.124197 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:59.124177    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/41e4b13e-548c-4690-8562-590f60dadf1b-service-ca\") pod \"console-557b84cc57-2nhsl\" (UID: \"41e4b13e-548c-4690-8562-590f60dadf1b\") " pod="openshift-console/console-557b84cc57-2nhsl"
May 28 14:56:59.124368 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:59.124231    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/41e4b13e-548c-4690-8562-590f60dadf1b-trusted-ca-bundle\") pod \"console-557b84cc57-2nhsl\" (UID: \"41e4b13e-548c-4690-8562-590f60dadf1b\") " pod="openshift-console/console-557b84cc57-2nhsl"
May 28 14:56:59.224853 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:59.224820    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/41e4b13e-548c-4690-8562-590f60dadf1b-trusted-ca-bundle\") pod \"console-557b84cc57-2nhsl\" (UID: \"41e4b13e-548c-4690-8562-590f60dadf1b\") " pod="openshift-console/console-557b84cc57-2nhsl"
May 28 14:56:59.225279 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:59.224864    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/41e4b13e-548c-4690-8562-590f60dadf1b-console-serving-cert\") pod \"console-557b84cc57-2nhsl\" (UID: \"41e4b13e-548c-4690-8562-590f60dadf1b\") " pod="openshift-console/console-557b84cc57-2nhsl"
May 28 14:56:59.225279 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:59.224896    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/41e4b13e-548c-4690-8562-590f60dadf1b-console-config\") pod \"console-557b84cc57-2nhsl\" (UID: \"41e4b13e-548c-4690-8562-590f60dadf1b\") " pod="openshift-console/console-557b84cc57-2nhsl"
May 28 14:56:59.225279 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:59.224921    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/41e4b13e-548c-4690-8562-590f60dadf1b-console-oauth-config\") pod \"console-557b84cc57-2nhsl\" (UID: \"41e4b13e-548c-4690-8562-590f60dadf1b\") " pod="openshift-console/console-557b84cc57-2nhsl"
May 28 14:56:59.225279 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:59.224936    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/41e4b13e-548c-4690-8562-590f60dadf1b-oauth-serving-cert\") pod \"console-557b84cc57-2nhsl\" (UID: \"41e4b13e-548c-4690-8562-590f60dadf1b\") " pod="openshift-console/console-557b84cc57-2nhsl"
May 28 14:56:59.225279 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:59.224965    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nwfhw\" (UniqueName: \"kubernetes.io/projected/41e4b13e-548c-4690-8562-590f60dadf1b-kube-api-access-nwfhw\") pod \"console-557b84cc57-2nhsl\" (UID: \"41e4b13e-548c-4690-8562-590f60dadf1b\") " pod="openshift-console/console-557b84cc57-2nhsl"
May 28 14:56:59.225279 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:59.224985    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/41e4b13e-548c-4690-8562-590f60dadf1b-service-ca\") pod \"console-557b84cc57-2nhsl\" (UID: \"41e4b13e-548c-4690-8562-590f60dadf1b\") " pod="openshift-console/console-557b84cc57-2nhsl"
May 28 14:56:59.225770 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:59.225740    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/41e4b13e-548c-4690-8562-590f60dadf1b-console-config\") pod \"console-557b84cc57-2nhsl\" (UID: \"41e4b13e-548c-4690-8562-590f60dadf1b\") " pod="openshift-console/console-557b84cc57-2nhsl"
May 28 14:56:59.225884 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:59.225823    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/41e4b13e-548c-4690-8562-590f60dadf1b-service-ca\") pod \"console-557b84cc57-2nhsl\" (UID: \"41e4b13e-548c-4690-8562-590f60dadf1b\") " pod="openshift-console/console-557b84cc57-2nhsl"
May 28 14:56:59.225884 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:59.225823    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/41e4b13e-548c-4690-8562-590f60dadf1b-oauth-serving-cert\") pod \"console-557b84cc57-2nhsl\" (UID: \"41e4b13e-548c-4690-8562-590f60dadf1b\") " pod="openshift-console/console-557b84cc57-2nhsl"
May 28 14:56:59.226096 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:59.226074    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/41e4b13e-548c-4690-8562-590f60dadf1b-trusted-ca-bundle\") pod \"console-557b84cc57-2nhsl\" (UID: \"41e4b13e-548c-4690-8562-590f60dadf1b\") " pod="openshift-console/console-557b84cc57-2nhsl"
May 28 14:56:59.227442 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:59.227422    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/41e4b13e-548c-4690-8562-590f60dadf1b-console-serving-cert\") pod \"console-557b84cc57-2nhsl\" (UID: \"41e4b13e-548c-4690-8562-590f60dadf1b\") " pod="openshift-console/console-557b84cc57-2nhsl"
May 28 14:56:59.227529 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:59.227463    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/41e4b13e-548c-4690-8562-590f60dadf1b-console-oauth-config\") pod \"console-557b84cc57-2nhsl\" (UID: \"41e4b13e-548c-4690-8562-590f60dadf1b\") " pod="openshift-console/console-557b84cc57-2nhsl"
May 28 14:56:59.232764 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:59.232746    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nwfhw\" (UniqueName: \"kubernetes.io/projected/41e4b13e-548c-4690-8562-590f60dadf1b-kube-api-access-nwfhw\") pod \"console-557b84cc57-2nhsl\" (UID: \"41e4b13e-548c-4690-8562-590f60dadf1b\") " pod="openshift-console/console-557b84cc57-2nhsl"
May 28 14:56:59.355058 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:59.354973    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-557b84cc57-2nhsl"
May 28 14:56:59.480953 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:56:59.480919    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-557b84cc57-2nhsl"]
May 28 14:56:59.484031 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:56:59.484005    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41e4b13e_548c_4690_8562_590f60dadf1b.slice/crio-efaed30b1e21aee8568d713cb97f9688811dec9ed4adaa1d986b802579652145 WatchSource:0}: Error finding container efaed30b1e21aee8568d713cb97f9688811dec9ed4adaa1d986b802579652145: Status 404 returned error can't find the container with id efaed30b1e21aee8568d713cb97f9688811dec9ed4adaa1d986b802579652145
May 28 14:57:00.216498 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:57:00.216463    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-557b84cc57-2nhsl" event={"ID":"41e4b13e-548c-4690-8562-590f60dadf1b","Type":"ContainerStarted","Data":"5f2cee4021fe51566612f00851567c0d47bad7432e1fcaff1384951bfb9ef121"}
May 28 14:57:00.216498 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:57:00.216502    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-557b84cc57-2nhsl" event={"ID":"41e4b13e-548c-4690-8562-590f60dadf1b","Type":"ContainerStarted","Data":"efaed30b1e21aee8568d713cb97f9688811dec9ed4adaa1d986b802579652145"}
May 28 14:57:00.237330 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:57:00.237281    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-557b84cc57-2nhsl" podStartSLOduration=1.237264419 podStartE2EDuration="1.237264419s" podCreationTimestamp="2026-05-28 14:56:59 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 14:57:00.235531137 +0000 UTC m=+240.324747861" watchObservedRunningTime="2026-05-28 14:57:00.237264419 +0000 UTC m=+240.326481141"
May 28 14:57:09.355831 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:57:09.355726    2563 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-557b84cc57-2nhsl"
May 28 14:57:09.355831 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:57:09.355781    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-557b84cc57-2nhsl"
May 28 14:57:09.360489 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:57:09.360466    2563 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-557b84cc57-2nhsl"
May 28 14:57:10.251005 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:57:10.250969    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-557b84cc57-2nhsl"
May 28 14:58:00.358291 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:58:00.358257    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-86zbj_8d769c1c-5bf7-49c6-bf05-531b243e935e/console-operator/2.log"
May 28 14:58:00.358793 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:58:00.358348    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-86zbj_8d769c1c-5bf7-49c6-bf05-531b243e935e/console-operator/2.log"
May 28 14:58:00.361779 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:58:00.361752    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ssv8l_f3df342f-512f-410a-8b64-171bc7255a0e/ovn-acl-logging/0.log"
May 28 14:58:00.361912 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:58:00.361800    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ssv8l_f3df342f-512f-410a-8b64-171bc7255a0e/ovn-acl-logging/0.log"
May 28 14:58:00.367764 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:58:00.367746    2563 kubelet.go:1628] "Image garbage collection succeeded"
May 28 14:58:16.658111 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:58:16.658078    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-57c4dd7699-8dcxx"]
May 28 14:58:16.661438 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:58:16.661416    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57c4dd7699-8dcxx"
May 28 14:58:16.671434 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:58:16.671402    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-57c4dd7699-8dcxx"]
May 28 14:58:16.758021 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:58:16.757978    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/42078623-d34e-4b9a-a467-a861f2a68c21-console-serving-cert\") pod \"console-57c4dd7699-8dcxx\" (UID: \"42078623-d34e-4b9a-a467-a861f2a68c21\") " pod="openshift-console/console-57c4dd7699-8dcxx"
May 28 14:58:16.758021 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:58:16.758029    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/42078623-d34e-4b9a-a467-a861f2a68c21-trusted-ca-bundle\") pod \"console-57c4dd7699-8dcxx\" (UID: \"42078623-d34e-4b9a-a467-a861f2a68c21\") " pod="openshift-console/console-57c4dd7699-8dcxx"
May 28 14:58:16.758249 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:58:16.758124    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gzww6\" (UniqueName: \"kubernetes.io/projected/42078623-d34e-4b9a-a467-a861f2a68c21-kube-api-access-gzww6\") pod \"console-57c4dd7699-8dcxx\" (UID: \"42078623-d34e-4b9a-a467-a861f2a68c21\") " pod="openshift-console/console-57c4dd7699-8dcxx"
May 28 14:58:16.758249 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:58:16.758162    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/42078623-d34e-4b9a-a467-a861f2a68c21-console-oauth-config\") pod \"console-57c4dd7699-8dcxx\" (UID: \"42078623-d34e-4b9a-a467-a861f2a68c21\") " pod="openshift-console/console-57c4dd7699-8dcxx"
May 28 14:58:16.758249 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:58:16.758182    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/42078623-d34e-4b9a-a467-a861f2a68c21-service-ca\") pod \"console-57c4dd7699-8dcxx\" (UID: \"42078623-d34e-4b9a-a467-a861f2a68c21\") " pod="openshift-console/console-57c4dd7699-8dcxx"
May 28 14:58:16.758249 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:58:16.758222    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/42078623-d34e-4b9a-a467-a861f2a68c21-oauth-serving-cert\") pod \"console-57c4dd7699-8dcxx\" (UID: \"42078623-d34e-4b9a-a467-a861f2a68c21\") " pod="openshift-console/console-57c4dd7699-8dcxx"
May 28 14:58:16.758388 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:58:16.758299    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/42078623-d34e-4b9a-a467-a861f2a68c21-console-config\") pod \"console-57c4dd7699-8dcxx\" (UID: \"42078623-d34e-4b9a-a467-a861f2a68c21\") " pod="openshift-console/console-57c4dd7699-8dcxx"
May 28 14:58:16.859149 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:58:16.859111    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/42078623-d34e-4b9a-a467-a861f2a68c21-console-oauth-config\") pod \"console-57c4dd7699-8dcxx\" (UID: \"42078623-d34e-4b9a-a467-a861f2a68c21\") " pod="openshift-console/console-57c4dd7699-8dcxx"
May 28 14:58:16.859149 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:58:16.859149    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/42078623-d34e-4b9a-a467-a861f2a68c21-service-ca\") pod \"console-57c4dd7699-8dcxx\" (UID: \"42078623-d34e-4b9a-a467-a861f2a68c21\") " pod="openshift-console/console-57c4dd7699-8dcxx"
May 28 14:58:16.859392 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:58:16.859166    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/42078623-d34e-4b9a-a467-a861f2a68c21-oauth-serving-cert\") pod \"console-57c4dd7699-8dcxx\" (UID: \"42078623-d34e-4b9a-a467-a861f2a68c21\") " pod="openshift-console/console-57c4dd7699-8dcxx"
May 28 14:58:16.859392 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:58:16.859205    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/42078623-d34e-4b9a-a467-a861f2a68c21-console-config\") pod \"console-57c4dd7699-8dcxx\" (UID: \"42078623-d34e-4b9a-a467-a861f2a68c21\") " pod="openshift-console/console-57c4dd7699-8dcxx"
May 28 14:58:16.859392 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:58:16.859234    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/42078623-d34e-4b9a-a467-a861f2a68c21-console-serving-cert\") pod \"console-57c4dd7699-8dcxx\" (UID: \"42078623-d34e-4b9a-a467-a861f2a68c21\") " pod="openshift-console/console-57c4dd7699-8dcxx"
May 28 14:58:16.859392 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:58:16.859252    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/42078623-d34e-4b9a-a467-a861f2a68c21-trusted-ca-bundle\") pod \"console-57c4dd7699-8dcxx\" (UID: \"42078623-d34e-4b9a-a467-a861f2a68c21\") " pod="openshift-console/console-57c4dd7699-8dcxx"
May 28 14:58:16.859392 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:58:16.859315    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gzww6\" (UniqueName: \"kubernetes.io/projected/42078623-d34e-4b9a-a467-a861f2a68c21-kube-api-access-gzww6\") pod \"console-57c4dd7699-8dcxx\" (UID: \"42078623-d34e-4b9a-a467-a861f2a68c21\") " pod="openshift-console/console-57c4dd7699-8dcxx"
May 28 14:58:16.860001 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:58:16.859977    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/42078623-d34e-4b9a-a467-a861f2a68c21-service-ca\") pod \"console-57c4dd7699-8dcxx\" (UID: \"42078623-d34e-4b9a-a467-a861f2a68c21\") " pod="openshift-console/console-57c4dd7699-8dcxx"
May 28 14:58:16.860108 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:58:16.860025    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/42078623-d34e-4b9a-a467-a861f2a68c21-oauth-serving-cert\") pod \"console-57c4dd7699-8dcxx\" (UID: \"42078623-d34e-4b9a-a467-a861f2a68c21\") " pod="openshift-console/console-57c4dd7699-8dcxx"
May 28 14:58:16.860167 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:58:16.860145    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/42078623-d34e-4b9a-a467-a861f2a68c21-console-config\") pod \"console-57c4dd7699-8dcxx\" (UID: \"42078623-d34e-4b9a-a467-a861f2a68c21\") " pod="openshift-console/console-57c4dd7699-8dcxx"
May 28 14:58:16.860271 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:58:16.860253    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/42078623-d34e-4b9a-a467-a861f2a68c21-trusted-ca-bundle\") pod \"console-57c4dd7699-8dcxx\" (UID: \"42078623-d34e-4b9a-a467-a861f2a68c21\") " pod="openshift-console/console-57c4dd7699-8dcxx"
May 28 14:58:16.861653 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:58:16.861632    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/42078623-d34e-4b9a-a467-a861f2a68c21-console-oauth-config\") pod \"console-57c4dd7699-8dcxx\" (UID: \"42078623-d34e-4b9a-a467-a861f2a68c21\") " pod="openshift-console/console-57c4dd7699-8dcxx"
May 28 14:58:16.861818 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:58:16.861800    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/42078623-d34e-4b9a-a467-a861f2a68c21-console-serving-cert\") pod \"console-57c4dd7699-8dcxx\" (UID: \"42078623-d34e-4b9a-a467-a861f2a68c21\") " pod="openshift-console/console-57c4dd7699-8dcxx"
May 28 14:58:16.870869 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:58:16.870846    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gzww6\" (UniqueName: \"kubernetes.io/projected/42078623-d34e-4b9a-a467-a861f2a68c21-kube-api-access-gzww6\") pod \"console-57c4dd7699-8dcxx\" (UID: \"42078623-d34e-4b9a-a467-a861f2a68c21\") " pod="openshift-console/console-57c4dd7699-8dcxx"
May 28 14:58:16.972064 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:58:16.971978    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57c4dd7699-8dcxx"
May 28 14:58:17.102406 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:58:17.102377    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-57c4dd7699-8dcxx"]
May 28 14:58:17.104917 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:58:17.104893    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42078623_d34e_4b9a_a467_a861f2a68c21.slice/crio-fc75b1075f88bed6216eaaf081c9f33b48e1b05c94aa7b4eeb33ff1ad565fbc1 WatchSource:0}: Error finding container fc75b1075f88bed6216eaaf081c9f33b48e1b05c94aa7b4eeb33ff1ad565fbc1: Status 404 returned error can't find the container with id fc75b1075f88bed6216eaaf081c9f33b48e1b05c94aa7b4eeb33ff1ad565fbc1
May 28 14:58:17.106595 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:58:17.106575    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 28 14:58:17.430949 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:58:17.430907    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57c4dd7699-8dcxx" event={"ID":"42078623-d34e-4b9a-a467-a861f2a68c21","Type":"ContainerStarted","Data":"7fb34272b8c705379729cb95af3f408e9769151f5720f19b0df786bf76bc6665"}
May 28 14:58:17.430949 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:58:17.430951    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57c4dd7699-8dcxx" event={"ID":"42078623-d34e-4b9a-a467-a861f2a68c21","Type":"ContainerStarted","Data":"fc75b1075f88bed6216eaaf081c9f33b48e1b05c94aa7b4eeb33ff1ad565fbc1"}
May 28 14:58:17.449958 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:58:17.449911    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-57c4dd7699-8dcxx" podStartSLOduration=1.449896529 podStartE2EDuration="1.449896529s" podCreationTimestamp="2026-05-28 14:58:16 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 14:58:17.448112254 +0000 UTC m=+317.537328978" watchObservedRunningTime="2026-05-28 14:58:17.449896529 +0000 UTC m=+317.539113251"
May 28 14:58:26.972426 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:58:26.972384    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-57c4dd7699-8dcxx"
May 28 14:58:26.972426 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:58:26.972436    2563 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-57c4dd7699-8dcxx"
May 28 14:58:26.977318 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:58:26.977290    2563 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-57c4dd7699-8dcxx"
May 28 14:58:27.464095 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:58:27.464065    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-57c4dd7699-8dcxx"
May 28 14:58:27.506969 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:58:27.506932    2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-557b84cc57-2nhsl"]
May 28 14:58:52.529049 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:58:52.528938    2563 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-557b84cc57-2nhsl" podUID="41e4b13e-548c-4690-8562-590f60dadf1b" containerName="console" containerID="cri-o://5f2cee4021fe51566612f00851567c0d47bad7432e1fcaff1384951bfb9ef121" gracePeriod=15
May 28 14:58:52.768158 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:58:52.768136    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-557b84cc57-2nhsl_41e4b13e-548c-4690-8562-590f60dadf1b/console/0.log"
May 28 14:58:52.768263 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:58:52.768196    2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-557b84cc57-2nhsl"
May 28 14:58:52.841327 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:58:52.841239    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/41e4b13e-548c-4690-8562-590f60dadf1b-service-ca\") pod \"41e4b13e-548c-4690-8562-590f60dadf1b\" (UID: \"41e4b13e-548c-4690-8562-590f60dadf1b\") "
May 28 14:58:52.841327 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:58:52.841280    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nwfhw\" (UniqueName: \"kubernetes.io/projected/41e4b13e-548c-4690-8562-590f60dadf1b-kube-api-access-nwfhw\") pod \"41e4b13e-548c-4690-8562-590f60dadf1b\" (UID: \"41e4b13e-548c-4690-8562-590f60dadf1b\") "
May 28 14:58:52.841327 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:58:52.841304    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/41e4b13e-548c-4690-8562-590f60dadf1b-console-oauth-config\") pod \"41e4b13e-548c-4690-8562-590f60dadf1b\" (UID: \"41e4b13e-548c-4690-8562-590f60dadf1b\") "
May 28 14:58:52.841642 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:58:52.841377    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/41e4b13e-548c-4690-8562-590f60dadf1b-console-serving-cert\") pod \"41e4b13e-548c-4690-8562-590f60dadf1b\" (UID: \"41e4b13e-548c-4690-8562-590f60dadf1b\") "
May 28 14:58:52.841642 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:58:52.841419    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/41e4b13e-548c-4690-8562-590f60dadf1b-trusted-ca-bundle\") pod \"41e4b13e-548c-4690-8562-590f60dadf1b\" (UID: \"41e4b13e-548c-4690-8562-590f60dadf1b\") "
May 28 14:58:52.841642 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:58:52.841455    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/41e4b13e-548c-4690-8562-590f60dadf1b-console-config\") pod \"41e4b13e-548c-4690-8562-590f60dadf1b\" (UID: \"41e4b13e-548c-4690-8562-590f60dadf1b\") "
May 28 14:58:52.841642 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:58:52.841493    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/41e4b13e-548c-4690-8562-590f60dadf1b-oauth-serving-cert\") pod \"41e4b13e-548c-4690-8562-590f60dadf1b\" (UID: \"41e4b13e-548c-4690-8562-590f60dadf1b\") "
May 28 14:58:52.841886 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:58:52.841665    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/41e4b13e-548c-4690-8562-590f60dadf1b-service-ca" (OuterVolumeSpecName: "service-ca") pod "41e4b13e-548c-4690-8562-590f60dadf1b" (UID: "41e4b13e-548c-4690-8562-590f60dadf1b"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 14:58:52.841939 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:58:52.841891    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/41e4b13e-548c-4690-8562-590f60dadf1b-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "41e4b13e-548c-4690-8562-590f60dadf1b" (UID: "41e4b13e-548c-4690-8562-590f60dadf1b"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 14:58:52.841939 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:58:52.841898    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/41e4b13e-548c-4690-8562-590f60dadf1b-console-config" (OuterVolumeSpecName: "console-config") pod "41e4b13e-548c-4690-8562-590f60dadf1b" (UID: "41e4b13e-548c-4690-8562-590f60dadf1b"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 14:58:52.842017 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:58:52.841993    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/41e4b13e-548c-4690-8562-590f60dadf1b-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "41e4b13e-548c-4690-8562-590f60dadf1b" (UID: "41e4b13e-548c-4690-8562-590f60dadf1b"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 14:58:52.843577 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:58:52.843545    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/41e4b13e-548c-4690-8562-590f60dadf1b-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "41e4b13e-548c-4690-8562-590f60dadf1b" (UID: "41e4b13e-548c-4690-8562-590f60dadf1b"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 14:58:52.843577 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:58:52.843558    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/41e4b13e-548c-4690-8562-590f60dadf1b-kube-api-access-nwfhw" (OuterVolumeSpecName: "kube-api-access-nwfhw") pod "41e4b13e-548c-4690-8562-590f60dadf1b" (UID: "41e4b13e-548c-4690-8562-590f60dadf1b"). InnerVolumeSpecName "kube-api-access-nwfhw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 14:58:52.843736 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:58:52.843594    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/41e4b13e-548c-4690-8562-590f60dadf1b-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "41e4b13e-548c-4690-8562-590f60dadf1b" (UID: "41e4b13e-548c-4690-8562-590f60dadf1b"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 14:58:52.942220 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:58:52.942183    2563 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/41e4b13e-548c-4690-8562-590f60dadf1b-console-serving-cert\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
May 28 14:58:52.942220 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:58:52.942219    2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/41e4b13e-548c-4690-8562-590f60dadf1b-trusted-ca-bundle\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
May 28 14:58:52.942401 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:58:52.942235    2563 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/41e4b13e-548c-4690-8562-590f60dadf1b-console-config\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
May 28 14:58:52.942401 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:58:52.942249    2563 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/41e4b13e-548c-4690-8562-590f60dadf1b-oauth-serving-cert\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
May 28 14:58:52.942401 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:58:52.942257    2563 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/41e4b13e-548c-4690-8562-590f60dadf1b-service-ca\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
May 28 14:58:52.942401 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:58:52.942266    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nwfhw\" (UniqueName: \"kubernetes.io/projected/41e4b13e-548c-4690-8562-590f60dadf1b-kube-api-access-nwfhw\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
May 28 14:58:52.942401 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:58:52.942274    2563 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/41e4b13e-548c-4690-8562-590f60dadf1b-console-oauth-config\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
May 28 14:58:53.538434 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:58:53.538404    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-557b84cc57-2nhsl_41e4b13e-548c-4690-8562-590f60dadf1b/console/0.log"
May 28 14:58:53.538821 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:58:53.538446    2563 generic.go:358] "Generic (PLEG): container finished" podID="41e4b13e-548c-4690-8562-590f60dadf1b" containerID="5f2cee4021fe51566612f00851567c0d47bad7432e1fcaff1384951bfb9ef121" exitCode=2
May 28 14:58:53.538821 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:58:53.538540    2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-557b84cc57-2nhsl"
May 28 14:58:53.538821 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:58:53.538537    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-557b84cc57-2nhsl" event={"ID":"41e4b13e-548c-4690-8562-590f60dadf1b","Type":"ContainerDied","Data":"5f2cee4021fe51566612f00851567c0d47bad7432e1fcaff1384951bfb9ef121"}
May 28 14:58:53.538821 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:58:53.538639    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-557b84cc57-2nhsl" event={"ID":"41e4b13e-548c-4690-8562-590f60dadf1b","Type":"ContainerDied","Data":"efaed30b1e21aee8568d713cb97f9688811dec9ed4adaa1d986b802579652145"}
May 28 14:58:53.538821 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:58:53.538654    2563 scope.go:117] "RemoveContainer" containerID="5f2cee4021fe51566612f00851567c0d47bad7432e1fcaff1384951bfb9ef121"
May 28 14:58:53.546665 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:58:53.546647    2563 scope.go:117] "RemoveContainer" containerID="5f2cee4021fe51566612f00851567c0d47bad7432e1fcaff1384951bfb9ef121"
May 28 14:58:53.546963 ip-10-0-137-84 kubenswrapper[2563]: E0528 14:58:53.546939    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5f2cee4021fe51566612f00851567c0d47bad7432e1fcaff1384951bfb9ef121\": container with ID starting with 5f2cee4021fe51566612f00851567c0d47bad7432e1fcaff1384951bfb9ef121 not found: ID does not exist" containerID="5f2cee4021fe51566612f00851567c0d47bad7432e1fcaff1384951bfb9ef121"
May 28 14:58:53.547040 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:58:53.546973    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f2cee4021fe51566612f00851567c0d47bad7432e1fcaff1384951bfb9ef121"} err="failed to get container status \"5f2cee4021fe51566612f00851567c0d47bad7432e1fcaff1384951bfb9ef121\": rpc error: code = NotFound desc = could not find container \"5f2cee4021fe51566612f00851567c0d47bad7432e1fcaff1384951bfb9ef121\": container with ID starting with 5f2cee4021fe51566612f00851567c0d47bad7432e1fcaff1384951bfb9ef121 not found: ID does not exist"
May 28 14:58:53.559221 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:58:53.559199    2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-557b84cc57-2nhsl"]
May 28 14:58:53.564270 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:58:53.564251    2563 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-557b84cc57-2nhsl"]
May 28 14:58:54.479135 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:58:54.479102    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="41e4b13e-548c-4690-8562-590f60dadf1b" path="/var/lib/kubelet/pods/41e4b13e-548c-4690-8562-590f60dadf1b/volumes"
May 28 14:59:18.253328 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:59:18.253293    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dmhkgt"]
May 28 14:59:18.253732 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:59:18.253597    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="41e4b13e-548c-4690-8562-590f60dadf1b" containerName="console"
May 28 14:59:18.253732 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:59:18.253609    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="41e4b13e-548c-4690-8562-590f60dadf1b" containerName="console"
May 28 14:59:18.253732 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:59:18.253670    2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="41e4b13e-548c-4690-8562-590f60dadf1b" containerName="console"
May 28 14:59:18.256822 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:59:18.256805    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dmhkgt"
May 28 14:59:18.259543 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:59:18.259522    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
May 28 14:59:18.259662 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:59:18.259524    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
May 28 14:59:18.259662 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:59:18.259528    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-6gg56\""
May 28 14:59:18.265649 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:59:18.265626    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dmhkgt"]
May 28 14:59:18.360427 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:59:18.360398    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dda8d565-8cee-4b2f-9f74-e4b1a37025e9-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dmhkgt\" (UID: \"dda8d565-8cee-4b2f-9f74-e4b1a37025e9\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dmhkgt"
May 28 14:59:18.360427 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:59:18.360432    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4sz97\" (UniqueName: \"kubernetes.io/projected/dda8d565-8cee-4b2f-9f74-e4b1a37025e9-kube-api-access-4sz97\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dmhkgt\" (UID: \"dda8d565-8cee-4b2f-9f74-e4b1a37025e9\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dmhkgt"
May 28 14:59:18.360632 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:59:18.360470    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dda8d565-8cee-4b2f-9f74-e4b1a37025e9-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dmhkgt\" (UID: \"dda8d565-8cee-4b2f-9f74-e4b1a37025e9\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dmhkgt"
May 28 14:59:18.461940 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:59:18.461905    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dda8d565-8cee-4b2f-9f74-e4b1a37025e9-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dmhkgt\" (UID: \"dda8d565-8cee-4b2f-9f74-e4b1a37025e9\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dmhkgt"
May 28 14:59:18.462062 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:59:18.461992    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dda8d565-8cee-4b2f-9f74-e4b1a37025e9-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dmhkgt\" (UID: \"dda8d565-8cee-4b2f-9f74-e4b1a37025e9\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dmhkgt"
May 28 14:59:18.462062 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:59:18.462018    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4sz97\" (UniqueName: \"kubernetes.io/projected/dda8d565-8cee-4b2f-9f74-e4b1a37025e9-kube-api-access-4sz97\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dmhkgt\" (UID: \"dda8d565-8cee-4b2f-9f74-e4b1a37025e9\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dmhkgt"
May 28 14:59:18.462345 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:59:18.462320    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dda8d565-8cee-4b2f-9f74-e4b1a37025e9-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dmhkgt\" (UID: \"dda8d565-8cee-4b2f-9f74-e4b1a37025e9\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dmhkgt"
May 28 14:59:18.462345 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:59:18.462334    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dda8d565-8cee-4b2f-9f74-e4b1a37025e9-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dmhkgt\" (UID: \"dda8d565-8cee-4b2f-9f74-e4b1a37025e9\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dmhkgt"
May 28 14:59:18.471252 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:59:18.471219    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4sz97\" (UniqueName: \"kubernetes.io/projected/dda8d565-8cee-4b2f-9f74-e4b1a37025e9-kube-api-access-4sz97\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dmhkgt\" (UID: \"dda8d565-8cee-4b2f-9f74-e4b1a37025e9\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dmhkgt"
May 28 14:59:18.566386 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:59:18.566310    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dmhkgt"
May 28 14:59:18.694992 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:59:18.694918    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dmhkgt"]
May 28 14:59:18.697750 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:59:18.697720    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddda8d565_8cee_4b2f_9f74_e4b1a37025e9.slice/crio-c92a0dec36e78a9ecce69f841225374c1a61596b80e61e12b7182f412b28948c WatchSource:0}: Error finding container c92a0dec36e78a9ecce69f841225374c1a61596b80e61e12b7182f412b28948c: Status 404 returned error can't find the container with id c92a0dec36e78a9ecce69f841225374c1a61596b80e61e12b7182f412b28948c
May 28 14:59:19.613635 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:59:19.613588    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dmhkgt" event={"ID":"dda8d565-8cee-4b2f-9f74-e4b1a37025e9","Type":"ContainerStarted","Data":"c92a0dec36e78a9ecce69f841225374c1a61596b80e61e12b7182f412b28948c"}
May 28 14:59:26.634175 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:59:26.634137    2563 generic.go:358] "Generic (PLEG): container finished" podID="dda8d565-8cee-4b2f-9f74-e4b1a37025e9" containerID="2538d8ee0d158a47c2dc0a6911c6f3009108d8a405e4689bc092f67f43cbd80c" exitCode=0
May 28 14:59:26.634573 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:59:26.634230    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dmhkgt" event={"ID":"dda8d565-8cee-4b2f-9f74-e4b1a37025e9","Type":"ContainerDied","Data":"2538d8ee0d158a47c2dc0a6911c6f3009108d8a405e4689bc092f67f43cbd80c"}
May 28 14:59:28.641877 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:59:28.641850    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dmhkgt" event={"ID":"dda8d565-8cee-4b2f-9f74-e4b1a37025e9","Type":"ContainerStarted","Data":"5df83218a0013c1c3996089921cde2c1dabafea962c6ca72d59e7e1b11fbbc31"}
May 28 14:59:29.646750 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:59:29.646714    2563 generic.go:358] "Generic (PLEG): container finished" podID="dda8d565-8cee-4b2f-9f74-e4b1a37025e9" containerID="5df83218a0013c1c3996089921cde2c1dabafea962c6ca72d59e7e1b11fbbc31" exitCode=0
May 28 14:59:29.647197 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:59:29.646782    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dmhkgt" event={"ID":"dda8d565-8cee-4b2f-9f74-e4b1a37025e9","Type":"ContainerDied","Data":"5df83218a0013c1c3996089921cde2c1dabafea962c6ca72d59e7e1b11fbbc31"}
May 28 14:59:35.667761 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:59:35.667726    2563 generic.go:358] "Generic (PLEG): container finished" podID="dda8d565-8cee-4b2f-9f74-e4b1a37025e9" containerID="a01d2d8e109a26ab7ff2c81774f3fd61df111238fea98364cc1f60b4072d6576" exitCode=0
May 28 14:59:35.668153 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:59:35.667817    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dmhkgt" event={"ID":"dda8d565-8cee-4b2f-9f74-e4b1a37025e9","Type":"ContainerDied","Data":"a01d2d8e109a26ab7ff2c81774f3fd61df111238fea98364cc1f60b4072d6576"}
May 28 14:59:36.792879 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:59:36.792856    2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dmhkgt"
May 28 14:59:36.914387 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:59:36.914345    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dda8d565-8cee-4b2f-9f74-e4b1a37025e9-util\") pod \"dda8d565-8cee-4b2f-9f74-e4b1a37025e9\" (UID: \"dda8d565-8cee-4b2f-9f74-e4b1a37025e9\") "
May 28 14:59:36.914387 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:59:36.914397    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4sz97\" (UniqueName: \"kubernetes.io/projected/dda8d565-8cee-4b2f-9f74-e4b1a37025e9-kube-api-access-4sz97\") pod \"dda8d565-8cee-4b2f-9f74-e4b1a37025e9\" (UID: \"dda8d565-8cee-4b2f-9f74-e4b1a37025e9\") "
May 28 14:59:36.914628 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:59:36.914460    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dda8d565-8cee-4b2f-9f74-e4b1a37025e9-bundle\") pod \"dda8d565-8cee-4b2f-9f74-e4b1a37025e9\" (UID: \"dda8d565-8cee-4b2f-9f74-e4b1a37025e9\") "
May 28 14:59:36.915203 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:59:36.915171    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dda8d565-8cee-4b2f-9f74-e4b1a37025e9-bundle" (OuterVolumeSpecName: "bundle") pod "dda8d565-8cee-4b2f-9f74-e4b1a37025e9" (UID: "dda8d565-8cee-4b2f-9f74-e4b1a37025e9"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 14:59:36.916595 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:59:36.916566    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dda8d565-8cee-4b2f-9f74-e4b1a37025e9-kube-api-access-4sz97" (OuterVolumeSpecName: "kube-api-access-4sz97") pod "dda8d565-8cee-4b2f-9f74-e4b1a37025e9" (UID: "dda8d565-8cee-4b2f-9f74-e4b1a37025e9"). InnerVolumeSpecName "kube-api-access-4sz97". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 14:59:36.918562 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:59:36.918536    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dda8d565-8cee-4b2f-9f74-e4b1a37025e9-util" (OuterVolumeSpecName: "util") pod "dda8d565-8cee-4b2f-9f74-e4b1a37025e9" (UID: "dda8d565-8cee-4b2f-9f74-e4b1a37025e9"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 14:59:37.015936 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:59:37.015912    2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dda8d565-8cee-4b2f-9f74-e4b1a37025e9-bundle\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
May 28 14:59:37.015936 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:59:37.015935    2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dda8d565-8cee-4b2f-9f74-e4b1a37025e9-util\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
May 28 14:59:37.016117 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:59:37.015945    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4sz97\" (UniqueName: \"kubernetes.io/projected/dda8d565-8cee-4b2f-9f74-e4b1a37025e9-kube-api-access-4sz97\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
May 28 14:59:37.675577 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:59:37.675541    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dmhkgt" event={"ID":"dda8d565-8cee-4b2f-9f74-e4b1a37025e9","Type":"ContainerDied","Data":"c92a0dec36e78a9ecce69f841225374c1a61596b80e61e12b7182f412b28948c"}
May 28 14:59:37.675577 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:59:37.675582    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c92a0dec36e78a9ecce69f841225374c1a61596b80e61e12b7182f412b28948c"
May 28 14:59:37.675806 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:59:37.675607    2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dmhkgt"
May 28 14:59:41.206906 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:59:41.206870    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-xltdw"]
May 28 14:59:41.207275 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:59:41.207164    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dda8d565-8cee-4b2f-9f74-e4b1a37025e9" containerName="util"
May 28 14:59:41.207275 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:59:41.207180    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="dda8d565-8cee-4b2f-9f74-e4b1a37025e9" containerName="util"
May 28 14:59:41.207275 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:59:41.207199    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dda8d565-8cee-4b2f-9f74-e4b1a37025e9" containerName="extract"
May 28 14:59:41.207275 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:59:41.207209    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="dda8d565-8cee-4b2f-9f74-e4b1a37025e9" containerName="extract"
May 28 14:59:41.207275 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:59:41.207223    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dda8d565-8cee-4b2f-9f74-e4b1a37025e9" containerName="pull"
May 28 14:59:41.207275 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:59:41.207227    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="dda8d565-8cee-4b2f-9f74-e4b1a37025e9" containerName="pull"
May 28 14:59:41.207462 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:59:41.207291    2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="dda8d565-8cee-4b2f-9f74-e4b1a37025e9" containerName="extract"
May 28 14:59:41.220797 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:59:41.220766    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-xltdw"]
May 28 14:59:41.220934 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:59:41.220873    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-xltdw"
May 28 14:59:41.223475 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:59:41.223442    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
May 28 14:59:41.223591 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:59:41.223482    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-ww2g2\""
May 28 14:59:41.223591 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:59:41.223535    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
May 28 14:59:41.352602 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:59:41.352563    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/914eddb0-b47d-4db7-a21c-77476141275b-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-xltdw\" (UID: \"914eddb0-b47d-4db7-a21c-77476141275b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-xltdw"
May 28 14:59:41.352791 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:59:41.352614    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l4vt6\" (UniqueName: \"kubernetes.io/projected/914eddb0-b47d-4db7-a21c-77476141275b-kube-api-access-l4vt6\") pod \"cert-manager-operator-controller-manager-54b9655956-xltdw\" (UID: \"914eddb0-b47d-4db7-a21c-77476141275b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-xltdw"
May 28 14:59:41.453942 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:59:41.453910    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/914eddb0-b47d-4db7-a21c-77476141275b-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-xltdw\" (UID: \"914eddb0-b47d-4db7-a21c-77476141275b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-xltdw"
May 28 14:59:41.454087 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:59:41.453957    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l4vt6\" (UniqueName: \"kubernetes.io/projected/914eddb0-b47d-4db7-a21c-77476141275b-kube-api-access-l4vt6\") pod \"cert-manager-operator-controller-manager-54b9655956-xltdw\" (UID: \"914eddb0-b47d-4db7-a21c-77476141275b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-xltdw"
May 28 14:59:41.454279 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:59:41.454260    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/914eddb0-b47d-4db7-a21c-77476141275b-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-xltdw\" (UID: \"914eddb0-b47d-4db7-a21c-77476141275b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-xltdw"
May 28 14:59:41.461857 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:59:41.461792    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l4vt6\" (UniqueName: \"kubernetes.io/projected/914eddb0-b47d-4db7-a21c-77476141275b-kube-api-access-l4vt6\") pod \"cert-manager-operator-controller-manager-54b9655956-xltdw\" (UID: \"914eddb0-b47d-4db7-a21c-77476141275b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-xltdw"
May 28 14:59:41.529881 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:59:41.529842    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-xltdw"
May 28 14:59:41.666793 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:59:41.662045    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-xltdw"]
May 28 14:59:41.688933 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:59:41.688903    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-xltdw" event={"ID":"914eddb0-b47d-4db7-a21c-77476141275b","Type":"ContainerStarted","Data":"a37b528ce16f80d94e2805d159c4f53135528e5765ac09d3da5deb5c23ed709b"}
May 28 14:59:44.700539 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:59:44.700499    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-xltdw" event={"ID":"914eddb0-b47d-4db7-a21c-77476141275b","Type":"ContainerStarted","Data":"abdb77cf5a75468589731fa8afc8d76c2fc1643111cf1f12985eee0f3f83d06f"}
May 28 14:59:44.720752 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:59:44.720672    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-xltdw" podStartSLOduration=1.486104424 podStartE2EDuration="3.720641069s" podCreationTimestamp="2026-05-28 14:59:41 +0000 UTC" firstStartedPulling="2026-05-28 14:59:41.669042213 +0000 UTC m=+401.758258922" lastFinishedPulling="2026-05-28 14:59:43.903578864 +0000 UTC m=+403.992795567" observedRunningTime="2026-05-28 14:59:44.718763372 +0000 UTC m=+404.807980096" watchObservedRunningTime="2026-05-28 14:59:44.720641069 +0000 UTC m=+404.809857792"
May 28 14:59:45.706872 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:59:45.706838    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6rvf9"]
May 28 14:59:45.709626 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:59:45.709608    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6rvf9"
May 28 14:59:45.712074 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:59:45.712048    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
May 28 14:59:45.712190 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:59:45.712048    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-6gg56\""
May 28 14:59:45.712965 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:59:45.712951    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
May 28 14:59:45.718787 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:59:45.718763    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6rvf9"]
May 28 14:59:45.796012 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:59:45.795974    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/71efe44c-d3d7-480f-8149-8c4e27e09211-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6rvf9\" (UID: \"71efe44c-d3d7-480f-8149-8c4e27e09211\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6rvf9"
May 28 14:59:45.796161 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:59:45.796067    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vfkpn\" (UniqueName: \"kubernetes.io/projected/71efe44c-d3d7-480f-8149-8c4e27e09211-kube-api-access-vfkpn\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6rvf9\" (UID: \"71efe44c-d3d7-480f-8149-8c4e27e09211\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6rvf9"
May 28 14:59:45.796161 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:59:45.796103    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/71efe44c-d3d7-480f-8149-8c4e27e09211-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6rvf9\" (UID: \"71efe44c-d3d7-480f-8149-8c4e27e09211\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6rvf9"
May 28 14:59:45.896583 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:59:45.896552    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/71efe44c-d3d7-480f-8149-8c4e27e09211-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6rvf9\" (UID: \"71efe44c-d3d7-480f-8149-8c4e27e09211\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6rvf9"
May 28 14:59:45.896759 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:59:45.896602    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vfkpn\" (UniqueName: \"kubernetes.io/projected/71efe44c-d3d7-480f-8149-8c4e27e09211-kube-api-access-vfkpn\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6rvf9\" (UID: \"71efe44c-d3d7-480f-8149-8c4e27e09211\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6rvf9"
May 28 14:59:45.896759 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:59:45.896633    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/71efe44c-d3d7-480f-8149-8c4e27e09211-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6rvf9\" (UID: \"71efe44c-d3d7-480f-8149-8c4e27e09211\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6rvf9"
May 28 14:59:45.896942 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:59:45.896921    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/71efe44c-d3d7-480f-8149-8c4e27e09211-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6rvf9\" (UID: \"71efe44c-d3d7-480f-8149-8c4e27e09211\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6rvf9"
May 28 14:59:45.896978 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:59:45.896954    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/71efe44c-d3d7-480f-8149-8c4e27e09211-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6rvf9\" (UID: \"71efe44c-d3d7-480f-8149-8c4e27e09211\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6rvf9"
May 28 14:59:45.904752 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:59:45.904724    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vfkpn\" (UniqueName: \"kubernetes.io/projected/71efe44c-d3d7-480f-8149-8c4e27e09211-kube-api-access-vfkpn\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6rvf9\" (UID: \"71efe44c-d3d7-480f-8149-8c4e27e09211\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6rvf9"
May 28 14:59:46.019550 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:59:46.019518    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6rvf9"
May 28 14:59:46.143596 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:59:46.143559    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6rvf9"]
May 28 14:59:46.146615 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:59:46.146589    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71efe44c_d3d7_480f_8149_8c4e27e09211.slice/crio-80a331c290b34b9cc208a2dedfeb5b044cd53ea9b26201684c7ffa82920b79ff WatchSource:0}: Error finding container 80a331c290b34b9cc208a2dedfeb5b044cd53ea9b26201684c7ffa82920b79ff: Status 404 returned error can't find the container with id 80a331c290b34b9cc208a2dedfeb5b044cd53ea9b26201684c7ffa82920b79ff
May 28 14:59:46.713168 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:59:46.713125    2563 generic.go:358] "Generic (PLEG): container finished" podID="71efe44c-d3d7-480f-8149-8c4e27e09211" containerID="42776c6caaf6c6ed301572ef3d50c02030b2be338f423c349b6fb673baac6683" exitCode=0
May 28 14:59:46.713570 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:59:46.713186    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6rvf9" event={"ID":"71efe44c-d3d7-480f-8149-8c4e27e09211","Type":"ContainerDied","Data":"42776c6caaf6c6ed301572ef3d50c02030b2be338f423c349b6fb673baac6683"}
May 28 14:59:46.713570 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:59:46.713212    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6rvf9" event={"ID":"71efe44c-d3d7-480f-8149-8c4e27e09211","Type":"ContainerStarted","Data":"80a331c290b34b9cc208a2dedfeb5b044cd53ea9b26201684c7ffa82920b79ff"}
May 28 14:59:47.116572 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:59:47.116537    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-xwp9l"]
May 28 14:59:47.118661 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:59:47.118646    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-587ccfb98-xwp9l"
May 28 14:59:47.121687 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:59:47.121643    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-rrtvg\""
May 28 14:59:47.121931 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:59:47.121913    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
May 28 14:59:47.121985 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:59:47.121916    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
May 28 14:59:47.130308 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:59:47.130283    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-xwp9l"]
May 28 14:59:47.206637 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:59:47.206602    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7dhsp\" (UniqueName: \"kubernetes.io/projected/b29aece8-f1e3-4212-8ed8-ec3d1cfca424-kube-api-access-7dhsp\") pod \"cert-manager-webhook-587ccfb98-xwp9l\" (UID: \"b29aece8-f1e3-4212-8ed8-ec3d1cfca424\") " pod="cert-manager/cert-manager-webhook-587ccfb98-xwp9l"
May 28 14:59:47.206799 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:59:47.206651    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b29aece8-f1e3-4212-8ed8-ec3d1cfca424-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-xwp9l\" (UID: \"b29aece8-f1e3-4212-8ed8-ec3d1cfca424\") " pod="cert-manager/cert-manager-webhook-587ccfb98-xwp9l"
May 28 14:59:47.307535 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:59:47.307487    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7dhsp\" (UniqueName: \"kubernetes.io/projected/b29aece8-f1e3-4212-8ed8-ec3d1cfca424-kube-api-access-7dhsp\") pod \"cert-manager-webhook-587ccfb98-xwp9l\" (UID: \"b29aece8-f1e3-4212-8ed8-ec3d1cfca424\") " pod="cert-manager/cert-manager-webhook-587ccfb98-xwp9l"
May 28 14:59:47.307755 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:59:47.307551    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b29aece8-f1e3-4212-8ed8-ec3d1cfca424-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-xwp9l\" (UID: \"b29aece8-f1e3-4212-8ed8-ec3d1cfca424\") " pod="cert-manager/cert-manager-webhook-587ccfb98-xwp9l"
May 28 14:59:47.316036 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:59:47.315995    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b29aece8-f1e3-4212-8ed8-ec3d1cfca424-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-xwp9l\" (UID: \"b29aece8-f1e3-4212-8ed8-ec3d1cfca424\") " pod="cert-manager/cert-manager-webhook-587ccfb98-xwp9l"
May 28 14:59:47.316125 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:59:47.316044    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7dhsp\" (UniqueName: \"kubernetes.io/projected/b29aece8-f1e3-4212-8ed8-ec3d1cfca424-kube-api-access-7dhsp\") pod \"cert-manager-webhook-587ccfb98-xwp9l\" (UID: \"b29aece8-f1e3-4212-8ed8-ec3d1cfca424\") " pod="cert-manager/cert-manager-webhook-587ccfb98-xwp9l"
May 28 14:59:47.428373 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:59:47.428295    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-587ccfb98-xwp9l"
May 28 14:59:47.551051 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:59:47.551023    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-xwp9l"]
May 28 14:59:47.552898 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:59:47.552869    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb29aece8_f1e3_4212_8ed8_ec3d1cfca424.slice/crio-507afc6efd4cf7c97242fe9557a41a499053166e78c072941d03735c11d11ec2 WatchSource:0}: Error finding container 507afc6efd4cf7c97242fe9557a41a499053166e78c072941d03735c11d11ec2: Status 404 returned error can't find the container with id 507afc6efd4cf7c97242fe9557a41a499053166e78c072941d03735c11d11ec2
May 28 14:59:47.718148 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:59:47.718067    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-587ccfb98-xwp9l" event={"ID":"b29aece8-f1e3-4212-8ed8-ec3d1cfca424","Type":"ContainerStarted","Data":"507afc6efd4cf7c97242fe9557a41a499053166e78c072941d03735c11d11ec2"}
May 28 14:59:49.728107 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:59:49.728076    2563 generic.go:358] "Generic (PLEG): container finished" podID="71efe44c-d3d7-480f-8149-8c4e27e09211" containerID="888671d57d3f8dd09269589120ca276386efa0bcb6fbd7efe221197278e5d8ec" exitCode=0
May 28 14:59:49.728465 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:59:49.728196    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6rvf9" event={"ID":"71efe44c-d3d7-480f-8149-8c4e27e09211","Type":"ContainerDied","Data":"888671d57d3f8dd09269589120ca276386efa0bcb6fbd7efe221197278e5d8ec"}
May 28 14:59:50.732762 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:59:50.732722    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-587ccfb98-xwp9l" event={"ID":"b29aece8-f1e3-4212-8ed8-ec3d1cfca424","Type":"ContainerStarted","Data":"aa25eb5a6098f1ffd2170ce4ed7416bc81587de76ec1a034321b87e612903a85"}
May 28 14:59:50.733141 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:59:50.732881    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-587ccfb98-xwp9l"
May 28 14:59:50.734476 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:59:50.734447    2563 generic.go:358] "Generic (PLEG): container finished" podID="71efe44c-d3d7-480f-8149-8c4e27e09211" containerID="738f3bf47ff3da17434f9cbf501c2e52c473c8ba021b775c191fd395282ff566" exitCode=0
May 28 14:59:50.734576 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:59:50.734485    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6rvf9" event={"ID":"71efe44c-d3d7-480f-8149-8c4e27e09211","Type":"ContainerDied","Data":"738f3bf47ff3da17434f9cbf501c2e52c473c8ba021b775c191fd395282ff566"}
May 28 14:59:50.761359 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:59:50.761307    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-587ccfb98-xwp9l" podStartSLOduration=0.748547356 podStartE2EDuration="3.761291851s" podCreationTimestamp="2026-05-28 14:59:47 +0000 UTC" firstStartedPulling="2026-05-28 14:59:47.554813394 +0000 UTC m=+407.644030099" lastFinishedPulling="2026-05-28 14:59:50.567557878 +0000 UTC m=+410.656774594" observedRunningTime="2026-05-28 14:59:50.758740173 +0000 UTC m=+410.847956897" watchObservedRunningTime="2026-05-28 14:59:50.761291851 +0000 UTC m=+410.850508573"
May 28 14:59:51.861795 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:59:51.861771    2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6rvf9"
May 28 14:59:51.949350 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:59:51.949319    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/71efe44c-d3d7-480f-8149-8c4e27e09211-bundle\") pod \"71efe44c-d3d7-480f-8149-8c4e27e09211\" (UID: \"71efe44c-d3d7-480f-8149-8c4e27e09211\") "
May 28 14:59:51.949477 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:59:51.949359    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vfkpn\" (UniqueName: \"kubernetes.io/projected/71efe44c-d3d7-480f-8149-8c4e27e09211-kube-api-access-vfkpn\") pod \"71efe44c-d3d7-480f-8149-8c4e27e09211\" (UID: \"71efe44c-d3d7-480f-8149-8c4e27e09211\") "
May 28 14:59:51.949477 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:59:51.949386    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/71efe44c-d3d7-480f-8149-8c4e27e09211-util\") pod \"71efe44c-d3d7-480f-8149-8c4e27e09211\" (UID: \"71efe44c-d3d7-480f-8149-8c4e27e09211\") "
May 28 14:59:51.949764 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:59:51.949740    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/71efe44c-d3d7-480f-8149-8c4e27e09211-bundle" (OuterVolumeSpecName: "bundle") pod "71efe44c-d3d7-480f-8149-8c4e27e09211" (UID: "71efe44c-d3d7-480f-8149-8c4e27e09211"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 14:59:51.951421 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:59:51.951380    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/71efe44c-d3d7-480f-8149-8c4e27e09211-kube-api-access-vfkpn" (OuterVolumeSpecName: "kube-api-access-vfkpn") pod "71efe44c-d3d7-480f-8149-8c4e27e09211" (UID: "71efe44c-d3d7-480f-8149-8c4e27e09211"). InnerVolumeSpecName "kube-api-access-vfkpn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 14:59:51.953249 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:59:51.953228    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/71efe44c-d3d7-480f-8149-8c4e27e09211-util" (OuterVolumeSpecName: "util") pod "71efe44c-d3d7-480f-8149-8c4e27e09211" (UID: "71efe44c-d3d7-480f-8149-8c4e27e09211"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 14:59:52.050405 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:59:52.050379    2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/71efe44c-d3d7-480f-8149-8c4e27e09211-bundle\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
May 28 14:59:52.050405 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:59:52.050403    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vfkpn\" (UniqueName: \"kubernetes.io/projected/71efe44c-d3d7-480f-8149-8c4e27e09211-kube-api-access-vfkpn\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
May 28 14:59:52.050405 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:59:52.050414    2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/71efe44c-d3d7-480f-8149-8c4e27e09211-util\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
May 28 14:59:52.742487 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:59:52.742457    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6rvf9" event={"ID":"71efe44c-d3d7-480f-8149-8c4e27e09211","Type":"ContainerDied","Data":"80a331c290b34b9cc208a2dedfeb5b044cd53ea9b26201684c7ffa82920b79ff"}
May 28 14:59:52.742487 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:59:52.742486    2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6rvf9"
May 28 14:59:52.742668 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:59:52.742490    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="80a331c290b34b9cc208a2dedfeb5b044cd53ea9b26201684c7ffa82920b79ff"
May 28 14:59:56.739563 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:59:56.739526    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-587ccfb98-xwp9l"
May 28 14:59:58.452667 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:59:58.452631    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-v8xrw"]
May 28 14:59:58.453065 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:59:58.452970    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71efe44c-d3d7-480f-8149-8c4e27e09211" containerName="pull"
May 28 14:59:58.453065 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:59:58.452983    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="71efe44c-d3d7-480f-8149-8c4e27e09211" containerName="pull"
May 28 14:59:58.453065 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:59:58.453000    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71efe44c-d3d7-480f-8149-8c4e27e09211" containerName="extract"
May 28 14:59:58.453065 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:59:58.453005    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="71efe44c-d3d7-480f-8149-8c4e27e09211" containerName="extract"
May 28 14:59:58.453065 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:59:58.453013    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71efe44c-d3d7-480f-8149-8c4e27e09211" containerName="util"
May 28 14:59:58.453065 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:59:58.453018    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="71efe44c-d3d7-480f-8149-8c4e27e09211" containerName="util"
May 28 14:59:58.453065 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:59:58.453065    2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="71efe44c-d3d7-480f-8149-8c4e27e09211" containerName="extract"
May 28 14:59:58.455473 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:59:58.455457    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-v8xrw"
May 28 14:59:58.457774 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:59:58.457747    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
May 28 14:59:58.457902 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:59:58.457827    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
May 28 14:59:58.458697 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:59:58.458661    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-rgn7j\""
May 28 14:59:58.463038 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:59:58.463018    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-v8xrw"]
May 28 14:59:58.607899 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:59:58.607864    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j2sch\" (UniqueName: \"kubernetes.io/projected/faafd460-717b-4391-9b11-c5d2f05ce26b-kube-api-access-j2sch\") pod \"openshift-lws-operator-bfc7f696d-v8xrw\" (UID: \"faafd460-717b-4391-9b11-c5d2f05ce26b\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-v8xrw"
May 28 14:59:58.608089 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:59:58.607914    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/faafd460-717b-4391-9b11-c5d2f05ce26b-tmp\") pod \"openshift-lws-operator-bfc7f696d-v8xrw\" (UID: \"faafd460-717b-4391-9b11-c5d2f05ce26b\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-v8xrw"
May 28 14:59:58.709151 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:59:58.709068    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-j2sch\" (UniqueName: \"kubernetes.io/projected/faafd460-717b-4391-9b11-c5d2f05ce26b-kube-api-access-j2sch\") pod \"openshift-lws-operator-bfc7f696d-v8xrw\" (UID: \"faafd460-717b-4391-9b11-c5d2f05ce26b\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-v8xrw"
May 28 14:59:58.709151 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:59:58.709114    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/faafd460-717b-4391-9b11-c5d2f05ce26b-tmp\") pod \"openshift-lws-operator-bfc7f696d-v8xrw\" (UID: \"faafd460-717b-4391-9b11-c5d2f05ce26b\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-v8xrw"
May 28 14:59:58.709496 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:59:58.709480    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/faafd460-717b-4391-9b11-c5d2f05ce26b-tmp\") pod \"openshift-lws-operator-bfc7f696d-v8xrw\" (UID: \"faafd460-717b-4391-9b11-c5d2f05ce26b\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-v8xrw"
May 28 14:59:58.719463 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:59:58.719435    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j2sch\" (UniqueName: \"kubernetes.io/projected/faafd460-717b-4391-9b11-c5d2f05ce26b-kube-api-access-j2sch\") pod \"openshift-lws-operator-bfc7f696d-v8xrw\" (UID: \"faafd460-717b-4391-9b11-c5d2f05ce26b\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-v8xrw"
May 28 14:59:58.764633 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:59:58.764601    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-v8xrw"
May 28 14:59:58.885527 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:59:58.885495    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-v8xrw"]
May 28 14:59:58.887814 ip-10-0-137-84 kubenswrapper[2563]: W0528 14:59:58.887785    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfaafd460_717b_4391_9b11_c5d2f05ce26b.slice/crio-c9c5e71669d0ea3fd06ede8d10dc013088106fb00cb5615bfbbd78add044d3b3 WatchSource:0}: Error finding container c9c5e71669d0ea3fd06ede8d10dc013088106fb00cb5615bfbbd78add044d3b3: Status 404 returned error can't find the container with id c9c5e71669d0ea3fd06ede8d10dc013088106fb00cb5615bfbbd78add044d3b3
May 28 14:59:59.767916 ip-10-0-137-84 kubenswrapper[2563]: I0528 14:59:59.767880    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-v8xrw" event={"ID":"faafd460-717b-4391-9b11-c5d2f05ce26b","Type":"ContainerStarted","Data":"c9c5e71669d0ea3fd06ede8d10dc013088106fb00cb5615bfbbd78add044d3b3"}
May 28 15:00:01.775399 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:01.775357    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-v8xrw" event={"ID":"faafd460-717b-4391-9b11-c5d2f05ce26b","Type":"ContainerStarted","Data":"230bf6ebf71eb53852f6efdaf168c1330705a7784c5840b840eaba6e847608a6"}
May 28 15:00:01.792966 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:01.792905    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-v8xrw" podStartSLOduration=1.7599849509999999 podStartE2EDuration="3.792888737s" podCreationTimestamp="2026-05-28 14:59:58 +0000 UTC" firstStartedPulling="2026-05-28 14:59:58.889356395 +0000 UTC m=+418.978573096" lastFinishedPulling="2026-05-28 15:00:00.922260181 +0000 UTC m=+421.011476882" observedRunningTime="2026-05-28 15:00:01.792648165 +0000 UTC m=+421.881864888" watchObservedRunningTime="2026-05-28 15:00:01.792888737 +0000 UTC m=+421.882105459"
May 28 15:00:05.829868 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:05.829830    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c55lbtw"]
May 28 15:00:05.832516 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:05.832498    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c55lbtw"
May 28 15:00:05.834929 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:05.834897    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
May 28 15:00:05.834929 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:05.834921    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
May 28 15:00:05.835115 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:05.834945    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-6gg56\""
May 28 15:00:05.840416 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:05.840391    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c55lbtw"]
May 28 15:00:05.972861 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:05.972823    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6wkrc\" (UniqueName: \"kubernetes.io/projected/da116050-9f57-458f-8313-e6b6b17adf7c-kube-api-access-6wkrc\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c55lbtw\" (UID: \"da116050-9f57-458f-8313-e6b6b17adf7c\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c55lbtw"
May 28 15:00:05.973037 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:05.972866    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/da116050-9f57-458f-8313-e6b6b17adf7c-bundle\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c55lbtw\" (UID: \"da116050-9f57-458f-8313-e6b6b17adf7c\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c55lbtw"
May 28 15:00:05.973037 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:05.972895    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/da116050-9f57-458f-8313-e6b6b17adf7c-util\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c55lbtw\" (UID: \"da116050-9f57-458f-8313-e6b6b17adf7c\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c55lbtw"
May 28 15:00:06.074294 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:06.074258    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6wkrc\" (UniqueName: \"kubernetes.io/projected/da116050-9f57-458f-8313-e6b6b17adf7c-kube-api-access-6wkrc\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c55lbtw\" (UID: \"da116050-9f57-458f-8313-e6b6b17adf7c\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c55lbtw"
May 28 15:00:06.074294 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:06.074296    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/da116050-9f57-458f-8313-e6b6b17adf7c-bundle\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c55lbtw\" (UID: \"da116050-9f57-458f-8313-e6b6b17adf7c\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c55lbtw"
May 28 15:00:06.074539 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:06.074322    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/da116050-9f57-458f-8313-e6b6b17adf7c-util\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c55lbtw\" (UID: \"da116050-9f57-458f-8313-e6b6b17adf7c\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c55lbtw"
May 28 15:00:06.074721 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:06.074698    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/da116050-9f57-458f-8313-e6b6b17adf7c-bundle\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c55lbtw\" (UID: \"da116050-9f57-458f-8313-e6b6b17adf7c\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c55lbtw"
May 28 15:00:06.074787 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:06.074721    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/da116050-9f57-458f-8313-e6b6b17adf7c-util\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c55lbtw\" (UID: \"da116050-9f57-458f-8313-e6b6b17adf7c\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c55lbtw"
May 28 15:00:06.082333 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:06.082273    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6wkrc\" (UniqueName: \"kubernetes.io/projected/da116050-9f57-458f-8313-e6b6b17adf7c-kube-api-access-6wkrc\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c55lbtw\" (UID: \"da116050-9f57-458f-8313-e6b6b17adf7c\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c55lbtw"
May 28 15:00:06.142644 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:06.142612    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c55lbtw"
May 28 15:00:06.272002 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:06.271975    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c55lbtw"]
May 28 15:00:06.274051 ip-10-0-137-84 kubenswrapper[2563]: W0528 15:00:06.274021    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda116050_9f57_458f_8313_e6b6b17adf7c.slice/crio-1f12bc77f7ffbc8610341b5ce3dbcc8cbf0cf8c8098e13a70e6e3505bb645493 WatchSource:0}: Error finding container 1f12bc77f7ffbc8610341b5ce3dbcc8cbf0cf8c8098e13a70e6e3505bb645493: Status 404 returned error can't find the container with id 1f12bc77f7ffbc8610341b5ce3dbcc8cbf0cf8c8098e13a70e6e3505bb645493
May 28 15:00:06.792563 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:06.792526    2563 generic.go:358] "Generic (PLEG): container finished" podID="da116050-9f57-458f-8313-e6b6b17adf7c" containerID="40f4591d0694a1886faab237095cb33231583bb267b763e1fa101b1c65dc8789" exitCode=0
May 28 15:00:06.792756 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:06.792587    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c55lbtw" event={"ID":"da116050-9f57-458f-8313-e6b6b17adf7c","Type":"ContainerDied","Data":"40f4591d0694a1886faab237095cb33231583bb267b763e1fa101b1c65dc8789"}
May 28 15:00:06.792756 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:06.792612    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c55lbtw" event={"ID":"da116050-9f57-458f-8313-e6b6b17adf7c","Type":"ContainerStarted","Data":"1f12bc77f7ffbc8610341b5ce3dbcc8cbf0cf8c8098e13a70e6e3505bb645493"}
May 28 15:00:07.797461 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:07.797424    2563 generic.go:358] "Generic (PLEG): container finished" podID="da116050-9f57-458f-8313-e6b6b17adf7c" containerID="d3d5a2e754c3b8f9a892b8eb96c3192c5336acbb3f02b5e99ccc262374f2820f" exitCode=0
May 28 15:00:07.797842 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:07.797485    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c55lbtw" event={"ID":"da116050-9f57-458f-8313-e6b6b17adf7c","Type":"ContainerDied","Data":"d3d5a2e754c3b8f9a892b8eb96c3192c5336acbb3f02b5e99ccc262374f2820f"}
May 28 15:00:08.802357 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:08.802319    2563 generic.go:358] "Generic (PLEG): container finished" podID="da116050-9f57-458f-8313-e6b6b17adf7c" containerID="9696e12182063b74a664db4b875d6e77fc75d7fd249f84c7450f13bf044a0389" exitCode=0
May 28 15:00:08.802766 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:08.802406    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c55lbtw" event={"ID":"da116050-9f57-458f-8313-e6b6b17adf7c","Type":"ContainerDied","Data":"9696e12182063b74a664db4b875d6e77fc75d7fd249f84c7450f13bf044a0389"}
May 28 15:00:09.928939 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:09.928905    2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c55lbtw"
May 28 15:00:10.009397 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:10.009357    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6wkrc\" (UniqueName: \"kubernetes.io/projected/da116050-9f57-458f-8313-e6b6b17adf7c-kube-api-access-6wkrc\") pod \"da116050-9f57-458f-8313-e6b6b17adf7c\" (UID: \"da116050-9f57-458f-8313-e6b6b17adf7c\") "
May 28 15:00:10.009397 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:10.009402    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/da116050-9f57-458f-8313-e6b6b17adf7c-util\") pod \"da116050-9f57-458f-8313-e6b6b17adf7c\" (UID: \"da116050-9f57-458f-8313-e6b6b17adf7c\") "
May 28 15:00:10.009646 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:10.009447    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/da116050-9f57-458f-8313-e6b6b17adf7c-bundle\") pod \"da116050-9f57-458f-8313-e6b6b17adf7c\" (UID: \"da116050-9f57-458f-8313-e6b6b17adf7c\") "
May 28 15:00:10.010340 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:10.010304    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/da116050-9f57-458f-8313-e6b6b17adf7c-bundle" (OuterVolumeSpecName: "bundle") pod "da116050-9f57-458f-8313-e6b6b17adf7c" (UID: "da116050-9f57-458f-8313-e6b6b17adf7c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 15:00:10.011549 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:10.011529    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/da116050-9f57-458f-8313-e6b6b17adf7c-kube-api-access-6wkrc" (OuterVolumeSpecName: "kube-api-access-6wkrc") pod "da116050-9f57-458f-8313-e6b6b17adf7c" (UID: "da116050-9f57-458f-8313-e6b6b17adf7c"). InnerVolumeSpecName "kube-api-access-6wkrc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 15:00:10.015358 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:10.015321    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/da116050-9f57-458f-8313-e6b6b17adf7c-util" (OuterVolumeSpecName: "util") pod "da116050-9f57-458f-8313-e6b6b17adf7c" (UID: "da116050-9f57-458f-8313-e6b6b17adf7c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 15:00:10.110457 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:10.110362    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6wkrc\" (UniqueName: \"kubernetes.io/projected/da116050-9f57-458f-8313-e6b6b17adf7c-kube-api-access-6wkrc\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
May 28 15:00:10.110457 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:10.110401    2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/da116050-9f57-458f-8313-e6b6b17adf7c-util\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
May 28 15:00:10.110457 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:10.110415    2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/da116050-9f57-458f-8313-e6b6b17adf7c-bundle\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
May 28 15:00:10.811833 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:10.811797    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c55lbtw" event={"ID":"da116050-9f57-458f-8313-e6b6b17adf7c","Type":"ContainerDied","Data":"1f12bc77f7ffbc8610341b5ce3dbcc8cbf0cf8c8098e13a70e6e3505bb645493"}
May 28 15:00:10.811833 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:10.811833    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1f12bc77f7ffbc8610341b5ce3dbcc8cbf0cf8c8098e13a70e6e3505bb645493"
May 28 15:00:10.812055 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:10.811842    2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c55lbtw"
May 28 15:00:15.671357 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:15.671316    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9sjn6p"]
May 28 15:00:15.671767 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:15.671626    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da116050-9f57-458f-8313-e6b6b17adf7c" containerName="extract"
May 28 15:00:15.671767 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:15.671638    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="da116050-9f57-458f-8313-e6b6b17adf7c" containerName="extract"
May 28 15:00:15.671767 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:15.671653    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da116050-9f57-458f-8313-e6b6b17adf7c" containerName="pull"
May 28 15:00:15.671767 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:15.671658    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="da116050-9f57-458f-8313-e6b6b17adf7c" containerName="pull"
May 28 15:00:15.671767 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:15.671666    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da116050-9f57-458f-8313-e6b6b17adf7c" containerName="util"
May 28 15:00:15.671767 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:15.671688    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="da116050-9f57-458f-8313-e6b6b17adf7c" containerName="util"
May 28 15:00:15.671767 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:15.671760    2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="da116050-9f57-458f-8313-e6b6b17adf7c" containerName="extract"
May 28 15:00:15.674049 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:15.674022    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9sjn6p"
May 28 15:00:15.676521 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:15.676500    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
May 28 15:00:15.676636 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:15.676501    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
May 28 15:00:15.677485 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:15.677463    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-6gg56\""
May 28 15:00:15.683569 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:15.683545    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9sjn6p"]
May 28 15:00:15.757384 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:15.757354    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/71391508-5c9f-4aa4-bb4b-2dbff71840b2-bundle\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9sjn6p\" (UID: \"71391508-5c9f-4aa4-bb4b-2dbff71840b2\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9sjn6p"
May 28 15:00:15.757557 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:15.757404    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/71391508-5c9f-4aa4-bb4b-2dbff71840b2-util\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9sjn6p\" (UID: \"71391508-5c9f-4aa4-bb4b-2dbff71840b2\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9sjn6p"
May 28 15:00:15.757557 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:15.757488    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6vxcx\" (UniqueName: \"kubernetes.io/projected/71391508-5c9f-4aa4-bb4b-2dbff71840b2-kube-api-access-6vxcx\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9sjn6p\" (UID: \"71391508-5c9f-4aa4-bb4b-2dbff71840b2\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9sjn6p"
May 28 15:00:15.858495 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:15.858456    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/71391508-5c9f-4aa4-bb4b-2dbff71840b2-util\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9sjn6p\" (UID: \"71391508-5c9f-4aa4-bb4b-2dbff71840b2\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9sjn6p"
May 28 15:00:15.858725 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:15.858536    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6vxcx\" (UniqueName: \"kubernetes.io/projected/71391508-5c9f-4aa4-bb4b-2dbff71840b2-kube-api-access-6vxcx\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9sjn6p\" (UID: \"71391508-5c9f-4aa4-bb4b-2dbff71840b2\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9sjn6p"
May 28 15:00:15.858725 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:15.858591    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/71391508-5c9f-4aa4-bb4b-2dbff71840b2-bundle\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9sjn6p\" (UID: \"71391508-5c9f-4aa4-bb4b-2dbff71840b2\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9sjn6p"
May 28 15:00:15.858901 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:15.858879    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/71391508-5c9f-4aa4-bb4b-2dbff71840b2-util\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9sjn6p\" (UID: \"71391508-5c9f-4aa4-bb4b-2dbff71840b2\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9sjn6p"
May 28 15:00:15.858964 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:15.858948    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/71391508-5c9f-4aa4-bb4b-2dbff71840b2-bundle\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9sjn6p\" (UID: \"71391508-5c9f-4aa4-bb4b-2dbff71840b2\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9sjn6p"
May 28 15:00:15.869534 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:15.869503    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6vxcx\" (UniqueName: \"kubernetes.io/projected/71391508-5c9f-4aa4-bb4b-2dbff71840b2-kube-api-access-6vxcx\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9sjn6p\" (UID: \"71391508-5c9f-4aa4-bb4b-2dbff71840b2\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9sjn6p"
May 28 15:00:15.982989 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:15.982904    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9sjn6p"
May 28 15:00:16.113865 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:16.113748    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9sjn6p"]
May 28 15:00:16.116548 ip-10-0-137-84 kubenswrapper[2563]: W0528 15:00:16.116511    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71391508_5c9f_4aa4_bb4b_2dbff71840b2.slice/crio-5e8963d38f3447cd47503c231e4118529a685504f278748eaada33051ee4099c WatchSource:0}: Error finding container 5e8963d38f3447cd47503c231e4118529a685504f278748eaada33051ee4099c: Status 404 returned error can't find the container with id 5e8963d38f3447cd47503c231e4118529a685504f278748eaada33051ee4099c
May 28 15:00:16.834513 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:16.834474    2563 generic.go:358] "Generic (PLEG): container finished" podID="71391508-5c9f-4aa4-bb4b-2dbff71840b2" containerID="1c77ae7c92b659077aaebe2cd1a0f40931d9fb0139d709d7e7830ff166e5ad01" exitCode=0
May 28 15:00:16.834955 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:16.834541    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9sjn6p" event={"ID":"71391508-5c9f-4aa4-bb4b-2dbff71840b2","Type":"ContainerDied","Data":"1c77ae7c92b659077aaebe2cd1a0f40931d9fb0139d709d7e7830ff166e5ad01"}
May 28 15:00:16.834955 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:16.834572    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9sjn6p" event={"ID":"71391508-5c9f-4aa4-bb4b-2dbff71840b2","Type":"ContainerStarted","Data":"5e8963d38f3447cd47503c231e4118529a685504f278748eaada33051ee4099c"}
May 28 15:00:17.799140 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:17.799105    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-b5d999694-gjn49"]
May 28 15:00:17.812727 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:17.812704    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-b5d999694-gjn49"
May 28 15:00:17.815255 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:17.815234    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
May 28 15:00:17.815364 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:17.815240    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-scgwz\""
May 28 15:00:17.815513 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:17.815499    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
May 28 15:00:17.815780 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:17.815757    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
May 28 15:00:17.816160 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:17.816144    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
May 28 15:00:17.820989 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:17.820966    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-b5d999694-gjn49"]
May 28 15:00:17.840569 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:17.840539    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9sjn6p" event={"ID":"71391508-5c9f-4aa4-bb4b-2dbff71840b2","Type":"ContainerDied","Data":"b7a2b99d4929d2257ae7c0dcc8533b71ba4294ba64defa7c8c8dffc0c6f569e7"}
May 28 15:00:17.840569 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:17.840538    2563 generic.go:358] "Generic (PLEG): container finished" podID="71391508-5c9f-4aa4-bb4b-2dbff71840b2" containerID="b7a2b99d4929d2257ae7c0dcc8533b71ba4294ba64defa7c8c8dffc0c6f569e7" exitCode=0
May 28 15:00:17.876487 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:17.876460    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9cfn2\" (UniqueName: \"kubernetes.io/projected/55bf31bf-ca89-426d-b785-77be0930103d-kube-api-access-9cfn2\") pod \"opendatahub-operator-controller-manager-b5d999694-gjn49\" (UID: \"55bf31bf-ca89-426d-b785-77be0930103d\") " pod="opendatahub/opendatahub-operator-controller-manager-b5d999694-gjn49"
May 28 15:00:17.876563 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:17.876516    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/55bf31bf-ca89-426d-b785-77be0930103d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-b5d999694-gjn49\" (UID: \"55bf31bf-ca89-426d-b785-77be0930103d\") " pod="opendatahub/opendatahub-operator-controller-manager-b5d999694-gjn49"
May 28 15:00:17.876625 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:17.876601    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/55bf31bf-ca89-426d-b785-77be0930103d-webhook-cert\") pod \"opendatahub-operator-controller-manager-b5d999694-gjn49\" (UID: \"55bf31bf-ca89-426d-b785-77be0930103d\") " pod="opendatahub/opendatahub-operator-controller-manager-b5d999694-gjn49"
May 28 15:00:17.977205 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:17.977168    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9cfn2\" (UniqueName: \"kubernetes.io/projected/55bf31bf-ca89-426d-b785-77be0930103d-kube-api-access-9cfn2\") pod \"opendatahub-operator-controller-manager-b5d999694-gjn49\" (UID: \"55bf31bf-ca89-426d-b785-77be0930103d\") " pod="opendatahub/opendatahub-operator-controller-manager-b5d999694-gjn49"
May 28 15:00:17.977369 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:17.977219    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/55bf31bf-ca89-426d-b785-77be0930103d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-b5d999694-gjn49\" (UID: \"55bf31bf-ca89-426d-b785-77be0930103d\") " pod="opendatahub/opendatahub-operator-controller-manager-b5d999694-gjn49"
May 28 15:00:17.977369 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:17.977247    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/55bf31bf-ca89-426d-b785-77be0930103d-webhook-cert\") pod \"opendatahub-operator-controller-manager-b5d999694-gjn49\" (UID: \"55bf31bf-ca89-426d-b785-77be0930103d\") " pod="opendatahub/opendatahub-operator-controller-manager-b5d999694-gjn49"
May 28 15:00:17.979621 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:17.979599    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/55bf31bf-ca89-426d-b785-77be0930103d-webhook-cert\") pod \"opendatahub-operator-controller-manager-b5d999694-gjn49\" (UID: \"55bf31bf-ca89-426d-b785-77be0930103d\") " pod="opendatahub/opendatahub-operator-controller-manager-b5d999694-gjn49"
May 28 15:00:17.979748 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:17.979636    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/55bf31bf-ca89-426d-b785-77be0930103d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-b5d999694-gjn49\" (UID: \"55bf31bf-ca89-426d-b785-77be0930103d\") " pod="opendatahub/opendatahub-operator-controller-manager-b5d999694-gjn49"
May 28 15:00:17.986272 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:17.986245    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9cfn2\" (UniqueName: \"kubernetes.io/projected/55bf31bf-ca89-426d-b785-77be0930103d-kube-api-access-9cfn2\") pod \"opendatahub-operator-controller-manager-b5d999694-gjn49\" (UID: \"55bf31bf-ca89-426d-b785-77be0930103d\") " pod="opendatahub/opendatahub-operator-controller-manager-b5d999694-gjn49"
May 28 15:00:18.123728 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:18.123621    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-b5d999694-gjn49"
May 28 15:00:18.254893 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:18.254858    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-b5d999694-gjn49"]
May 28 15:00:18.258040 ip-10-0-137-84 kubenswrapper[2563]: W0528 15:00:18.258015    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55bf31bf_ca89_426d_b785_77be0930103d.slice/crio-67d8c210cf8def253b5193288dd6ed4f4e29f7418fe8901594a915c8cbc1c36c WatchSource:0}: Error finding container 67d8c210cf8def253b5193288dd6ed4f4e29f7418fe8901594a915c8cbc1c36c: Status 404 returned error can't find the container with id 67d8c210cf8def253b5193288dd6ed4f4e29f7418fe8901594a915c8cbc1c36c
May 28 15:00:18.846614 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:18.846560    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-b5d999694-gjn49" event={"ID":"55bf31bf-ca89-426d-b785-77be0930103d","Type":"ContainerStarted","Data":"67d8c210cf8def253b5193288dd6ed4f4e29f7418fe8901594a915c8cbc1c36c"}
May 28 15:00:18.849319 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:18.849288    2563 generic.go:358] "Generic (PLEG): container finished" podID="71391508-5c9f-4aa4-bb4b-2dbff71840b2" containerID="2942b344a733d38dfb5a4b351595af368dc283c7d21b76848bd144f534e0c7c3" exitCode=0
May 28 15:00:18.849454 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:18.849343    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9sjn6p" event={"ID":"71391508-5c9f-4aa4-bb4b-2dbff71840b2","Type":"ContainerDied","Data":"2942b344a733d38dfb5a4b351595af368dc283c7d21b76848bd144f534e0c7c3"}
May 28 15:00:20.710876 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:20.710852    2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9sjn6p"
May 28 15:00:20.802475 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:20.802450    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/71391508-5c9f-4aa4-bb4b-2dbff71840b2-util\") pod \"71391508-5c9f-4aa4-bb4b-2dbff71840b2\" (UID: \"71391508-5c9f-4aa4-bb4b-2dbff71840b2\") "
May 28 15:00:20.802608 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:20.802499    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/71391508-5c9f-4aa4-bb4b-2dbff71840b2-bundle\") pod \"71391508-5c9f-4aa4-bb4b-2dbff71840b2\" (UID: \"71391508-5c9f-4aa4-bb4b-2dbff71840b2\") "
May 28 15:00:20.802608 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:20.802542    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6vxcx\" (UniqueName: \"kubernetes.io/projected/71391508-5c9f-4aa4-bb4b-2dbff71840b2-kube-api-access-6vxcx\") pod \"71391508-5c9f-4aa4-bb4b-2dbff71840b2\" (UID: \"71391508-5c9f-4aa4-bb4b-2dbff71840b2\") "
May 28 15:00:20.803712 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:20.803660    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/71391508-5c9f-4aa4-bb4b-2dbff71840b2-bundle" (OuterVolumeSpecName: "bundle") pod "71391508-5c9f-4aa4-bb4b-2dbff71840b2" (UID: "71391508-5c9f-4aa4-bb4b-2dbff71840b2"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 15:00:20.804526 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:20.804505    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/71391508-5c9f-4aa4-bb4b-2dbff71840b2-kube-api-access-6vxcx" (OuterVolumeSpecName: "kube-api-access-6vxcx") pod "71391508-5c9f-4aa4-bb4b-2dbff71840b2" (UID: "71391508-5c9f-4aa4-bb4b-2dbff71840b2"). InnerVolumeSpecName "kube-api-access-6vxcx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 15:00:20.810453 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:20.810424    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/71391508-5c9f-4aa4-bb4b-2dbff71840b2-util" (OuterVolumeSpecName: "util") pod "71391508-5c9f-4aa4-bb4b-2dbff71840b2" (UID: "71391508-5c9f-4aa4-bb4b-2dbff71840b2"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 15:00:20.857750 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:20.857723    2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9sjn6p"
May 28 15:00:20.857878 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:20.857727    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9sjn6p" event={"ID":"71391508-5c9f-4aa4-bb4b-2dbff71840b2","Type":"ContainerDied","Data":"5e8963d38f3447cd47503c231e4118529a685504f278748eaada33051ee4099c"}
May 28 15:00:20.857878 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:20.857847    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5e8963d38f3447cd47503c231e4118529a685504f278748eaada33051ee4099c"
May 28 15:00:20.859131 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:20.859106    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-b5d999694-gjn49" event={"ID":"55bf31bf-ca89-426d-b785-77be0930103d","Type":"ContainerStarted","Data":"5654357b960e0ed4f4b6e3ebbab867874c5fca63f0452f8adb4998ae676193a1"}
May 28 15:00:20.859233 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:20.859209    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-b5d999694-gjn49"
May 28 15:00:20.880794 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:20.880748    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-b5d999694-gjn49" podStartSLOduration=1.418420075 podStartE2EDuration="3.880737164s" podCreationTimestamp="2026-05-28 15:00:17 +0000 UTC" firstStartedPulling="2026-05-28 15:00:18.259898468 +0000 UTC m=+438.349115173" lastFinishedPulling="2026-05-28 15:00:20.722215557 +0000 UTC m=+440.811432262" observedRunningTime="2026-05-28 15:00:20.87783584 +0000 UTC m=+440.967052562" watchObservedRunningTime="2026-05-28 15:00:20.880737164 +0000 UTC m=+440.969953887"
May 28 15:00:20.903377 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:20.903350    2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/71391508-5c9f-4aa4-bb4b-2dbff71840b2-bundle\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
May 28 15:00:20.903377 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:20.903371    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6vxcx\" (UniqueName: \"kubernetes.io/projected/71391508-5c9f-4aa4-bb4b-2dbff71840b2-kube-api-access-6vxcx\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
May 28 15:00:20.903377 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:20.903381    2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/71391508-5c9f-4aa4-bb4b-2dbff71840b2-util\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
May 28 15:00:31.864932 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:31.864899    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-b5d999694-gjn49"
May 28 15:00:40.543762 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:40.543726    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835nbx98"]
May 28 15:00:40.544172 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:40.544056    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71391508-5c9f-4aa4-bb4b-2dbff71840b2" containerName="pull"
May 28 15:00:40.544172 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:40.544069    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="71391508-5c9f-4aa4-bb4b-2dbff71840b2" containerName="pull"
May 28 15:00:40.544172 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:40.544083    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71391508-5c9f-4aa4-bb4b-2dbff71840b2" containerName="extract"
May 28 15:00:40.544172 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:40.544088    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="71391508-5c9f-4aa4-bb4b-2dbff71840b2" containerName="extract"
May 28 15:00:40.544172 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:40.544096    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71391508-5c9f-4aa4-bb4b-2dbff71840b2" containerName="util"
May 28 15:00:40.544172 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:40.544101    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="71391508-5c9f-4aa4-bb4b-2dbff71840b2" containerName="util"
May 28 15:00:40.544172 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:40.544158    2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="71391508-5c9f-4aa4-bb4b-2dbff71840b2" containerName="extract"
May 28 15:00:40.546341 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:40.546324    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835nbx98"
May 28 15:00:40.548775 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:40.548748    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
May 28 15:00:40.548918 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:40.548892    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
May 28 15:00:40.549043 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:40.548944    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-6gg56\""
May 28 15:00:40.555448 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:40.555423    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835nbx98"]
May 28 15:00:40.677134 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:40.677099    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/299108de-a459-44f6-9913-4e2530c49ad6-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835nbx98\" (UID: \"299108de-a459-44f6-9913-4e2530c49ad6\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835nbx98"
May 28 15:00:40.677334 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:40.677233    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2kpdm\" (UniqueName: \"kubernetes.io/projected/299108de-a459-44f6-9913-4e2530c49ad6-kube-api-access-2kpdm\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835nbx98\" (UID: \"299108de-a459-44f6-9913-4e2530c49ad6\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835nbx98"
May 28 15:00:40.677334 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:40.677277    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/299108de-a459-44f6-9913-4e2530c49ad6-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835nbx98\" (UID: \"299108de-a459-44f6-9913-4e2530c49ad6\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835nbx98"
May 28 15:00:40.778296 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:40.778262    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2kpdm\" (UniqueName: \"kubernetes.io/projected/299108de-a459-44f6-9913-4e2530c49ad6-kube-api-access-2kpdm\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835nbx98\" (UID: \"299108de-a459-44f6-9913-4e2530c49ad6\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835nbx98"
May 28 15:00:40.778296 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:40.778308    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/299108de-a459-44f6-9913-4e2530c49ad6-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835nbx98\" (UID: \"299108de-a459-44f6-9913-4e2530c49ad6\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835nbx98"
May 28 15:00:40.778561 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:40.778330    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/299108de-a459-44f6-9913-4e2530c49ad6-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835nbx98\" (UID: \"299108de-a459-44f6-9913-4e2530c49ad6\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835nbx98"
May 28 15:00:40.778775 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:40.778752    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/299108de-a459-44f6-9913-4e2530c49ad6-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835nbx98\" (UID: \"299108de-a459-44f6-9913-4e2530c49ad6\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835nbx98"
May 28 15:00:40.778775 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:40.778764    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/299108de-a459-44f6-9913-4e2530c49ad6-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835nbx98\" (UID: \"299108de-a459-44f6-9913-4e2530c49ad6\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835nbx98"
May 28 15:00:40.786385 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:40.786365    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2kpdm\" (UniqueName: \"kubernetes.io/projected/299108de-a459-44f6-9913-4e2530c49ad6-kube-api-access-2kpdm\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835nbx98\" (UID: \"299108de-a459-44f6-9913-4e2530c49ad6\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835nbx98"
May 28 15:00:40.857242 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:40.857153    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835nbx98"
May 28 15:00:40.986346 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:40.986318    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835nbx98"]
May 28 15:00:40.988402 ip-10-0-137-84 kubenswrapper[2563]: W0528 15:00:40.988373    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod299108de_a459_44f6_9913_4e2530c49ad6.slice/crio-0a9f805ed6f22cf1d054b59ccd37e08bb12c06ee655dff92c5bf830252b7f9c2 WatchSource:0}: Error finding container 0a9f805ed6f22cf1d054b59ccd37e08bb12c06ee655dff92c5bf830252b7f9c2: Status 404 returned error can't find the container with id 0a9f805ed6f22cf1d054b59ccd37e08bb12c06ee655dff92c5bf830252b7f9c2
May 28 15:00:41.931138 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:41.931094    2563 generic.go:358] "Generic (PLEG): container finished" podID="299108de-a459-44f6-9913-4e2530c49ad6" containerID="19ad1bdf1765da703f634cc2c9aaf9489d56862e67c7112d3817f6801773f8a0" exitCode=0
May 28 15:00:41.931511 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:41.931182    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835nbx98" event={"ID":"299108de-a459-44f6-9913-4e2530c49ad6","Type":"ContainerDied","Data":"19ad1bdf1765da703f634cc2c9aaf9489d56862e67c7112d3817f6801773f8a0"}
May 28 15:00:41.931511 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:41.931223    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835nbx98" event={"ID":"299108de-a459-44f6-9913-4e2530c49ad6","Type":"ContainerStarted","Data":"0a9f805ed6f22cf1d054b59ccd37e08bb12c06ee655dff92c5bf830252b7f9c2"}
May 28 15:00:42.022329 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:42.022292    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5fc8d7b98d-zbcf8"]
May 28 15:00:42.024491 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:42.024473    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5fc8d7b98d-zbcf8"
May 28 15:00:42.026979 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:42.026957    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
May 28 15:00:42.027093 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:42.027002    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
May 28 15:00:42.027093 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:42.027011    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-w4tjq\""
May 28 15:00:42.027093 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:42.027030    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
May 28 15:00:42.027093 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:42.027031    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
May 28 15:00:42.034391 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:42.034370    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5fc8d7b98d-zbcf8"]
May 28 15:00:42.089038 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:42.088955    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9mmbn\" (UniqueName: \"kubernetes.io/projected/dedd0929-f9a8-4f36-b9b3-e33a9587f506-kube-api-access-9mmbn\") pod \"kube-auth-proxy-5fc8d7b98d-zbcf8\" (UID: \"dedd0929-f9a8-4f36-b9b3-e33a9587f506\") " pod="openshift-ingress/kube-auth-proxy-5fc8d7b98d-zbcf8"
May 28 15:00:42.089038 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:42.089011    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dedd0929-f9a8-4f36-b9b3-e33a9587f506-tmp\") pod \"kube-auth-proxy-5fc8d7b98d-zbcf8\" (UID: \"dedd0929-f9a8-4f36-b9b3-e33a9587f506\") " pod="openshift-ingress/kube-auth-proxy-5fc8d7b98d-zbcf8"
May 28 15:00:42.089252 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:42.089115    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dedd0929-f9a8-4f36-b9b3-e33a9587f506-tls-certs\") pod \"kube-auth-proxy-5fc8d7b98d-zbcf8\" (UID: \"dedd0929-f9a8-4f36-b9b3-e33a9587f506\") " pod="openshift-ingress/kube-auth-proxy-5fc8d7b98d-zbcf8"
May 28 15:00:42.189880 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:42.189845    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9mmbn\" (UniqueName: \"kubernetes.io/projected/dedd0929-f9a8-4f36-b9b3-e33a9587f506-kube-api-access-9mmbn\") pod \"kube-auth-proxy-5fc8d7b98d-zbcf8\" (UID: \"dedd0929-f9a8-4f36-b9b3-e33a9587f506\") " pod="openshift-ingress/kube-auth-proxy-5fc8d7b98d-zbcf8"
May 28 15:00:42.190029 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:42.189895    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dedd0929-f9a8-4f36-b9b3-e33a9587f506-tmp\") pod \"kube-auth-proxy-5fc8d7b98d-zbcf8\" (UID: \"dedd0929-f9a8-4f36-b9b3-e33a9587f506\") " pod="openshift-ingress/kube-auth-proxy-5fc8d7b98d-zbcf8"
May 28 15:00:42.190116 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:42.190019    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dedd0929-f9a8-4f36-b9b3-e33a9587f506-tls-certs\") pod \"kube-auth-proxy-5fc8d7b98d-zbcf8\" (UID: \"dedd0929-f9a8-4f36-b9b3-e33a9587f506\") " pod="openshift-ingress/kube-auth-proxy-5fc8d7b98d-zbcf8"
May 28 15:00:42.192044 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:42.192024    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dedd0929-f9a8-4f36-b9b3-e33a9587f506-tmp\") pod \"kube-auth-proxy-5fc8d7b98d-zbcf8\" (UID: \"dedd0929-f9a8-4f36-b9b3-e33a9587f506\") " pod="openshift-ingress/kube-auth-proxy-5fc8d7b98d-zbcf8"
May 28 15:00:42.192397 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:42.192380    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dedd0929-f9a8-4f36-b9b3-e33a9587f506-tls-certs\") pod \"kube-auth-proxy-5fc8d7b98d-zbcf8\" (UID: \"dedd0929-f9a8-4f36-b9b3-e33a9587f506\") " pod="openshift-ingress/kube-auth-proxy-5fc8d7b98d-zbcf8"
May 28 15:00:42.197483 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:42.197461    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9mmbn\" (UniqueName: \"kubernetes.io/projected/dedd0929-f9a8-4f36-b9b3-e33a9587f506-kube-api-access-9mmbn\") pod \"kube-auth-proxy-5fc8d7b98d-zbcf8\" (UID: \"dedd0929-f9a8-4f36-b9b3-e33a9587f506\") " pod="openshift-ingress/kube-auth-proxy-5fc8d7b98d-zbcf8"
May 28 15:00:42.333778 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:42.333744    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5fc8d7b98d-zbcf8"
May 28 15:00:42.475286 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:42.475230    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5fc8d7b98d-zbcf8"]
May 28 15:00:42.480602 ip-10-0-137-84 kubenswrapper[2563]: W0528 15:00:42.480565    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddedd0929_f9a8_4f36_b9b3_e33a9587f506.slice/crio-4fde8a060a988377bc0b4bea39e0509232d53a927b8a6698641ca7f691ef1990 WatchSource:0}: Error finding container 4fde8a060a988377bc0b4bea39e0509232d53a927b8a6698641ca7f691ef1990: Status 404 returned error can't find the container with id 4fde8a060a988377bc0b4bea39e0509232d53a927b8a6698641ca7f691ef1990
May 28 15:00:42.936244 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:42.936199    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5fc8d7b98d-zbcf8" event={"ID":"dedd0929-f9a8-4f36-b9b3-e33a9587f506","Type":"ContainerStarted","Data":"4fde8a060a988377bc0b4bea39e0509232d53a927b8a6698641ca7f691ef1990"}
May 28 15:00:42.937801 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:42.937770    2563 generic.go:358] "Generic (PLEG): container finished" podID="299108de-a459-44f6-9913-4e2530c49ad6" containerID="4b588ce3ffb674c4d6902b99bce08d8d10fcd834af7221fa1b181d00da996752" exitCode=0
May 28 15:00:42.937927 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:42.937844    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835nbx98" event={"ID":"299108de-a459-44f6-9913-4e2530c49ad6","Type":"ContainerDied","Data":"4b588ce3ffb674c4d6902b99bce08d8d10fcd834af7221fa1b181d00da996752"}
May 28 15:00:43.944110 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:43.944076    2563 generic.go:358] "Generic (PLEG): container finished" podID="299108de-a459-44f6-9913-4e2530c49ad6" containerID="a8b1298f2a1121f42e170b65afb17ddbcf77f027492fa41c314345812e026eaf" exitCode=0
May 28 15:00:43.944573 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:43.944163    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835nbx98" event={"ID":"299108de-a459-44f6-9913-4e2530c49ad6","Type":"ContainerDied","Data":"a8b1298f2a1121f42e170b65afb17ddbcf77f027492fa41c314345812e026eaf"}
May 28 15:00:44.190430 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:44.190394    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-858dbf95b8-kg5l7"]
May 28 15:00:44.196749 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:44.196627    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-858dbf95b8-kg5l7"
May 28 15:00:44.199339 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:44.199311    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
May 28 15:00:44.199811 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:44.199609    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-mhv79\""
May 28 15:00:44.200116 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:44.200088    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-858dbf95b8-kg5l7"]
May 28 15:00:44.309416 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:44.309384    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/06209136-eb4e-43c1-a481-dae591bdc5ac-cert\") pod \"odh-model-controller-858dbf95b8-kg5l7\" (UID: \"06209136-eb4e-43c1-a481-dae591bdc5ac\") " pod="opendatahub/odh-model-controller-858dbf95b8-kg5l7"
May 28 15:00:44.309606 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:44.309438    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rtkvg\" (UniqueName: \"kubernetes.io/projected/06209136-eb4e-43c1-a481-dae591bdc5ac-kube-api-access-rtkvg\") pod \"odh-model-controller-858dbf95b8-kg5l7\" (UID: \"06209136-eb4e-43c1-a481-dae591bdc5ac\") " pod="opendatahub/odh-model-controller-858dbf95b8-kg5l7"
May 28 15:00:44.411475 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:44.410992    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/06209136-eb4e-43c1-a481-dae591bdc5ac-cert\") pod \"odh-model-controller-858dbf95b8-kg5l7\" (UID: \"06209136-eb4e-43c1-a481-dae591bdc5ac\") " pod="opendatahub/odh-model-controller-858dbf95b8-kg5l7"
May 28 15:00:44.411475 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:44.411076    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rtkvg\" (UniqueName: \"kubernetes.io/projected/06209136-eb4e-43c1-a481-dae591bdc5ac-kube-api-access-rtkvg\") pod \"odh-model-controller-858dbf95b8-kg5l7\" (UID: \"06209136-eb4e-43c1-a481-dae591bdc5ac\") " pod="opendatahub/odh-model-controller-858dbf95b8-kg5l7"
May 28 15:00:44.411475 ip-10-0-137-84 kubenswrapper[2563]: E0528 15:00:44.411129    2563 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
May 28 15:00:44.411475 ip-10-0-137-84 kubenswrapper[2563]: E0528 15:00:44.411208    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/06209136-eb4e-43c1-a481-dae591bdc5ac-cert podName:06209136-eb4e-43c1-a481-dae591bdc5ac nodeName:}" failed. No retries permitted until 2026-05-28 15:00:44.911185516 +0000 UTC m=+465.000402220 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/06209136-eb4e-43c1-a481-dae591bdc5ac-cert") pod "odh-model-controller-858dbf95b8-kg5l7" (UID: "06209136-eb4e-43c1-a481-dae591bdc5ac") : secret "odh-model-controller-webhook-cert" not found
May 28 15:00:44.419795 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:44.419762    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rtkvg\" (UniqueName: \"kubernetes.io/projected/06209136-eb4e-43c1-a481-dae591bdc5ac-kube-api-access-rtkvg\") pod \"odh-model-controller-858dbf95b8-kg5l7\" (UID: \"06209136-eb4e-43c1-a481-dae591bdc5ac\") " pod="opendatahub/odh-model-controller-858dbf95b8-kg5l7"
May 28 15:00:44.917137 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:44.917103    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/06209136-eb4e-43c1-a481-dae591bdc5ac-cert\") pod \"odh-model-controller-858dbf95b8-kg5l7\" (UID: \"06209136-eb4e-43c1-a481-dae591bdc5ac\") " pod="opendatahub/odh-model-controller-858dbf95b8-kg5l7"
May 28 15:00:44.919396 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:44.919377    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/06209136-eb4e-43c1-a481-dae591bdc5ac-cert\") pod \"odh-model-controller-858dbf95b8-kg5l7\" (UID: \"06209136-eb4e-43c1-a481-dae591bdc5ac\") " pod="opendatahub/odh-model-controller-858dbf95b8-kg5l7"
May 28 15:00:45.071666 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:45.071639    2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835nbx98"
May 28 15:00:45.111448 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:45.111413    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-858dbf95b8-kg5l7"
May 28 15:00:45.219380 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:45.219298    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/299108de-a459-44f6-9913-4e2530c49ad6-util\") pod \"299108de-a459-44f6-9913-4e2530c49ad6\" (UID: \"299108de-a459-44f6-9913-4e2530c49ad6\") "
May 28 15:00:45.219380 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:45.219353    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/299108de-a459-44f6-9913-4e2530c49ad6-bundle\") pod \"299108de-a459-44f6-9913-4e2530c49ad6\" (UID: \"299108de-a459-44f6-9913-4e2530c49ad6\") "
May 28 15:00:45.219585 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:45.219411    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2kpdm\" (UniqueName: \"kubernetes.io/projected/299108de-a459-44f6-9913-4e2530c49ad6-kube-api-access-2kpdm\") pod \"299108de-a459-44f6-9913-4e2530c49ad6\" (UID: \"299108de-a459-44f6-9913-4e2530c49ad6\") "
May 28 15:00:45.220482 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:45.220447    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/299108de-a459-44f6-9913-4e2530c49ad6-bundle" (OuterVolumeSpecName: "bundle") pod "299108de-a459-44f6-9913-4e2530c49ad6" (UID: "299108de-a459-44f6-9913-4e2530c49ad6"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 15:00:45.222032 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:45.222006    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/299108de-a459-44f6-9913-4e2530c49ad6-kube-api-access-2kpdm" (OuterVolumeSpecName: "kube-api-access-2kpdm") pod "299108de-a459-44f6-9913-4e2530c49ad6" (UID: "299108de-a459-44f6-9913-4e2530c49ad6"). InnerVolumeSpecName "kube-api-access-2kpdm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 15:00:45.227433 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:45.227402    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/299108de-a459-44f6-9913-4e2530c49ad6-util" (OuterVolumeSpecName: "util") pod "299108de-a459-44f6-9913-4e2530c49ad6" (UID: "299108de-a459-44f6-9913-4e2530c49ad6"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 15:00:45.320754 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:45.320713    2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/299108de-a459-44f6-9913-4e2530c49ad6-util\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
May 28 15:00:45.320754 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:45.320754    2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/299108de-a459-44f6-9913-4e2530c49ad6-bundle\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
May 28 15:00:45.320976 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:45.320769    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2kpdm\" (UniqueName: \"kubernetes.io/projected/299108de-a459-44f6-9913-4e2530c49ad6-kube-api-access-2kpdm\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
May 28 15:00:45.892183 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:45.892158    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-858dbf95b8-kg5l7"]
May 28 15:00:45.893830 ip-10-0-137-84 kubenswrapper[2563]: W0528 15:00:45.893802    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06209136_eb4e_43c1_a481_dae591bdc5ac.slice/crio-169561181ce08bc44f9f64b67312625c5d44a656736184808c211b893c7a5f04 WatchSource:0}: Error finding container 169561181ce08bc44f9f64b67312625c5d44a656736184808c211b893c7a5f04: Status 404 returned error can't find the container with id 169561181ce08bc44f9f64b67312625c5d44a656736184808c211b893c7a5f04
May 28 15:00:45.952178 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:45.952143    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5fc8d7b98d-zbcf8" event={"ID":"dedd0929-f9a8-4f36-b9b3-e33a9587f506","Type":"ContainerStarted","Data":"9338ea8b2fbbab36eed3943508bea1263018e0982a487156df5b2649074e1200"}
May 28 15:00:45.953330 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:45.953300    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-kg5l7" event={"ID":"06209136-eb4e-43c1-a481-dae591bdc5ac","Type":"ContainerStarted","Data":"169561181ce08bc44f9f64b67312625c5d44a656736184808c211b893c7a5f04"}
May 28 15:00:45.954827 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:45.954806    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835nbx98" event={"ID":"299108de-a459-44f6-9913-4e2530c49ad6","Type":"ContainerDied","Data":"0a9f805ed6f22cf1d054b59ccd37e08bb12c06ee655dff92c5bf830252b7f9c2"}
May 28 15:00:45.954827 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:45.954829    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0a9f805ed6f22cf1d054b59ccd37e08bb12c06ee655dff92c5bf830252b7f9c2"
May 28 15:00:45.954986 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:45.954845    2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835nbx98"
May 28 15:00:45.971381 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:45.971344    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5fc8d7b98d-zbcf8" podStartSLOduration=0.658377643 podStartE2EDuration="3.971330843s" podCreationTimestamp="2026-05-28 15:00:42 +0000 UTC" firstStartedPulling="2026-05-28 15:00:42.48218936 +0000 UTC m=+462.571406061" lastFinishedPulling="2026-05-28 15:00:45.795142545 +0000 UTC m=+465.884359261" observedRunningTime="2026-05-28 15:00:45.969841021 +0000 UTC m=+466.059057744" watchObservedRunningTime="2026-05-28 15:00:45.971330843 +0000 UTC m=+466.060547565"
May 28 15:00:48.967708 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:48.967594    2563 generic.go:358] "Generic (PLEG): container finished" podID="06209136-eb4e-43c1-a481-dae591bdc5ac" containerID="8bf33056f6589203aad7f6e83790a984938a41fd65efc38fbbbc24e562b9b1f7" exitCode=1
May 28 15:00:48.968170 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:48.967706    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-kg5l7" event={"ID":"06209136-eb4e-43c1-a481-dae591bdc5ac","Type":"ContainerDied","Data":"8bf33056f6589203aad7f6e83790a984938a41fd65efc38fbbbc24e562b9b1f7"}
May 28 15:00:48.968170 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:48.967953    2563 scope.go:117] "RemoveContainer" containerID="8bf33056f6589203aad7f6e83790a984938a41fd65efc38fbbbc24e562b9b1f7"
May 28 15:00:49.408716 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:49.408670    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-856948b99f-bdt6n"]
May 28 15:00:49.409179 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:49.409160    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="299108de-a459-44f6-9913-4e2530c49ad6" containerName="pull"
May 28 15:00:49.409230 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:49.409187    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="299108de-a459-44f6-9913-4e2530c49ad6" containerName="pull"
May 28 15:00:49.409230 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:49.409216    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="299108de-a459-44f6-9913-4e2530c49ad6" containerName="util"
May 28 15:00:49.409230 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:49.409225    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="299108de-a459-44f6-9913-4e2530c49ad6" containerName="util"
May 28 15:00:49.409317 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:49.409250    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="299108de-a459-44f6-9913-4e2530c49ad6" containerName="extract"
May 28 15:00:49.409317 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:49.409260    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="299108de-a459-44f6-9913-4e2530c49ad6" containerName="extract"
May 28 15:00:49.409379 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:49.409343    2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="299108de-a459-44f6-9913-4e2530c49ad6" containerName="extract"
May 28 15:00:49.411412 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:49.411391    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-856948b99f-bdt6n"
May 28 15:00:49.414091 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:49.414071    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-d7xp5\""
May 28 15:00:49.414189 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:49.414073    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
May 28 15:00:49.419149 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:49.419121    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-856948b99f-bdt6n"]
May 28 15:00:49.560742 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:49.560712    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/be160959-19f4-48e1-938d-9181823a2263-cert\") pod \"kserve-controller-manager-856948b99f-bdt6n\" (UID: \"be160959-19f4-48e1-938d-9181823a2263\") " pod="opendatahub/kserve-controller-manager-856948b99f-bdt6n"
May 28 15:00:49.560881 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:49.560845    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b6dnj\" (UniqueName: \"kubernetes.io/projected/be160959-19f4-48e1-938d-9181823a2263-kube-api-access-b6dnj\") pod \"kserve-controller-manager-856948b99f-bdt6n\" (UID: \"be160959-19f4-48e1-938d-9181823a2263\") " pod="opendatahub/kserve-controller-manager-856948b99f-bdt6n"
May 28 15:00:49.661864 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:49.661826    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-b6dnj\" (UniqueName: \"kubernetes.io/projected/be160959-19f4-48e1-938d-9181823a2263-kube-api-access-b6dnj\") pod \"kserve-controller-manager-856948b99f-bdt6n\" (UID: \"be160959-19f4-48e1-938d-9181823a2263\") " pod="opendatahub/kserve-controller-manager-856948b99f-bdt6n"
May 28 15:00:49.662026 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:49.661879    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/be160959-19f4-48e1-938d-9181823a2263-cert\") pod \"kserve-controller-manager-856948b99f-bdt6n\" (UID: \"be160959-19f4-48e1-938d-9181823a2263\") " pod="opendatahub/kserve-controller-manager-856948b99f-bdt6n"
May 28 15:00:49.662026 ip-10-0-137-84 kubenswrapper[2563]: E0528 15:00:49.661984    2563 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
May 28 15:00:49.662095 ip-10-0-137-84 kubenswrapper[2563]: E0528 15:00:49.662046    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be160959-19f4-48e1-938d-9181823a2263-cert podName:be160959-19f4-48e1-938d-9181823a2263 nodeName:}" failed. No retries permitted until 2026-05-28 15:00:50.162026469 +0000 UTC m=+470.251243169 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/be160959-19f4-48e1-938d-9181823a2263-cert") pod "kserve-controller-manager-856948b99f-bdt6n" (UID: "be160959-19f4-48e1-938d-9181823a2263") : secret "kserve-webhook-server-cert" not found
May 28 15:00:49.676851 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:49.676822    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b6dnj\" (UniqueName: \"kubernetes.io/projected/be160959-19f4-48e1-938d-9181823a2263-kube-api-access-b6dnj\") pod \"kserve-controller-manager-856948b99f-bdt6n\" (UID: \"be160959-19f4-48e1-938d-9181823a2263\") " pod="opendatahub/kserve-controller-manager-856948b99f-bdt6n"
May 28 15:00:49.973316 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:49.973232    2563 generic.go:358] "Generic (PLEG): container finished" podID="06209136-eb4e-43c1-a481-dae591bdc5ac" containerID="ed66a6033214cdb27b70d2360a8c8095a9f2f3d04d8174982b2938d3d8cbd4fe" exitCode=1
May 28 15:00:49.973732 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:49.973314    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-kg5l7" event={"ID":"06209136-eb4e-43c1-a481-dae591bdc5ac","Type":"ContainerDied","Data":"ed66a6033214cdb27b70d2360a8c8095a9f2f3d04d8174982b2938d3d8cbd4fe"}
May 28 15:00:49.973732 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:49.973362    2563 scope.go:117] "RemoveContainer" containerID="8bf33056f6589203aad7f6e83790a984938a41fd65efc38fbbbc24e562b9b1f7"
May 28 15:00:49.973732 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:49.973569    2563 scope.go:117] "RemoveContainer" containerID="ed66a6033214cdb27b70d2360a8c8095a9f2f3d04d8174982b2938d3d8cbd4fe"
May 28 15:00:49.973900 ip-10-0-137-84 kubenswrapper[2563]: E0528 15:00:49.973770    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=odh-model-controller-858dbf95b8-kg5l7_opendatahub(06209136-eb4e-43c1-a481-dae591bdc5ac)\"" pod="opendatahub/odh-model-controller-858dbf95b8-kg5l7" podUID="06209136-eb4e-43c1-a481-dae591bdc5ac"
May 28 15:00:50.166720 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:50.166654    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/be160959-19f4-48e1-938d-9181823a2263-cert\") pod \"kserve-controller-manager-856948b99f-bdt6n\" (UID: \"be160959-19f4-48e1-938d-9181823a2263\") " pod="opendatahub/kserve-controller-manager-856948b99f-bdt6n"
May 28 15:00:50.169006 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:50.168987    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/be160959-19f4-48e1-938d-9181823a2263-cert\") pod \"kserve-controller-manager-856948b99f-bdt6n\" (UID: \"be160959-19f4-48e1-938d-9181823a2263\") " pod="opendatahub/kserve-controller-manager-856948b99f-bdt6n"
May 28 15:00:50.354365 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:50.354326    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-856948b99f-bdt6n"
May 28 15:00:50.480472 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:50.480444    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-856948b99f-bdt6n"]
May 28 15:00:50.480837 ip-10-0-137-84 kubenswrapper[2563]: W0528 15:00:50.480812    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe160959_19f4_48e1_938d_9181823a2263.slice/crio-ac2fc5f57d058a0c421e7577e8e4e9cb82c4263dae6e55f72cb60c4c8cbb1dc2 WatchSource:0}: Error finding container ac2fc5f57d058a0c421e7577e8e4e9cb82c4263dae6e55f72cb60c4c8cbb1dc2: Status 404 returned error can't find the container with id ac2fc5f57d058a0c421e7577e8e4e9cb82c4263dae6e55f72cb60c4c8cbb1dc2
May 28 15:00:50.979425 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:50.979392    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-856948b99f-bdt6n" event={"ID":"be160959-19f4-48e1-938d-9181823a2263","Type":"ContainerStarted","Data":"ac2fc5f57d058a0c421e7577e8e4e9cb82c4263dae6e55f72cb60c4c8cbb1dc2"}
May 28 15:00:50.980987 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:50.980965    2563 scope.go:117] "RemoveContainer" containerID="ed66a6033214cdb27b70d2360a8c8095a9f2f3d04d8174982b2938d3d8cbd4fe"
May 28 15:00:50.981148 ip-10-0-137-84 kubenswrapper[2563]: E0528 15:00:50.981133    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=odh-model-controller-858dbf95b8-kg5l7_opendatahub(06209136-eb4e-43c1-a481-dae591bdc5ac)\"" pod="opendatahub/odh-model-controller-858dbf95b8-kg5l7" podUID="06209136-eb4e-43c1-a481-dae591bdc5ac"
May 28 15:00:53.993061 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:53.993022    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-856948b99f-bdt6n" event={"ID":"be160959-19f4-48e1-938d-9181823a2263","Type":"ContainerStarted","Data":"ff0ccec417cdc56ff224c77019dda21e48b2a0d1c2b0f697fda0fd7dffb00ed6"}
May 28 15:00:53.993471 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:53.993213    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-856948b99f-bdt6n"
May 28 15:00:54.080519 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:54.080465    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-856948b99f-bdt6n" podStartSLOduration=1.665971619 podStartE2EDuration="5.080451176s" podCreationTimestamp="2026-05-28 15:00:49 +0000 UTC" firstStartedPulling="2026-05-28 15:00:50.482098343 +0000 UTC m=+470.571315044" lastFinishedPulling="2026-05-28 15:00:53.896577896 +0000 UTC m=+473.985794601" observedRunningTime="2026-05-28 15:00:54.07923847 +0000 UTC m=+474.168455194" watchObservedRunningTime="2026-05-28 15:00:54.080451176 +0000 UTC m=+474.169667899"
May 28 15:00:54.745812 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:54.745779    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ajzf5t"]
May 28 15:00:54.749470 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:54.749454    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ajzf5t"
May 28 15:00:54.752266 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:54.752246    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
May 28 15:00:54.752383 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:54.752244    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
May 28 15:00:54.752383 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:54.752248    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-6gg56\""
May 28 15:00:54.761291 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:54.761266    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ajzf5t"]
May 28 15:00:54.904559 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:54.904510    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tbzzw\" (UniqueName: \"kubernetes.io/projected/23fcf69a-8201-4b99-be74-2a8a261d93e1-kube-api-access-tbzzw\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ajzf5t\" (UID: \"23fcf69a-8201-4b99-be74-2a8a261d93e1\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ajzf5t"
May 28 15:00:54.904775 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:54.904589    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/23fcf69a-8201-4b99-be74-2a8a261d93e1-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ajzf5t\" (UID: \"23fcf69a-8201-4b99-be74-2a8a261d93e1\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ajzf5t"
May 28 15:00:54.904775 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:54.904640    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/23fcf69a-8201-4b99-be74-2a8a261d93e1-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ajzf5t\" (UID: \"23fcf69a-8201-4b99-be74-2a8a261d93e1\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ajzf5t"
May 28 15:00:55.005555 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:55.005470    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/23fcf69a-8201-4b99-be74-2a8a261d93e1-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ajzf5t\" (UID: \"23fcf69a-8201-4b99-be74-2a8a261d93e1\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ajzf5t"
May 28 15:00:55.005555 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:55.005530    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tbzzw\" (UniqueName: \"kubernetes.io/projected/23fcf69a-8201-4b99-be74-2a8a261d93e1-kube-api-access-tbzzw\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ajzf5t\" (UID: \"23fcf69a-8201-4b99-be74-2a8a261d93e1\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ajzf5t"
May 28 15:00:55.005963 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:55.005586    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/23fcf69a-8201-4b99-be74-2a8a261d93e1-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ajzf5t\" (UID: \"23fcf69a-8201-4b99-be74-2a8a261d93e1\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ajzf5t"
May 28 15:00:55.005963 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:55.005943    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/23fcf69a-8201-4b99-be74-2a8a261d93e1-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ajzf5t\" (UID: \"23fcf69a-8201-4b99-be74-2a8a261d93e1\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ajzf5t"
May 28 15:00:55.005963 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:55.005957    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/23fcf69a-8201-4b99-be74-2a8a261d93e1-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ajzf5t\" (UID: \"23fcf69a-8201-4b99-be74-2a8a261d93e1\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ajzf5t"
May 28 15:00:55.017519 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:55.017492    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tbzzw\" (UniqueName: \"kubernetes.io/projected/23fcf69a-8201-4b99-be74-2a8a261d93e1-kube-api-access-tbzzw\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ajzf5t\" (UID: \"23fcf69a-8201-4b99-be74-2a8a261d93e1\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ajzf5t"
May 28 15:00:55.058487 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:55.058448    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ajzf5t"
May 28 15:00:55.111584 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:55.111556    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-858dbf95b8-kg5l7"
May 28 15:00:55.112112 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:55.112094    2563 scope.go:117] "RemoveContainer" containerID="ed66a6033214cdb27b70d2360a8c8095a9f2f3d04d8174982b2938d3d8cbd4fe"
May 28 15:00:55.112421 ip-10-0-137-84 kubenswrapper[2563]: E0528 15:00:55.112349    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=odh-model-controller-858dbf95b8-kg5l7_opendatahub(06209136-eb4e-43c1-a481-dae591bdc5ac)\"" pod="opendatahub/odh-model-controller-858dbf95b8-kg5l7" podUID="06209136-eb4e-43c1-a481-dae591bdc5ac"
May 28 15:00:55.197063 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:55.197022    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ajzf5t"]
May 28 15:00:55.202434 ip-10-0-137-84 kubenswrapper[2563]: W0528 15:00:55.202402    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23fcf69a_8201_4b99_be74_2a8a261d93e1.slice/crio-11acdaa4e65c6ce48a5ea63a27e6a2eef27f5a3b0b79c45922acef2075cb09bb WatchSource:0}: Error finding container 11acdaa4e65c6ce48a5ea63a27e6a2eef27f5a3b0b79c45922acef2075cb09bb: Status 404 returned error can't find the container with id 11acdaa4e65c6ce48a5ea63a27e6a2eef27f5a3b0b79c45922acef2075cb09bb
May 28 15:00:56.002073 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:56.002031    2563 generic.go:358] "Generic (PLEG): container finished" podID="23fcf69a-8201-4b99-be74-2a8a261d93e1" containerID="92c7336fdfa13d9a84c5c9548c932cb4272a360e163e0ef4601a119982f4be87" exitCode=0
May 28 15:00:56.002279 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:56.002112    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ajzf5t" event={"ID":"23fcf69a-8201-4b99-be74-2a8a261d93e1","Type":"ContainerDied","Data":"92c7336fdfa13d9a84c5c9548c932cb4272a360e163e0ef4601a119982f4be87"}
May 28 15:00:56.002279 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:56.002137    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ajzf5t" event={"ID":"23fcf69a-8201-4b99-be74-2a8a261d93e1","Type":"ContainerStarted","Data":"11acdaa4e65c6ce48a5ea63a27e6a2eef27f5a3b0b79c45922acef2075cb09bb"}
May 28 15:00:56.165180 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:56.165140    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-zz7xz"]
May 28 15:00:56.168630 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:56.168612    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-55f49c5f94-zz7xz"
May 28 15:00:56.171222 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:56.171202    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-7ndcl\""
May 28 15:00:56.171340 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:56.171239    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\""
May 28 15:00:56.171340 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:56.171327    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\""
May 28 15:00:56.179453 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:56.179431    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-zz7xz"]
May 28 15:00:56.318669 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:56.318578    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/5205de65-cbf5-4422-a874-112f349be6c6-operator-config\") pod \"servicemesh-operator3-55f49c5f94-zz7xz\" (UID: \"5205de65-cbf5-4422-a874-112f349be6c6\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-zz7xz"
May 28 15:00:56.318669 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:56.318622    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8tgth\" (UniqueName: \"kubernetes.io/projected/5205de65-cbf5-4422-a874-112f349be6c6-kube-api-access-8tgth\") pod \"servicemesh-operator3-55f49c5f94-zz7xz\" (UID: \"5205de65-cbf5-4422-a874-112f349be6c6\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-zz7xz"
May 28 15:00:56.419359 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:56.419323    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/5205de65-cbf5-4422-a874-112f349be6c6-operator-config\") pod \"servicemesh-operator3-55f49c5f94-zz7xz\" (UID: \"5205de65-cbf5-4422-a874-112f349be6c6\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-zz7xz"
May 28 15:00:56.419515 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:56.419371    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8tgth\" (UniqueName: \"kubernetes.io/projected/5205de65-cbf5-4422-a874-112f349be6c6-kube-api-access-8tgth\") pod \"servicemesh-operator3-55f49c5f94-zz7xz\" (UID: \"5205de65-cbf5-4422-a874-112f349be6c6\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-zz7xz"
May 28 15:00:56.421835 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:56.421807    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/5205de65-cbf5-4422-a874-112f349be6c6-operator-config\") pod \"servicemesh-operator3-55f49c5f94-zz7xz\" (UID: \"5205de65-cbf5-4422-a874-112f349be6c6\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-zz7xz"
May 28 15:00:56.427794 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:56.427764    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8tgth\" (UniqueName: \"kubernetes.io/projected/5205de65-cbf5-4422-a874-112f349be6c6-kube-api-access-8tgth\") pod \"servicemesh-operator3-55f49c5f94-zz7xz\" (UID: \"5205de65-cbf5-4422-a874-112f349be6c6\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-zz7xz"
May 28 15:00:56.478195 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:56.478170    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-55f49c5f94-zz7xz"
May 28 15:00:56.615910 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:56.615884    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-zz7xz"]
May 28 15:00:56.618171 ip-10-0-137-84 kubenswrapper[2563]: W0528 15:00:56.618137    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5205de65_cbf5_4422_a874_112f349be6c6.slice/crio-4e3cb6a35307a329ac9397d2c123ca607e216df43e5a69eda5f228abd914ef62 WatchSource:0}: Error finding container 4e3cb6a35307a329ac9397d2c123ca607e216df43e5a69eda5f228abd914ef62: Status 404 returned error can't find the container with id 4e3cb6a35307a329ac9397d2c123ca607e216df43e5a69eda5f228abd914ef62
May 28 15:00:57.007038 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:57.007005    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-55f49c5f94-zz7xz" event={"ID":"5205de65-cbf5-4422-a874-112f349be6c6","Type":"ContainerStarted","Data":"4e3cb6a35307a329ac9397d2c123ca607e216df43e5a69eda5f228abd914ef62"}
May 28 15:00:58.013935 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:58.013901    2563 generic.go:358] "Generic (PLEG): container finished" podID="23fcf69a-8201-4b99-be74-2a8a261d93e1" containerID="828ed7423a614b3197213f1db402c14475bd563b6c26bc39c735d4fc2ba0f8c8" exitCode=0
May 28 15:00:58.014351 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:58.013956    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ajzf5t" event={"ID":"23fcf69a-8201-4b99-be74-2a8a261d93e1","Type":"ContainerDied","Data":"828ed7423a614b3197213f1db402c14475bd563b6c26bc39c735d4fc2ba0f8c8"}
May 28 15:00:59.020284 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:59.020248    2563 generic.go:358] "Generic (PLEG): container finished" podID="23fcf69a-8201-4b99-be74-2a8a261d93e1" containerID="74f5bef02bc97653a333b3c5b10fdf761a7dd67b3d51ef25e161e036732069d4" exitCode=0
May 28 15:00:59.020759 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:00:59.020329    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ajzf5t" event={"ID":"23fcf69a-8201-4b99-be74-2a8a261d93e1","Type":"ContainerDied","Data":"74f5bef02bc97653a333b3c5b10fdf761a7dd67b3d51ef25e161e036732069d4"}
May 28 15:01:00.155313 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:00.155288    2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ajzf5t"
May 28 15:01:00.256646 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:00.256608    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tbzzw\" (UniqueName: \"kubernetes.io/projected/23fcf69a-8201-4b99-be74-2a8a261d93e1-kube-api-access-tbzzw\") pod \"23fcf69a-8201-4b99-be74-2a8a261d93e1\" (UID: \"23fcf69a-8201-4b99-be74-2a8a261d93e1\") "
May 28 15:01:00.256646 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:00.256659    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/23fcf69a-8201-4b99-be74-2a8a261d93e1-bundle\") pod \"23fcf69a-8201-4b99-be74-2a8a261d93e1\" (UID: \"23fcf69a-8201-4b99-be74-2a8a261d93e1\") "
May 28 15:01:00.256927 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:00.256708    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/23fcf69a-8201-4b99-be74-2a8a261d93e1-util\") pod \"23fcf69a-8201-4b99-be74-2a8a261d93e1\" (UID: \"23fcf69a-8201-4b99-be74-2a8a261d93e1\") "
May 28 15:01:00.257535 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:00.257513    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/23fcf69a-8201-4b99-be74-2a8a261d93e1-bundle" (OuterVolumeSpecName: "bundle") pod "23fcf69a-8201-4b99-be74-2a8a261d93e1" (UID: "23fcf69a-8201-4b99-be74-2a8a261d93e1"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 15:01:00.259127 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:00.259097    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/23fcf69a-8201-4b99-be74-2a8a261d93e1-kube-api-access-tbzzw" (OuterVolumeSpecName: "kube-api-access-tbzzw") pod "23fcf69a-8201-4b99-be74-2a8a261d93e1" (UID: "23fcf69a-8201-4b99-be74-2a8a261d93e1"). InnerVolumeSpecName "kube-api-access-tbzzw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 15:01:00.264909 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:00.264880    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/23fcf69a-8201-4b99-be74-2a8a261d93e1-util" (OuterVolumeSpecName: "util") pod "23fcf69a-8201-4b99-be74-2a8a261d93e1" (UID: "23fcf69a-8201-4b99-be74-2a8a261d93e1"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 15:01:00.357846 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:00.357768    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tbzzw\" (UniqueName: \"kubernetes.io/projected/23fcf69a-8201-4b99-be74-2a8a261d93e1-kube-api-access-tbzzw\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
May 28 15:01:00.357846 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:00.357803    2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/23fcf69a-8201-4b99-be74-2a8a261d93e1-bundle\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
May 28 15:01:00.357846 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:00.357818    2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/23fcf69a-8201-4b99-be74-2a8a261d93e1-util\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
May 28 15:01:01.030045 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:01.030007    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ajzf5t" event={"ID":"23fcf69a-8201-4b99-be74-2a8a261d93e1","Type":"ContainerDied","Data":"11acdaa4e65c6ce48a5ea63a27e6a2eef27f5a3b0b79c45922acef2075cb09bb"}
May 28 15:01:01.030045 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:01.030046    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="11acdaa4e65c6ce48a5ea63a27e6a2eef27f5a3b0b79c45922acef2075cb09bb"
May 28 15:01:01.030253 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:01.030056    2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ajzf5t"
May 28 15:01:03.041513 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:03.041474    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-55f49c5f94-zz7xz" event={"ID":"5205de65-cbf5-4422-a874-112f349be6c6","Type":"ContainerStarted","Data":"7747034e29ef14547eb8662aecd2eb17037d8014fa8052ba5e5d4bd981603111"}
May 28 15:01:03.041915 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:03.041614    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-55f49c5f94-zz7xz"
May 28 15:01:03.063324 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:03.063272    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-55f49c5f94-zz7xz" podStartSLOduration=1.488465651 podStartE2EDuration="7.063258028s" podCreationTimestamp="2026-05-28 15:00:56 +0000 UTC" firstStartedPulling="2026-05-28 15:00:56.620626397 +0000 UTC m=+476.709843099" lastFinishedPulling="2026-05-28 15:01:02.195418766 +0000 UTC m=+482.284635476" observedRunningTime="2026-05-28 15:01:03.06146967 +0000 UTC m=+483.150686394" watchObservedRunningTime="2026-05-28 15:01:03.063258028 +0000 UTC m=+483.152474750"
May 28 15:01:05.111769 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:05.111740    2563 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="opendatahub/odh-model-controller-858dbf95b8-kg5l7"
May 28 15:01:05.112154 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:05.112139    2563 scope.go:117] "RemoveContainer" containerID="ed66a6033214cdb27b70d2360a8c8095a9f2f3d04d8174982b2938d3d8cbd4fe"
May 28 15:01:06.056193 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:06.056157    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-kg5l7" event={"ID":"06209136-eb4e-43c1-a481-dae591bdc5ac","Type":"ContainerStarted","Data":"7d0759a569de1d450bef3eed2375f735fbf7c5732508370bfb958ff13e3d4752"}
May 28 15:01:06.056403 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:06.056386    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-858dbf95b8-kg5l7"
May 28 15:01:06.072653 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:06.072600    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/odh-model-controller-858dbf95b8-kg5l7" podStartSLOduration=2.590303736 podStartE2EDuration="22.072587159s" podCreationTimestamp="2026-05-28 15:00:44 +0000 UTC" firstStartedPulling="2026-05-28 15:00:45.895179615 +0000 UTC m=+465.984396320" lastFinishedPulling="2026-05-28 15:01:05.377463028 +0000 UTC m=+485.466679743" observedRunningTime="2026-05-28 15:01:06.071740918 +0000 UTC m=+486.160957641" watchObservedRunningTime="2026-05-28 15:01:06.072587159 +0000 UTC m=+486.161803903"
May 28 15:01:11.418693 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:11.418634    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-6l4qq"]
May 28 15:01:11.419070 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:11.419016    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="23fcf69a-8201-4b99-be74-2a8a261d93e1" containerName="util"
May 28 15:01:11.419070 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:11.419030    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="23fcf69a-8201-4b99-be74-2a8a261d93e1" containerName="util"
May 28 15:01:11.419070 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:11.419045    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="23fcf69a-8201-4b99-be74-2a8a261d93e1" containerName="extract"
May 28 15:01:11.419070 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:11.419051    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="23fcf69a-8201-4b99-be74-2a8a261d93e1" containerName="extract"
May 28 15:01:11.419070 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:11.419068    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="23fcf69a-8201-4b99-be74-2a8a261d93e1" containerName="pull"
May 28 15:01:11.419222 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:11.419076    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="23fcf69a-8201-4b99-be74-2a8a261d93e1" containerName="pull"
May 28 15:01:11.419222 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:11.419129    2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="23fcf69a-8201-4b99-be74-2a8a261d93e1" containerName="extract"
May 28 15:01:11.421931 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:11.421911    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-6l4qq"
May 28 15:01:11.424921 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:11.424894    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
May 28 15:01:11.424921 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:11.424915    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
May 28 15:01:11.425115 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:11.424949    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
May 28 15:01:11.425115 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:11.424919    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-86kzj\""
May 28 15:01:11.425115 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:11.424906    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
May 28 15:01:11.433325 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:11.433300    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-6l4qq"]
May 28 15:01:11.449369 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:11.449338    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/25884d71-fd2b-45a7-9018-6fda36c71e54-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-6l4qq\" (UID: \"25884d71-fd2b-45a7-9018-6fda36c71e54\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-6l4qq"
May 28 15:01:11.449555 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:11.449380    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/25884d71-fd2b-45a7-9018-6fda36c71e54-local-certs\") pod \"istiod-openshift-gateway-798958bb55-6l4qq\" (UID: \"25884d71-fd2b-45a7-9018-6fda36c71e54\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-6l4qq"
May 28 15:01:11.449555 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:11.449399    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q5ftd\" (UniqueName: \"kubernetes.io/projected/25884d71-fd2b-45a7-9018-6fda36c71e54-kube-api-access-q5ftd\") pod \"istiod-openshift-gateway-798958bb55-6l4qq\" (UID: \"25884d71-fd2b-45a7-9018-6fda36c71e54\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-6l4qq"
May 28 15:01:11.449555 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:11.449462    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/25884d71-fd2b-45a7-9018-6fda36c71e54-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-6l4qq\" (UID: \"25884d71-fd2b-45a7-9018-6fda36c71e54\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-6l4qq"
May 28 15:01:11.449555 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:11.449491    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/25884d71-fd2b-45a7-9018-6fda36c71e54-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-6l4qq\" (UID: \"25884d71-fd2b-45a7-9018-6fda36c71e54\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-6l4qq"
May 28 15:01:11.449555 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:11.449511    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/25884d71-fd2b-45a7-9018-6fda36c71e54-cacerts\") pod \"istiod-openshift-gateway-798958bb55-6l4qq\" (UID: \"25884d71-fd2b-45a7-9018-6fda36c71e54\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-6l4qq"
May 28 15:01:11.449555 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:11.449535    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/25884d71-fd2b-45a7-9018-6fda36c71e54-istio-token\") pod \"istiod-openshift-gateway-798958bb55-6l4qq\" (UID: \"25884d71-fd2b-45a7-9018-6fda36c71e54\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-6l4qq"
May 28 15:01:11.550306 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:11.550266    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/25884d71-fd2b-45a7-9018-6fda36c71e54-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-6l4qq\" (UID: \"25884d71-fd2b-45a7-9018-6fda36c71e54\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-6l4qq"
May 28 15:01:11.550461 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:11.550325    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/25884d71-fd2b-45a7-9018-6fda36c71e54-local-certs\") pod \"istiod-openshift-gateway-798958bb55-6l4qq\" (UID: \"25884d71-fd2b-45a7-9018-6fda36c71e54\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-6l4qq"
May 28 15:01:11.550461 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:11.550350    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-q5ftd\" (UniqueName: \"kubernetes.io/projected/25884d71-fd2b-45a7-9018-6fda36c71e54-kube-api-access-q5ftd\") pod \"istiod-openshift-gateway-798958bb55-6l4qq\" (UID: \"25884d71-fd2b-45a7-9018-6fda36c71e54\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-6l4qq"
May 28 15:01:11.550461 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:11.550432    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/25884d71-fd2b-45a7-9018-6fda36c71e54-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-6l4qq\" (UID: \"25884d71-fd2b-45a7-9018-6fda36c71e54\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-6l4qq"
May 28 15:01:11.550638 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:11.550482    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/25884d71-fd2b-45a7-9018-6fda36c71e54-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-6l4qq\" (UID: \"25884d71-fd2b-45a7-9018-6fda36c71e54\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-6l4qq"
May 28 15:01:11.550638 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:11.550514    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/25884d71-fd2b-45a7-9018-6fda36c71e54-cacerts\") pod \"istiod-openshift-gateway-798958bb55-6l4qq\" (UID: \"25884d71-fd2b-45a7-9018-6fda36c71e54\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-6l4qq"
May 28 15:01:11.550638 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:11.550575    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/25884d71-fd2b-45a7-9018-6fda36c71e54-istio-token\") pod \"istiod-openshift-gateway-798958bb55-6l4qq\" (UID: \"25884d71-fd2b-45a7-9018-6fda36c71e54\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-6l4qq"
May 28 15:01:11.551233 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:11.551192    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/25884d71-fd2b-45a7-9018-6fda36c71e54-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-6l4qq\" (UID: \"25884d71-fd2b-45a7-9018-6fda36c71e54\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-6l4qq"
May 28 15:01:11.552723 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:11.552698    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/25884d71-fd2b-45a7-9018-6fda36c71e54-local-certs\") pod \"istiod-openshift-gateway-798958bb55-6l4qq\" (UID: \"25884d71-fd2b-45a7-9018-6fda36c71e54\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-6l4qq"
May 28 15:01:11.552861 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:11.552830    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/25884d71-fd2b-45a7-9018-6fda36c71e54-cacerts\") pod \"istiod-openshift-gateway-798958bb55-6l4qq\" (UID: \"25884d71-fd2b-45a7-9018-6fda36c71e54\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-6l4qq"
May 28 15:01:11.553061 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:11.553041    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/25884d71-fd2b-45a7-9018-6fda36c71e54-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-6l4qq\" (UID: \"25884d71-fd2b-45a7-9018-6fda36c71e54\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-6l4qq"
May 28 15:01:11.553104 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:11.553089    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/25884d71-fd2b-45a7-9018-6fda36c71e54-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-6l4qq\" (UID: \"25884d71-fd2b-45a7-9018-6fda36c71e54\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-6l4qq"
May 28 15:01:11.557721 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:11.557700    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/25884d71-fd2b-45a7-9018-6fda36c71e54-istio-token\") pod \"istiod-openshift-gateway-798958bb55-6l4qq\" (UID: \"25884d71-fd2b-45a7-9018-6fda36c71e54\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-6l4qq"
May 28 15:01:11.557970 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:11.557952    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q5ftd\" (UniqueName: \"kubernetes.io/projected/25884d71-fd2b-45a7-9018-6fda36c71e54-kube-api-access-q5ftd\") pod \"istiod-openshift-gateway-798958bb55-6l4qq\" (UID: \"25884d71-fd2b-45a7-9018-6fda36c71e54\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-6l4qq"
May 28 15:01:11.733082 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:11.732982    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-6l4qq"
May 28 15:01:11.876102 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:11.876059    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-6l4qq"]
May 28 15:01:11.878993 ip-10-0-137-84 kubenswrapper[2563]: W0528 15:01:11.878960    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25884d71_fd2b_45a7_9018_6fda36c71e54.slice/crio-852f6e1367fc3322f97c42472587c2424fda8e8fdffe1a5c5101186ada7d3989 WatchSource:0}: Error finding container 852f6e1367fc3322f97c42472587c2424fda8e8fdffe1a5c5101186ada7d3989: Status 404 returned error can't find the container with id 852f6e1367fc3322f97c42472587c2424fda8e8fdffe1a5c5101186ada7d3989
May 28 15:01:12.081170 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:12.081134    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-6l4qq" event={"ID":"25884d71-fd2b-45a7-9018-6fda36c71e54","Type":"ContainerStarted","Data":"852f6e1367fc3322f97c42472587c2424fda8e8fdffe1a5c5101186ada7d3989"}
May 28 15:01:14.048148 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:14.048101    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-55f49c5f94-zz7xz"
May 28 15:01:14.381237 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:14.381192    2563 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
May 28 15:01:14.381386 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:14.381291    2563 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
May 28 15:01:15.101584 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:15.101550    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-6l4qq" event={"ID":"25884d71-fd2b-45a7-9018-6fda36c71e54","Type":"ContainerStarted","Data":"c24a6f267c273f6639654d6ea23062ab757d6798170b41d5af790bda67422317"}
May 28 15:01:15.102049 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:15.101741    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-6l4qq"
May 28 15:01:15.103408 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:15.103377    2563 patch_prober.go:28] interesting pod/istiod-openshift-gateway-798958bb55-6l4qq container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
May 28 15:01:15.103513 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:15.103436    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-6l4qq" podUID="25884d71-fd2b-45a7-9018-6fda36c71e54" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 28 15:01:15.131474 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:15.131422    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-6l4qq" podStartSLOduration=1.631998005 podStartE2EDuration="4.131406088s" podCreationTimestamp="2026-05-28 15:01:11 +0000 UTC" firstStartedPulling="2026-05-28 15:01:11.881510201 +0000 UTC m=+491.970726907" lastFinishedPulling="2026-05-28 15:01:14.380918285 +0000 UTC m=+494.470134990" observedRunningTime="2026-05-28 15:01:15.129349916 +0000 UTC m=+495.218566640" watchObservedRunningTime="2026-05-28 15:01:15.131406088 +0000 UTC m=+495.220622810"
May 28 15:01:16.106900 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:16.106865    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-6l4qq"
May 28 15:01:17.061409 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:17.061369    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-858dbf95b8-kg5l7"
May 28 15:01:25.002612 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:25.002582    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-856948b99f-bdt6n"
May 28 15:01:51.833137 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:51.833049    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cd6wx"]
May 28 15:01:51.841745 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:51.841720    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cd6wx"
May 28 15:01:51.844258 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:51.844235    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-5frlp\""
May 28 15:01:51.844518 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:51.844500    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
May 28 15:01:51.844613 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:51.844586    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cd6wx"]
May 28 15:01:51.845310 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:51.845284    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
May 28 15:01:51.915169 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:51.915136    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/694ffbd0-047e-41db-8553-72d8dc15bc1e-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cd6wx\" (UID: \"694ffbd0-047e-41db-8553-72d8dc15bc1e\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cd6wx"
May 28 15:01:51.915321 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:51.915175    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/694ffbd0-047e-41db-8553-72d8dc15bc1e-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cd6wx\" (UID: \"694ffbd0-047e-41db-8553-72d8dc15bc1e\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cd6wx"
May 28 15:01:51.915321 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:51.915237    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bq4cv\" (UniqueName: \"kubernetes.io/projected/694ffbd0-047e-41db-8553-72d8dc15bc1e-kube-api-access-bq4cv\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cd6wx\" (UID: \"694ffbd0-047e-41db-8553-72d8dc15bc1e\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cd6wx"
May 28 15:01:52.016234 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:52.016198    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bq4cv\" (UniqueName: \"kubernetes.io/projected/694ffbd0-047e-41db-8553-72d8dc15bc1e-kube-api-access-bq4cv\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cd6wx\" (UID: \"694ffbd0-047e-41db-8553-72d8dc15bc1e\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cd6wx"
May 28 15:01:52.016411 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:52.016272    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/694ffbd0-047e-41db-8553-72d8dc15bc1e-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cd6wx\" (UID: \"694ffbd0-047e-41db-8553-72d8dc15bc1e\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cd6wx"
May 28 15:01:52.016411 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:52.016296    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/694ffbd0-047e-41db-8553-72d8dc15bc1e-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cd6wx\" (UID: \"694ffbd0-047e-41db-8553-72d8dc15bc1e\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cd6wx"
May 28 15:01:52.016641 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:52.016623    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/694ffbd0-047e-41db-8553-72d8dc15bc1e-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cd6wx\" (UID: \"694ffbd0-047e-41db-8553-72d8dc15bc1e\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cd6wx"
May 28 15:01:52.016726 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:52.016668    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/694ffbd0-047e-41db-8553-72d8dc15bc1e-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cd6wx\" (UID: \"694ffbd0-047e-41db-8553-72d8dc15bc1e\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cd6wx"
May 28 15:01:52.024942 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:52.024918    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bq4cv\" (UniqueName: \"kubernetes.io/projected/694ffbd0-047e-41db-8553-72d8dc15bc1e-kube-api-access-bq4cv\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cd6wx\" (UID: \"694ffbd0-047e-41db-8553-72d8dc15bc1e\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cd6wx"
May 28 15:01:52.151606 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:52.151527    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cd6wx"
May 28 15:01:52.239694 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:52.239653    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73g2hn6"]
May 28 15:01:52.250841 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:52.249483    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73g2hn6"
May 28 15:01:52.257892 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:52.257311    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73g2hn6"]
May 28 15:01:52.305199 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:52.305176    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cd6wx"]
May 28 15:01:52.307772 ip-10-0-137-84 kubenswrapper[2563]: W0528 15:01:52.307742    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod694ffbd0_047e_41db_8553_72d8dc15bc1e.slice/crio-4f95d9ac7cf629ed361af717dcaff8e8c623d1c595e16a8f16010d068de84bd9 WatchSource:0}: Error finding container 4f95d9ac7cf629ed361af717dcaff8e8c623d1c595e16a8f16010d068de84bd9: Status 404 returned error can't find the container with id 4f95d9ac7cf629ed361af717dcaff8e8c623d1c595e16a8f16010d068de84bd9
May 28 15:01:52.320833 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:52.320808    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b6793a01-9a5f-4b68-a3e6-b0595698f194-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73g2hn6\" (UID: \"b6793a01-9a5f-4b68-a3e6-b0595698f194\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73g2hn6"
May 28 15:01:52.320966 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:52.320855    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b6793a01-9a5f-4b68-a3e6-b0595698f194-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73g2hn6\" (UID: \"b6793a01-9a5f-4b68-a3e6-b0595698f194\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73g2hn6"
May 28 15:01:52.320966 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:52.320901    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t9vmd\" (UniqueName: \"kubernetes.io/projected/b6793a01-9a5f-4b68-a3e6-b0595698f194-kube-api-access-t9vmd\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73g2hn6\" (UID: \"b6793a01-9a5f-4b68-a3e6-b0595698f194\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73g2hn6"
May 28 15:01:52.421561 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:52.421524    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b6793a01-9a5f-4b68-a3e6-b0595698f194-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73g2hn6\" (UID: \"b6793a01-9a5f-4b68-a3e6-b0595698f194\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73g2hn6"
May 28 15:01:52.421671 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:52.421598    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b6793a01-9a5f-4b68-a3e6-b0595698f194-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73g2hn6\" (UID: \"b6793a01-9a5f-4b68-a3e6-b0595698f194\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73g2hn6"
May 28 15:01:52.421671 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:52.421662    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t9vmd\" (UniqueName: \"kubernetes.io/projected/b6793a01-9a5f-4b68-a3e6-b0595698f194-kube-api-access-t9vmd\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73g2hn6\" (UID: \"b6793a01-9a5f-4b68-a3e6-b0595698f194\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73g2hn6"
May 28 15:01:52.421984 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:52.421961    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b6793a01-9a5f-4b68-a3e6-b0595698f194-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73g2hn6\" (UID: \"b6793a01-9a5f-4b68-a3e6-b0595698f194\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73g2hn6"
May 28 15:01:52.422203 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:52.422186    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b6793a01-9a5f-4b68-a3e6-b0595698f194-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73g2hn6\" (UID: \"b6793a01-9a5f-4b68-a3e6-b0595698f194\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73g2hn6"
May 28 15:01:52.430925 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:52.430903    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t9vmd\" (UniqueName: \"kubernetes.io/projected/b6793a01-9a5f-4b68-a3e6-b0595698f194-kube-api-access-t9vmd\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73g2hn6\" (UID: \"b6793a01-9a5f-4b68-a3e6-b0595698f194\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73g2hn6"
May 28 15:01:52.564158 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:52.564119    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73g2hn6"
May 28 15:01:52.638614 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:52.638585    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17f9nc"]
May 28 15:01:52.644375 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:52.644346    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17f9nc"
May 28 15:01:52.651792 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:52.651533    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17f9nc"]
May 28 15:01:52.698288 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:52.698262    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73g2hn6"]
May 28 15:01:52.699754 ip-10-0-137-84 kubenswrapper[2563]: W0528 15:01:52.699731    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6793a01_9a5f_4b68_a3e6_b0595698f194.slice/crio-de9407237f0ee4b97d09d6b9a4f43005613f9df00a3f5a1bf3f0d2d28c1c7a37 WatchSource:0}: Error finding container de9407237f0ee4b97d09d6b9a4f43005613f9df00a3f5a1bf3f0d2d28c1c7a37: Status 404 returned error can't find the container with id de9407237f0ee4b97d09d6b9a4f43005613f9df00a3f5a1bf3f0d2d28c1c7a37
May 28 15:01:52.724562 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:52.724538    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8b3dc7ba-da07-48ea-a8fb-cfc5c37001b9-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17f9nc\" (UID: \"8b3dc7ba-da07-48ea-a8fb-cfc5c37001b9\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17f9nc"
May 28 15:01:52.724710 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:52.724624    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8b3dc7ba-da07-48ea-a8fb-cfc5c37001b9-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17f9nc\" (UID: \"8b3dc7ba-da07-48ea-a8fb-cfc5c37001b9\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17f9nc"
May 28 15:01:52.724710 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:52.724665    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v4d9v\" (UniqueName: \"kubernetes.io/projected/8b3dc7ba-da07-48ea-a8fb-cfc5c37001b9-kube-api-access-v4d9v\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17f9nc\" (UID: \"8b3dc7ba-da07-48ea-a8fb-cfc5c37001b9\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17f9nc"
May 28 15:01:52.825351 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:52.825319    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8b3dc7ba-da07-48ea-a8fb-cfc5c37001b9-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17f9nc\" (UID: \"8b3dc7ba-da07-48ea-a8fb-cfc5c37001b9\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17f9nc"
May 28 15:01:52.825476 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:52.825359    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-v4d9v\" (UniqueName: \"kubernetes.io/projected/8b3dc7ba-da07-48ea-a8fb-cfc5c37001b9-kube-api-access-v4d9v\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17f9nc\" (UID: \"8b3dc7ba-da07-48ea-a8fb-cfc5c37001b9\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17f9nc"
May 28 15:01:52.825476 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:52.825401    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8b3dc7ba-da07-48ea-a8fb-cfc5c37001b9-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17f9nc\" (UID: \"8b3dc7ba-da07-48ea-a8fb-cfc5c37001b9\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17f9nc"
May 28 15:01:52.825761 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:52.825740    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8b3dc7ba-da07-48ea-a8fb-cfc5c37001b9-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17f9nc\" (UID: \"8b3dc7ba-da07-48ea-a8fb-cfc5c37001b9\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17f9nc"
May 28 15:01:52.825809 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:52.825745    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8b3dc7ba-da07-48ea-a8fb-cfc5c37001b9-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17f9nc\" (UID: \"8b3dc7ba-da07-48ea-a8fb-cfc5c37001b9\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17f9nc"
May 28 15:01:52.833822 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:52.833798    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v4d9v\" (UniqueName: \"kubernetes.io/projected/8b3dc7ba-da07-48ea-a8fb-cfc5c37001b9-kube-api-access-v4d9v\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17f9nc\" (UID: \"8b3dc7ba-da07-48ea-a8fb-cfc5c37001b9\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17f9nc"
May 28 15:01:52.958089 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:52.957987    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17f9nc"
May 28 15:01:53.084430 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:53.084402    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17f9nc"]
May 28 15:01:53.086305 ip-10-0-137-84 kubenswrapper[2563]: W0528 15:01:53.086271    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b3dc7ba_da07_48ea_a8fb_cfc5c37001b9.slice/crio-80e0b1ebefd3ececec0d1382bb961c1189d43594d104d191fc14acf39396ee30 WatchSource:0}: Error finding container 80e0b1ebefd3ececec0d1382bb961c1189d43594d104d191fc14acf39396ee30: Status 404 returned error can't find the container with id 80e0b1ebefd3ececec0d1382bb961c1189d43594d104d191fc14acf39396ee30
May 28 15:01:53.232670 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:53.232603    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b42xm"]
May 28 15:01:53.236211 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:53.236189    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b42xm"
May 28 15:01:53.243320 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:53.243294    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b42xm"]
May 28 15:01:53.262474 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:53.262447    2563 generic.go:358] "Generic (PLEG): container finished" podID="694ffbd0-047e-41db-8553-72d8dc15bc1e" containerID="b3509671533c318fe28a305534d1ece1a06af8c12e55f9770a4213740178e2b4" exitCode=0
May 28 15:01:53.262595 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:53.262502    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cd6wx" event={"ID":"694ffbd0-047e-41db-8553-72d8dc15bc1e","Type":"ContainerDied","Data":"b3509671533c318fe28a305534d1ece1a06af8c12e55f9770a4213740178e2b4"}
May 28 15:01:53.262595 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:53.262545    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cd6wx" event={"ID":"694ffbd0-047e-41db-8553-72d8dc15bc1e","Type":"ContainerStarted","Data":"4f95d9ac7cf629ed361af717dcaff8e8c623d1c595e16a8f16010d068de84bd9"}
May 28 15:01:53.264028 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:53.264008    2563 generic.go:358] "Generic (PLEG): container finished" podID="8b3dc7ba-da07-48ea-a8fb-cfc5c37001b9" containerID="d336bf7fb5de64b34d2cfc2b226332968567b7c2a92ac3620fb17e1ee1e33dff" exitCode=0
May 28 15:01:53.264111 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:53.264094    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17f9nc" event={"ID":"8b3dc7ba-da07-48ea-a8fb-cfc5c37001b9","Type":"ContainerDied","Data":"d336bf7fb5de64b34d2cfc2b226332968567b7c2a92ac3620fb17e1ee1e33dff"}
May 28 15:01:53.264163 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:53.264123    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17f9nc" event={"ID":"8b3dc7ba-da07-48ea-a8fb-cfc5c37001b9","Type":"ContainerStarted","Data":"80e0b1ebefd3ececec0d1382bb961c1189d43594d104d191fc14acf39396ee30"}
May 28 15:01:53.265582 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:53.265551    2563 generic.go:358] "Generic (PLEG): container finished" podID="b6793a01-9a5f-4b68-a3e6-b0595698f194" containerID="569b136afd7cc09c1cbc6e485284c15ee1fac3344b79d01f32f0cb990f200e86" exitCode=0
May 28 15:01:53.265660 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:53.265584    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73g2hn6" event={"ID":"b6793a01-9a5f-4b68-a3e6-b0595698f194","Type":"ContainerDied","Data":"569b136afd7cc09c1cbc6e485284c15ee1fac3344b79d01f32f0cb990f200e86"}
May 28 15:01:53.265660 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:53.265619    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73g2hn6" event={"ID":"b6793a01-9a5f-4b68-a3e6-b0595698f194","Type":"ContainerStarted","Data":"de9407237f0ee4b97d09d6b9a4f43005613f9df00a3f5a1bf3f0d2d28c1c7a37"}
May 28 15:01:53.328748 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:53.328717    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b64e35a1-749b-41f5-a3de-10a9207863a2-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b42xm\" (UID: \"b64e35a1-749b-41f5-a3de-10a9207863a2\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b42xm"
May 28 15:01:53.328927 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:53.328848    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x6d6z\" (UniqueName: \"kubernetes.io/projected/b64e35a1-749b-41f5-a3de-10a9207863a2-kube-api-access-x6d6z\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b42xm\" (UID: \"b64e35a1-749b-41f5-a3de-10a9207863a2\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b42xm"
May 28 15:01:53.328987 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:53.328968    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b64e35a1-749b-41f5-a3de-10a9207863a2-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b42xm\" (UID: \"b64e35a1-749b-41f5-a3de-10a9207863a2\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b42xm"
May 28 15:01:53.429698 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:53.429631    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b64e35a1-749b-41f5-a3de-10a9207863a2-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b42xm\" (UID: \"b64e35a1-749b-41f5-a3de-10a9207863a2\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b42xm"
May 28 15:01:53.429925 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:53.429770    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-x6d6z\" (UniqueName: \"kubernetes.io/projected/b64e35a1-749b-41f5-a3de-10a9207863a2-kube-api-access-x6d6z\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b42xm\" (UID: \"b64e35a1-749b-41f5-a3de-10a9207863a2\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b42xm"
May 28 15:01:53.429925 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:53.429844    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b64e35a1-749b-41f5-a3de-10a9207863a2-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b42xm\" (UID: \"b64e35a1-749b-41f5-a3de-10a9207863a2\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b42xm"
May 28 15:01:53.430070 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:53.430047    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b64e35a1-749b-41f5-a3de-10a9207863a2-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b42xm\" (UID: \"b64e35a1-749b-41f5-a3de-10a9207863a2\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b42xm"
May 28 15:01:53.430178 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:53.430159    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b64e35a1-749b-41f5-a3de-10a9207863a2-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b42xm\" (UID: \"b64e35a1-749b-41f5-a3de-10a9207863a2\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b42xm"
May 28 15:01:53.438527 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:53.438495    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x6d6z\" (UniqueName: \"kubernetes.io/projected/b64e35a1-749b-41f5-a3de-10a9207863a2-kube-api-access-x6d6z\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b42xm\" (UID: \"b64e35a1-749b-41f5-a3de-10a9207863a2\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b42xm"
May 28 15:01:53.555505 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:53.555471    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b42xm"
May 28 15:01:53.685638 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:53.685610    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b42xm"]
May 28 15:01:53.687233 ip-10-0-137-84 kubenswrapper[2563]: W0528 15:01:53.687200    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb64e35a1_749b_41f5_a3de_10a9207863a2.slice/crio-9b494ed0276608e85baf381ddd02954ea98c8ce6772e0909a8d143540b0c5a96 WatchSource:0}: Error finding container 9b494ed0276608e85baf381ddd02954ea98c8ce6772e0909a8d143540b0c5a96: Status 404 returned error can't find the container with id 9b494ed0276608e85baf381ddd02954ea98c8ce6772e0909a8d143540b0c5a96
May 28 15:01:54.271875 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:54.271847    2563 generic.go:358] "Generic (PLEG): container finished" podID="b6793a01-9a5f-4b68-a3e6-b0595698f194" containerID="e0a249291551ec3fd9f9693be1d154a12caf981632ba1b80440310cf276d4036" exitCode=0
May 28 15:01:54.272229 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:54.271913    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73g2hn6" event={"ID":"b6793a01-9a5f-4b68-a3e6-b0595698f194","Type":"ContainerDied","Data":"e0a249291551ec3fd9f9693be1d154a12caf981632ba1b80440310cf276d4036"}
May 28 15:01:54.273228 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:54.273200    2563 generic.go:358] "Generic (PLEG): container finished" podID="b64e35a1-749b-41f5-a3de-10a9207863a2" containerID="f095192f0b5e6c24a993633ae259b6348df930760815e3c93f18f80942fbeb6b" exitCode=0
May 28 15:01:54.273326 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:54.273230    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b42xm" event={"ID":"b64e35a1-749b-41f5-a3de-10a9207863a2","Type":"ContainerDied","Data":"f095192f0b5e6c24a993633ae259b6348df930760815e3c93f18f80942fbeb6b"}
May 28 15:01:54.273326 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:54.273261    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b42xm" event={"ID":"b64e35a1-749b-41f5-a3de-10a9207863a2","Type":"ContainerStarted","Data":"9b494ed0276608e85baf381ddd02954ea98c8ce6772e0909a8d143540b0c5a96"}
May 28 15:01:55.279282 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:55.279248    2563 generic.go:358] "Generic (PLEG): container finished" podID="694ffbd0-047e-41db-8553-72d8dc15bc1e" containerID="44c3f8ea574aeb896c4a432f176a615794a928d743077d8f6e2bb2f946ab888b" exitCode=0
May 28 15:01:55.279751 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:55.279339    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cd6wx" event={"ID":"694ffbd0-047e-41db-8553-72d8dc15bc1e","Type":"ContainerDied","Data":"44c3f8ea574aeb896c4a432f176a615794a928d743077d8f6e2bb2f946ab888b"}
May 28 15:01:55.281086 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:55.281066    2563 generic.go:358] "Generic (PLEG): container finished" podID="8b3dc7ba-da07-48ea-a8fb-cfc5c37001b9" containerID="c36c66455a1ad2760b28f8e3c6ece2fd48819a77fcb5b5e38ec4428eca109bcc" exitCode=0
May 28 15:01:55.281172 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:55.281143    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17f9nc" event={"ID":"8b3dc7ba-da07-48ea-a8fb-cfc5c37001b9","Type":"ContainerDied","Data":"c36c66455a1ad2760b28f8e3c6ece2fd48819a77fcb5b5e38ec4428eca109bcc"}
May 28 15:01:55.283124 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:55.283102    2563 generic.go:358] "Generic (PLEG): container finished" podID="b6793a01-9a5f-4b68-a3e6-b0595698f194" containerID="a8a64faa7bffad5fa8d0173e2cff52bdda33269c7b54b974819210b7c9c990ff" exitCode=0
May 28 15:01:55.283224 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:55.283181    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73g2hn6" event={"ID":"b6793a01-9a5f-4b68-a3e6-b0595698f194","Type":"ContainerDied","Data":"a8a64faa7bffad5fa8d0173e2cff52bdda33269c7b54b974819210b7c9c990ff"}
May 28 15:01:55.284935 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:55.284815    2563 generic.go:358] "Generic (PLEG): container finished" podID="b64e35a1-749b-41f5-a3de-10a9207863a2" containerID="a5035dfd96c6cf41dc8ed56b99fb77fda394426592ed281d85fd4cf95209d56a" exitCode=0
May 28 15:01:55.284935 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:55.284875    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b42xm" event={"ID":"b64e35a1-749b-41f5-a3de-10a9207863a2","Type":"ContainerDied","Data":"a5035dfd96c6cf41dc8ed56b99fb77fda394426592ed281d85fd4cf95209d56a"}
May 28 15:01:56.291327 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:56.291293    2563 generic.go:358] "Generic (PLEG): container finished" podID="694ffbd0-047e-41db-8553-72d8dc15bc1e" containerID="83c1f5759f8b569985b48443bf56e97189df3011fad8716a17b1e7ccf498dab7" exitCode=0
May 28 15:01:56.291869 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:56.291385    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cd6wx" event={"ID":"694ffbd0-047e-41db-8553-72d8dc15bc1e","Type":"ContainerDied","Data":"83c1f5759f8b569985b48443bf56e97189df3011fad8716a17b1e7ccf498dab7"}
May 28 15:01:56.293072 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:56.293048    2563 generic.go:358] "Generic (PLEG): container finished" podID="8b3dc7ba-da07-48ea-a8fb-cfc5c37001b9" containerID="524f0e0031577313281c9b045a600d69045e1a3aab362a897dfedf3fa9047a03" exitCode=0
May 28 15:01:56.293167 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:56.293133    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17f9nc" event={"ID":"8b3dc7ba-da07-48ea-a8fb-cfc5c37001b9","Type":"ContainerDied","Data":"524f0e0031577313281c9b045a600d69045e1a3aab362a897dfedf3fa9047a03"}
May 28 15:01:56.294879 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:56.294854    2563 generic.go:358] "Generic (PLEG): container finished" podID="b64e35a1-749b-41f5-a3de-10a9207863a2" containerID="6d298ee4ded603f26a0bff3305d73a70d899d5203e3a3c2b0cb7502003ecc87b" exitCode=0
May 28 15:01:56.295002 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:56.294881    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b42xm" event={"ID":"b64e35a1-749b-41f5-a3de-10a9207863a2","Type":"ContainerDied","Data":"6d298ee4ded603f26a0bff3305d73a70d899d5203e3a3c2b0cb7502003ecc87b"}
May 28 15:01:56.428549 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:56.428526    2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73g2hn6"
May 28 15:01:56.458085 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:56.458053    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b6793a01-9a5f-4b68-a3e6-b0595698f194-util\") pod \"b6793a01-9a5f-4b68-a3e6-b0595698f194\" (UID: \"b6793a01-9a5f-4b68-a3e6-b0595698f194\") "
May 28 15:01:56.458232 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:56.458176    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b6793a01-9a5f-4b68-a3e6-b0595698f194-bundle\") pod \"b6793a01-9a5f-4b68-a3e6-b0595698f194\" (UID: \"b6793a01-9a5f-4b68-a3e6-b0595698f194\") "
May 28 15:01:56.458232 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:56.458210    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t9vmd\" (UniqueName: \"kubernetes.io/projected/b6793a01-9a5f-4b68-a3e6-b0595698f194-kube-api-access-t9vmd\") pod \"b6793a01-9a5f-4b68-a3e6-b0595698f194\" (UID: \"b6793a01-9a5f-4b68-a3e6-b0595698f194\") "
May 28 15:01:56.458798 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:56.458766    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b6793a01-9a5f-4b68-a3e6-b0595698f194-bundle" (OuterVolumeSpecName: "bundle") pod "b6793a01-9a5f-4b68-a3e6-b0595698f194" (UID: "b6793a01-9a5f-4b68-a3e6-b0595698f194"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 15:01:56.460381 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:56.460350    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b6793a01-9a5f-4b68-a3e6-b0595698f194-kube-api-access-t9vmd" (OuterVolumeSpecName: "kube-api-access-t9vmd") pod "b6793a01-9a5f-4b68-a3e6-b0595698f194" (UID: "b6793a01-9a5f-4b68-a3e6-b0595698f194"). InnerVolumeSpecName "kube-api-access-t9vmd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 15:01:56.463535 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:56.463495    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b6793a01-9a5f-4b68-a3e6-b0595698f194-util" (OuterVolumeSpecName: "util") pod "b6793a01-9a5f-4b68-a3e6-b0595698f194" (UID: "b6793a01-9a5f-4b68-a3e6-b0595698f194"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 15:01:56.559842 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:56.559795    2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b6793a01-9a5f-4b68-a3e6-b0595698f194-bundle\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
May 28 15:01:56.559842 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:56.559836    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t9vmd\" (UniqueName: \"kubernetes.io/projected/b6793a01-9a5f-4b68-a3e6-b0595698f194-kube-api-access-t9vmd\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
May 28 15:01:56.559842 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:56.559849    2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b6793a01-9a5f-4b68-a3e6-b0595698f194-util\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
May 28 15:01:57.301484 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:57.301446    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73g2hn6" event={"ID":"b6793a01-9a5f-4b68-a3e6-b0595698f194","Type":"ContainerDied","Data":"de9407237f0ee4b97d09d6b9a4f43005613f9df00a3f5a1bf3f0d2d28c1c7a37"}
May 28 15:01:57.301484 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:57.301487    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="de9407237f0ee4b97d09d6b9a4f43005613f9df00a3f5a1bf3f0d2d28c1c7a37"
May 28 15:01:57.302017 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:57.301506    2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73g2hn6"
May 28 15:01:57.442470 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:57.442443    2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cd6wx"
May 28 15:01:57.469600 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:57.469574    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bq4cv\" (UniqueName: \"kubernetes.io/projected/694ffbd0-047e-41db-8553-72d8dc15bc1e-kube-api-access-bq4cv\") pod \"694ffbd0-047e-41db-8553-72d8dc15bc1e\" (UID: \"694ffbd0-047e-41db-8553-72d8dc15bc1e\") "
May 28 15:01:57.469748 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:57.469716    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/694ffbd0-047e-41db-8553-72d8dc15bc1e-bundle\") pod \"694ffbd0-047e-41db-8553-72d8dc15bc1e\" (UID: \"694ffbd0-047e-41db-8553-72d8dc15bc1e\") "
May 28 15:01:57.469791 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:57.469775    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/694ffbd0-047e-41db-8553-72d8dc15bc1e-util\") pod \"694ffbd0-047e-41db-8553-72d8dc15bc1e\" (UID: \"694ffbd0-047e-41db-8553-72d8dc15bc1e\") "
May 28 15:01:57.470374 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:57.470325    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/694ffbd0-047e-41db-8553-72d8dc15bc1e-bundle" (OuterVolumeSpecName: "bundle") pod "694ffbd0-047e-41db-8553-72d8dc15bc1e" (UID: "694ffbd0-047e-41db-8553-72d8dc15bc1e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 15:01:57.471992 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:57.471958    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/694ffbd0-047e-41db-8553-72d8dc15bc1e-kube-api-access-bq4cv" (OuterVolumeSpecName: "kube-api-access-bq4cv") pod "694ffbd0-047e-41db-8553-72d8dc15bc1e" (UID: "694ffbd0-047e-41db-8553-72d8dc15bc1e"). InnerVolumeSpecName "kube-api-access-bq4cv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 15:01:57.478958 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:57.478932    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/694ffbd0-047e-41db-8553-72d8dc15bc1e-util" (OuterVolumeSpecName: "util") pod "694ffbd0-047e-41db-8553-72d8dc15bc1e" (UID: "694ffbd0-047e-41db-8553-72d8dc15bc1e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 15:01:57.491783 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:57.491765    2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b42xm"
May 28 15:01:57.495031 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:57.495011    2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17f9nc"
May 28 15:01:57.571217 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:57.571129    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b64e35a1-749b-41f5-a3de-10a9207863a2-util\") pod \"b64e35a1-749b-41f5-a3de-10a9207863a2\" (UID: \"b64e35a1-749b-41f5-a3de-10a9207863a2\") "
May 28 15:01:57.571217 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:57.571165    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x6d6z\" (UniqueName: \"kubernetes.io/projected/b64e35a1-749b-41f5-a3de-10a9207863a2-kube-api-access-x6d6z\") pod \"b64e35a1-749b-41f5-a3de-10a9207863a2\" (UID: \"b64e35a1-749b-41f5-a3de-10a9207863a2\") "
May 28 15:01:57.571217 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:57.571194    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8b3dc7ba-da07-48ea-a8fb-cfc5c37001b9-util\") pod \"8b3dc7ba-da07-48ea-a8fb-cfc5c37001b9\" (UID: \"8b3dc7ba-da07-48ea-a8fb-cfc5c37001b9\") "
May 28 15:01:57.571498 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:57.571397    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b64e35a1-749b-41f5-a3de-10a9207863a2-bundle\") pod \"b64e35a1-749b-41f5-a3de-10a9207863a2\" (UID: \"b64e35a1-749b-41f5-a3de-10a9207863a2\") "
May 28 15:01:57.571498 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:57.571486    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v4d9v\" (UniqueName: \"kubernetes.io/projected/8b3dc7ba-da07-48ea-a8fb-cfc5c37001b9-kube-api-access-v4d9v\") pod \"8b3dc7ba-da07-48ea-a8fb-cfc5c37001b9\" (UID: \"8b3dc7ba-da07-48ea-a8fb-cfc5c37001b9\") "
May 28 15:01:57.571599 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:57.571550    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8b3dc7ba-da07-48ea-a8fb-cfc5c37001b9-bundle\") pod \"8b3dc7ba-da07-48ea-a8fb-cfc5c37001b9\" (UID: \"8b3dc7ba-da07-48ea-a8fb-cfc5c37001b9\") "
May 28 15:01:57.571920 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:57.571854    2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/694ffbd0-047e-41db-8553-72d8dc15bc1e-bundle\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
May 28 15:01:57.571920 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:57.571875    2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/694ffbd0-047e-41db-8553-72d8dc15bc1e-util\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
May 28 15:01:57.571920 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:57.571889    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bq4cv\" (UniqueName: \"kubernetes.io/projected/694ffbd0-047e-41db-8553-72d8dc15bc1e-kube-api-access-bq4cv\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
May 28 15:01:57.572144 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:57.572025    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b64e35a1-749b-41f5-a3de-10a9207863a2-bundle" (OuterVolumeSpecName: "bundle") pod "b64e35a1-749b-41f5-a3de-10a9207863a2" (UID: "b64e35a1-749b-41f5-a3de-10a9207863a2"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 15:01:57.572237 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:57.572211    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b3dc7ba-da07-48ea-a8fb-cfc5c37001b9-bundle" (OuterVolumeSpecName: "bundle") pod "8b3dc7ba-da07-48ea-a8fb-cfc5c37001b9" (UID: "8b3dc7ba-da07-48ea-a8fb-cfc5c37001b9"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 15:01:57.573531 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:57.573497    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8b3dc7ba-da07-48ea-a8fb-cfc5c37001b9-kube-api-access-v4d9v" (OuterVolumeSpecName: "kube-api-access-v4d9v") pod "8b3dc7ba-da07-48ea-a8fb-cfc5c37001b9" (UID: "8b3dc7ba-da07-48ea-a8fb-cfc5c37001b9"). InnerVolumeSpecName "kube-api-access-v4d9v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 15:01:57.573845 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:57.573664    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b64e35a1-749b-41f5-a3de-10a9207863a2-kube-api-access-x6d6z" (OuterVolumeSpecName: "kube-api-access-x6d6z") pod "b64e35a1-749b-41f5-a3de-10a9207863a2" (UID: "b64e35a1-749b-41f5-a3de-10a9207863a2"). InnerVolumeSpecName "kube-api-access-x6d6z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 15:01:57.577230 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:57.577191    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b64e35a1-749b-41f5-a3de-10a9207863a2-util" (OuterVolumeSpecName: "util") pod "b64e35a1-749b-41f5-a3de-10a9207863a2" (UID: "b64e35a1-749b-41f5-a3de-10a9207863a2"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 15:01:57.577557 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:57.577538    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b3dc7ba-da07-48ea-a8fb-cfc5c37001b9-util" (OuterVolumeSpecName: "util") pod "8b3dc7ba-da07-48ea-a8fb-cfc5c37001b9" (UID: "8b3dc7ba-da07-48ea-a8fb-cfc5c37001b9"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 15:01:57.672817 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:57.672783    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v4d9v\" (UniqueName: \"kubernetes.io/projected/8b3dc7ba-da07-48ea-a8fb-cfc5c37001b9-kube-api-access-v4d9v\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
May 28 15:01:57.672817 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:57.672814    2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8b3dc7ba-da07-48ea-a8fb-cfc5c37001b9-bundle\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
May 28 15:01:57.672817 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:57.672824    2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b64e35a1-749b-41f5-a3de-10a9207863a2-util\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
May 28 15:01:57.673047 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:57.672832    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x6d6z\" (UniqueName: \"kubernetes.io/projected/b64e35a1-749b-41f5-a3de-10a9207863a2-kube-api-access-x6d6z\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
May 28 15:01:57.673047 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:57.672842    2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8b3dc7ba-da07-48ea-a8fb-cfc5c37001b9-util\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
May 28 15:01:57.673047 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:57.672852    2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b64e35a1-749b-41f5-a3de-10a9207863a2-bundle\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
May 28 15:01:58.308163 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:58.308124    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cd6wx" event={"ID":"694ffbd0-047e-41db-8553-72d8dc15bc1e","Type":"ContainerDied","Data":"4f95d9ac7cf629ed361af717dcaff8e8c623d1c595e16a8f16010d068de84bd9"}
May 28 15:01:58.308163 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:58.308164    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4f95d9ac7cf629ed361af717dcaff8e8c623d1c595e16a8f16010d068de84bd9"
May 28 15:01:58.308163 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:58.308143    2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cd6wx"
May 28 15:01:58.309920 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:58.309892    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17f9nc" event={"ID":"8b3dc7ba-da07-48ea-a8fb-cfc5c37001b9","Type":"ContainerDied","Data":"80e0b1ebefd3ececec0d1382bb961c1189d43594d104d191fc14acf39396ee30"}
May 28 15:01:58.310040 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:58.309923    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="80e0b1ebefd3ececec0d1382bb961c1189d43594d104d191fc14acf39396ee30"
May 28 15:01:58.310040 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:58.309902    2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17f9nc"
May 28 15:01:58.311593 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:58.311571    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b42xm" event={"ID":"b64e35a1-749b-41f5-a3de-10a9207863a2","Type":"ContainerDied","Data":"9b494ed0276608e85baf381ddd02954ea98c8ce6772e0909a8d143540b0c5a96"}
May 28 15:01:58.311593 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:58.311588    2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b42xm"
May 28 15:01:58.311741 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:01:58.311595    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9b494ed0276608e85baf381ddd02954ea98c8ce6772e0909a8d143540b0c5a96"
May 28 15:02:00.395082 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:00.395047    2563 scope.go:117] "RemoveContainer" containerID="bdba328be05dfe4bed1b429b165e45a70d77ed18b462c9a26849df3591470042"
May 28 15:02:04.436631 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:04.436591    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-6b6f566684-qm8sl"]
May 28 15:02:04.437117 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:04.437100    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b6793a01-9a5f-4b68-a3e6-b0595698f194" containerName="util"
May 28 15:02:04.437178 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:04.437120    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6793a01-9a5f-4b68-a3e6-b0595698f194" containerName="util"
May 28 15:02:04.437178 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:04.437134    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b64e35a1-749b-41f5-a3de-10a9207863a2" containerName="util"
May 28 15:02:04.437178 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:04.437142    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="b64e35a1-749b-41f5-a3de-10a9207863a2" containerName="util"
May 28 15:02:04.437178 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:04.437160    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b6793a01-9a5f-4b68-a3e6-b0595698f194" containerName="pull"
May 28 15:02:04.437178 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:04.437168    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6793a01-9a5f-4b68-a3e6-b0595698f194" containerName="pull"
May 28 15:02:04.437178 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:04.437177    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b64e35a1-749b-41f5-a3de-10a9207863a2" containerName="extract"
May 28 15:02:04.437373 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:04.437186    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="b64e35a1-749b-41f5-a3de-10a9207863a2" containerName="extract"
May 28 15:02:04.437373 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:04.437199    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="694ffbd0-047e-41db-8553-72d8dc15bc1e" containerName="util"
May 28 15:02:04.437373 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:04.437207    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="694ffbd0-047e-41db-8553-72d8dc15bc1e" containerName="util"
May 28 15:02:04.437373 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:04.437217    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b64e35a1-749b-41f5-a3de-10a9207863a2" containerName="pull"
May 28 15:02:04.437373 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:04.437225    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="b64e35a1-749b-41f5-a3de-10a9207863a2" containerName="pull"
May 28 15:02:04.437373 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:04.437237    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="694ffbd0-047e-41db-8553-72d8dc15bc1e" containerName="pull"
May 28 15:02:04.437373 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:04.437246    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="694ffbd0-047e-41db-8553-72d8dc15bc1e" containerName="pull"
May 28 15:02:04.437373 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:04.437254    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b6793a01-9a5f-4b68-a3e6-b0595698f194" containerName="extract"
May 28 15:02:04.437373 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:04.437263    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6793a01-9a5f-4b68-a3e6-b0595698f194" containerName="extract"
May 28 15:02:04.437373 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:04.437273    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b3dc7ba-da07-48ea-a8fb-cfc5c37001b9" containerName="pull"
May 28 15:02:04.437373 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:04.437282    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b3dc7ba-da07-48ea-a8fb-cfc5c37001b9" containerName="pull"
May 28 15:02:04.437373 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:04.437290    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="694ffbd0-047e-41db-8553-72d8dc15bc1e" containerName="extract"
May 28 15:02:04.437373 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:04.437298    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="694ffbd0-047e-41db-8553-72d8dc15bc1e" containerName="extract"
May 28 15:02:04.437373 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:04.437314    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b3dc7ba-da07-48ea-a8fb-cfc5c37001b9" containerName="extract"
May 28 15:02:04.437373 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:04.437321    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b3dc7ba-da07-48ea-a8fb-cfc5c37001b9" containerName="extract"
May 28 15:02:04.437373 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:04.437354    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b3dc7ba-da07-48ea-a8fb-cfc5c37001b9" containerName="util"
May 28 15:02:04.437373 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:04.437362    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b3dc7ba-da07-48ea-a8fb-cfc5c37001b9" containerName="util"
May 28 15:02:04.437923 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:04.437429    2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="b64e35a1-749b-41f5-a3de-10a9207863a2" containerName="extract"
May 28 15:02:04.437923 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:04.437443    2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="b6793a01-9a5f-4b68-a3e6-b0595698f194" containerName="extract"
May 28 15:02:04.437923 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:04.437456    2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="8b3dc7ba-da07-48ea-a8fb-cfc5c37001b9" containerName="extract"
May 28 15:02:04.437923 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:04.437466    2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="694ffbd0-047e-41db-8553-72d8dc15bc1e" containerName="extract"
May 28 15:02:04.441892 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:04.441868    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b6f566684-qm8sl"
May 28 15:02:04.447584 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:04.447556    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6b6f566684-qm8sl"]
May 28 15:02:04.530692 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:04.530653    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/89d79ffb-d7c0-467d-b624-e329e9486b09-console-serving-cert\") pod \"console-6b6f566684-qm8sl\" (UID: \"89d79ffb-d7c0-467d-b624-e329e9486b09\") " pod="openshift-console/console-6b6f566684-qm8sl"
May 28 15:02:04.530866 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:04.530751    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/89d79ffb-d7c0-467d-b624-e329e9486b09-trusted-ca-bundle\") pod \"console-6b6f566684-qm8sl\" (UID: \"89d79ffb-d7c0-467d-b624-e329e9486b09\") " pod="openshift-console/console-6b6f566684-qm8sl"
May 28 15:02:04.530866 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:04.530816    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/89d79ffb-d7c0-467d-b624-e329e9486b09-console-config\") pod \"console-6b6f566684-qm8sl\" (UID: \"89d79ffb-d7c0-467d-b624-e329e9486b09\") " pod="openshift-console/console-6b6f566684-qm8sl"
May 28 15:02:04.530866 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:04.530833    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-95vcw\" (UniqueName: \"kubernetes.io/projected/89d79ffb-d7c0-467d-b624-e329e9486b09-kube-api-access-95vcw\") pod \"console-6b6f566684-qm8sl\" (UID: \"89d79ffb-d7c0-467d-b624-e329e9486b09\") " pod="openshift-console/console-6b6f566684-qm8sl"
May 28 15:02:04.531018 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:04.530892    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/89d79ffb-d7c0-467d-b624-e329e9486b09-console-oauth-config\") pod \"console-6b6f566684-qm8sl\" (UID: \"89d79ffb-d7c0-467d-b624-e329e9486b09\") " pod="openshift-console/console-6b6f566684-qm8sl"
May 28 15:02:04.531018 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:04.530921    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/89d79ffb-d7c0-467d-b624-e329e9486b09-service-ca\") pod \"console-6b6f566684-qm8sl\" (UID: \"89d79ffb-d7c0-467d-b624-e329e9486b09\") " pod="openshift-console/console-6b6f566684-qm8sl"
May 28 15:02:04.531018 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:04.530985    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/89d79ffb-d7c0-467d-b624-e329e9486b09-oauth-serving-cert\") pod \"console-6b6f566684-qm8sl\" (UID: \"89d79ffb-d7c0-467d-b624-e329e9486b09\") " pod="openshift-console/console-6b6f566684-qm8sl"
May 28 15:02:04.631958 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:04.631916    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/89d79ffb-d7c0-467d-b624-e329e9486b09-trusted-ca-bundle\") pod \"console-6b6f566684-qm8sl\" (UID: \"89d79ffb-d7c0-467d-b624-e329e9486b09\") " pod="openshift-console/console-6b6f566684-qm8sl"
May 28 15:02:04.632129 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:04.631979    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/89d79ffb-d7c0-467d-b624-e329e9486b09-console-config\") pod \"console-6b6f566684-qm8sl\" (UID: \"89d79ffb-d7c0-467d-b624-e329e9486b09\") " pod="openshift-console/console-6b6f566684-qm8sl"
May 28 15:02:04.632129 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:04.631999    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-95vcw\" (UniqueName: \"kubernetes.io/projected/89d79ffb-d7c0-467d-b624-e329e9486b09-kube-api-access-95vcw\") pod \"console-6b6f566684-qm8sl\" (UID: \"89d79ffb-d7c0-467d-b624-e329e9486b09\") " pod="openshift-console/console-6b6f566684-qm8sl"
May 28 15:02:04.632129 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:04.632035    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/89d79ffb-d7c0-467d-b624-e329e9486b09-console-oauth-config\") pod \"console-6b6f566684-qm8sl\" (UID: \"89d79ffb-d7c0-467d-b624-e329e9486b09\") " pod="openshift-console/console-6b6f566684-qm8sl"
May 28 15:02:04.632129 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:04.632061    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/89d79ffb-d7c0-467d-b624-e329e9486b09-service-ca\") pod \"console-6b6f566684-qm8sl\" (UID: \"89d79ffb-d7c0-467d-b624-e329e9486b09\") " pod="openshift-console/console-6b6f566684-qm8sl"
May 28 15:02:04.632129 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:04.632096    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/89d79ffb-d7c0-467d-b624-e329e9486b09-oauth-serving-cert\") pod \"console-6b6f566684-qm8sl\" (UID: \"89d79ffb-d7c0-467d-b624-e329e9486b09\") " pod="openshift-console/console-6b6f566684-qm8sl"
May 28 15:02:04.632423 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:04.632223    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/89d79ffb-d7c0-467d-b624-e329e9486b09-console-serving-cert\") pod \"console-6b6f566684-qm8sl\" (UID: \"89d79ffb-d7c0-467d-b624-e329e9486b09\") " pod="openshift-console/console-6b6f566684-qm8sl"
May 28 15:02:04.632901 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:04.632875    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/89d79ffb-d7c0-467d-b624-e329e9486b09-console-config\") pod \"console-6b6f566684-qm8sl\" (UID: \"89d79ffb-d7c0-467d-b624-e329e9486b09\") " pod="openshift-console/console-6b6f566684-qm8sl"
May 28 15:02:04.632901 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:04.632888    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/89d79ffb-d7c0-467d-b624-e329e9486b09-oauth-serving-cert\") pod \"console-6b6f566684-qm8sl\" (UID: \"89d79ffb-d7c0-467d-b624-e329e9486b09\") " pod="openshift-console/console-6b6f566684-qm8sl"
May 28 15:02:04.633046 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:04.632913    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/89d79ffb-d7c0-467d-b624-e329e9486b09-trusted-ca-bundle\") pod \"console-6b6f566684-qm8sl\" (UID: \"89d79ffb-d7c0-467d-b624-e329e9486b09\") " pod="openshift-console/console-6b6f566684-qm8sl"
May 28 15:02:04.633046 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:04.632938    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/89d79ffb-d7c0-467d-b624-e329e9486b09-service-ca\") pod \"console-6b6f566684-qm8sl\" (UID: \"89d79ffb-d7c0-467d-b624-e329e9486b09\") " pod="openshift-console/console-6b6f566684-qm8sl"
May 28 15:02:04.634494 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:04.634465    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/89d79ffb-d7c0-467d-b624-e329e9486b09-console-oauth-config\") pod \"console-6b6f566684-qm8sl\" (UID: \"89d79ffb-d7c0-467d-b624-e329e9486b09\") " pod="openshift-console/console-6b6f566684-qm8sl"
May 28 15:02:04.634711 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:04.634695    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/89d79ffb-d7c0-467d-b624-e329e9486b09-console-serving-cert\") pod \"console-6b6f566684-qm8sl\" (UID: \"89d79ffb-d7c0-467d-b624-e329e9486b09\") " pod="openshift-console/console-6b6f566684-qm8sl"
May 28 15:02:04.642996 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:04.642970    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-95vcw\" (UniqueName: \"kubernetes.io/projected/89d79ffb-d7c0-467d-b624-e329e9486b09-kube-api-access-95vcw\") pod \"console-6b6f566684-qm8sl\" (UID: \"89d79ffb-d7c0-467d-b624-e329e9486b09\") " pod="openshift-console/console-6b6f566684-qm8sl"
May 28 15:02:04.752589 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:04.752559    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b6f566684-qm8sl"
May 28 15:02:04.880367 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:04.880338    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6b6f566684-qm8sl"]
May 28 15:02:04.881840 ip-10-0-137-84 kubenswrapper[2563]: W0528 15:02:04.881812    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89d79ffb_d7c0_467d_b624_e329e9486b09.slice/crio-5e7000c846f3145502a5b3862303347d69da5ad348f5354ad6ff3f5167d3c29a WatchSource:0}: Error finding container 5e7000c846f3145502a5b3862303347d69da5ad348f5354ad6ff3f5167d3c29a: Status 404 returned error can't find the container with id 5e7000c846f3145502a5b3862303347d69da5ad348f5354ad6ff3f5167d3c29a
May 28 15:02:05.341866 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:05.341830    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b6f566684-qm8sl" event={"ID":"89d79ffb-d7c0-467d-b624-e329e9486b09","Type":"ContainerStarted","Data":"b5eff1c90fd56c12e4ae73bba35591006e5ad8402b61257ea942465d108937c2"}
May 28 15:02:05.341866 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:05.341867    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b6f566684-qm8sl" event={"ID":"89d79ffb-d7c0-467d-b624-e329e9486b09","Type":"ContainerStarted","Data":"5e7000c846f3145502a5b3862303347d69da5ad348f5354ad6ff3f5167d3c29a"}
May 28 15:02:05.361669 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:05.361618    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-6b6f566684-qm8sl" podStartSLOduration=1.361604845 podStartE2EDuration="1.361604845s" podCreationTimestamp="2026-05-28 15:02:04 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 15:02:05.359311073 +0000 UTC m=+545.448527797" watchObservedRunningTime="2026-05-28 15:02:05.361604845 +0000 UTC m=+545.450821568"
May 28 15:02:12.984730 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:12.984662    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-kgvjb"]
May 28 15:02:12.987851 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:12.987825    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-kgvjb"
May 28 15:02:12.990597 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:12.990571    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-s954q\""
May 28 15:02:12.990826 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:12.990806    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
May 28 15:02:12.990924 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:12.990818    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
May 28 15:02:13.005056 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:13.005020    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-kgvjb"]
May 28 15:02:13.110051 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:13.110011    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kl8df\" (UniqueName: \"kubernetes.io/projected/31b05d6b-20eb-4a8e-9b56-fe68eb1024c5-kube-api-access-kl8df\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-kgvjb\" (UID: \"31b05d6b-20eb-4a8e-9b56-fe68eb1024c5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-kgvjb"
May 28 15:02:13.110221 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:13.110116    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/31b05d6b-20eb-4a8e-9b56-fe68eb1024c5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-kgvjb\" (UID: \"31b05d6b-20eb-4a8e-9b56-fe68eb1024c5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-kgvjb"
May 28 15:02:13.210774 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:13.210739    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kl8df\" (UniqueName: \"kubernetes.io/projected/31b05d6b-20eb-4a8e-9b56-fe68eb1024c5-kube-api-access-kl8df\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-kgvjb\" (UID: \"31b05d6b-20eb-4a8e-9b56-fe68eb1024c5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-kgvjb"
May 28 15:02:13.210924 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:13.210804    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/31b05d6b-20eb-4a8e-9b56-fe68eb1024c5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-kgvjb\" (UID: \"31b05d6b-20eb-4a8e-9b56-fe68eb1024c5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-kgvjb"
May 28 15:02:13.211135 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:13.211118    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/31b05d6b-20eb-4a8e-9b56-fe68eb1024c5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-kgvjb\" (UID: \"31b05d6b-20eb-4a8e-9b56-fe68eb1024c5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-kgvjb"
May 28 15:02:13.227876 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:13.227849    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kl8df\" (UniqueName: \"kubernetes.io/projected/31b05d6b-20eb-4a8e-9b56-fe68eb1024c5-kube-api-access-kl8df\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-kgvjb\" (UID: \"31b05d6b-20eb-4a8e-9b56-fe68eb1024c5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-kgvjb"
May 28 15:02:13.299021 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:13.298974    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-kgvjb"
May 28 15:02:13.433621 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:13.433590    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-kgvjb"]
May 28 15:02:13.435921 ip-10-0-137-84 kubenswrapper[2563]: W0528 15:02:13.435895    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31b05d6b_20eb_4a8e_9b56_fe68eb1024c5.slice/crio-87c68c87a336fccffe3807d8c098b8609f14333972c8b8d1a276a6445ecc0ee2 WatchSource:0}: Error finding container 87c68c87a336fccffe3807d8c098b8609f14333972c8b8d1a276a6445ecc0ee2: Status 404 returned error can't find the container with id 87c68c87a336fccffe3807d8c098b8609f14333972c8b8d1a276a6445ecc0ee2
May 28 15:02:14.377774 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:14.377737    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-kgvjb" event={"ID":"31b05d6b-20eb-4a8e-9b56-fe68eb1024c5","Type":"ContainerStarted","Data":"87c68c87a336fccffe3807d8c098b8609f14333972c8b8d1a276a6445ecc0ee2"}
May 28 15:02:14.753584 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:14.753548    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6b6f566684-qm8sl"
May 28 15:02:14.753785 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:14.753672    2563 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6b6f566684-qm8sl"
May 28 15:02:14.759043 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:14.759019    2563 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6b6f566684-qm8sl"
May 28 15:02:15.386587 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:15.386555    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6b6f566684-qm8sl"
May 28 15:02:15.436528 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:15.436474    2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-57c4dd7699-8dcxx"]
May 28 15:02:18.980377 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:18.980340    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-44qnt"]
May 28 15:02:18.983811 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:18.983795    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-44qnt"
May 28 15:02:18.987278 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:18.987244    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-6trz8\""
May 28 15:02:18.987278 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:18.987244    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
May 28 15:02:18.993245 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:18.993219    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-44qnt"]
May 28 15:02:19.072220 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:19.072133    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k4zcz\" (UniqueName: \"kubernetes.io/projected/da85fe0c-e659-4deb-b84b-c946ad346262-kube-api-access-k4zcz\") pod \"dns-operator-controller-manager-648d5c98bc-44qnt\" (UID: \"da85fe0c-e659-4deb-b84b-c946ad346262\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-44qnt"
May 28 15:02:19.173852 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:19.173792    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k4zcz\" (UniqueName: \"kubernetes.io/projected/da85fe0c-e659-4deb-b84b-c946ad346262-kube-api-access-k4zcz\") pod \"dns-operator-controller-manager-648d5c98bc-44qnt\" (UID: \"da85fe0c-e659-4deb-b84b-c946ad346262\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-44qnt"
May 28 15:02:19.182847 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:19.182816    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k4zcz\" (UniqueName: \"kubernetes.io/projected/da85fe0c-e659-4deb-b84b-c946ad346262-kube-api-access-k4zcz\") pod \"dns-operator-controller-manager-648d5c98bc-44qnt\" (UID: \"da85fe0c-e659-4deb-b84b-c946ad346262\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-44qnt"
May 28 15:02:19.294395 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:19.294353    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-44qnt"
May 28 15:02:19.401398 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:19.401364    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-kgvjb" event={"ID":"31b05d6b-20eb-4a8e-9b56-fe68eb1024c5","Type":"ContainerStarted","Data":"d5d6f4ca2448be5763f153b1c3bc2bf855ec9309acc67ef6dcbbb75bc330b52b"}
May 28 15:02:19.401562 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:19.401491    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-kgvjb"
May 28 15:02:19.426099 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:19.426026    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-kgvjb" podStartSLOduration=2.11059212 podStartE2EDuration="7.426011478s" podCreationTimestamp="2026-05-28 15:02:12 +0000 UTC" firstStartedPulling="2026-05-28 15:02:13.438241271 +0000 UTC m=+553.527457972" lastFinishedPulling="2026-05-28 15:02:18.753660629 +0000 UTC m=+558.842877330" observedRunningTime="2026-05-28 15:02:19.424236124 +0000 UTC m=+559.513452850" watchObservedRunningTime="2026-05-28 15:02:19.426011478 +0000 UTC m=+559.515228200"
May 28 15:02:19.430978 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:19.430952    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-44qnt"]
May 28 15:02:19.432437 ip-10-0-137-84 kubenswrapper[2563]: W0528 15:02:19.432410    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda85fe0c_e659_4deb_b84b_c946ad346262.slice/crio-081ca39f525525705f1556a4fa79d06c288b7b8c5ff6d2013a74ab87bf004cff WatchSource:0}: Error finding container 081ca39f525525705f1556a4fa79d06c288b7b8c5ff6d2013a74ab87bf004cff: Status 404 returned error can't find the container with id 081ca39f525525705f1556a4fa79d06c288b7b8c5ff6d2013a74ab87bf004cff
May 28 15:02:20.406405 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:20.406369    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-44qnt" event={"ID":"da85fe0c-e659-4deb-b84b-c946ad346262","Type":"ContainerStarted","Data":"081ca39f525525705f1556a4fa79d06c288b7b8c5ff6d2013a74ab87bf004cff"}
May 28 15:02:22.416879 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:22.416840    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-44qnt" event={"ID":"da85fe0c-e659-4deb-b84b-c946ad346262","Type":"ContainerStarted","Data":"0714713948d4b62e3367b6c859afda9f18242834d72b89a72687caa1a10dd07a"}
May 28 15:02:22.417258 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:22.416949    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-44qnt"
May 28 15:02:22.435722 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:22.435649    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-44qnt" podStartSLOduration=2.028207101 podStartE2EDuration="4.435635236s" podCreationTimestamp="2026-05-28 15:02:18 +0000 UTC" firstStartedPulling="2026-05-28 15:02:19.434395659 +0000 UTC m=+559.523612361" lastFinishedPulling="2026-05-28 15:02:21.84182379 +0000 UTC m=+561.931040496" observedRunningTime="2026-05-28 15:02:22.434088467 +0000 UTC m=+562.523305194" watchObservedRunningTime="2026-05-28 15:02:22.435635236 +0000 UTC m=+562.524851959"
May 28 15:02:30.408991 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:30.408953    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-kgvjb"
May 28 15:02:31.494442 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:31.494404    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-h6srp"]
May 28 15:02:31.499254 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:31.499235    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-h6srp"
May 28 15:02:31.512709 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:31.512661    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-h6srp"]
May 28 15:02:31.582286 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:31.582239    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xwm84\" (UniqueName: \"kubernetes.io/projected/94e8da07-5b24-4e91-b99d-9847b5667954-kube-api-access-xwm84\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-h6srp\" (UID: \"94e8da07-5b24-4e91-b99d-9847b5667954\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-h6srp"
May 28 15:02:31.582486 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:31.582422    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/94e8da07-5b24-4e91-b99d-9847b5667954-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-h6srp\" (UID: \"94e8da07-5b24-4e91-b99d-9847b5667954\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-h6srp"
May 28 15:02:31.682840 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:31.682806    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/94e8da07-5b24-4e91-b99d-9847b5667954-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-h6srp\" (UID: \"94e8da07-5b24-4e91-b99d-9847b5667954\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-h6srp"
May 28 15:02:31.683016 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:31.682863    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xwm84\" (UniqueName: \"kubernetes.io/projected/94e8da07-5b24-4e91-b99d-9847b5667954-kube-api-access-xwm84\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-h6srp\" (UID: \"94e8da07-5b24-4e91-b99d-9847b5667954\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-h6srp"
May 28 15:02:31.683253 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:31.683228    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/94e8da07-5b24-4e91-b99d-9847b5667954-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-h6srp\" (UID: \"94e8da07-5b24-4e91-b99d-9847b5667954\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-h6srp"
May 28 15:02:31.691418 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:31.691390    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xwm84\" (UniqueName: \"kubernetes.io/projected/94e8da07-5b24-4e91-b99d-9847b5667954-kube-api-access-xwm84\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-h6srp\" (UID: \"94e8da07-5b24-4e91-b99d-9847b5667954\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-h6srp"
May 28 15:02:31.809826 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:31.809715    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-h6srp"
May 28 15:02:31.968085 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:31.968055    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-h6srp"]
May 28 15:02:31.969836 ip-10-0-137-84 kubenswrapper[2563]: W0528 15:02:31.969792    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94e8da07_5b24_4e91_b99d_9847b5667954.slice/crio-f09a0740557cd8e77a88a97adaaf35b53b439057bb0f1ef954bd38fb07589f90 WatchSource:0}: Error finding container f09a0740557cd8e77a88a97adaaf35b53b439057bb0f1ef954bd38fb07589f90: Status 404 returned error can't find the container with id f09a0740557cd8e77a88a97adaaf35b53b439057bb0f1ef954bd38fb07589f90
May 28 15:02:32.262867 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:32.262829    2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-kgvjb"]
May 28 15:02:32.263134 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:32.263106    2563 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-kgvjb" podUID="31b05d6b-20eb-4a8e-9b56-fe68eb1024c5" containerName="manager" containerID="cri-o://d5d6f4ca2448be5763f153b1c3bc2bf855ec9309acc67ef6dcbbb75bc330b52b" gracePeriod=2
May 28 15:02:32.273568 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:32.273531    2563 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-kgvjb"]
May 28 15:02:32.287526 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:32.287491    2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-h6srp"]
May 28 15:02:32.289822 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:32.289795    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-crdcq"]
May 28 15:02:32.290162 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:32.290148    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31b05d6b-20eb-4a8e-9b56-fe68eb1024c5" containerName="manager"
May 28 15:02:32.290224 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:32.290163    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="31b05d6b-20eb-4a8e-9b56-fe68eb1024c5" containerName="manager"
May 28 15:02:32.290277 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:32.290234    2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="31b05d6b-20eb-4a8e-9b56-fe68eb1024c5" containerName="manager"
May 28 15:02:32.293302 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:32.293280    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-crdcq"
May 28 15:02:32.295758 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:32.295730    2563 status_manager.go:895] "Failed to get status for pod" podUID="31b05d6b-20eb-4a8e-9b56-fe68eb1024c5" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-kgvjb" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-kgvjb\" is forbidden: User \"system:node:ip-10-0-137-84.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-84.ec2.internal' and this object"
May 28 15:02:32.304352 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:32.304293    2563 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-h6srp"]
May 28 15:02:32.307962 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:32.307925    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-crdcq"]
May 28 15:02:32.320719 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:32.320688    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-nhxzg"]
May 28 15:02:32.321084 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:32.321068    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94e8da07-5b24-4e91-b99d-9847b5667954" containerName="manager"
May 28 15:02:32.321151 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:32.321085    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="94e8da07-5b24-4e91-b99d-9847b5667954" containerName="manager"
May 28 15:02:32.321206 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:32.321152    2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="94e8da07-5b24-4e91-b99d-9847b5667954" containerName="manager"
May 28 15:02:32.324115 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:32.324093    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-nhxzg"
May 28 15:02:32.338241 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:32.338191    2563 status_manager.go:895] "Failed to get status for pod" podUID="31b05d6b-20eb-4a8e-9b56-fe68eb1024c5" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-kgvjb" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-kgvjb\" is forbidden: User \"system:node:ip-10-0-137-84.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-84.ec2.internal' and this object"
May 28 15:02:32.348371 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:32.348255    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-nhxzg"]
May 28 15:02:32.389860 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:32.389822    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/950fa335-8ee1-4931-8e53-663fe82a141d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-crdcq\" (UID: \"950fa335-8ee1-4931-8e53-663fe82a141d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-crdcq"
May 28 15:02:32.390027 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:32.389886    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3486a976-a83a-4209-b180-e1ce735c890a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-nhxzg\" (UID: \"3486a976-a83a-4209-b180-e1ce735c890a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-nhxzg"
May 28 15:02:32.390027 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:32.389956    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kq2t6\" (UniqueName: \"kubernetes.io/projected/3486a976-a83a-4209-b180-e1ce735c890a-kube-api-access-kq2t6\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-nhxzg\" (UID: \"3486a976-a83a-4209-b180-e1ce735c890a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-nhxzg"
May 28 15:02:32.390027 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:32.390001    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c2b7h\" (UniqueName: \"kubernetes.io/projected/950fa335-8ee1-4931-8e53-663fe82a141d-kube-api-access-c2b7h\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-crdcq\" (UID: \"950fa335-8ee1-4931-8e53-663fe82a141d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-crdcq"
May 28 15:02:32.458302 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:32.458267    2563 generic.go:358] "Generic (PLEG): container finished" podID="31b05d6b-20eb-4a8e-9b56-fe68eb1024c5" containerID="d5d6f4ca2448be5763f153b1c3bc2bf855ec9309acc67ef6dcbbb75bc330b52b" exitCode=0
May 28 15:02:32.460102 ip-10-0-137-84 kubenswrapper[2563]: E0528 15:02:32.460079    2563 kuberuntime_manager.go:623] "Missing actuated resource record" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-h6srp" container="manager"
May 28 15:02:32.462605 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:32.462570    2563 status_manager.go:895] "Failed to get status for pod" podUID="94e8da07-5b24-4e91-b99d-9847b5667954" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-h6srp" err="pods \"kuadrant-operator-controller-manager-6bc9f4c76f-h6srp\" is forbidden: User \"system:node:ip-10-0-137-84.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-84.ec2.internal' and this object"
May 28 15:02:32.464528 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:32.464498    2563 status_manager.go:895] "Failed to get status for pod" podUID="31b05d6b-20eb-4a8e-9b56-fe68eb1024c5" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-kgvjb" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-kgvjb\" is forbidden: User \"system:node:ip-10-0-137-84.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-84.ec2.internal' and this object"
May 28 15:02:32.491107 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:32.491072    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kq2t6\" (UniqueName: \"kubernetes.io/projected/3486a976-a83a-4209-b180-e1ce735c890a-kube-api-access-kq2t6\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-nhxzg\" (UID: \"3486a976-a83a-4209-b180-e1ce735c890a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-nhxzg"
May 28 15:02:32.491284 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:32.491262    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c2b7h\" (UniqueName: \"kubernetes.io/projected/950fa335-8ee1-4931-8e53-663fe82a141d-kube-api-access-c2b7h\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-crdcq\" (UID: \"950fa335-8ee1-4931-8e53-663fe82a141d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-crdcq"
May 28 15:02:32.491365 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:32.491337    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/950fa335-8ee1-4931-8e53-663fe82a141d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-crdcq\" (UID: \"950fa335-8ee1-4931-8e53-663fe82a141d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-crdcq"
May 28 15:02:32.491443 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:32.491423    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3486a976-a83a-4209-b180-e1ce735c890a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-nhxzg\" (UID: \"3486a976-a83a-4209-b180-e1ce735c890a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-nhxzg"
May 28 15:02:32.491915 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:32.491719    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/950fa335-8ee1-4931-8e53-663fe82a141d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-crdcq\" (UID: \"950fa335-8ee1-4931-8e53-663fe82a141d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-crdcq"
May 28 15:02:32.491915 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:32.491839    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3486a976-a83a-4209-b180-e1ce735c890a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-nhxzg\" (UID: \"3486a976-a83a-4209-b180-e1ce735c890a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-nhxzg"
May 28 15:02:32.499346 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:32.499321    2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-kgvjb"
May 28 15:02:32.500210 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:32.500190    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c2b7h\" (UniqueName: \"kubernetes.io/projected/950fa335-8ee1-4931-8e53-663fe82a141d-kube-api-access-c2b7h\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-crdcq\" (UID: \"950fa335-8ee1-4931-8e53-663fe82a141d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-crdcq"
May 28 15:02:32.500302 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:32.500262    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kq2t6\" (UniqueName: \"kubernetes.io/projected/3486a976-a83a-4209-b180-e1ce735c890a-kube-api-access-kq2t6\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-nhxzg\" (UID: \"3486a976-a83a-4209-b180-e1ce735c890a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-nhxzg"
May 28 15:02:32.592866 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:32.592771    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kl8df\" (UniqueName: \"kubernetes.io/projected/31b05d6b-20eb-4a8e-9b56-fe68eb1024c5-kube-api-access-kl8df\") pod \"31b05d6b-20eb-4a8e-9b56-fe68eb1024c5\" (UID: \"31b05d6b-20eb-4a8e-9b56-fe68eb1024c5\") "
May 28 15:02:32.592866 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:32.592832    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/31b05d6b-20eb-4a8e-9b56-fe68eb1024c5-extensions-socket-volume\") pod \"31b05d6b-20eb-4a8e-9b56-fe68eb1024c5\" (UID: \"31b05d6b-20eb-4a8e-9b56-fe68eb1024c5\") "
May 28 15:02:32.593342 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:32.593319    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31b05d6b-20eb-4a8e-9b56-fe68eb1024c5-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "31b05d6b-20eb-4a8e-9b56-fe68eb1024c5" (UID: "31b05d6b-20eb-4a8e-9b56-fe68eb1024c5"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 15:02:32.594929 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:32.594909    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/31b05d6b-20eb-4a8e-9b56-fe68eb1024c5-kube-api-access-kl8df" (OuterVolumeSpecName: "kube-api-access-kl8df") pod "31b05d6b-20eb-4a8e-9b56-fe68eb1024c5" (UID: "31b05d6b-20eb-4a8e-9b56-fe68eb1024c5"). InnerVolumeSpecName "kube-api-access-kl8df". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 15:02:32.643735 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:32.643703    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-crdcq"
May 28 15:02:32.652530 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:32.652501    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-nhxzg"
May 28 15:02:32.694328 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:32.694264    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kl8df\" (UniqueName: \"kubernetes.io/projected/31b05d6b-20eb-4a8e-9b56-fe68eb1024c5-kube-api-access-kl8df\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
May 28 15:02:32.694328 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:32.694301    2563 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/31b05d6b-20eb-4a8e-9b56-fe68eb1024c5-extensions-socket-volume\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
May 28 15:02:32.792396 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:32.792365    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-crdcq"]
May 28 15:02:32.794469 ip-10-0-137-84 kubenswrapper[2563]: W0528 15:02:32.794441    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod950fa335_8ee1_4931_8e53_663fe82a141d.slice/crio-0fb355f06a33ea8cfafdeb73c209569b06c743058720cf02e15f314e81e6afb5 WatchSource:0}: Error finding container 0fb355f06a33ea8cfafdeb73c209569b06c743058720cf02e15f314e81e6afb5: Status 404 returned error can't find the container with id 0fb355f06a33ea8cfafdeb73c209569b06c743058720cf02e15f314e81e6afb5
May 28 15:02:32.820343 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:32.820312    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-nhxzg"]
May 28 15:02:32.821412 ip-10-0-137-84 kubenswrapper[2563]: W0528 15:02:32.821379    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3486a976_a83a_4209_b180_e1ce735c890a.slice/crio-ba20331eebe8ee890ad9926ca1d4d474a07e797dbb68be2384f2c6a073a082cd WatchSource:0}: Error finding container ba20331eebe8ee890ad9926ca1d4d474a07e797dbb68be2384f2c6a073a082cd: Status 404 returned error can't find the container with id ba20331eebe8ee890ad9926ca1d4d474a07e797dbb68be2384f2c6a073a082cd
May 28 15:02:33.424167 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:33.424134    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-44qnt"
May 28 15:02:33.465784 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:33.465747    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-crdcq" event={"ID":"950fa335-8ee1-4931-8e53-663fe82a141d","Type":"ContainerStarted","Data":"2851ed24dc865f3741922304ac56db70153aa700331dd11579bce24dcd1903be"}
May 28 15:02:33.465784 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:33.465786    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-crdcq" event={"ID":"950fa335-8ee1-4931-8e53-663fe82a141d","Type":"ContainerStarted","Data":"0fb355f06a33ea8cfafdeb73c209569b06c743058720cf02e15f314e81e6afb5"}
May 28 15:02:33.466027 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:33.465847    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-crdcq"
May 28 15:02:33.467303 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:33.467275    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-nhxzg" event={"ID":"3486a976-a83a-4209-b180-e1ce735c890a","Type":"ContainerStarted","Data":"e6ea90a8bfb7793fde17ab30857969760e273969ee8d6c6fbfea05325820ca55"}
May 28 15:02:33.467303 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:33.467304    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-nhxzg" event={"ID":"3486a976-a83a-4209-b180-e1ce735c890a","Type":"ContainerStarted","Data":"ba20331eebe8ee890ad9926ca1d4d474a07e797dbb68be2384f2c6a073a082cd"}
May 28 15:02:33.467465 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:33.467329    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-nhxzg"
May 28 15:02:33.468467 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:33.468449    2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-kgvjb"
May 28 15:02:33.468467 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:33.468460    2563 scope.go:117] "RemoveContainer" containerID="d5d6f4ca2448be5763f153b1c3bc2bf855ec9309acc67ef6dcbbb75bc330b52b"
May 28 15:02:33.470620 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:33.470285    2563 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-h6srp" podUID="94e8da07-5b24-4e91-b99d-9847b5667954" containerName="manager" containerID="cri-o://f83a48a1f46c09a348c5d7339f2294f22e6e219e8a9ee839d2bc2681b6093a5b" gracePeriod=2
May 28 15:02:33.531102 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:33.531043    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-crdcq" podStartSLOduration=1.5310268759999999 podStartE2EDuration="1.531026876s" podCreationTimestamp="2026-05-28 15:02:32 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 15:02:33.5279818 +0000 UTC m=+573.617198512" watchObservedRunningTime="2026-05-28 15:02:33.531026876 +0000 UTC m=+573.620243616"
May 28 15:02:33.557637 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:33.557580    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-nhxzg" podStartSLOduration=1.5575664919999999 podStartE2EDuration="1.557566492s" podCreationTimestamp="2026-05-28 15:02:32 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 15:02:33.553687284 +0000 UTC m=+573.642904000" watchObservedRunningTime="2026-05-28 15:02:33.557566492 +0000 UTC m=+573.646783215"
May 28 15:02:33.720047 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:33.720003    2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-h6srp"
May 28 15:02:33.722787 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:33.722757    2563 status_manager.go:895] "Failed to get status for pod" podUID="94e8da07-5b24-4e91-b99d-9847b5667954" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-h6srp" err="pods \"kuadrant-operator-controller-manager-6bc9f4c76f-h6srp\" is forbidden: User \"system:node:ip-10-0-137-84.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-84.ec2.internal' and this object"
May 28 15:02:33.804338 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:33.804300    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xwm84\" (UniqueName: \"kubernetes.io/projected/94e8da07-5b24-4e91-b99d-9847b5667954-kube-api-access-xwm84\") pod \"94e8da07-5b24-4e91-b99d-9847b5667954\" (UID: \"94e8da07-5b24-4e91-b99d-9847b5667954\") "
May 28 15:02:33.804514 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:33.804396    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/94e8da07-5b24-4e91-b99d-9847b5667954-extensions-socket-volume\") pod \"94e8da07-5b24-4e91-b99d-9847b5667954\" (UID: \"94e8da07-5b24-4e91-b99d-9847b5667954\") "
May 28 15:02:33.804767 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:33.804741    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94e8da07-5b24-4e91-b99d-9847b5667954-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "94e8da07-5b24-4e91-b99d-9847b5667954" (UID: "94e8da07-5b24-4e91-b99d-9847b5667954"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 15:02:33.806487 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:33.806463    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/94e8da07-5b24-4e91-b99d-9847b5667954-kube-api-access-xwm84" (OuterVolumeSpecName: "kube-api-access-xwm84") pod "94e8da07-5b24-4e91-b99d-9847b5667954" (UID: "94e8da07-5b24-4e91-b99d-9847b5667954"). InnerVolumeSpecName "kube-api-access-xwm84". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 15:02:33.905693 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:33.905649    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xwm84\" (UniqueName: \"kubernetes.io/projected/94e8da07-5b24-4e91-b99d-9847b5667954-kube-api-access-xwm84\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
May 28 15:02:33.905878 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:33.905711    2563 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/94e8da07-5b24-4e91-b99d-9847b5667954-extensions-socket-volume\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
May 28 15:02:34.476229 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:34.476187    2563 generic.go:358] "Generic (PLEG): container finished" podID="94e8da07-5b24-4e91-b99d-9847b5667954" containerID="f83a48a1f46c09a348c5d7339f2294f22e6e219e8a9ee839d2bc2681b6093a5b" exitCode=0
May 28 15:02:34.476403 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:34.476292    2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-h6srp"
May 28 15:02:34.478585 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:34.478547    2563 status_manager.go:895] "Failed to get status for pod" podUID="94e8da07-5b24-4e91-b99d-9847b5667954" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-h6srp" err="pods \"kuadrant-operator-controller-manager-6bc9f4c76f-h6srp\" is forbidden: User \"system:node:ip-10-0-137-84.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-84.ec2.internal' and this object"
May 28 15:02:34.480103 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:34.480079    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="31b05d6b-20eb-4a8e-9b56-fe68eb1024c5" path="/var/lib/kubelet/pods/31b05d6b-20eb-4a8e-9b56-fe68eb1024c5/volumes"
May 28 15:02:34.480445 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:34.480432    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="94e8da07-5b24-4e91-b99d-9847b5667954" path="/var/lib/kubelet/pods/94e8da07-5b24-4e91-b99d-9847b5667954/volumes"
May 28 15:02:34.480794 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:34.480781    2563 scope.go:117] "RemoveContainer" containerID="f83a48a1f46c09a348c5d7339f2294f22e6e219e8a9ee839d2bc2681b6093a5b"
May 28 15:02:34.490995 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:34.490823    2563 scope.go:117] "RemoveContainer" containerID="f83a48a1f46c09a348c5d7339f2294f22e6e219e8a9ee839d2bc2681b6093a5b"
May 28 15:02:34.491142 ip-10-0-137-84 kubenswrapper[2563]: E0528 15:02:34.491120    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f83a48a1f46c09a348c5d7339f2294f22e6e219e8a9ee839d2bc2681b6093a5b\": container with ID starting with f83a48a1f46c09a348c5d7339f2294f22e6e219e8a9ee839d2bc2681b6093a5b not found: ID does not exist" containerID="f83a48a1f46c09a348c5d7339f2294f22e6e219e8a9ee839d2bc2681b6093a5b"
May 28 15:02:34.491186 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:34.491153    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f83a48a1f46c09a348c5d7339f2294f22e6e219e8a9ee839d2bc2681b6093a5b"} err="failed to get container status \"f83a48a1f46c09a348c5d7339f2294f22e6e219e8a9ee839d2bc2681b6093a5b\": rpc error: code = NotFound desc = could not find container \"f83a48a1f46c09a348c5d7339f2294f22e6e219e8a9ee839d2bc2681b6093a5b\": container with ID starting with f83a48a1f46c09a348c5d7339f2294f22e6e219e8a9ee839d2bc2681b6093a5b not found: ID does not exist"
May 28 15:02:40.463946 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:40.463905    2563 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-57c4dd7699-8dcxx" podUID="42078623-d34e-4b9a-a467-a861f2a68c21" containerName="console" containerID="cri-o://7fb34272b8c705379729cb95af3f408e9769151f5720f19b0df786bf76bc6665" gracePeriod=15
May 28 15:02:40.719943 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:40.719874    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-57c4dd7699-8dcxx_42078623-d34e-4b9a-a467-a861f2a68c21/console/0.log"
May 28 15:02:40.719943 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:40.719936    2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57c4dd7699-8dcxx"
May 28 15:02:40.766563 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:40.766524    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/42078623-d34e-4b9a-a467-a861f2a68c21-oauth-serving-cert\") pod \"42078623-d34e-4b9a-a467-a861f2a68c21\" (UID: \"42078623-d34e-4b9a-a467-a861f2a68c21\") "
May 28 15:02:40.766563 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:40.766566    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gzww6\" (UniqueName: \"kubernetes.io/projected/42078623-d34e-4b9a-a467-a861f2a68c21-kube-api-access-gzww6\") pod \"42078623-d34e-4b9a-a467-a861f2a68c21\" (UID: \"42078623-d34e-4b9a-a467-a861f2a68c21\") "
May 28 15:02:40.766839 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:40.766606    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/42078623-d34e-4b9a-a467-a861f2a68c21-console-oauth-config\") pod \"42078623-d34e-4b9a-a467-a861f2a68c21\" (UID: \"42078623-d34e-4b9a-a467-a861f2a68c21\") "
May 28 15:02:40.766839 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:40.766636    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/42078623-d34e-4b9a-a467-a861f2a68c21-trusted-ca-bundle\") pod \"42078623-d34e-4b9a-a467-a861f2a68c21\" (UID: \"42078623-d34e-4b9a-a467-a861f2a68c21\") "
May 28 15:02:40.766959 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:40.766850    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/42078623-d34e-4b9a-a467-a861f2a68c21-console-config\") pod \"42078623-d34e-4b9a-a467-a861f2a68c21\" (UID: \"42078623-d34e-4b9a-a467-a861f2a68c21\") "
May 28 15:02:40.766959 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:40.766900    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/42078623-d34e-4b9a-a467-a861f2a68c21-service-ca\") pod \"42078623-d34e-4b9a-a467-a861f2a68c21\" (UID: \"42078623-d34e-4b9a-a467-a861f2a68c21\") "
May 28 15:02:40.766959 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:40.766944    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/42078623-d34e-4b9a-a467-a861f2a68c21-console-serving-cert\") pod \"42078623-d34e-4b9a-a467-a861f2a68c21\" (UID: \"42078623-d34e-4b9a-a467-a861f2a68c21\") "
May 28 15:02:40.767194 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:40.767132    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/42078623-d34e-4b9a-a467-a861f2a68c21-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "42078623-d34e-4b9a-a467-a861f2a68c21" (UID: "42078623-d34e-4b9a-a467-a861f2a68c21"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 15:02:40.767194 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:40.767145    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/42078623-d34e-4b9a-a467-a861f2a68c21-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "42078623-d34e-4b9a-a467-a861f2a68c21" (UID: "42078623-d34e-4b9a-a467-a861f2a68c21"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 15:02:40.767337 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:40.767278    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/42078623-d34e-4b9a-a467-a861f2a68c21-console-config" (OuterVolumeSpecName: "console-config") pod "42078623-d34e-4b9a-a467-a861f2a68c21" (UID: "42078623-d34e-4b9a-a467-a861f2a68c21"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 15:02:40.767337 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:40.767294    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/42078623-d34e-4b9a-a467-a861f2a68c21-service-ca" (OuterVolumeSpecName: "service-ca") pod "42078623-d34e-4b9a-a467-a861f2a68c21" (UID: "42078623-d34e-4b9a-a467-a861f2a68c21"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 15:02:40.767337 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:40.767318    2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/42078623-d34e-4b9a-a467-a861f2a68c21-trusted-ca-bundle\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
May 28 15:02:40.767432 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:40.767337    2563 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/42078623-d34e-4b9a-a467-a861f2a68c21-oauth-serving-cert\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
May 28 15:02:40.769020 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:40.768991    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/42078623-d34e-4b9a-a467-a861f2a68c21-kube-api-access-gzww6" (OuterVolumeSpecName: "kube-api-access-gzww6") pod "42078623-d34e-4b9a-a467-a861f2a68c21" (UID: "42078623-d34e-4b9a-a467-a861f2a68c21"). InnerVolumeSpecName "kube-api-access-gzww6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 15:02:40.769112 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:40.769080    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/42078623-d34e-4b9a-a467-a861f2a68c21-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "42078623-d34e-4b9a-a467-a861f2a68c21" (UID: "42078623-d34e-4b9a-a467-a861f2a68c21"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 15:02:40.769308 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:40.769287    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/42078623-d34e-4b9a-a467-a861f2a68c21-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "42078623-d34e-4b9a-a467-a861f2a68c21" (UID: "42078623-d34e-4b9a-a467-a861f2a68c21"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 15:02:40.868415 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:40.868380    2563 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/42078623-d34e-4b9a-a467-a861f2a68c21-console-config\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
May 28 15:02:40.868415 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:40.868410    2563 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/42078623-d34e-4b9a-a467-a861f2a68c21-service-ca\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
May 28 15:02:40.868415 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:40.868419    2563 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/42078623-d34e-4b9a-a467-a861f2a68c21-console-serving-cert\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
May 28 15:02:40.868621 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:40.868428    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gzww6\" (UniqueName: \"kubernetes.io/projected/42078623-d34e-4b9a-a467-a861f2a68c21-kube-api-access-gzww6\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
May 28 15:02:40.868621 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:40.868438    2563 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/42078623-d34e-4b9a-a467-a861f2a68c21-console-oauth-config\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
May 28 15:02:41.508776 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:41.508748    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-57c4dd7699-8dcxx_42078623-d34e-4b9a-a467-a861f2a68c21/console/0.log"
May 28 15:02:41.509263 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:41.508788    2563 generic.go:358] "Generic (PLEG): container finished" podID="42078623-d34e-4b9a-a467-a861f2a68c21" containerID="7fb34272b8c705379729cb95af3f408e9769151f5720f19b0df786bf76bc6665" exitCode=2
May 28 15:02:41.509263 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:41.508823    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57c4dd7699-8dcxx" event={"ID":"42078623-d34e-4b9a-a467-a861f2a68c21","Type":"ContainerDied","Data":"7fb34272b8c705379729cb95af3f408e9769151f5720f19b0df786bf76bc6665"}
May 28 15:02:41.509263 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:41.508865    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57c4dd7699-8dcxx" event={"ID":"42078623-d34e-4b9a-a467-a861f2a68c21","Type":"ContainerDied","Data":"fc75b1075f88bed6216eaaf081c9f33b48e1b05c94aa7b4eeb33ff1ad565fbc1"}
May 28 15:02:41.509263 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:41.508869    2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57c4dd7699-8dcxx"
May 28 15:02:41.509263 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:41.508880    2563 scope.go:117] "RemoveContainer" containerID="7fb34272b8c705379729cb95af3f408e9769151f5720f19b0df786bf76bc6665"
May 28 15:02:41.517773 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:41.517752    2563 scope.go:117] "RemoveContainer" containerID="7fb34272b8c705379729cb95af3f408e9769151f5720f19b0df786bf76bc6665"
May 28 15:02:41.518020 ip-10-0-137-84 kubenswrapper[2563]: E0528 15:02:41.518005    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7fb34272b8c705379729cb95af3f408e9769151f5720f19b0df786bf76bc6665\": container with ID starting with 7fb34272b8c705379729cb95af3f408e9769151f5720f19b0df786bf76bc6665 not found: ID does not exist" containerID="7fb34272b8c705379729cb95af3f408e9769151f5720f19b0df786bf76bc6665"
May 28 15:02:41.518070 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:41.518027    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7fb34272b8c705379729cb95af3f408e9769151f5720f19b0df786bf76bc6665"} err="failed to get container status \"7fb34272b8c705379729cb95af3f408e9769151f5720f19b0df786bf76bc6665\": rpc error: code = NotFound desc = could not find container \"7fb34272b8c705379729cb95af3f408e9769151f5720f19b0df786bf76bc6665\": container with ID starting with 7fb34272b8c705379729cb95af3f408e9769151f5720f19b0df786bf76bc6665 not found: ID does not exist"
May 28 15:02:41.529596 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:41.529566    2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-57c4dd7699-8dcxx"]
May 28 15:02:41.532477 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:41.532451    2563 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-57c4dd7699-8dcxx"]
May 28 15:02:42.480331 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:42.480299    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="42078623-d34e-4b9a-a467-a861f2a68c21" path="/var/lib/kubelet/pods/42078623-d34e-4b9a-a467-a861f2a68c21/volumes"
May 28 15:02:44.481519 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:44.481483    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-crdcq"
May 28 15:02:44.482083 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:44.481548    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-nhxzg"
May 28 15:02:44.543471 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:44.543432    2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-crdcq"]
May 28 15:02:44.543743 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:44.543718    2563 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-crdcq" podUID="950fa335-8ee1-4931-8e53-663fe82a141d" containerName="manager" containerID="cri-o://2851ed24dc865f3741922304ac56db70153aa700331dd11579bce24dcd1903be" gracePeriod=10
May 28 15:02:44.778582 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:44.778549    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-2dqs8"]
May 28 15:02:44.779030 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:44.779014    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="42078623-d34e-4b9a-a467-a861f2a68c21" containerName="console"
May 28 15:02:44.779030 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:44.779032    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="42078623-d34e-4b9a-a467-a861f2a68c21" containerName="console"
May 28 15:02:44.779137 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:44.779092    2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="42078623-d34e-4b9a-a467-a861f2a68c21" containerName="console"
May 28 15:02:44.782143 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:44.782092    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-2dqs8"
May 28 15:02:44.793896 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:44.793866    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-2dqs8"]
May 28 15:02:44.813390 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:44.813361    2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-crdcq"
May 28 15:02:44.905181 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:44.905148    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/950fa335-8ee1-4931-8e53-663fe82a141d-extensions-socket-volume\") pod \"950fa335-8ee1-4931-8e53-663fe82a141d\" (UID: \"950fa335-8ee1-4931-8e53-663fe82a141d\") "
May 28 15:02:44.905366 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:44.905249    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c2b7h\" (UniqueName: \"kubernetes.io/projected/950fa335-8ee1-4931-8e53-663fe82a141d-kube-api-access-c2b7h\") pod \"950fa335-8ee1-4931-8e53-663fe82a141d\" (UID: \"950fa335-8ee1-4931-8e53-663fe82a141d\") "
May 28 15:02:44.905366 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:44.905333    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7bslx\" (UniqueName: \"kubernetes.io/projected/294d11b9-c0aa-4e94-966f-03d59714d772-kube-api-access-7bslx\") pod \"kuadrant-operator-controller-manager-55c7f4c975-2dqs8\" (UID: \"294d11b9-c0aa-4e94-966f-03d59714d772\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-2dqs8"
May 28 15:02:44.905461 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:44.905374    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/294d11b9-c0aa-4e94-966f-03d59714d772-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-2dqs8\" (UID: \"294d11b9-c0aa-4e94-966f-03d59714d772\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-2dqs8"
May 28 15:02:44.905625 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:44.905600    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/950fa335-8ee1-4931-8e53-663fe82a141d-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "950fa335-8ee1-4931-8e53-663fe82a141d" (UID: "950fa335-8ee1-4931-8e53-663fe82a141d"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 15:02:44.907490 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:44.907465    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/950fa335-8ee1-4931-8e53-663fe82a141d-kube-api-access-c2b7h" (OuterVolumeSpecName: "kube-api-access-c2b7h") pod "950fa335-8ee1-4931-8e53-663fe82a141d" (UID: "950fa335-8ee1-4931-8e53-663fe82a141d"). InnerVolumeSpecName "kube-api-access-c2b7h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 15:02:45.006780 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:45.006740    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/294d11b9-c0aa-4e94-966f-03d59714d772-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-2dqs8\" (UID: \"294d11b9-c0aa-4e94-966f-03d59714d772\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-2dqs8"
May 28 15:02:45.006931 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:45.006848    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7bslx\" (UniqueName: \"kubernetes.io/projected/294d11b9-c0aa-4e94-966f-03d59714d772-kube-api-access-7bslx\") pod \"kuadrant-operator-controller-manager-55c7f4c975-2dqs8\" (UID: \"294d11b9-c0aa-4e94-966f-03d59714d772\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-2dqs8"
May 28 15:02:45.006931 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:45.006897    2563 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/950fa335-8ee1-4931-8e53-663fe82a141d-extensions-socket-volume\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
May 28 15:02:45.006931 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:45.006909    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c2b7h\" (UniqueName: \"kubernetes.io/projected/950fa335-8ee1-4931-8e53-663fe82a141d-kube-api-access-c2b7h\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
May 28 15:02:45.007183 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:45.007164    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/294d11b9-c0aa-4e94-966f-03d59714d772-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-2dqs8\" (UID: \"294d11b9-c0aa-4e94-966f-03d59714d772\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-2dqs8"
May 28 15:02:45.015170 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:45.015143    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7bslx\" (UniqueName: \"kubernetes.io/projected/294d11b9-c0aa-4e94-966f-03d59714d772-kube-api-access-7bslx\") pod \"kuadrant-operator-controller-manager-55c7f4c975-2dqs8\" (UID: \"294d11b9-c0aa-4e94-966f-03d59714d772\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-2dqs8"
May 28 15:02:45.111189 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:45.111149    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-2dqs8"
May 28 15:02:45.251554 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:45.251523    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-2dqs8"]
May 28 15:02:45.253724 ip-10-0-137-84 kubenswrapper[2563]: W0528 15:02:45.253696    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod294d11b9_c0aa_4e94_966f_03d59714d772.slice/crio-a6361adbc9ace28acb79793f9b4228a88382cc30ae0d3d0e7fa716bf86c3cac9 WatchSource:0}: Error finding container a6361adbc9ace28acb79793f9b4228a88382cc30ae0d3d0e7fa716bf86c3cac9: Status 404 returned error can't find the container with id a6361adbc9ace28acb79793f9b4228a88382cc30ae0d3d0e7fa716bf86c3cac9
May 28 15:02:45.533995 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:45.533911    2563 generic.go:358] "Generic (PLEG): container finished" podID="950fa335-8ee1-4931-8e53-663fe82a141d" containerID="2851ed24dc865f3741922304ac56db70153aa700331dd11579bce24dcd1903be" exitCode=0
May 28 15:02:45.533995 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:45.533971    2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-crdcq"
May 28 15:02:45.533995 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:45.533982    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-crdcq" event={"ID":"950fa335-8ee1-4931-8e53-663fe82a141d","Type":"ContainerDied","Data":"2851ed24dc865f3741922304ac56db70153aa700331dd11579bce24dcd1903be"}
May 28 15:02:45.534525 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:45.534012    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-crdcq" event={"ID":"950fa335-8ee1-4931-8e53-663fe82a141d","Type":"ContainerDied","Data":"0fb355f06a33ea8cfafdeb73c209569b06c743058720cf02e15f314e81e6afb5"}
May 28 15:02:45.534525 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:45.534035    2563 scope.go:117] "RemoveContainer" containerID="2851ed24dc865f3741922304ac56db70153aa700331dd11579bce24dcd1903be"
May 28 15:02:45.535646 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:45.535621    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-2dqs8" event={"ID":"294d11b9-c0aa-4e94-966f-03d59714d772","Type":"ContainerStarted","Data":"b81986b2266dce96404a07199f871dd0d0678d5e4dc2d4992caae9905d393d2c"}
May 28 15:02:45.535789 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:45.535650    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-2dqs8" event={"ID":"294d11b9-c0aa-4e94-966f-03d59714d772","Type":"ContainerStarted","Data":"a6361adbc9ace28acb79793f9b4228a88382cc30ae0d3d0e7fa716bf86c3cac9"}
May 28 15:02:45.535855 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:45.535811    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-2dqs8"
May 28 15:02:45.543652 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:45.543637    2563 scope.go:117] "RemoveContainer" containerID="2851ed24dc865f3741922304ac56db70153aa700331dd11579bce24dcd1903be"
May 28 15:02:45.543909 ip-10-0-137-84 kubenswrapper[2563]: E0528 15:02:45.543892    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2851ed24dc865f3741922304ac56db70153aa700331dd11579bce24dcd1903be\": container with ID starting with 2851ed24dc865f3741922304ac56db70153aa700331dd11579bce24dcd1903be not found: ID does not exist" containerID="2851ed24dc865f3741922304ac56db70153aa700331dd11579bce24dcd1903be"
May 28 15:02:45.543977 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:45.543916    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2851ed24dc865f3741922304ac56db70153aa700331dd11579bce24dcd1903be"} err="failed to get container status \"2851ed24dc865f3741922304ac56db70153aa700331dd11579bce24dcd1903be\": rpc error: code = NotFound desc = could not find container \"2851ed24dc865f3741922304ac56db70153aa700331dd11579bce24dcd1903be\": container with ID starting with 2851ed24dc865f3741922304ac56db70153aa700331dd11579bce24dcd1903be not found: ID does not exist"
May 28 15:02:45.561141 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:45.560636    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-2dqs8" podStartSLOduration=1.560621598 podStartE2EDuration="1.560621598s" podCreationTimestamp="2026-05-28 15:02:44 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 15:02:45.557180449 +0000 UTC m=+585.646397173" watchObservedRunningTime="2026-05-28 15:02:45.560621598 +0000 UTC m=+585.649838325"
May 28 15:02:45.580911 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:45.580883    2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-crdcq"]
May 28 15:02:45.587853 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:45.587819    2563 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-crdcq"]
May 28 15:02:46.480327 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:46.480296    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="950fa335-8ee1-4931-8e53-663fe82a141d" path="/var/lib/kubelet/pods/950fa335-8ee1-4931-8e53-663fe82a141d/volumes"
May 28 15:02:56.543222 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:56.543187    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-2dqs8"
May 28 15:02:56.596878 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:56.596840    2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-nhxzg"]
May 28 15:02:56.597152 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:56.597108    2563 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-nhxzg" podUID="3486a976-a83a-4209-b180-e1ce735c890a" containerName="manager" containerID="cri-o://e6ea90a8bfb7793fde17ab30857969760e273969ee8d6c6fbfea05325820ca55" gracePeriod=10
May 28 15:02:56.856588 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:56.856558    2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-nhxzg"
May 28 15:02:56.909487 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:56.909452    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3486a976-a83a-4209-b180-e1ce735c890a-extensions-socket-volume\") pod \"3486a976-a83a-4209-b180-e1ce735c890a\" (UID: \"3486a976-a83a-4209-b180-e1ce735c890a\") "
May 28 15:02:56.909487 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:56.909489    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kq2t6\" (UniqueName: \"kubernetes.io/projected/3486a976-a83a-4209-b180-e1ce735c890a-kube-api-access-kq2t6\") pod \"3486a976-a83a-4209-b180-e1ce735c890a\" (UID: \"3486a976-a83a-4209-b180-e1ce735c890a\") "
May 28 15:02:56.909853 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:56.909826    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3486a976-a83a-4209-b180-e1ce735c890a-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "3486a976-a83a-4209-b180-e1ce735c890a" (UID: "3486a976-a83a-4209-b180-e1ce735c890a"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 15:02:56.911487 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:56.911467    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3486a976-a83a-4209-b180-e1ce735c890a-kube-api-access-kq2t6" (OuterVolumeSpecName: "kube-api-access-kq2t6") pod "3486a976-a83a-4209-b180-e1ce735c890a" (UID: "3486a976-a83a-4209-b180-e1ce735c890a"). InnerVolumeSpecName "kube-api-access-kq2t6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 15:02:57.010280 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:57.010241    2563 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3486a976-a83a-4209-b180-e1ce735c890a-extensions-socket-volume\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
May 28 15:02:57.010280 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:57.010274    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kq2t6\" (UniqueName: \"kubernetes.io/projected/3486a976-a83a-4209-b180-e1ce735c890a-kube-api-access-kq2t6\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
May 28 15:02:57.591512 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:57.591473    2563 generic.go:358] "Generic (PLEG): container finished" podID="3486a976-a83a-4209-b180-e1ce735c890a" containerID="e6ea90a8bfb7793fde17ab30857969760e273969ee8d6c6fbfea05325820ca55" exitCode=0
May 28 15:02:57.592018 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:57.591548    2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-nhxzg"
May 28 15:02:57.592018 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:57.591557    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-nhxzg" event={"ID":"3486a976-a83a-4209-b180-e1ce735c890a","Type":"ContainerDied","Data":"e6ea90a8bfb7793fde17ab30857969760e273969ee8d6c6fbfea05325820ca55"}
May 28 15:02:57.592018 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:57.591594    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-nhxzg" event={"ID":"3486a976-a83a-4209-b180-e1ce735c890a","Type":"ContainerDied","Data":"ba20331eebe8ee890ad9926ca1d4d474a07e797dbb68be2384f2c6a073a082cd"}
May 28 15:02:57.592018 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:57.591612    2563 scope.go:117] "RemoveContainer" containerID="e6ea90a8bfb7793fde17ab30857969760e273969ee8d6c6fbfea05325820ca55"
May 28 15:02:57.602061 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:57.601884    2563 scope.go:117] "RemoveContainer" containerID="e6ea90a8bfb7793fde17ab30857969760e273969ee8d6c6fbfea05325820ca55"
May 28 15:02:57.602251 ip-10-0-137-84 kubenswrapper[2563]: E0528 15:02:57.602227    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e6ea90a8bfb7793fde17ab30857969760e273969ee8d6c6fbfea05325820ca55\": container with ID starting with e6ea90a8bfb7793fde17ab30857969760e273969ee8d6c6fbfea05325820ca55 not found: ID does not exist" containerID="e6ea90a8bfb7793fde17ab30857969760e273969ee8d6c6fbfea05325820ca55"
May 28 15:02:57.602325 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:57.602263    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e6ea90a8bfb7793fde17ab30857969760e273969ee8d6c6fbfea05325820ca55"} err="failed to get container status \"e6ea90a8bfb7793fde17ab30857969760e273969ee8d6c6fbfea05325820ca55\": rpc error: code = NotFound desc = could not find container \"e6ea90a8bfb7793fde17ab30857969760e273969ee8d6c6fbfea05325820ca55\": container with ID starting with e6ea90a8bfb7793fde17ab30857969760e273969ee8d6c6fbfea05325820ca55 not found: ID does not exist"
May 28 15:02:57.619800 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:57.619775    2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-nhxzg"]
May 28 15:02:57.623800 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:57.623773    2563 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-nhxzg"]
May 28 15:02:58.480175 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:02:58.480143    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3486a976-a83a-4209-b180-e1ce735c890a" path="/var/lib/kubelet/pods/3486a976-a83a-4209-b180-e1ce735c890a/volumes"
May 28 15:03:00.398199 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:03:00.398157    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-86zbj_8d769c1c-5bf7-49c6-bf05-531b243e935e/console-operator/2.log"
May 28 15:03:00.399189 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:03:00.399169    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-86zbj_8d769c1c-5bf7-49c6-bf05-531b243e935e/console-operator/2.log"
May 28 15:03:00.401601 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:03:00.401581    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ssv8l_f3df342f-512f-410a-8b64-171bc7255a0e/ovn-acl-logging/0.log"
May 28 15:03:00.402480 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:03:00.402458    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ssv8l_f3df342f-512f-410a-8b64-171bc7255a0e/ovn-acl-logging/0.log"
May 28 15:03:15.228889 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:03:15.228849    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-5tmsb"]
May 28 15:03:15.229274 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:03:15.229234    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3486a976-a83a-4209-b180-e1ce735c890a" containerName="manager"
May 28 15:03:15.229274 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:03:15.229248    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="3486a976-a83a-4209-b180-e1ce735c890a" containerName="manager"
May 28 15:03:15.229274 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:03:15.229267    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="950fa335-8ee1-4931-8e53-663fe82a141d" containerName="manager"
May 28 15:03:15.229274 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:03:15.229274    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="950fa335-8ee1-4931-8e53-663fe82a141d" containerName="manager"
May 28 15:03:15.229448 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:03:15.229332    2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="950fa335-8ee1-4931-8e53-663fe82a141d" containerName="manager"
May 28 15:03:15.229448 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:03:15.229343    2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="3486a976-a83a-4209-b180-e1ce735c890a" containerName="manager"
May 28 15:03:15.231371 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:03:15.231353    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-5tmsb"
May 28 15:03:15.233822 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:03:15.233800    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
May 28 15:03:15.233945 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:03:15.233898    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-5frlp\""
May 28 15:03:15.239526 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:03:15.239501    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-5tmsb"]
May 28 15:03:15.325245 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:03:15.325213    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-5tmsb"]
May 28 15:03:15.371480 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:03:15.371450    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/af544c0e-f9b1-4e2e-8823-95cfe9a8442e-config-file\") pod \"limitador-limitador-7d549b5b-5tmsb\" (UID: \"af544c0e-f9b1-4e2e-8823-95cfe9a8442e\") " pod="kuadrant-system/limitador-limitador-7d549b5b-5tmsb"
May 28 15:03:15.371643 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:03:15.371492    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kjwx9\" (UniqueName: \"kubernetes.io/projected/af544c0e-f9b1-4e2e-8823-95cfe9a8442e-kube-api-access-kjwx9\") pod \"limitador-limitador-7d549b5b-5tmsb\" (UID: \"af544c0e-f9b1-4e2e-8823-95cfe9a8442e\") " pod="kuadrant-system/limitador-limitador-7d549b5b-5tmsb"
May 28 15:03:15.472653 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:03:15.472620    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/af544c0e-f9b1-4e2e-8823-95cfe9a8442e-config-file\") pod \"limitador-limitador-7d549b5b-5tmsb\" (UID: \"af544c0e-f9b1-4e2e-8823-95cfe9a8442e\") " pod="kuadrant-system/limitador-limitador-7d549b5b-5tmsb"
May 28 15:03:15.472872 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:03:15.472669    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kjwx9\" (UniqueName: \"kubernetes.io/projected/af544c0e-f9b1-4e2e-8823-95cfe9a8442e-kube-api-access-kjwx9\") pod \"limitador-limitador-7d549b5b-5tmsb\" (UID: \"af544c0e-f9b1-4e2e-8823-95cfe9a8442e\") " pod="kuadrant-system/limitador-limitador-7d549b5b-5tmsb"
May 28 15:03:15.473253 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:03:15.473231    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/af544c0e-f9b1-4e2e-8823-95cfe9a8442e-config-file\") pod \"limitador-limitador-7d549b5b-5tmsb\" (UID: \"af544c0e-f9b1-4e2e-8823-95cfe9a8442e\") " pod="kuadrant-system/limitador-limitador-7d549b5b-5tmsb"
May 28 15:03:15.480459 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:03:15.480398    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kjwx9\" (UniqueName: \"kubernetes.io/projected/af544c0e-f9b1-4e2e-8823-95cfe9a8442e-kube-api-access-kjwx9\") pod \"limitador-limitador-7d549b5b-5tmsb\" (UID: \"af544c0e-f9b1-4e2e-8823-95cfe9a8442e\") " pod="kuadrant-system/limitador-limitador-7d549b5b-5tmsb"
May 28 15:03:15.542021 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:03:15.541995    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-5tmsb"
May 28 15:03:15.699190 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:03:15.699161    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-5tmsb"]
May 28 15:03:15.700296 ip-10-0-137-84 kubenswrapper[2563]: W0528 15:03:15.700268    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf544c0e_f9b1_4e2e_8823_95cfe9a8442e.slice/crio-3e6cd04cf615a856f4ade70ad2be11ae23524893cc898a3fd5767f2d4c55dc1d WatchSource:0}: Error finding container 3e6cd04cf615a856f4ade70ad2be11ae23524893cc898a3fd5767f2d4c55dc1d: Status 404 returned error can't find the container with id 3e6cd04cf615a856f4ade70ad2be11ae23524893cc898a3fd5767f2d4c55dc1d
May 28 15:03:16.674550 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:03:16.674417    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-5tmsb" event={"ID":"af544c0e-f9b1-4e2e-8823-95cfe9a8442e","Type":"ContainerStarted","Data":"3e6cd04cf615a856f4ade70ad2be11ae23524893cc898a3fd5767f2d4c55dc1d"}
May 28 15:03:18.684602 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:03:18.684567    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-5tmsb" event={"ID":"af544c0e-f9b1-4e2e-8823-95cfe9a8442e","Type":"ContainerStarted","Data":"52058f72367e1e5270b9fe28b3f51f5b738cf39147fa27c86c38614c0d8671d6"}
May 28 15:03:18.684992 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:03:18.684697    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-7d549b5b-5tmsb"
May 28 15:03:18.699644 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:03:18.699589    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-7d549b5b-5tmsb" podStartSLOduration=0.878353249 podStartE2EDuration="3.699576785s" podCreationTimestamp="2026-05-28 15:03:15 +0000 UTC" firstStartedPulling="2026-05-28 15:03:15.702067075 +0000 UTC m=+615.791283777" lastFinishedPulling="2026-05-28 15:03:18.523290608 +0000 UTC m=+618.612507313" observedRunningTime="2026-05-28 15:03:18.69926163 +0000 UTC m=+618.788478354" watchObservedRunningTime="2026-05-28 15:03:18.699576785 +0000 UTC m=+618.788793510"
May 28 15:03:29.690277 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:03:29.690249    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-7d549b5b-5tmsb"
May 28 15:03:31.936126 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:03:31.936084    2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-5tmsb"]
May 28 15:03:31.936540 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:03:31.936334    2563 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-7d549b5b-5tmsb" podUID="af544c0e-f9b1-4e2e-8823-95cfe9a8442e" containerName="limitador" containerID="cri-o://52058f72367e1e5270b9fe28b3f51f5b738cf39147fa27c86c38614c0d8671d6" gracePeriod=30
May 28 15:03:32.480903 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:03:32.480881    2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-5tmsb"
May 28 15:03:32.521398 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:03:32.521321    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/af544c0e-f9b1-4e2e-8823-95cfe9a8442e-config-file\") pod \"af544c0e-f9b1-4e2e-8823-95cfe9a8442e\" (UID: \"af544c0e-f9b1-4e2e-8823-95cfe9a8442e\") "
May 28 15:03:32.521398 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:03:32.521363    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kjwx9\" (UniqueName: \"kubernetes.io/projected/af544c0e-f9b1-4e2e-8823-95cfe9a8442e-kube-api-access-kjwx9\") pod \"af544c0e-f9b1-4e2e-8823-95cfe9a8442e\" (UID: \"af544c0e-f9b1-4e2e-8823-95cfe9a8442e\") "
May 28 15:03:32.521670 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:03:32.521647    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/af544c0e-f9b1-4e2e-8823-95cfe9a8442e-config-file" (OuterVolumeSpecName: "config-file") pod "af544c0e-f9b1-4e2e-8823-95cfe9a8442e" (UID: "af544c0e-f9b1-4e2e-8823-95cfe9a8442e"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 15:03:32.523417 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:03:32.523381    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/af544c0e-f9b1-4e2e-8823-95cfe9a8442e-kube-api-access-kjwx9" (OuterVolumeSpecName: "kube-api-access-kjwx9") pod "af544c0e-f9b1-4e2e-8823-95cfe9a8442e" (UID: "af544c0e-f9b1-4e2e-8823-95cfe9a8442e"). InnerVolumeSpecName "kube-api-access-kjwx9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 15:03:32.622198 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:03:32.622159    2563 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/af544c0e-f9b1-4e2e-8823-95cfe9a8442e-config-file\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
May 28 15:03:32.622198 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:03:32.622191    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kjwx9\" (UniqueName: \"kubernetes.io/projected/af544c0e-f9b1-4e2e-8823-95cfe9a8442e-kube-api-access-kjwx9\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
May 28 15:03:32.744487 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:03:32.744450    2563 generic.go:358] "Generic (PLEG): container finished" podID="af544c0e-f9b1-4e2e-8823-95cfe9a8442e" containerID="52058f72367e1e5270b9fe28b3f51f5b738cf39147fa27c86c38614c0d8671d6" exitCode=0
May 28 15:03:32.744658 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:03:32.744523    2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-5tmsb"
May 28 15:03:32.744658 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:03:32.744538    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-5tmsb" event={"ID":"af544c0e-f9b1-4e2e-8823-95cfe9a8442e","Type":"ContainerDied","Data":"52058f72367e1e5270b9fe28b3f51f5b738cf39147fa27c86c38614c0d8671d6"}
May 28 15:03:32.744658 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:03:32.744579    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-5tmsb" event={"ID":"af544c0e-f9b1-4e2e-8823-95cfe9a8442e","Type":"ContainerDied","Data":"3e6cd04cf615a856f4ade70ad2be11ae23524893cc898a3fd5767f2d4c55dc1d"}
May 28 15:03:32.744658 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:03:32.744596    2563 scope.go:117] "RemoveContainer" containerID="52058f72367e1e5270b9fe28b3f51f5b738cf39147fa27c86c38614c0d8671d6"
May 28 15:03:32.753370 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:03:32.753352    2563 scope.go:117] "RemoveContainer" containerID="52058f72367e1e5270b9fe28b3f51f5b738cf39147fa27c86c38614c0d8671d6"
May 28 15:03:32.753623 ip-10-0-137-84 kubenswrapper[2563]: E0528 15:03:32.753604    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"52058f72367e1e5270b9fe28b3f51f5b738cf39147fa27c86c38614c0d8671d6\": container with ID starting with 52058f72367e1e5270b9fe28b3f51f5b738cf39147fa27c86c38614c0d8671d6 not found: ID does not exist" containerID="52058f72367e1e5270b9fe28b3f51f5b738cf39147fa27c86c38614c0d8671d6"
May 28 15:03:32.753715 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:03:32.753631    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"52058f72367e1e5270b9fe28b3f51f5b738cf39147fa27c86c38614c0d8671d6"} err="failed to get container status \"52058f72367e1e5270b9fe28b3f51f5b738cf39147fa27c86c38614c0d8671d6\": rpc error: code = NotFound desc = could not find container \"52058f72367e1e5270b9fe28b3f51f5b738cf39147fa27c86c38614c0d8671d6\": container with ID starting with 52058f72367e1e5270b9fe28b3f51f5b738cf39147fa27c86c38614c0d8671d6 not found: ID does not exist"
May 28 15:03:32.765838 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:03:32.765814    2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-5tmsb"]
May 28 15:03:32.769237 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:03:32.769215    2563 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-5tmsb"]
May 28 15:03:34.480233 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:03:34.480200    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="af544c0e-f9b1-4e2e-8823-95cfe9a8442e" path="/var/lib/kubelet/pods/af544c0e-f9b1-4e2e-8823-95cfe9a8442e/volumes"
May 28 15:03:36.996836 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:03:36.996802    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-68c4fbbd6f-84fd8"]
May 28 15:03:36.997252 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:03:36.997150    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="af544c0e-f9b1-4e2e-8823-95cfe9a8442e" containerName="limitador"
May 28 15:03:36.997252 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:03:36.997161    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="af544c0e-f9b1-4e2e-8823-95cfe9a8442e" containerName="limitador"
May 28 15:03:36.997252 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:03:36.997244    2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="af544c0e-f9b1-4e2e-8823-95cfe9a8442e" containerName="limitador"
May 28 15:03:37.000061 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:03:37.000043    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-68c4fbbd6f-84fd8"
May 28 15:03:37.002454 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:03:37.002430    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\""
May 28 15:03:37.002591 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:03:37.002430    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-zqxb6\""
May 28 15:03:37.007491 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:03:37.007464    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-68c4fbbd6f-84fd8"]
May 28 15:03:37.061774 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:03:37.061744    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lq2rf\" (UniqueName: \"kubernetes.io/projected/d6a82f62-d75b-4803-b61b-864066f6d592-kube-api-access-lq2rf\") pod \"postgres-68c4fbbd6f-84fd8\" (UID: \"d6a82f62-d75b-4803-b61b-864066f6d592\") " pod="opendatahub/postgres-68c4fbbd6f-84fd8"
May 28 15:03:37.061955 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:03:37.061861    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/d6a82f62-d75b-4803-b61b-864066f6d592-data\") pod \"postgres-68c4fbbd6f-84fd8\" (UID: \"d6a82f62-d75b-4803-b61b-864066f6d592\") " pod="opendatahub/postgres-68c4fbbd6f-84fd8"
May 28 15:03:37.162979 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:03:37.162946    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/d6a82f62-d75b-4803-b61b-864066f6d592-data\") pod \"postgres-68c4fbbd6f-84fd8\" (UID: \"d6a82f62-d75b-4803-b61b-864066f6d592\") " pod="opendatahub/postgres-68c4fbbd6f-84fd8"
May 28 15:03:37.163171 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:03:37.163001    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lq2rf\" (UniqueName: \"kubernetes.io/projected/d6a82f62-d75b-4803-b61b-864066f6d592-kube-api-access-lq2rf\") pod \"postgres-68c4fbbd6f-84fd8\" (UID: \"d6a82f62-d75b-4803-b61b-864066f6d592\") " pod="opendatahub/postgres-68c4fbbd6f-84fd8"
May 28 15:03:37.163373 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:03:37.163349    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/d6a82f62-d75b-4803-b61b-864066f6d592-data\") pod \"postgres-68c4fbbd6f-84fd8\" (UID: \"d6a82f62-d75b-4803-b61b-864066f6d592\") " pod="opendatahub/postgres-68c4fbbd6f-84fd8"
May 28 15:03:37.172250 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:03:37.172230    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lq2rf\" (UniqueName: \"kubernetes.io/projected/d6a82f62-d75b-4803-b61b-864066f6d592-kube-api-access-lq2rf\") pod \"postgres-68c4fbbd6f-84fd8\" (UID: \"d6a82f62-d75b-4803-b61b-864066f6d592\") " pod="opendatahub/postgres-68c4fbbd6f-84fd8"
May 28 15:03:37.313547 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:03:37.313451    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-68c4fbbd6f-84fd8"
May 28 15:03:37.438365 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:03:37.438333    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-68c4fbbd6f-84fd8"]
May 28 15:03:37.439796 ip-10-0-137-84 kubenswrapper[2563]: W0528 15:03:37.439772    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6a82f62_d75b_4803_b61b_864066f6d592.slice/crio-91330bbb185aeb06506512edef59c0ebb96a579d14f09d2b5f75943c00e9a9ce WatchSource:0}: Error finding container 91330bbb185aeb06506512edef59c0ebb96a579d14f09d2b5f75943c00e9a9ce: Status 404 returned error can't find the container with id 91330bbb185aeb06506512edef59c0ebb96a579d14f09d2b5f75943c00e9a9ce
May 28 15:03:37.441162 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:03:37.441144    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 28 15:03:37.764945 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:03:37.764910    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-68c4fbbd6f-84fd8" event={"ID":"d6a82f62-d75b-4803-b61b-864066f6d592","Type":"ContainerStarted","Data":"91330bbb185aeb06506512edef59c0ebb96a579d14f09d2b5f75943c00e9a9ce"}
May 28 15:03:42.789532 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:03:42.789497    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-68c4fbbd6f-84fd8" event={"ID":"d6a82f62-d75b-4803-b61b-864066f6d592","Type":"ContainerStarted","Data":"1cfee51f1994f99b8c9f407d1914ab0719578c96a50427108651c5331b1566c3"}
May 28 15:03:42.789973 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:03:42.789607    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-68c4fbbd6f-84fd8"
May 28 15:03:42.806052 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:03:42.806006    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/postgres-68c4fbbd6f-84fd8" podStartSLOduration=1.572548905 podStartE2EDuration="6.805991986s" podCreationTimestamp="2026-05-28 15:03:36 +0000 UTC" firstStartedPulling="2026-05-28 15:03:37.441324361 +0000 UTC m=+637.530541062" lastFinishedPulling="2026-05-28 15:03:42.674767439 +0000 UTC m=+642.763984143" observedRunningTime="2026-05-28 15:03:42.804047836 +0000 UTC m=+642.893264559" watchObservedRunningTime="2026-05-28 15:03:42.805991986 +0000 UTC m=+642.895208708"
May 28 15:03:48.821939 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:03:48.821909    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-68c4fbbd6f-84fd8"
May 28 15:03:54.955835 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:03:54.955795    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-8678b856c4-fssmm"]
May 28 15:03:55.024399 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:03:55.024359    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-8678b856c4-fssmm"]
May 28 15:03:55.024570 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:03:55.024488    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8678b856c4-fssmm"
May 28 15:03:55.027324 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:03:55.027295    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
May 28 15:03:55.027478 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:03:55.027297    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-w2vzc\""
May 28 15:03:55.027478 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:03:55.027300    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
May 28 15:03:55.123001 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:03:55.122967    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5c48cdb64c-pphtw"]
May 28 15:03:55.128839 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:03:55.128816    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5c48cdb64c-pphtw"
May 28 15:03:55.136611 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:03:55.136576    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n2tgz\" (UniqueName: \"kubernetes.io/projected/bc69a073-d31d-4b79-9392-667b2b4e41d1-kube-api-access-n2tgz\") pod \"maas-controller-8678b856c4-fssmm\" (UID: \"bc69a073-d31d-4b79-9392-667b2b4e41d1\") " pod="opendatahub/maas-controller-8678b856c4-fssmm"
May 28 15:03:55.136740 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:03:55.136619    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bc69a073-d31d-4b79-9392-667b2b4e41d1-webhook-cert\") pod \"maas-controller-8678b856c4-fssmm\" (UID: \"bc69a073-d31d-4b79-9392-667b2b4e41d1\") " pod="opendatahub/maas-controller-8678b856c4-fssmm"
May 28 15:03:55.138691 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:03:55.138649    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5c48cdb64c-pphtw"]
May 28 15:03:55.237481 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:03:55.237392    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n2tgz\" (UniqueName: \"kubernetes.io/projected/bc69a073-d31d-4b79-9392-667b2b4e41d1-kube-api-access-n2tgz\") pod \"maas-controller-8678b856c4-fssmm\" (UID: \"bc69a073-d31d-4b79-9392-667b2b4e41d1\") " pod="opendatahub/maas-controller-8678b856c4-fssmm"
May 28 15:03:55.237481 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:03:55.237446    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bc69a073-d31d-4b79-9392-667b2b4e41d1-webhook-cert\") pod \"maas-controller-8678b856c4-fssmm\" (UID: \"bc69a073-d31d-4b79-9392-667b2b4e41d1\") " pod="opendatahub/maas-controller-8678b856c4-fssmm"
May 28 15:03:55.237669 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:03:55.237488    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zvhv7\" (UniqueName: \"kubernetes.io/projected/0066592b-0730-41df-8216-c88968f66ad9-kube-api-access-zvhv7\") pod \"maas-controller-5c48cdb64c-pphtw\" (UID: \"0066592b-0730-41df-8216-c88968f66ad9\") " pod="opendatahub/maas-controller-5c48cdb64c-pphtw"
May 28 15:03:55.237669 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:03:55.237561    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0066592b-0730-41df-8216-c88968f66ad9-webhook-cert\") pod \"maas-controller-5c48cdb64c-pphtw\" (UID: \"0066592b-0730-41df-8216-c88968f66ad9\") " pod="opendatahub/maas-controller-5c48cdb64c-pphtw"
May 28 15:03:55.239915 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:03:55.239888    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bc69a073-d31d-4b79-9392-667b2b4e41d1-webhook-cert\") pod \"maas-controller-8678b856c4-fssmm\" (UID: \"bc69a073-d31d-4b79-9392-667b2b4e41d1\") " pod="opendatahub/maas-controller-8678b856c4-fssmm"
May 28 15:03:55.249923 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:03:55.249900    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n2tgz\" (UniqueName: \"kubernetes.io/projected/bc69a073-d31d-4b79-9392-667b2b4e41d1-kube-api-access-n2tgz\") pod \"maas-controller-8678b856c4-fssmm\" (UID: \"bc69a073-d31d-4b79-9392-667b2b4e41d1\") " pod="opendatahub/maas-controller-8678b856c4-fssmm"
May 28 15:03:55.335277 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:03:55.335228    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8678b856c4-fssmm"
May 28 15:03:55.338372 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:03:55.338352    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0066592b-0730-41df-8216-c88968f66ad9-webhook-cert\") pod \"maas-controller-5c48cdb64c-pphtw\" (UID: \"0066592b-0730-41df-8216-c88968f66ad9\") " pod="opendatahub/maas-controller-5c48cdb64c-pphtw"
May 28 15:03:55.338446 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:03:55.338419    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zvhv7\" (UniqueName: \"kubernetes.io/projected/0066592b-0730-41df-8216-c88968f66ad9-kube-api-access-zvhv7\") pod \"maas-controller-5c48cdb64c-pphtw\" (UID: \"0066592b-0730-41df-8216-c88968f66ad9\") " pod="opendatahub/maas-controller-5c48cdb64c-pphtw"
May 28 15:03:55.340840 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:03:55.340819    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0066592b-0730-41df-8216-c88968f66ad9-webhook-cert\") pod \"maas-controller-5c48cdb64c-pphtw\" (UID: \"0066592b-0730-41df-8216-c88968f66ad9\") " pod="opendatahub/maas-controller-5c48cdb64c-pphtw"
May 28 15:03:55.346984 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:03:55.346960    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zvhv7\" (UniqueName: \"kubernetes.io/projected/0066592b-0730-41df-8216-c88968f66ad9-kube-api-access-zvhv7\") pod \"maas-controller-5c48cdb64c-pphtw\" (UID: \"0066592b-0730-41df-8216-c88968f66ad9\") " pod="opendatahub/maas-controller-5c48cdb64c-pphtw"
May 28 15:03:55.440731 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:03:55.440700    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5c48cdb64c-pphtw"
May 28 15:03:55.481748 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:03:55.481724    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-8678b856c4-fssmm"]
May 28 15:03:55.483537 ip-10-0-137-84 kubenswrapper[2563]: W0528 15:03:55.483510    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc69a073_d31d_4b79_9392_667b2b4e41d1.slice/crio-8a190acae92d02f1bc0c061afa053610b879cf9bb3fd4c6c676876e3fe90de9f WatchSource:0}: Error finding container 8a190acae92d02f1bc0c061afa053610b879cf9bb3fd4c6c676876e3fe90de9f: Status 404 returned error can't find the container with id 8a190acae92d02f1bc0c061afa053610b879cf9bb3fd4c6c676876e3fe90de9f
May 28 15:03:55.584065 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:03:55.581634    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5c48cdb64c-pphtw"]
May 28 15:03:55.840744 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:03:55.840655    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5c48cdb64c-pphtw" event={"ID":"0066592b-0730-41df-8216-c88968f66ad9","Type":"ContainerStarted","Data":"6f99b53e5bc0c8cba3ac9f78c71a26b368c680dde2d5bcd1e4992addfbc0dc32"}
May 28 15:03:55.841705 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:03:55.841663    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8678b856c4-fssmm" event={"ID":"bc69a073-d31d-4b79-9392-667b2b4e41d1","Type":"ContainerStarted","Data":"8a190acae92d02f1bc0c061afa053610b879cf9bb3fd4c6c676876e3fe90de9f"}
May 28 15:03:58.859700 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:03:58.859638    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5c48cdb64c-pphtw" event={"ID":"0066592b-0730-41df-8216-c88968f66ad9","Type":"ContainerStarted","Data":"f642be359b060068637d3c7d90941b35615807fb44c2aaec772899d9ed4acb1f"}
May 28 15:03:58.860173 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:03:58.859850    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5c48cdb64c-pphtw"
May 28 15:03:58.861179 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:03:58.861146    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8678b856c4-fssmm" event={"ID":"bc69a073-d31d-4b79-9392-667b2b4e41d1","Type":"ContainerStarted","Data":"7b94b5673e53f63ca320f5f46a81de58e9eec7e9d1669c63ccbffdd6b0fcccfb"}
May 28 15:03:58.861324 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:03:58.861311    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-8678b856c4-fssmm"
May 28 15:03:58.877787 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:03:58.877739    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-5c48cdb64c-pphtw" podStartSLOduration=1.178661202 podStartE2EDuration="3.877723329s" podCreationTimestamp="2026-05-28 15:03:55 +0000 UTC" firstStartedPulling="2026-05-28 15:03:55.585447734 +0000 UTC m=+655.674664435" lastFinishedPulling="2026-05-28 15:03:58.284509858 +0000 UTC m=+658.373726562" observedRunningTime="2026-05-28 15:03:58.875754392 +0000 UTC m=+658.964971116" watchObservedRunningTime="2026-05-28 15:03:58.877723329 +0000 UTC m=+658.966940052"
May 28 15:03:58.891177 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:03:58.891126    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-8678b856c4-fssmm" podStartSLOduration=2.096506572 podStartE2EDuration="4.891110359s" podCreationTimestamp="2026-05-28 15:03:54 +0000 UTC" firstStartedPulling="2026-05-28 15:03:55.484948664 +0000 UTC m=+655.574165365" lastFinishedPulling="2026-05-28 15:03:58.279552438 +0000 UTC m=+658.368769152" observedRunningTime="2026-05-28 15:03:58.889860159 +0000 UTC m=+658.979076882" watchObservedRunningTime="2026-05-28 15:03:58.891110359 +0000 UTC m=+658.980327082"
May 28 15:04:09.870034 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:04:09.870002    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5c48cdb64c-pphtw"
May 28 15:04:09.870547 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:04:09.870160    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-8678b856c4-fssmm"
May 28 15:04:09.916514 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:04:09.916480    2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-8678b856c4-fssmm"]
May 28 15:04:09.916761 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:04:09.916714    2563 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-controller-8678b856c4-fssmm" podUID="bc69a073-d31d-4b79-9392-667b2b4e41d1" containerName="manager" containerID="cri-o://7b94b5673e53f63ca320f5f46a81de58e9eec7e9d1669c63ccbffdd6b0fcccfb" gracePeriod=30
May 28 15:04:10.164108 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:04:10.164084    2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8678b856c4-fssmm"
May 28 15:04:10.170768 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:04:10.170747    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n2tgz\" (UniqueName: \"kubernetes.io/projected/bc69a073-d31d-4b79-9392-667b2b4e41d1-kube-api-access-n2tgz\") pod \"bc69a073-d31d-4b79-9392-667b2b4e41d1\" (UID: \"bc69a073-d31d-4b79-9392-667b2b4e41d1\") "
May 28 15:04:10.170865 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:04:10.170803    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bc69a073-d31d-4b79-9392-667b2b4e41d1-webhook-cert\") pod \"bc69a073-d31d-4b79-9392-667b2b4e41d1\" (UID: \"bc69a073-d31d-4b79-9392-667b2b4e41d1\") "
May 28 15:04:10.172980 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:04:10.172947    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bc69a073-d31d-4b79-9392-667b2b4e41d1-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "bc69a073-d31d-4b79-9392-667b2b4e41d1" (UID: "bc69a073-d31d-4b79-9392-667b2b4e41d1"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 15:04:10.173080 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:04:10.172980    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bc69a073-d31d-4b79-9392-667b2b4e41d1-kube-api-access-n2tgz" (OuterVolumeSpecName: "kube-api-access-n2tgz") pod "bc69a073-d31d-4b79-9392-667b2b4e41d1" (UID: "bc69a073-d31d-4b79-9392-667b2b4e41d1"). InnerVolumeSpecName "kube-api-access-n2tgz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 15:04:10.272101 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:04:10.272063    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n2tgz\" (UniqueName: \"kubernetes.io/projected/bc69a073-d31d-4b79-9392-667b2b4e41d1-kube-api-access-n2tgz\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
May 28 15:04:10.272101 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:04:10.272099    2563 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bc69a073-d31d-4b79-9392-667b2b4e41d1-webhook-cert\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
May 28 15:04:10.908287 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:04:10.908255    2563 generic.go:358] "Generic (PLEG): container finished" podID="bc69a073-d31d-4b79-9392-667b2b4e41d1" containerID="7b94b5673e53f63ca320f5f46a81de58e9eec7e9d1669c63ccbffdd6b0fcccfb" exitCode=0
May 28 15:04:10.908749 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:04:10.908317    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8678b856c4-fssmm" event={"ID":"bc69a073-d31d-4b79-9392-667b2b4e41d1","Type":"ContainerDied","Data":"7b94b5673e53f63ca320f5f46a81de58e9eec7e9d1669c63ccbffdd6b0fcccfb"}
May 28 15:04:10.908749 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:04:10.908340    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8678b856c4-fssmm" event={"ID":"bc69a073-d31d-4b79-9392-667b2b4e41d1","Type":"ContainerDied","Data":"8a190acae92d02f1bc0c061afa053610b879cf9bb3fd4c6c676876e3fe90de9f"}
May 28 15:04:10.908749 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:04:10.908356    2563 scope.go:117] "RemoveContainer" containerID="7b94b5673e53f63ca320f5f46a81de58e9eec7e9d1669c63ccbffdd6b0fcccfb"
May 28 15:04:10.908749 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:04:10.908317    2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8678b856c4-fssmm"
May 28 15:04:10.920211 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:04:10.917831    2563 scope.go:117] "RemoveContainer" containerID="7b94b5673e53f63ca320f5f46a81de58e9eec7e9d1669c63ccbffdd6b0fcccfb"
May 28 15:04:10.920211 ip-10-0-137-84 kubenswrapper[2563]: E0528 15:04:10.918156    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7b94b5673e53f63ca320f5f46a81de58e9eec7e9d1669c63ccbffdd6b0fcccfb\": container with ID starting with 7b94b5673e53f63ca320f5f46a81de58e9eec7e9d1669c63ccbffdd6b0fcccfb not found: ID does not exist" containerID="7b94b5673e53f63ca320f5f46a81de58e9eec7e9d1669c63ccbffdd6b0fcccfb"
May 28 15:04:10.920211 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:04:10.918187    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7b94b5673e53f63ca320f5f46a81de58e9eec7e9d1669c63ccbffdd6b0fcccfb"} err="failed to get container status \"7b94b5673e53f63ca320f5f46a81de58e9eec7e9d1669c63ccbffdd6b0fcccfb\": rpc error: code = NotFound desc = could not find container \"7b94b5673e53f63ca320f5f46a81de58e9eec7e9d1669c63ccbffdd6b0fcccfb\": container with ID starting with 7b94b5673e53f63ca320f5f46a81de58e9eec7e9d1669c63ccbffdd6b0fcccfb not found: ID does not exist"
May 28 15:04:10.927055 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:04:10.927030    2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-8678b856c4-fssmm"]
May 28 15:04:10.930302 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:04:10.930280    2563 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-8678b856c4-fssmm"]
May 28 15:04:12.486482 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:04:12.486448    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bc69a073-d31d-4b79-9392-667b2b4e41d1" path="/var/lib/kubelet/pods/bc69a073-d31d-4b79-9392-667b2b4e41d1/volumes"
May 28 15:04:30.803261 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:04:30.803224    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-5597c655cd-xtppj"]
May 28 15:04:30.811075 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:04:30.811037    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc69a073-d31d-4b79-9392-667b2b4e41d1" containerName="manager"
May 28 15:04:30.811315 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:04:30.811198    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc69a073-d31d-4b79-9392-667b2b4e41d1" containerName="manager"
May 28 15:04:30.811604 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:04:30.811590    2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="bc69a073-d31d-4b79-9392-667b2b4e41d1" containerName="manager"
May 28 15:04:30.814359 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:04:30.814321    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-5597c655cd-xtppj"
May 28 15:04:30.816950 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:04:30.816913    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\""
May 28 15:04:30.817094 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:04:30.816934    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-xljxx\""
May 28 15:04:30.817386 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:04:30.817362    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-5597c655cd-xtppj"]
May 28 15:04:30.842428 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:04:30.842396    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d02f025a-7767-44dc-9787-75f02e0807ef-maas-api-tls\") pod \"maas-api-5597c655cd-xtppj\" (UID: \"d02f025a-7767-44dc-9787-75f02e0807ef\") " pod="opendatahub/maas-api-5597c655cd-xtppj"
May 28 15:04:30.842618 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:04:30.842520    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-65qss\" (UniqueName: \"kubernetes.io/projected/d02f025a-7767-44dc-9787-75f02e0807ef-kube-api-access-65qss\") pod \"maas-api-5597c655cd-xtppj\" (UID: \"d02f025a-7767-44dc-9787-75f02e0807ef\") " pod="opendatahub/maas-api-5597c655cd-xtppj"
May 28 15:04:30.943892 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:04:30.943851    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d02f025a-7767-44dc-9787-75f02e0807ef-maas-api-tls\") pod \"maas-api-5597c655cd-xtppj\" (UID: \"d02f025a-7767-44dc-9787-75f02e0807ef\") " pod="opendatahub/maas-api-5597c655cd-xtppj"
May 28 15:04:30.944083 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:04:30.943931    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-65qss\" (UniqueName: \"kubernetes.io/projected/d02f025a-7767-44dc-9787-75f02e0807ef-kube-api-access-65qss\") pod \"maas-api-5597c655cd-xtppj\" (UID: \"d02f025a-7767-44dc-9787-75f02e0807ef\") " pod="opendatahub/maas-api-5597c655cd-xtppj"
May 28 15:04:30.946425 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:04:30.946402    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d02f025a-7767-44dc-9787-75f02e0807ef-maas-api-tls\") pod \"maas-api-5597c655cd-xtppj\" (UID: \"d02f025a-7767-44dc-9787-75f02e0807ef\") " pod="opendatahub/maas-api-5597c655cd-xtppj"
May 28 15:04:30.952358 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:04:30.952336    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-65qss\" (UniqueName: \"kubernetes.io/projected/d02f025a-7767-44dc-9787-75f02e0807ef-kube-api-access-65qss\") pod \"maas-api-5597c655cd-xtppj\" (UID: \"d02f025a-7767-44dc-9787-75f02e0807ef\") " pod="opendatahub/maas-api-5597c655cd-xtppj"
May 28 15:04:31.126537 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:04:31.126436    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-5597c655cd-xtppj"
May 28 15:04:31.127581 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:04:31.127465    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-ll9jd"]
May 28 15:04:31.130516 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:04:31.130494    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58b6c8fdc7-ll9jd"
May 28 15:04:31.132767 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:04:31.132741    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
May 28 15:04:31.132877 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:04:31.132806    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-wxnc5\""
May 28 15:04:31.138736 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:04:31.138710    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-ll9jd"]
May 28 15:04:31.247549 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:04:31.247494    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m6xmr\" (UniqueName: \"kubernetes.io/projected/2fa8ea47-f07c-4e56-b9e0-67f7cd57e6d2-kube-api-access-m6xmr\") pod \"payload-processing-58b6c8fdc7-ll9jd\" (UID: \"2fa8ea47-f07c-4e56-b9e0-67f7cd57e6d2\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-ll9jd"
May 28 15:04:31.277995 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:04:31.277964    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-5597c655cd-xtppj"]
May 28 15:04:31.281224 ip-10-0-137-84 kubenswrapper[2563]: W0528 15:04:31.281190    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd02f025a_7767_44dc_9787_75f02e0807ef.slice/crio-7ef15dc3d2001202d247ea1cdb3d3fbf78dfe7a49db6f0044a783282639ad44a WatchSource:0}: Error finding container 7ef15dc3d2001202d247ea1cdb3d3fbf78dfe7a49db6f0044a783282639ad44a: Status 404 returned error can't find the container with id 7ef15dc3d2001202d247ea1cdb3d3fbf78dfe7a49db6f0044a783282639ad44a
May 28 15:04:31.348689 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:04:31.348634    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-m6xmr\" (UniqueName: \"kubernetes.io/projected/2fa8ea47-f07c-4e56-b9e0-67f7cd57e6d2-kube-api-access-m6xmr\") pod \"payload-processing-58b6c8fdc7-ll9jd\" (UID: \"2fa8ea47-f07c-4e56-b9e0-67f7cd57e6d2\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-ll9jd"
May 28 15:04:31.356739 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:04:31.356655    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m6xmr\" (UniqueName: \"kubernetes.io/projected/2fa8ea47-f07c-4e56-b9e0-67f7cd57e6d2-kube-api-access-m6xmr\") pod \"payload-processing-58b6c8fdc7-ll9jd\" (UID: \"2fa8ea47-f07c-4e56-b9e0-67f7cd57e6d2\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-ll9jd"
May 28 15:04:31.464598 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:04:31.464509    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58b6c8fdc7-ll9jd"
May 28 15:04:31.609433 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:04:31.609242    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-ll9jd"]
May 28 15:04:31.611941 ip-10-0-137-84 kubenswrapper[2563]: W0528 15:04:31.611914    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2fa8ea47_f07c_4e56_b9e0_67f7cd57e6d2.slice/crio-2dfa0a3d0e525743481f366427e0fff1ca36382e8a275fb02fd7dc98d97dea19 WatchSource:0}: Error finding container 2dfa0a3d0e525743481f366427e0fff1ca36382e8a275fb02fd7dc98d97dea19: Status 404 returned error can't find the container with id 2dfa0a3d0e525743481f366427e0fff1ca36382e8a275fb02fd7dc98d97dea19
May 28 15:04:31.995559 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:04:31.995519    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-5597c655cd-xtppj" event={"ID":"d02f025a-7767-44dc-9787-75f02e0807ef","Type":"ContainerStarted","Data":"7ef15dc3d2001202d247ea1cdb3d3fbf78dfe7a49db6f0044a783282639ad44a"}
May 28 15:04:31.996650 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:04:31.996623    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58b6c8fdc7-ll9jd" event={"ID":"2fa8ea47-f07c-4e56-b9e0-67f7cd57e6d2","Type":"ContainerStarted","Data":"2dfa0a3d0e525743481f366427e0fff1ca36382e8a275fb02fd7dc98d97dea19"}
May 28 15:04:34.007189 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:04:34.007132    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58b6c8fdc7-ll9jd" event={"ID":"2fa8ea47-f07c-4e56-b9e0-67f7cd57e6d2","Type":"ContainerStarted","Data":"781fa101d6d92674882b9e6132dc06a223debdf7b7d6ecd69179a1ebc67fc870"}
May 28 15:04:34.007886 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:04:34.007750    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58b6c8fdc7-ll9jd"
May 28 15:04:34.009482 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:04:34.009451    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-5597c655cd-xtppj" event={"ID":"d02f025a-7767-44dc-9787-75f02e0807ef","Type":"ContainerStarted","Data":"9e416c1d38c479cbc0d49f97520e96047699e579306bcf3a94b3287d02b4b984"}
May 28 15:04:34.009769 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:04:34.009748    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-5597c655cd-xtppj"
May 28 15:04:34.026743 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:04:34.026671    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58b6c8fdc7-ll9jd" podStartSLOduration=1.041495687 podStartE2EDuration="3.026654363s" podCreationTimestamp="2026-05-28 15:04:31 +0000 UTC" firstStartedPulling="2026-05-28 15:04:31.614175965 +0000 UTC m=+691.703392666" lastFinishedPulling="2026-05-28 15:04:33.599334636 +0000 UTC m=+693.688551342" observedRunningTime="2026-05-28 15:04:34.02405257 +0000 UTC m=+694.113269294" watchObservedRunningTime="2026-05-28 15:04:34.026654363 +0000 UTC m=+694.115871089"
May 28 15:04:34.040763 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:04:34.040699    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-api-5597c655cd-xtppj" podStartSLOduration=1.723035506 podStartE2EDuration="4.040668318s" podCreationTimestamp="2026-05-28 15:04:30 +0000 UTC" firstStartedPulling="2026-05-28 15:04:31.284208204 +0000 UTC m=+691.373424908" lastFinishedPulling="2026-05-28 15:04:33.601841016 +0000 UTC m=+693.691057720" observedRunningTime="2026-05-28 15:04:34.039137179 +0000 UTC m=+694.128353902" watchObservedRunningTime="2026-05-28 15:04:34.040668318 +0000 UTC m=+694.129885040"
May 28 15:04:40.018195 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:04:40.018120    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-5597c655cd-xtppj"
May 28 15:04:45.015159 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:04:45.015126    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58b6c8fdc7-ll9jd"
May 28 15:04:51.821231 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:04:51.821191    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-24h2q"]
May 28 15:04:51.823920 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:04:51.823902    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-24h2q"
May 28 15:04:51.826557 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:04:51.826533    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
May 28 15:04:51.826668 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:04:51.826540    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
May 28 15:04:51.827505 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:04:51.827486    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-dngbq\""
May 28 15:04:51.827591 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:04:51.827572    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
May 28 15:04:51.835234 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:04:51.835204    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-24h2q"]
May 28 15:04:51.945080 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:04:51.945044    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9c2ebfbc-7979-400e-abbc-ebccf8b91150-tls-certs\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-24h2q\" (UID: \"9c2ebfbc-7979-400e-abbc-ebccf8b91150\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-24h2q"
May 28 15:04:51.945080 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:04:51.945093    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9c2ebfbc-7979-400e-abbc-ebccf8b91150-dshm\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-24h2q\" (UID: \"9c2ebfbc-7979-400e-abbc-ebccf8b91150\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-24h2q"
May 28 15:04:51.945291 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:04:51.945111    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9c2ebfbc-7979-400e-abbc-ebccf8b91150-model-cache\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-24h2q\" (UID: \"9c2ebfbc-7979-400e-abbc-ebccf8b91150\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-24h2q"
May 28 15:04:51.945291 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:04:51.945194    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9c2ebfbc-7979-400e-abbc-ebccf8b91150-home\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-24h2q\" (UID: \"9c2ebfbc-7979-400e-abbc-ebccf8b91150\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-24h2q"
May 28 15:04:51.945291 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:04:51.945215    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6kmn2\" (UniqueName: \"kubernetes.io/projected/9c2ebfbc-7979-400e-abbc-ebccf8b91150-kube-api-access-6kmn2\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-24h2q\" (UID: \"9c2ebfbc-7979-400e-abbc-ebccf8b91150\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-24h2q"
May 28 15:04:51.945291 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:04:51.945237    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/9c2ebfbc-7979-400e-abbc-ebccf8b91150-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-24h2q\" (UID: \"9c2ebfbc-7979-400e-abbc-ebccf8b91150\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-24h2q"
May 28 15:04:52.046527 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:04:52.046485    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9c2ebfbc-7979-400e-abbc-ebccf8b91150-home\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-24h2q\" (UID: \"9c2ebfbc-7979-400e-abbc-ebccf8b91150\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-24h2q"
May 28 15:04:52.046757 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:04:52.046537    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6kmn2\" (UniqueName: \"kubernetes.io/projected/9c2ebfbc-7979-400e-abbc-ebccf8b91150-kube-api-access-6kmn2\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-24h2q\" (UID: \"9c2ebfbc-7979-400e-abbc-ebccf8b91150\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-24h2q"
May 28 15:04:52.046757 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:04:52.046574    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/9c2ebfbc-7979-400e-abbc-ebccf8b91150-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-24h2q\" (UID: \"9c2ebfbc-7979-400e-abbc-ebccf8b91150\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-24h2q"
May 28 15:04:52.046757 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:04:52.046721    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9c2ebfbc-7979-400e-abbc-ebccf8b91150-tls-certs\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-24h2q\" (UID: \"9c2ebfbc-7979-400e-abbc-ebccf8b91150\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-24h2q"
May 28 15:04:52.046942 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:04:52.046770    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9c2ebfbc-7979-400e-abbc-ebccf8b91150-dshm\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-24h2q\" (UID: \"9c2ebfbc-7979-400e-abbc-ebccf8b91150\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-24h2q"
May 28 15:04:52.046942 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:04:52.046797    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9c2ebfbc-7979-400e-abbc-ebccf8b91150-model-cache\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-24h2q\" (UID: \"9c2ebfbc-7979-400e-abbc-ebccf8b91150\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-24h2q"
May 28 15:04:52.047051 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:04:52.047010    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9c2ebfbc-7979-400e-abbc-ebccf8b91150-home\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-24h2q\" (UID: \"9c2ebfbc-7979-400e-abbc-ebccf8b91150\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-24h2q"
May 28 15:04:52.047097 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:04:52.047051    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/9c2ebfbc-7979-400e-abbc-ebccf8b91150-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-24h2q\" (UID: \"9c2ebfbc-7979-400e-abbc-ebccf8b91150\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-24h2q"
May 28 15:04:52.047179 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:04:52.047159    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9c2ebfbc-7979-400e-abbc-ebccf8b91150-model-cache\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-24h2q\" (UID: \"9c2ebfbc-7979-400e-abbc-ebccf8b91150\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-24h2q"
May 28 15:04:52.049021 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:04:52.048994    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9c2ebfbc-7979-400e-abbc-ebccf8b91150-dshm\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-24h2q\" (UID: \"9c2ebfbc-7979-400e-abbc-ebccf8b91150\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-24h2q"
May 28 15:04:52.049203 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:04:52.049179    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9c2ebfbc-7979-400e-abbc-ebccf8b91150-tls-certs\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-24h2q\" (UID: \"9c2ebfbc-7979-400e-abbc-ebccf8b91150\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-24h2q"
May 28 15:04:52.053980 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:04:52.053952    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6kmn2\" (UniqueName: \"kubernetes.io/projected/9c2ebfbc-7979-400e-abbc-ebccf8b91150-kube-api-access-6kmn2\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-24h2q\" (UID: \"9c2ebfbc-7979-400e-abbc-ebccf8b91150\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-24h2q"
May 28 15:04:52.140413 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:04:52.140327    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-24h2q"
May 28 15:04:52.285088 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:04:52.285062    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-24h2q"]
May 28 15:04:52.287358 ip-10-0-137-84 kubenswrapper[2563]: W0528 15:04:52.287324    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c2ebfbc_7979_400e_abbc_ebccf8b91150.slice/crio-2cb15a8e69480564e33764107407a52363257cc605fab85de186262ca54b9949 WatchSource:0}: Error finding container 2cb15a8e69480564e33764107407a52363257cc605fab85de186262ca54b9949: Status 404 returned error can't find the container with id 2cb15a8e69480564e33764107407a52363257cc605fab85de186262ca54b9949
May 28 15:04:53.092064 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:04:53.092028    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-24h2q" event={"ID":"9c2ebfbc-7979-400e-abbc-ebccf8b91150","Type":"ContainerStarted","Data":"2cb15a8e69480564e33764107407a52363257cc605fab85de186262ca54b9949"}
May 28 15:04:59.119211 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:04:59.119170    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-24h2q" event={"ID":"9c2ebfbc-7979-400e-abbc-ebccf8b91150","Type":"ContainerStarted","Data":"29596e58c12aec3934b9f29d9050e741c2bb428c166b3698ee9a64c9ae739710"}
May 28 15:05:05.119513 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:05:05.119472    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccgzps7"]
May 28 15:05:05.123349 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:05:05.123328    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccgzps7"
May 28 15:05:05.125881 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:05:05.125859    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
May 28 15:05:05.131841 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:05:05.131815    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccgzps7"]
May 28 15:05:05.144232 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:05:05.144202    2563 generic.go:358] "Generic (PLEG): container finished" podID="9c2ebfbc-7979-400e-abbc-ebccf8b91150" containerID="29596e58c12aec3934b9f29d9050e741c2bb428c166b3698ee9a64c9ae739710" exitCode=0
May 28 15:05:05.144382 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:05:05.144261    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-24h2q" event={"ID":"9c2ebfbc-7979-400e-abbc-ebccf8b91150","Type":"ContainerDied","Data":"29596e58c12aec3934b9f29d9050e741c2bb428c166b3698ee9a64c9ae739710"}
May 28 15:05:05.175948 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:05:05.175899    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mpdpj\" (UniqueName: \"kubernetes.io/projected/cd84dad8-8374-4c00-8aa3-79828015437b-kube-api-access-mpdpj\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccgzps7\" (UID: \"cd84dad8-8374-4c00-8aa3-79828015437b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccgzps7"
May 28 15:05:05.176299 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:05:05.176277    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/cd84dad8-8374-4c00-8aa3-79828015437b-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccgzps7\" (UID: \"cd84dad8-8374-4c00-8aa3-79828015437b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccgzps7"
May 28 15:05:05.176411 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:05:05.176384    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cd84dad8-8374-4c00-8aa3-79828015437b-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccgzps7\" (UID: \"cd84dad8-8374-4c00-8aa3-79828015437b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccgzps7"
May 28 15:05:05.176516 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:05:05.176468    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cd84dad8-8374-4c00-8aa3-79828015437b-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccgzps7\" (UID: \"cd84dad8-8374-4c00-8aa3-79828015437b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccgzps7"
May 28 15:05:05.176604 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:05:05.176517    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cd84dad8-8374-4c00-8aa3-79828015437b-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccgzps7\" (UID: \"cd84dad8-8374-4c00-8aa3-79828015437b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccgzps7"
May 28 15:05:05.176604 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:05:05.176544    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cd84dad8-8374-4c00-8aa3-79828015437b-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccgzps7\" (UID: \"cd84dad8-8374-4c00-8aa3-79828015437b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccgzps7"
May 28 15:05:05.278223 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:05:05.278177    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mpdpj\" (UniqueName: \"kubernetes.io/projected/cd84dad8-8374-4c00-8aa3-79828015437b-kube-api-access-mpdpj\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccgzps7\" (UID: \"cd84dad8-8374-4c00-8aa3-79828015437b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccgzps7"
May 28 15:05:05.278403 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:05:05.278233    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/cd84dad8-8374-4c00-8aa3-79828015437b-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccgzps7\" (UID: \"cd84dad8-8374-4c00-8aa3-79828015437b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccgzps7"
May 28 15:05:05.278403 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:05:05.278279    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cd84dad8-8374-4c00-8aa3-79828015437b-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccgzps7\" (UID: \"cd84dad8-8374-4c00-8aa3-79828015437b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccgzps7"
May 28 15:05:05.278403 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:05:05.278349    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cd84dad8-8374-4c00-8aa3-79828015437b-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccgzps7\" (UID: \"cd84dad8-8374-4c00-8aa3-79828015437b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccgzps7"
May 28 15:05:05.278591 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:05:05.278403    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cd84dad8-8374-4c00-8aa3-79828015437b-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccgzps7\" (UID: \"cd84dad8-8374-4c00-8aa3-79828015437b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccgzps7"
May 28 15:05:05.278591 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:05:05.278430    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cd84dad8-8374-4c00-8aa3-79828015437b-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccgzps7\" (UID: \"cd84dad8-8374-4c00-8aa3-79828015437b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccgzps7"
May 28 15:05:05.279084 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:05:05.279057    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cd84dad8-8374-4c00-8aa3-79828015437b-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccgzps7\" (UID: \"cd84dad8-8374-4c00-8aa3-79828015437b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccgzps7"
May 28 15:05:05.279200 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:05:05.279181    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/cd84dad8-8374-4c00-8aa3-79828015437b-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccgzps7\" (UID: \"cd84dad8-8374-4c00-8aa3-79828015437b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccgzps7"
May 28 15:05:05.279390 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:05:05.279369    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cd84dad8-8374-4c00-8aa3-79828015437b-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccgzps7\" (UID: \"cd84dad8-8374-4c00-8aa3-79828015437b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccgzps7"
May 28 15:05:05.281031 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:05:05.280999    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cd84dad8-8374-4c00-8aa3-79828015437b-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccgzps7\" (UID: \"cd84dad8-8374-4c00-8aa3-79828015437b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccgzps7"
May 28 15:05:05.282003 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:05:05.281980    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cd84dad8-8374-4c00-8aa3-79828015437b-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccgzps7\" (UID: \"cd84dad8-8374-4c00-8aa3-79828015437b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccgzps7"
May 28 15:05:05.286452 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:05:05.286426    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mpdpj\" (UniqueName: \"kubernetes.io/projected/cd84dad8-8374-4c00-8aa3-79828015437b-kube-api-access-mpdpj\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccgzps7\" (UID: \"cd84dad8-8374-4c00-8aa3-79828015437b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccgzps7"
May 28 15:05:05.434484 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:05:05.434391    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccgzps7"
May 28 15:05:05.584438 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:05:05.584403    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccgzps7"]
May 28 15:05:05.586123 ip-10-0-137-84 kubenswrapper[2563]: W0528 15:05:05.586091    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd84dad8_8374_4c00_8aa3_79828015437b.slice/crio-efcdba28b54d1271248cd5215e91dc426308251b7b107c9adcd2e020988b980a WatchSource:0}: Error finding container efcdba28b54d1271248cd5215e91dc426308251b7b107c9adcd2e020988b980a: Status 404 returned error can't find the container with id efcdba28b54d1271248cd5215e91dc426308251b7b107c9adcd2e020988b980a
May 28 15:05:06.151615 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:05:06.151501    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccgzps7" event={"ID":"cd84dad8-8374-4c00-8aa3-79828015437b","Type":"ContainerStarted","Data":"be829fa40775c3ad7c5c8424af0b3d2d46e8b21e4b8f0289a42ddd543a8bea0e"}
May 28 15:05:06.151615 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:05:06.151539    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccgzps7" event={"ID":"cd84dad8-8374-4c00-8aa3-79828015437b","Type":"ContainerStarted","Data":"efcdba28b54d1271248cd5215e91dc426308251b7b107c9adcd2e020988b980a"}
May 28 15:05:07.157743 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:05:07.157700    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-24h2q" event={"ID":"9c2ebfbc-7979-400e-abbc-ebccf8b91150","Type":"ContainerStarted","Data":"9aac8da6c944a7e57a22f2917a5067f2c32a96ab2689496b54f6cdfb16d0cba6"}
May 28 15:05:07.158199 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:05:07.158054    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-24h2q"
May 28 15:05:07.180011 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:05:07.179949    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-24h2q" podStartSLOduration=1.820845659 podStartE2EDuration="16.17993292s" podCreationTimestamp="2026-05-28 15:04:51 +0000 UTC" firstStartedPulling="2026-05-28 15:04:52.289216018 +0000 UTC m=+712.378432719" lastFinishedPulling="2026-05-28 15:05:06.648303279 +0000 UTC m=+726.737519980" observedRunningTime="2026-05-28 15:05:07.177659233 +0000 UTC m=+727.266875957" watchObservedRunningTime="2026-05-28 15:05:07.17993292 +0000 UTC m=+727.269149643"
May 28 15:05:12.182422 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:05:12.182386    2563 generic.go:358] "Generic (PLEG): container finished" podID="cd84dad8-8374-4c00-8aa3-79828015437b" containerID="be829fa40775c3ad7c5c8424af0b3d2d46e8b21e4b8f0289a42ddd543a8bea0e" exitCode=0
May 28 15:05:12.182877 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:05:12.182448    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccgzps7" event={"ID":"cd84dad8-8374-4c00-8aa3-79828015437b","Type":"ContainerDied","Data":"be829fa40775c3ad7c5c8424af0b3d2d46e8b21e4b8f0289a42ddd543a8bea0e"}
May 28 15:05:18.180844 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:05:18.180807    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-24h2q"
May 28 15:05:20.721000 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:05:20.717409    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-sdpbq"]
May 28 15:05:20.722337 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:05:20.722308    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-sdpbq"
May 28 15:05:20.726333 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:05:20.726300    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
May 28 15:05:20.729137 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:05:20.729107    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-sdpbq"]
May 28 15:05:20.827395 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:05:20.827359    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/57a3807b-bf1e-4514-8684-a84a2938f6ab-home\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-sdpbq\" (UID: \"57a3807b-bf1e-4514-8684-a84a2938f6ab\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-sdpbq"
May 28 15:05:20.827395 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:05:20.827398    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/57a3807b-bf1e-4514-8684-a84a2938f6ab-dshm\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-sdpbq\" (UID: \"57a3807b-bf1e-4514-8684-a84a2938f6ab\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-sdpbq"
May 28 15:05:20.827608 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:05:20.827472    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/57a3807b-bf1e-4514-8684-a84a2938f6ab-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-sdpbq\" (UID: \"57a3807b-bf1e-4514-8684-a84a2938f6ab\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-sdpbq"
May 28 15:05:20.827608 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:05:20.827525    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/57a3807b-bf1e-4514-8684-a84a2938f6ab-model-cache\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-sdpbq\" (UID: \"57a3807b-bf1e-4514-8684-a84a2938f6ab\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-sdpbq"
May 28 15:05:20.827608 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:05:20.827581    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zxsgb\" (UniqueName: \"kubernetes.io/projected/57a3807b-bf1e-4514-8684-a84a2938f6ab-kube-api-access-zxsgb\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-sdpbq\" (UID: \"57a3807b-bf1e-4514-8684-a84a2938f6ab\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-sdpbq"
May 28 15:05:20.827723 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:05:20.827624    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/57a3807b-bf1e-4514-8684-a84a2938f6ab-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-sdpbq\" (UID: \"57a3807b-bf1e-4514-8684-a84a2938f6ab\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-sdpbq"
May 28 15:05:20.928700 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:05:20.928634    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/57a3807b-bf1e-4514-8684-a84a2938f6ab-model-cache\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-sdpbq\" (UID: \"57a3807b-bf1e-4514-8684-a84a2938f6ab\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-sdpbq"
May 28 15:05:20.928874 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:05:20.928721    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zxsgb\" (UniqueName: \"kubernetes.io/projected/57a3807b-bf1e-4514-8684-a84a2938f6ab-kube-api-access-zxsgb\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-sdpbq\" (UID: \"57a3807b-bf1e-4514-8684-a84a2938f6ab\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-sdpbq"
May 28 15:05:20.928874 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:05:20.928771    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/57a3807b-bf1e-4514-8684-a84a2938f6ab-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-sdpbq\" (UID: \"57a3807b-bf1e-4514-8684-a84a2938f6ab\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-sdpbq"
May 28 15:05:20.928874 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:05:20.928813    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/57a3807b-bf1e-4514-8684-a84a2938f6ab-home\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-sdpbq\" (UID: \"57a3807b-bf1e-4514-8684-a84a2938f6ab\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-sdpbq"
May 28 15:05:20.928874 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:05:20.928838    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/57a3807b-bf1e-4514-8684-a84a2938f6ab-dshm\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-sdpbq\" (UID: \"57a3807b-bf1e-4514-8684-a84a2938f6ab\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-sdpbq"
May 28 15:05:20.929146 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:05:20.928892    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/57a3807b-bf1e-4514-8684-a84a2938f6ab-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-sdpbq\" (UID: \"57a3807b-bf1e-4514-8684-a84a2938f6ab\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-sdpbq"
May 28 15:05:20.929207 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:05:20.929189    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/57a3807b-bf1e-4514-8684-a84a2938f6ab-model-cache\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-sdpbq\" (UID: \"57a3807b-bf1e-4514-8684-a84a2938f6ab\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-sdpbq"
May 28 15:05:20.929264 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:05:20.929206    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/57a3807b-bf1e-4514-8684-a84a2938f6ab-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-sdpbq\" (UID: \"57a3807b-bf1e-4514-8684-a84a2938f6ab\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-sdpbq"
May 28 15:05:20.929264 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:05:20.929235    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/57a3807b-bf1e-4514-8684-a84a2938f6ab-home\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-sdpbq\" (UID: \"57a3807b-bf1e-4514-8684-a84a2938f6ab\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-sdpbq"
May 28 15:05:20.931207 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:05:20.931180    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/57a3807b-bf1e-4514-8684-a84a2938f6ab-dshm\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-sdpbq\" (UID: \"57a3807b-bf1e-4514-8684-a84a2938f6ab\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-sdpbq"
May 28 15:05:20.931496 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:05:20.931479    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/57a3807b-bf1e-4514-8684-a84a2938f6ab-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-sdpbq\" (UID: \"57a3807b-bf1e-4514-8684-a84a2938f6ab\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-sdpbq"
May 28 15:05:20.935761 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:05:20.935739    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zxsgb\" (UniqueName: \"kubernetes.io/projected/57a3807b-bf1e-4514-8684-a84a2938f6ab-kube-api-access-zxsgb\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-sdpbq\" (UID: \"57a3807b-bf1e-4514-8684-a84a2938f6ab\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-sdpbq"
May 28 15:05:21.036728 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:05:21.036662    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-sdpbq"
May 28 15:05:21.180961 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:05:21.180934    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-sdpbq"]
May 28 15:05:21.183026 ip-10-0-137-84 kubenswrapper[2563]: W0528 15:05:21.182988    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57a3807b_bf1e_4514_8684_a84a2938f6ab.slice/crio-a0e644baa0cdc4bc93f4882fd147f4a2216005c2a1e953747d072d7e23ebde1c WatchSource:0}: Error finding container a0e644baa0cdc4bc93f4882fd147f4a2216005c2a1e953747d072d7e23ebde1c: Status 404 returned error can't find the container with id a0e644baa0cdc4bc93f4882fd147f4a2216005c2a1e953747d072d7e23ebde1c
May 28 15:05:21.220309 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:05:21.220268    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-sdpbq" event={"ID":"57a3807b-bf1e-4514-8684-a84a2938f6ab","Type":"ContainerStarted","Data":"a0e644baa0cdc4bc93f4882fd147f4a2216005c2a1e953747d072d7e23ebde1c"}
May 28 15:05:22.226228 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:05:22.226188    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccgzps7" event={"ID":"cd84dad8-8374-4c00-8aa3-79828015437b","Type":"ContainerStarted","Data":"ce61ad22b606cfd6ef27da741da79d834c021cec0dc7e186895859122ab4c39b"}
May 28 15:05:22.226697 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:05:22.226463    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccgzps7"
May 28 15:05:22.227738 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:05:22.227706    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-sdpbq" event={"ID":"57a3807b-bf1e-4514-8684-a84a2938f6ab","Type":"ContainerStarted","Data":"1453b9939feb151cf038e095c99710bace168a6108b764bd8e0049db6141e210"}
May 28 15:05:22.245075 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:05:22.245022    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccgzps7" podStartSLOduration=7.931123223 podStartE2EDuration="17.245007449s" podCreationTimestamp="2026-05-28 15:05:05 +0000 UTC" firstStartedPulling="2026-05-28 15:05:12.183354456 +0000 UTC m=+732.272571161" lastFinishedPulling="2026-05-28 15:05:21.497238674 +0000 UTC m=+741.586455387" observedRunningTime="2026-05-28 15:05:22.243031565 +0000 UTC m=+742.332248291" watchObservedRunningTime="2026-05-28 15:05:22.245007449 +0000 UTC m=+742.334224173"
May 28 15:05:23.424834 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:05:23.424797    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84db68679b-6h48w"]
May 28 15:05:23.428322 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:05:23.428300    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-6h48w"
May 28 15:05:23.430980 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:05:23.430949    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
May 28 15:05:23.437247 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:05:23.437222    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84db68679b-6h48w"]
May 28 15:05:23.553883 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:05:23.553839    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qx858\" (UniqueName: \"kubernetes.io/projected/6b2dc628-ae1b-4250-b28d-fb3498bcb363-kube-api-access-qx858\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-6h48w\" (UID: \"6b2dc628-ae1b-4250-b28d-fb3498bcb363\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-6h48w"
May 28 15:05:23.553883 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:05:23.553887    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6b2dc628-ae1b-4250-b28d-fb3498bcb363-home\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-6h48w\" (UID: \"6b2dc628-ae1b-4250-b28d-fb3498bcb363\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-6h48w"
May 28 15:05:23.554143 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:05:23.553935    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6b2dc628-ae1b-4250-b28d-fb3498bcb363-dshm\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-6h48w\" (UID: \"6b2dc628-ae1b-4250-b28d-fb3498bcb363\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-6h48w"
May 28 15:05:23.554143 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:05:23.553982    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6b2dc628-ae1b-4250-b28d-fb3498bcb363-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-6h48w\" (UID: \"6b2dc628-ae1b-4250-b28d-fb3498bcb363\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-6h48w"
May 28 15:05:23.554143 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:05:23.554006    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6b2dc628-ae1b-4250-b28d-fb3498bcb363-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-6h48w\" (UID: \"6b2dc628-ae1b-4250-b28d-fb3498bcb363\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-6h48w"
May 28 15:05:23.554143 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:05:23.554025    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/6b2dc628-ae1b-4250-b28d-fb3498bcb363-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-6h48w\" (UID: \"6b2dc628-ae1b-4250-b28d-fb3498bcb363\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-6h48w"
May 28 15:05:23.654857 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:05:23.654814    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qx858\" (UniqueName: \"kubernetes.io/projected/6b2dc628-ae1b-4250-b28d-fb3498bcb363-kube-api-access-qx858\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-6h48w\" (UID: \"6b2dc628-ae1b-4250-b28d-fb3498bcb363\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-6h48w"
May 28 15:05:23.654857 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:05:23.654863    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6b2dc628-ae1b-4250-b28d-fb3498bcb363-home\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-6h48w\" (UID: \"6b2dc628-ae1b-4250-b28d-fb3498bcb363\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-6h48w"
May 28 15:05:23.655120 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:05:23.654896    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6b2dc628-ae1b-4250-b28d-fb3498bcb363-dshm\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-6h48w\" (UID: \"6b2dc628-ae1b-4250-b28d-fb3498bcb363\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-6h48w"
May 28 15:05:23.655120 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:05:23.654934    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6b2dc628-ae1b-4250-b28d-fb3498bcb363-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-6h48w\" (UID: \"6b2dc628-ae1b-4250-b28d-fb3498bcb363\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-6h48w"
May 28 15:05:23.655120 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:05:23.654961    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6b2dc628-ae1b-4250-b28d-fb3498bcb363-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-6h48w\" (UID: \"6b2dc628-ae1b-4250-b28d-fb3498bcb363\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-6h48w"
May 28 15:05:23.655120 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:05:23.654987    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/6b2dc628-ae1b-4250-b28d-fb3498bcb363-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-6h48w\" (UID: \"6b2dc628-ae1b-4250-b28d-fb3498bcb363\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-6h48w"
May 28 15:05:23.655385 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:05:23.655362    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6b2dc628-ae1b-4250-b28d-fb3498bcb363-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-6h48w\" (UID: \"6b2dc628-ae1b-4250-b28d-fb3498bcb363\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-6h48w"
May 28 15:05:23.655453 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:05:23.655411    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6b2dc628-ae1b-4250-b28d-fb3498bcb363-home\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-6h48w\" (UID: \"6b2dc628-ae1b-4250-b28d-fb3498bcb363\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-6h48w"
May 28 15:05:23.655453 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:05:23.655424    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/6b2dc628-ae1b-4250-b28d-fb3498bcb363-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-6h48w\" (UID: \"6b2dc628-ae1b-4250-b28d-fb3498bcb363\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-6h48w"
May 28 15:05:23.657520 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:05:23.657494    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6b2dc628-ae1b-4250-b28d-fb3498bcb363-dshm\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-6h48w\" (UID: \"6b2dc628-ae1b-4250-b28d-fb3498bcb363\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-6h48w"
May 28 15:05:23.657643 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:05:23.657597    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6b2dc628-ae1b-4250-b28d-fb3498bcb363-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-6h48w\" (UID: \"6b2dc628-ae1b-4250-b28d-fb3498bcb363\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-6h48w"
May 28 15:05:23.668116 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:05:23.668091    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qx858\" (UniqueName: \"kubernetes.io/projected/6b2dc628-ae1b-4250-b28d-fb3498bcb363-kube-api-access-qx858\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-6h48w\" (UID: \"6b2dc628-ae1b-4250-b28d-fb3498bcb363\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-6h48w"
May 28 15:05:23.740503 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:05:23.740402    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-6h48w"
May 28 15:05:23.901992 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:05:23.901958    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84db68679b-6h48w"]
May 28 15:05:23.903454 ip-10-0-137-84 kubenswrapper[2563]: W0528 15:05:23.903427    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b2dc628_ae1b_4250_b28d_fb3498bcb363.slice/crio-dc41925817dfbb9312753dd072e5fdfd5ea69ddc731255e2b715a4bc65cbac67 WatchSource:0}: Error finding container dc41925817dfbb9312753dd072e5fdfd5ea69ddc731255e2b715a4bc65cbac67: Status 404 returned error can't find the container with id dc41925817dfbb9312753dd072e5fdfd5ea69ddc731255e2b715a4bc65cbac67
May 28 15:05:24.237381 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:05:24.237346    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-6h48w" event={"ID":"6b2dc628-ae1b-4250-b28d-fb3498bcb363","Type":"ContainerStarted","Data":"96231495bb3f7b699137062502700fe0d2d7d4a05fc794ffcf779e9abca35172"}
May 28 15:05:24.237381 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:05:24.237388    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-6h48w" event={"ID":"6b2dc628-ae1b-4250-b28d-fb3498bcb363","Type":"ContainerStarted","Data":"dc41925817dfbb9312753dd072e5fdfd5ea69ddc731255e2b715a4bc65cbac67"}
May 28 15:05:27.250731 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:05:27.250608    2563 generic.go:358] "Generic (PLEG): container finished" podID="57a3807b-bf1e-4514-8684-a84a2938f6ab" containerID="1453b9939feb151cf038e095c99710bace168a6108b764bd8e0049db6141e210" exitCode=0
May 28 15:05:27.250731 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:05:27.250696    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-sdpbq" event={"ID":"57a3807b-bf1e-4514-8684-a84a2938f6ab","Type":"ContainerDied","Data":"1453b9939feb151cf038e095c99710bace168a6108b764bd8e0049db6141e210"}
May 28 15:05:27.316060 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:05:27.316014    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-6b97b89985-8jgtx"]
May 28 15:05:27.318959 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:05:27.318936    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-8jgtx"
May 28 15:05:27.321466 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:05:27.321440    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
May 28 15:05:27.329566 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:05:27.329540    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-6b97b89985-8jgtx"]
May 28 15:05:27.390745 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:05:27.390701    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fed8a95a-399c-42d7-8b36-f0c60ce93bfe-model-cache\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-8jgtx\" (UID: \"fed8a95a-399c-42d7-8b36-f0c60ce93bfe\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-8jgtx"
May 28 15:05:27.390908 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:05:27.390808    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hst2q\" (UniqueName: \"kubernetes.io/projected/fed8a95a-399c-42d7-8b36-f0c60ce93bfe-kube-api-access-hst2q\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-8jgtx\" (UID: \"fed8a95a-399c-42d7-8b36-f0c60ce93bfe\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-8jgtx"
May 28 15:05:27.390908 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:05:27.390850    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fed8a95a-399c-42d7-8b36-f0c60ce93bfe-home\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-8jgtx\" (UID: \"fed8a95a-399c-42d7-8b36-f0c60ce93bfe\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-8jgtx"
May 28 15:05:27.391002 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:05:27.390966    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fed8a95a-399c-42d7-8b36-f0c60ce93bfe-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-8jgtx\" (UID: \"fed8a95a-399c-42d7-8b36-f0c60ce93bfe\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-8jgtx"
May 28 15:05:27.391128 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:05:27.391113    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/fed8a95a-399c-42d7-8b36-f0c60ce93bfe-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-8jgtx\" (UID: \"fed8a95a-399c-42d7-8b36-f0c60ce93bfe\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-8jgtx"
May 28 15:05:27.391165 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:05:27.391137    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fed8a95a-399c-42d7-8b36-f0c60ce93bfe-dshm\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-8jgtx\" (UID: \"fed8a95a-399c-42d7-8b36-f0c60ce93bfe\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-8jgtx"
May 28 15:05:27.492137 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:05:27.492102    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fed8a95a-399c-42d7-8b36-f0c60ce93bfe-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-8jgtx\" (UID: \"fed8a95a-399c-42d7-8b36-f0c60ce93bfe\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-8jgtx"
May 28 15:05:27.492301 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:05:27.492193    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/fed8a95a-399c-42d7-8b36-f0c60ce93bfe-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-8jgtx\" (UID: \"fed8a95a-399c-42d7-8b36-f0c60ce93bfe\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-8jgtx"
May 28 15:05:27.492301 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:05:27.492214    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fed8a95a-399c-42d7-8b36-f0c60ce93bfe-dshm\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-8jgtx\" (UID: \"fed8a95a-399c-42d7-8b36-f0c60ce93bfe\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-8jgtx"
May 28 15:05:27.492301 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:05:27.492255    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fed8a95a-399c-42d7-8b36-f0c60ce93bfe-model-cache\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-8jgtx\" (UID: \"fed8a95a-399c-42d7-8b36-f0c60ce93bfe\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-8jgtx"
May 28 15:05:27.492301 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:05:27.492292    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hst2q\" (UniqueName: \"kubernetes.io/projected/fed8a95a-399c-42d7-8b36-f0c60ce93bfe-kube-api-access-hst2q\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-8jgtx\" (UID: \"fed8a95a-399c-42d7-8b36-f0c60ce93bfe\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-8jgtx"
May 28 15:05:27.492529 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:05:27.492319    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fed8a95a-399c-42d7-8b36-f0c60ce93bfe-home\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-8jgtx\" (UID: \"fed8a95a-399c-42d7-8b36-f0c60ce93bfe\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-8jgtx"
May 28 15:05:27.492715 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:05:27.492671    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/fed8a95a-399c-42d7-8b36-f0c60ce93bfe-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-8jgtx\" (UID: \"fed8a95a-399c-42d7-8b36-f0c60ce93bfe\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-8jgtx"
May 28 15:05:27.492805 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:05:27.492776    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fed8a95a-399c-42d7-8b36-f0c60ce93bfe-model-cache\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-8jgtx\" (UID: \"fed8a95a-399c-42d7-8b36-f0c60ce93bfe\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-8jgtx"
May 28 15:05:27.492845 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:05:27.492824    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fed8a95a-399c-42d7-8b36-f0c60ce93bfe-home\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-8jgtx\" (UID: \"fed8a95a-399c-42d7-8b36-f0c60ce93bfe\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-8jgtx"
May 28 15:05:27.494564 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:05:27.494533    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fed8a95a-399c-42d7-8b36-f0c60ce93bfe-dshm\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-8jgtx\" (UID: \"fed8a95a-399c-42d7-8b36-f0c60ce93bfe\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-8jgtx"
May 28 15:05:27.495024 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:05:27.495006    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fed8a95a-399c-42d7-8b36-f0c60ce93bfe-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-8jgtx\" (UID: \"fed8a95a-399c-42d7-8b36-f0c60ce93bfe\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-8jgtx"
May 28 15:05:27.499715 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:05:27.499670    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hst2q\" (UniqueName: \"kubernetes.io/projected/fed8a95a-399c-42d7-8b36-f0c60ce93bfe-kube-api-access-hst2q\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-8jgtx\" (UID: \"fed8a95a-399c-42d7-8b36-f0c60ce93bfe\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-8jgtx"
May 28 15:05:27.629928 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:05:27.629844    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-8jgtx"
May 28 15:05:27.790417 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:05:27.790388    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-6b97b89985-8jgtx"]
May 28 15:05:27.792514 ip-10-0-137-84 kubenswrapper[2563]: W0528 15:05:27.792484    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfed8a95a_399c_42d7_8b36_f0c60ce93bfe.slice/crio-81da58e2ff1097d437c0405926d4af5fc7bff0cd6afe470f0c19d588ebe44633 WatchSource:0}: Error finding container 81da58e2ff1097d437c0405926d4af5fc7bff0cd6afe470f0c19d588ebe44633: Status 404 returned error can't find the container with id 81da58e2ff1097d437c0405926d4af5fc7bff0cd6afe470f0c19d588ebe44633
May 28 15:05:28.257908 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:05:28.257864    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-8jgtx" event={"ID":"fed8a95a-399c-42d7-8b36-f0c60ce93bfe","Type":"ContainerStarted","Data":"e1332e05a887b8be23dbd603a1ed4bfa077b266d16f48aadab82356eb5dd5666"}
May 28 15:05:28.258371 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:05:28.257917    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-8jgtx" event={"ID":"fed8a95a-399c-42d7-8b36-f0c60ce93bfe","Type":"ContainerStarted","Data":"81da58e2ff1097d437c0405926d4af5fc7bff0cd6afe470f0c19d588ebe44633"}
May 28 15:05:30.267729 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:05:30.267695    2563 generic.go:358] "Generic (PLEG): container finished" podID="6b2dc628-ae1b-4250-b28d-fb3498bcb363" containerID="96231495bb3f7b699137062502700fe0d2d7d4a05fc794ffcf779e9abca35172" exitCode=0
May 28 15:05:30.268154 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:05:30.267773    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-6h48w" event={"ID":"6b2dc628-ae1b-4250-b28d-fb3498bcb363","Type":"ContainerDied","Data":"96231495bb3f7b699137062502700fe0d2d7d4a05fc794ffcf779e9abca35172"}
May 28 15:05:32.286340 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:05:32.286306    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-sdpbq" event={"ID":"57a3807b-bf1e-4514-8684-a84a2938f6ab","Type":"ContainerStarted","Data":"d69747a46489c39795d36d6a922e01ee980d8c498918365bce526ed2a3f69ac1"}
May 28 15:05:32.286764 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:05:32.286523    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-sdpbq"
May 28 15:05:32.311398 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:05:32.311328    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-sdpbq" podStartSLOduration=8.152260641 podStartE2EDuration="12.311309327s" podCreationTimestamp="2026-05-28 15:05:20 +0000 UTC" firstStartedPulling="2026-05-28 15:05:27.251354268 +0000 UTC m=+747.340570969" lastFinishedPulling="2026-05-28 15:05:31.410402955 +0000 UTC m=+751.499619655" observedRunningTime="2026-05-28 15:05:32.306751075 +0000 UTC m=+752.395967800" watchObservedRunningTime="2026-05-28 15:05:32.311309327 +0000 UTC m=+752.400526042"
May 28 15:05:33.246954 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:05:33.246916    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccgzps7"
May 28 15:05:36.312597 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:05:36.312560    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-6h48w" event={"ID":"6b2dc628-ae1b-4250-b28d-fb3498bcb363","Type":"ContainerStarted","Data":"d0bdd9c7ef0a3f6ca10bccf881d430e223bd6b72b4ebb20f81ae1d5ee583ad4e"}
May 28 15:05:36.313010 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:05:36.312830    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-6h48w"
May 28 15:05:36.334429 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:05:36.334363    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-6h48w" podStartSLOduration=8.204788142 podStartE2EDuration="13.334344292s" podCreationTimestamp="2026-05-28 15:05:23 +0000 UTC" firstStartedPulling="2026-05-28 15:05:30.26848924 +0000 UTC m=+750.357705941" lastFinishedPulling="2026-05-28 15:05:35.39804538 +0000 UTC m=+755.487262091" observedRunningTime="2026-05-28 15:05:36.330293152 +0000 UTC m=+756.419509876" watchObservedRunningTime="2026-05-28 15:05:36.334344292 +0000 UTC m=+756.423561025"
May 28 15:05:37.318111 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:05:37.318077    2563 generic.go:358] "Generic (PLEG): container finished" podID="fed8a95a-399c-42d7-8b36-f0c60ce93bfe" containerID="e1332e05a887b8be23dbd603a1ed4bfa077b266d16f48aadab82356eb5dd5666" exitCode=0
May 28 15:05:37.318505 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:05:37.318147    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-8jgtx" event={"ID":"fed8a95a-399c-42d7-8b36-f0c60ce93bfe","Type":"ContainerDied","Data":"e1332e05a887b8be23dbd603a1ed4bfa077b266d16f48aadab82356eb5dd5666"}
May 28 15:05:38.324229 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:05:38.324190    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-8jgtx" event={"ID":"fed8a95a-399c-42d7-8b36-f0c60ce93bfe","Type":"ContainerStarted","Data":"c71af72278815c02bff94bbd6e28330063ac5f09b98130d29f31603163e461eb"}
May 28 15:05:38.324625 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:05:38.324396    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-8jgtx"
May 28 15:05:38.343707 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:05:38.343638    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-8jgtx" podStartSLOduration=10.765417164 podStartE2EDuration="11.343623962s" podCreationTimestamp="2026-05-28 15:05:27 +0000 UTC" firstStartedPulling="2026-05-28 15:05:37.318930162 +0000 UTC m=+757.408146864" lastFinishedPulling="2026-05-28 15:05:37.89713695 +0000 UTC m=+757.986353662" observedRunningTime="2026-05-28 15:05:38.341145946 +0000 UTC m=+758.430362668" watchObservedRunningTime="2026-05-28 15:05:38.343623962 +0000 UTC m=+758.432840713"
May 28 15:05:43.307449 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:05:43.307420    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-sdpbq"
May 28 15:05:47.331783 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:05:47.331750    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-6h48w"
May 28 15:05:49.341831 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:05:49.341790    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-8jgtx"
May 28 15:05:52.943826 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:05:52.943788    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-7f849f6b56-2tswc"]
May 28 15:05:52.947261 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:05:52.947244    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-2tswc"
May 28 15:05:52.949910 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:05:52.949887    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
May 28 15:05:52.955940 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:05:52.955918    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-7f849f6b56-2tswc"]
May 28 15:05:53.039204 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:05:53.039174    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2c25326a-be79-40b3-9e32-39bcbd860302-dshm\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-2tswc\" (UID: \"2c25326a-be79-40b3-9e32-39bcbd860302\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-2tswc"
May 28 15:05:53.039375 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:05:53.039237    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2c25326a-be79-40b3-9e32-39bcbd860302-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-2tswc\" (UID: \"2c25326a-be79-40b3-9e32-39bcbd860302\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-2tswc"
May 28 15:05:53.039375 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:05:53.039258    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/2c25326a-be79-40b3-9e32-39bcbd860302-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-2tswc\" (UID: \"2c25326a-be79-40b3-9e32-39bcbd860302\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-2tswc"
May 28 15:05:53.039375 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:05:53.039283    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kzp87\" (UniqueName: \"kubernetes.io/projected/2c25326a-be79-40b3-9e32-39bcbd860302-kube-api-access-kzp87\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-2tswc\" (UID: \"2c25326a-be79-40b3-9e32-39bcbd860302\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-2tswc"
May 28 15:05:53.039375 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:05:53.039348    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2c25326a-be79-40b3-9e32-39bcbd860302-model-cache\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-2tswc\" (UID: \"2c25326a-be79-40b3-9e32-39bcbd860302\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-2tswc"
May 28 15:05:53.039530 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:05:53.039378    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2c25326a-be79-40b3-9e32-39bcbd860302-home\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-2tswc\" (UID: \"2c25326a-be79-40b3-9e32-39bcbd860302\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-2tswc"
May 28 15:05:53.140062 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:05:53.140021    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2c25326a-be79-40b3-9e32-39bcbd860302-model-cache\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-2tswc\" (UID: \"2c25326a-be79-40b3-9e32-39bcbd860302\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-2tswc"
May 28 15:05:53.140062 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:05:53.140064    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2c25326a-be79-40b3-9e32-39bcbd860302-home\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-2tswc\" (UID: \"2c25326a-be79-40b3-9e32-39bcbd860302\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-2tswc"
May 28 15:05:53.140319 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:05:53.140110    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2c25326a-be79-40b3-9e32-39bcbd860302-dshm\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-2tswc\" (UID: \"2c25326a-be79-40b3-9e32-39bcbd860302\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-2tswc"
May 28 15:05:53.140319 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:05:53.140210    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2c25326a-be79-40b3-9e32-39bcbd860302-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-2tswc\" (UID: \"2c25326a-be79-40b3-9e32-39bcbd860302\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-2tswc"
May 28 15:05:53.140319 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:05:53.140233    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/2c25326a-be79-40b3-9e32-39bcbd860302-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-2tswc\" (UID: \"2c25326a-be79-40b3-9e32-39bcbd860302\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-2tswc"
May 28 15:05:53.140319 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:05:53.140280    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kzp87\" (UniqueName: \"kubernetes.io/projected/2c25326a-be79-40b3-9e32-39bcbd860302-kube-api-access-kzp87\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-2tswc\" (UID: \"2c25326a-be79-40b3-9e32-39bcbd860302\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-2tswc"
May 28 15:05:53.140519 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:05:53.140447    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2c25326a-be79-40b3-9e32-39bcbd860302-model-cache\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-2tswc\" (UID: \"2c25326a-be79-40b3-9e32-39bcbd860302\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-2tswc"
May 28 15:05:53.140574 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:05:53.140515    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2c25326a-be79-40b3-9e32-39bcbd860302-home\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-2tswc\" (UID: \"2c25326a-be79-40b3-9e32-39bcbd860302\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-2tswc"
May 28 15:05:53.140820 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:05:53.140795    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/2c25326a-be79-40b3-9e32-39bcbd860302-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-2tswc\" (UID: \"2c25326a-be79-40b3-9e32-39bcbd860302\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-2tswc"
May 28 15:05:53.142784 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:05:53.142755    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2c25326a-be79-40b3-9e32-39bcbd860302-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-2tswc\" (UID: \"2c25326a-be79-40b3-9e32-39bcbd860302\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-2tswc"
May 28 15:05:53.142891 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:05:53.142823    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2c25326a-be79-40b3-9e32-39bcbd860302-dshm\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-2tswc\" (UID: \"2c25326a-be79-40b3-9e32-39bcbd860302\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-2tswc"
May 28 15:05:53.148297 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:05:53.148274    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kzp87\" (UniqueName: \"kubernetes.io/projected/2c25326a-be79-40b3-9e32-39bcbd860302-kube-api-access-kzp87\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-2tswc\" (UID: \"2c25326a-be79-40b3-9e32-39bcbd860302\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-2tswc"
May 28 15:05:53.259076 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:05:53.259040    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-2tswc"
May 28 15:05:53.437163 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:05:53.437130    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-7f849f6b56-2tswc"]
May 28 15:05:53.437877 ip-10-0-137-84 kubenswrapper[2563]: W0528 15:05:53.437851    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c25326a_be79_40b3_9e32_39bcbd860302.slice/crio-e44d5c0aa89434cecb0a73cc91a1d7158a2b7dee48ec68cf0bff3c7c8cc72d75 WatchSource:0}: Error finding container e44d5c0aa89434cecb0a73cc91a1d7158a2b7dee48ec68cf0bff3c7c8cc72d75: Status 404 returned error can't find the container with id e44d5c0aa89434cecb0a73cc91a1d7158a2b7dee48ec68cf0bff3c7c8cc72d75
May 28 15:05:54.407123 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:05:54.407086    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-2tswc" event={"ID":"2c25326a-be79-40b3-9e32-39bcbd860302","Type":"ContainerStarted","Data":"97d652253da11352d592c074fbb02238594020b3bb8a0c865e726d4197fdc52f"}
May 28 15:05:54.407123 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:05:54.407129    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-2tswc" event={"ID":"2c25326a-be79-40b3-9e32-39bcbd860302","Type":"ContainerStarted","Data":"e44d5c0aa89434cecb0a73cc91a1d7158a2b7dee48ec68cf0bff3c7c8cc72d75"}
May 28 15:05:59.430691 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:05:59.430584    2563 generic.go:358] "Generic (PLEG): container finished" podID="2c25326a-be79-40b3-9e32-39bcbd860302" containerID="97d652253da11352d592c074fbb02238594020b3bb8a0c865e726d4197fdc52f" exitCode=0
May 28 15:05:59.431067 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:05:59.430661    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-2tswc" event={"ID":"2c25326a-be79-40b3-9e32-39bcbd860302","Type":"ContainerDied","Data":"97d652253da11352d592c074fbb02238594020b3bb8a0c865e726d4197fdc52f"}
May 28 15:06:00.437754 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:06:00.437712    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-2tswc" event={"ID":"2c25326a-be79-40b3-9e32-39bcbd860302","Type":"ContainerStarted","Data":"4b36c4453471ebc95e24166a0ad7e0aaaa92dc0a0bcacd00c67daa5db57daed6"}
May 28 15:06:00.438141 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:06:00.437968    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-2tswc"
May 28 15:06:00.462834 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:06:00.462784    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-2tswc" podStartSLOduration=8.049166908 podStartE2EDuration="8.46276942s" podCreationTimestamp="2026-05-28 15:05:52 +0000 UTC" firstStartedPulling="2026-05-28 15:05:59.431368561 +0000 UTC m=+779.520585262" lastFinishedPulling="2026-05-28 15:05:59.844971074 +0000 UTC m=+779.934187774" observedRunningTime="2026-05-28 15:06:00.459765482 +0000 UTC m=+780.548982205" watchObservedRunningTime="2026-05-28 15:06:00.46276942 +0000 UTC m=+780.551986168"
May 28 15:06:11.455363 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:06:11.455286    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-2tswc"
May 28 15:07:22.027938 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:07:22.027897    2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5c48cdb64c-pphtw"]
May 28 15:07:22.028469 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:07:22.028140    2563 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-controller-5c48cdb64c-pphtw" podUID="0066592b-0730-41df-8216-c88968f66ad9" containerName="manager" containerID="cri-o://f642be359b060068637d3c7d90941b35615807fb44c2aaec772899d9ed4acb1f" gracePeriod=30
May 28 15:07:22.285668 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:07:22.285599    2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5c48cdb64c-pphtw"
May 28 15:07:22.347626 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:07:22.347587    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zvhv7\" (UniqueName: \"kubernetes.io/projected/0066592b-0730-41df-8216-c88968f66ad9-kube-api-access-zvhv7\") pod \"0066592b-0730-41df-8216-c88968f66ad9\" (UID: \"0066592b-0730-41df-8216-c88968f66ad9\") "
May 28 15:07:22.347824 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:07:22.347664    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0066592b-0730-41df-8216-c88968f66ad9-webhook-cert\") pod \"0066592b-0730-41df-8216-c88968f66ad9\" (UID: \"0066592b-0730-41df-8216-c88968f66ad9\") "
May 28 15:07:22.349727 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:07:22.349648    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0066592b-0730-41df-8216-c88968f66ad9-kube-api-access-zvhv7" (OuterVolumeSpecName: "kube-api-access-zvhv7") pod "0066592b-0730-41df-8216-c88968f66ad9" (UID: "0066592b-0730-41df-8216-c88968f66ad9"). InnerVolumeSpecName "kube-api-access-zvhv7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 15:07:22.349727 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:07:22.349691    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0066592b-0730-41df-8216-c88968f66ad9-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "0066592b-0730-41df-8216-c88968f66ad9" (UID: "0066592b-0730-41df-8216-c88968f66ad9"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 15:07:22.449094 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:07:22.449057    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zvhv7\" (UniqueName: \"kubernetes.io/projected/0066592b-0730-41df-8216-c88968f66ad9-kube-api-access-zvhv7\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
May 28 15:07:22.449094 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:07:22.449088    2563 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0066592b-0730-41df-8216-c88968f66ad9-webhook-cert\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
May 28 15:07:22.783823 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:07:22.783792    2563 generic.go:358] "Generic (PLEG): container finished" podID="0066592b-0730-41df-8216-c88968f66ad9" containerID="f642be359b060068637d3c7d90941b35615807fb44c2aaec772899d9ed4acb1f" exitCode=0
May 28 15:07:22.784038 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:07:22.783871    2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5c48cdb64c-pphtw"
May 28 15:07:22.784038 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:07:22.783875    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5c48cdb64c-pphtw" event={"ID":"0066592b-0730-41df-8216-c88968f66ad9","Type":"ContainerDied","Data":"f642be359b060068637d3c7d90941b35615807fb44c2aaec772899d9ed4acb1f"}
May 28 15:07:22.784038 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:07:22.783915    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5c48cdb64c-pphtw" event={"ID":"0066592b-0730-41df-8216-c88968f66ad9","Type":"ContainerDied","Data":"6f99b53e5bc0c8cba3ac9f78c71a26b368c680dde2d5bcd1e4992addfbc0dc32"}
May 28 15:07:22.784038 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:07:22.783940    2563 scope.go:117] "RemoveContainer" containerID="f642be359b060068637d3c7d90941b35615807fb44c2aaec772899d9ed4acb1f"
May 28 15:07:22.793816 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:07:22.793798    2563 scope.go:117] "RemoveContainer" containerID="f642be359b060068637d3c7d90941b35615807fb44c2aaec772899d9ed4acb1f"
May 28 15:07:22.794080 ip-10-0-137-84 kubenswrapper[2563]: E0528 15:07:22.794061    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f642be359b060068637d3c7d90941b35615807fb44c2aaec772899d9ed4acb1f\": container with ID starting with f642be359b060068637d3c7d90941b35615807fb44c2aaec772899d9ed4acb1f not found: ID does not exist" containerID="f642be359b060068637d3c7d90941b35615807fb44c2aaec772899d9ed4acb1f"
May 28 15:07:22.794127 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:07:22.794089    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f642be359b060068637d3c7d90941b35615807fb44c2aaec772899d9ed4acb1f"} err="failed to get container status \"f642be359b060068637d3c7d90941b35615807fb44c2aaec772899d9ed4acb1f\": rpc error: code = NotFound desc = could not find container \"f642be359b060068637d3c7d90941b35615807fb44c2aaec772899d9ed4acb1f\": container with ID starting with f642be359b060068637d3c7d90941b35615807fb44c2aaec772899d9ed4acb1f not found: ID does not exist"
May 28 15:07:22.802246 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:07:22.802207    2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5c48cdb64c-pphtw"]
May 28 15:07:22.807893 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:07:22.807871    2563 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5c48cdb64c-pphtw"]
May 28 15:07:24.480620 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:07:24.480586    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0066592b-0730-41df-8216-c88968f66ad9" path="/var/lib/kubelet/pods/0066592b-0730-41df-8216-c88968f66ad9/volumes"
May 28 15:08:00.436484 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:08:00.436405    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-86zbj_8d769c1c-5bf7-49c6-bf05-531b243e935e/console-operator/2.log"
May 28 15:08:00.440112 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:08:00.440087    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ssv8l_f3df342f-512f-410a-8b64-171bc7255a0e/ovn-acl-logging/0.log"
May 28 15:08:00.440255 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:08:00.440139    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-86zbj_8d769c1c-5bf7-49c6-bf05-531b243e935e/console-operator/2.log"
May 28 15:08:00.443385 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:08:00.443363    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ssv8l_f3df342f-512f-410a-8b64-171bc7255a0e/ovn-acl-logging/0.log"
May 28 15:13:00.486512 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:13:00.486484    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-86zbj_8d769c1c-5bf7-49c6-bf05-531b243e935e/console-operator/2.log"
May 28 15:13:00.487444 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:13:00.487420    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-86zbj_8d769c1c-5bf7-49c6-bf05-531b243e935e/console-operator/2.log"
May 28 15:13:00.490183 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:13:00.490158    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ssv8l_f3df342f-512f-410a-8b64-171bc7255a0e/ovn-acl-logging/0.log"
May 28 15:13:00.490858 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:13:00.490831    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ssv8l_f3df342f-512f-410a-8b64-171bc7255a0e/ovn-acl-logging/0.log"
May 28 15:17:57.567336 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:17:57.567297    2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-2dqs8"]
May 28 15:17:57.567990 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:17:57.567600    2563 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-2dqs8" podUID="294d11b9-c0aa-4e94-966f-03d59714d772" containerName="manager" containerID="cri-o://b81986b2266dce96404a07199f871dd0d0678d5e4dc2d4992caae9905d393d2c" gracePeriod=10
May 28 15:17:57.932741 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:17:57.932717    2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-2dqs8"
May 28 15:17:57.981079 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:17:57.981044    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/294d11b9-c0aa-4e94-966f-03d59714d772-extensions-socket-volume\") pod \"294d11b9-c0aa-4e94-966f-03d59714d772\" (UID: \"294d11b9-c0aa-4e94-966f-03d59714d772\") "
May 28 15:17:57.981273 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:17:57.981161    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7bslx\" (UniqueName: \"kubernetes.io/projected/294d11b9-c0aa-4e94-966f-03d59714d772-kube-api-access-7bslx\") pod \"294d11b9-c0aa-4e94-966f-03d59714d772\" (UID: \"294d11b9-c0aa-4e94-966f-03d59714d772\") "
May 28 15:17:57.981474 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:17:57.981437    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/294d11b9-c0aa-4e94-966f-03d59714d772-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "294d11b9-c0aa-4e94-966f-03d59714d772" (UID: "294d11b9-c0aa-4e94-966f-03d59714d772"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 15:17:57.983225 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:17:57.983197    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/294d11b9-c0aa-4e94-966f-03d59714d772-kube-api-access-7bslx" (OuterVolumeSpecName: "kube-api-access-7bslx") pod "294d11b9-c0aa-4e94-966f-03d59714d772" (UID: "294d11b9-c0aa-4e94-966f-03d59714d772"). InnerVolumeSpecName "kube-api-access-7bslx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 15:17:58.082604 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:17:58.082556    2563 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/294d11b9-c0aa-4e94-966f-03d59714d772-extensions-socket-volume\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
May 28 15:17:58.082604 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:17:58.082595    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7bslx\" (UniqueName: \"kubernetes.io/projected/294d11b9-c0aa-4e94-966f-03d59714d772-kube-api-access-7bslx\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
May 28 15:17:58.518635 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:17:58.518593    2563 generic.go:358] "Generic (PLEG): container finished" podID="294d11b9-c0aa-4e94-966f-03d59714d772" containerID="b81986b2266dce96404a07199f871dd0d0678d5e4dc2d4992caae9905d393d2c" exitCode=0
May 28 15:17:58.518813 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:17:58.518708    2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-2dqs8"
May 28 15:17:58.518813 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:17:58.518706    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-2dqs8" event={"ID":"294d11b9-c0aa-4e94-966f-03d59714d772","Type":"ContainerDied","Data":"b81986b2266dce96404a07199f871dd0d0678d5e4dc2d4992caae9905d393d2c"}
May 28 15:17:58.518894 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:17:58.518814    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-2dqs8" event={"ID":"294d11b9-c0aa-4e94-966f-03d59714d772","Type":"ContainerDied","Data":"a6361adbc9ace28acb79793f9b4228a88382cc30ae0d3d0e7fa716bf86c3cac9"}
May 28 15:17:58.518894 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:17:58.518830    2563 scope.go:117] "RemoveContainer" containerID="b81986b2266dce96404a07199f871dd0d0678d5e4dc2d4992caae9905d393d2c"
May 28 15:17:58.528416 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:17:58.528383    2563 scope.go:117] "RemoveContainer" containerID="b81986b2266dce96404a07199f871dd0d0678d5e4dc2d4992caae9905d393d2c"
May 28 15:17:58.528712 ip-10-0-137-84 kubenswrapper[2563]: E0528 15:17:58.528691    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b81986b2266dce96404a07199f871dd0d0678d5e4dc2d4992caae9905d393d2c\": container with ID starting with b81986b2266dce96404a07199f871dd0d0678d5e4dc2d4992caae9905d393d2c not found: ID does not exist" containerID="b81986b2266dce96404a07199f871dd0d0678d5e4dc2d4992caae9905d393d2c"
May 28 15:17:58.528768 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:17:58.528723    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b81986b2266dce96404a07199f871dd0d0678d5e4dc2d4992caae9905d393d2c"} err="failed to get container status \"b81986b2266dce96404a07199f871dd0d0678d5e4dc2d4992caae9905d393d2c\": rpc error: code = NotFound desc = could not find container \"b81986b2266dce96404a07199f871dd0d0678d5e4dc2d4992caae9905d393d2c\": container with ID starting with b81986b2266dce96404a07199f871dd0d0678d5e4dc2d4992caae9905d393d2c not found: ID does not exist"
May 28 15:17:58.538749 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:17:58.538720    2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-2dqs8"]
May 28 15:17:58.541916 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:17:58.541894    2563 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-2dqs8"]
May 28 15:18:00.484477 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:18:00.484440    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="294d11b9-c0aa-4e94-966f-03d59714d772" path="/var/lib/kubelet/pods/294d11b9-c0aa-4e94-966f-03d59714d772/volumes"
May 28 15:18:00.522820 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:18:00.522791    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-86zbj_8d769c1c-5bf7-49c6-bf05-531b243e935e/console-operator/2.log"
May 28 15:18:00.525670 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:18:00.525643    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-86zbj_8d769c1c-5bf7-49c6-bf05-531b243e935e/console-operator/2.log"
May 28 15:18:00.526345 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:18:00.526323    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ssv8l_f3df342f-512f-410a-8b64-171bc7255a0e/ovn-acl-logging/0.log"
May 28 15:18:00.528965 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:18:00.528942    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ssv8l_f3df342f-512f-410a-8b64-171bc7255a0e/ovn-acl-logging/0.log"
May 28 15:19:03.684399 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:19:03.684355    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-ghr55"]
May 28 15:19:03.684923 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:19:03.684881    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="294d11b9-c0aa-4e94-966f-03d59714d772" containerName="manager"
May 28 15:19:03.684923 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:19:03.684898    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="294d11b9-c0aa-4e94-966f-03d59714d772" containerName="manager"
May 28 15:19:03.684923 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:19:03.684910    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0066592b-0730-41df-8216-c88968f66ad9" containerName="manager"
May 28 15:19:03.684923 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:19:03.684916    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="0066592b-0730-41df-8216-c88968f66ad9" containerName="manager"
May 28 15:19:03.685057 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:19:03.684995    2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="0066592b-0730-41df-8216-c88968f66ad9" containerName="manager"
May 28 15:19:03.685057 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:19:03.685013    2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="294d11b9-c0aa-4e94-966f-03d59714d772" containerName="manager"
May 28 15:19:03.687981 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:19:03.687964    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-ghr55"
May 28 15:19:03.690705 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:19:03.690657    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-s954q\""
May 28 15:19:03.697987 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:19:03.697962    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-ghr55"]
May 28 15:19:03.842871 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:19:03.842826    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2dmf2\" (UniqueName: \"kubernetes.io/projected/1c12c62e-cd71-47d7-9d39-d22bd3cb1407-kube-api-access-2dmf2\") pod \"kuadrant-operator-controller-manager-55c7f4c975-ghr55\" (UID: \"1c12c62e-cd71-47d7-9d39-d22bd3cb1407\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-ghr55"
May 28 15:19:03.843048 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:19:03.842972    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1c12c62e-cd71-47d7-9d39-d22bd3cb1407-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-ghr55\" (UID: \"1c12c62e-cd71-47d7-9d39-d22bd3cb1407\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-ghr55"
May 28 15:19:03.944557 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:19:03.944460    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1c12c62e-cd71-47d7-9d39-d22bd3cb1407-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-ghr55\" (UID: \"1c12c62e-cd71-47d7-9d39-d22bd3cb1407\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-ghr55"
May 28 15:19:03.944557 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:19:03.944550    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2dmf2\" (UniqueName: \"kubernetes.io/projected/1c12c62e-cd71-47d7-9d39-d22bd3cb1407-kube-api-access-2dmf2\") pod \"kuadrant-operator-controller-manager-55c7f4c975-ghr55\" (UID: \"1c12c62e-cd71-47d7-9d39-d22bd3cb1407\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-ghr55"
May 28 15:19:03.944902 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:19:03.944878    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1c12c62e-cd71-47d7-9d39-d22bd3cb1407-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-ghr55\" (UID: \"1c12c62e-cd71-47d7-9d39-d22bd3cb1407\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-ghr55"
May 28 15:19:03.952536 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:19:03.952508    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2dmf2\" (UniqueName: \"kubernetes.io/projected/1c12c62e-cd71-47d7-9d39-d22bd3cb1407-kube-api-access-2dmf2\") pod \"kuadrant-operator-controller-manager-55c7f4c975-ghr55\" (UID: \"1c12c62e-cd71-47d7-9d39-d22bd3cb1407\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-ghr55"
May 28 15:19:03.999269 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:19:03.999227    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-ghr55"
May 28 15:19:04.143585 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:19:04.143550    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-ghr55"]
May 28 15:19:04.144694 ip-10-0-137-84 kubenswrapper[2563]: W0528 15:19:04.144646    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c12c62e_cd71_47d7_9d39_d22bd3cb1407.slice/crio-7f855706c9ae3d8fec6cfbabe9a80f623da7bc21a8dee1dbd2b1b7f5c940b674 WatchSource:0}: Error finding container 7f855706c9ae3d8fec6cfbabe9a80f623da7bc21a8dee1dbd2b1b7f5c940b674: Status 404 returned error can't find the container with id 7f855706c9ae3d8fec6cfbabe9a80f623da7bc21a8dee1dbd2b1b7f5c940b674
May 28 15:19:04.146892 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:19:04.146875    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 28 15:19:04.796790 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:19:04.796743    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-ghr55" event={"ID":"1c12c62e-cd71-47d7-9d39-d22bd3cb1407","Type":"ContainerStarted","Data":"bbc5f3c152839c7035245dc234f7b64e50d55e368dc6fc26dee0beb3ff41f2e2"}
May 28 15:19:04.796790 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:19:04.796792    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-ghr55" event={"ID":"1c12c62e-cd71-47d7-9d39-d22bd3cb1407","Type":"ContainerStarted","Data":"7f855706c9ae3d8fec6cfbabe9a80f623da7bc21a8dee1dbd2b1b7f5c940b674"}
May 28 15:19:04.797316 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:19:04.796834    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-ghr55"
May 28 15:19:04.819227 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:19:04.819176    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-ghr55" podStartSLOduration=1.8191595600000001 podStartE2EDuration="1.81915956s" podCreationTimestamp="2026-05-28 15:19:03 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 15:19:04.817720596 +0000 UTC m=+1564.906937320" watchObservedRunningTime="2026-05-28 15:19:04.81915956 +0000 UTC m=+1564.908376282"
May 28 15:19:15.804415 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:19:15.804380    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-ghr55"
May 28 15:23:00.560418 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:23:00.560392    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-86zbj_8d769c1c-5bf7-49c6-bf05-531b243e935e/console-operator/2.log"
May 28 15:23:00.563536 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:23:00.563515    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ssv8l_f3df342f-512f-410a-8b64-171bc7255a0e/ovn-acl-logging/0.log"
May 28 15:23:00.565090 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:23:00.565073    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-86zbj_8d769c1c-5bf7-49c6-bf05-531b243e935e/console-operator/2.log"
May 28 15:23:00.568243 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:23:00.568227    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ssv8l_f3df342f-512f-410a-8b64-171bc7255a0e/ovn-acl-logging/0.log"
May 28 15:28:00.599578 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:28:00.599545    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-86zbj_8d769c1c-5bf7-49c6-bf05-531b243e935e/console-operator/2.log"
May 28 15:28:00.603367 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:28:00.603342    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ssv8l_f3df342f-512f-410a-8b64-171bc7255a0e/ovn-acl-logging/0.log"
May 28 15:28:00.604111 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:28:00.604090    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-86zbj_8d769c1c-5bf7-49c6-bf05-531b243e935e/console-operator/2.log"
May 28 15:28:00.607657 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:28:00.607640    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ssv8l_f3df342f-512f-410a-8b64-171bc7255a0e/ovn-acl-logging/0.log"
May 28 15:28:55.828347 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:28:55.828242    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-856948b99f-bdt6n_be160959-19f4-48e1-938d-9181823a2263/manager/0.log"
May 28 15:28:55.972970 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:28:55.972933    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-5597c655cd-xtppj_d02f025a-7767-44dc-9787-75f02e0807ef/maas-api/0.log"
May 28 15:28:56.382474 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:28:56.382440    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-858dbf95b8-kg5l7_06209136-eb4e-43c1-a481-dae591bdc5ac/manager/2.log"
May 28 15:28:56.501513 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:28:56.501484    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-b5d999694-gjn49_55bf31bf-ca89-426d-b785-77be0930103d/manager/0.log"
May 28 15:28:56.867084 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:28:56.867049    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-68c4fbbd6f-84fd8_d6a82f62-d75b-4803-b61b-864066f6d592/postgres/0.log"
May 28 15:28:57.732700 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:28:57.732646    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cd6wx_694ffbd0-047e-41db-8553-72d8dc15bc1e/util/0.log"
May 28 15:28:57.739549 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:28:57.739512    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cd6wx_694ffbd0-047e-41db-8553-72d8dc15bc1e/pull/0.log"
May 28 15:28:57.745956 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:28:57.745932    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cd6wx_694ffbd0-047e-41db-8553-72d8dc15bc1e/extract/0.log"
May 28 15:28:57.860226 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:28:57.860196    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b42xm_b64e35a1-749b-41f5-a3de-10a9207863a2/extract/0.log"
May 28 15:28:57.866476 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:28:57.866448    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b42xm_b64e35a1-749b-41f5-a3de-10a9207863a2/util/0.log"
May 28 15:28:57.873185 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:28:57.873155    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b42xm_b64e35a1-749b-41f5-a3de-10a9207863a2/pull/0.log"
May 28 15:28:58.034277 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:28:58.034247    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73g2hn6_b6793a01-9a5f-4b68-a3e6-b0595698f194/util/0.log"
May 28 15:28:58.041365 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:28:58.041336    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73g2hn6_b6793a01-9a5f-4b68-a3e6-b0595698f194/pull/0.log"
May 28 15:28:58.048230 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:28:58.048208    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73g2hn6_b6793a01-9a5f-4b68-a3e6-b0595698f194/extract/0.log"
May 28 15:28:58.167527 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:28:58.167496    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17f9nc_8b3dc7ba-da07-48ea-a8fb-cfc5c37001b9/extract/0.log"
May 28 15:28:58.174260 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:28:58.174231    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17f9nc_8b3dc7ba-da07-48ea-a8fb-cfc5c37001b9/util/0.log"
May 28 15:28:58.180547 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:28:58.180529    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17f9nc_8b3dc7ba-da07-48ea-a8fb-cfc5c37001b9/pull/0.log"
May 28 15:28:58.565523 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:28:58.565488    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-648d5c98bc-44qnt_da85fe0c-e659-4deb-b84b-c946ad346262/manager/0.log"
May 28 15:28:58.964950 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:28:58.964875    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-55c7f4c975-ghr55_1c12c62e-cd71-47d7-9d39-d22bd3cb1407/manager/0.log"
May 28 15:28:59.733030 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:28:59.732975    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-798958bb55-6l4qq_25884d71-fd2b-45a7-9018-6fda36c71e54/discovery/0.log"
May 28 15:28:59.974735 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:28:59.974700    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5fc8d7b98d-zbcf8_dedd0929-f9a8-4f36-b9b3-e33a9587f506/kube-auth-proxy/0.log"
May 28 15:29:00.247695 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:29:00.247647    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58b6c8fdc7-ll9jd_2fa8ea47-f07c-4e56-b9e0-67f7cd57e6d2/payload-processing/0.log"
May 28 15:29:00.736153 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:29:00.736068    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-7f849f6b56-2tswc_2c25326a-be79-40b3-9e32-39bcbd860302/storage-initializer/0.log"
May 28 15:29:00.743800 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:29:00.743775    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-7f849f6b56-2tswc_2c25326a-be79-40b3-9e32-39bcbd860302/main/0.log"
May 28 15:29:00.861273 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:29:00.861248    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-7bb4cdb4d7-24h2q_9c2ebfbc-7979-400e-abbc-ebccf8b91150/storage-initializer/0.log"
May 28 15:29:00.868833 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:29:00.868810    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-7bb4cdb4d7-24h2q_9c2ebfbc-7979-400e-abbc-ebccf8b91150/main/0.log"
May 28 15:29:00.992796 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:29:00.992766    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-84db68679b-6h48w_6b2dc628-ae1b-4250-b28d-fb3498bcb363/storage-initializer/0.log"
May 28 15:29:01.000160 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:29:01.000130    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-84db68679b-6h48w_6b2dc628-ae1b-4250-b28d-fb3498bcb363/main/0.log"
May 28 15:29:01.121909 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:29:01.121863    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccgzps7_cd84dad8-8374-4c00-8aa3-79828015437b/storage-initializer/0.log"
May 28 15:29:01.129845 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:29:01.129816    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccgzps7_cd84dad8-8374-4c00-8aa3-79828015437b/main/0.log"
May 28 15:29:01.250366 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:29:01.250278    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-8f8dc67b7-sdpbq_57a3807b-bf1e-4514-8684-a84a2938f6ab/storage-initializer/0.log"
May 28 15:29:01.257862 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:29:01.257838    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-8f8dc67b7-sdpbq_57a3807b-bf1e-4514-8684-a84a2938f6ab/main/0.log"
May 28 15:29:01.396540 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:29:01.396507    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-6b97b89985-8jgtx_fed8a95a-399c-42d7-8b36-f0c60ce93bfe/storage-initializer/0.log"
May 28 15:29:01.404841 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:29:01.404808    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-6b97b89985-8jgtx_fed8a95a-399c-42d7-8b36-f0c60ce93bfe/main/0.log"
May 28 15:29:08.786224 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:29:08.786164    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-5bqrk_248847de-48dc-4cb1-aa31-e48dc53e7f10/global-pull-secret-syncer/0.log"
May 28 15:29:08.926268 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:29:08.926226    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-889lh_0595a2ba-deef-42af-aef6-ad8abc4fbfba/konnectivity-agent/0.log"
May 28 15:29:09.034121 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:29:09.034073    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-137-84.ec2.internal_5826301e72f9d56159e32c558dac538c/haproxy/0.log"
May 28 15:29:12.432830 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:29:12.432797    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cd6wx_694ffbd0-047e-41db-8553-72d8dc15bc1e/extract/0.log"
May 28 15:29:12.519383 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:29:12.519349    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cd6wx_694ffbd0-047e-41db-8553-72d8dc15bc1e/util/0.log"
May 28 15:29:12.542937 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:29:12.542910    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cd6wx_694ffbd0-047e-41db-8553-72d8dc15bc1e/pull/0.log"
May 28 15:29:12.588007 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:29:12.587965    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b42xm_b64e35a1-749b-41f5-a3de-10a9207863a2/extract/0.log"
May 28 15:29:12.622572 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:29:12.622537    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b42xm_b64e35a1-749b-41f5-a3de-10a9207863a2/util/0.log"
May 28 15:29:12.663097 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:29:12.663062    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b42xm_b64e35a1-749b-41f5-a3de-10a9207863a2/pull/0.log"
May 28 15:29:12.692618 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:29:12.692538    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73g2hn6_b6793a01-9a5f-4b68-a3e6-b0595698f194/extract/0.log"
May 28 15:29:12.724151 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:29:12.724122    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73g2hn6_b6793a01-9a5f-4b68-a3e6-b0595698f194/util/0.log"
May 28 15:29:12.744645 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:29:12.744615    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73g2hn6_b6793a01-9a5f-4b68-a3e6-b0595698f194/pull/0.log"
May 28 15:29:12.769103 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:29:12.769077    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17f9nc_8b3dc7ba-da07-48ea-a8fb-cfc5c37001b9/extract/0.log"
May 28 15:29:12.787698 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:29:12.787645    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17f9nc_8b3dc7ba-da07-48ea-a8fb-cfc5c37001b9/util/0.log"
May 28 15:29:12.810113 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:29:12.810078    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17f9nc_8b3dc7ba-da07-48ea-a8fb-cfc5c37001b9/pull/0.log"
May 28 15:29:13.232073 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:29:13.232043    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-648d5c98bc-44qnt_da85fe0c-e659-4deb-b84b-c946ad346262/manager/0.log"
May 28 15:29:13.398008 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:29:13.397978    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-55c7f4c975-ghr55_1c12c62e-cd71-47d7-9d39-d22bd3cb1407/manager/0.log"
May 28 15:29:14.737228 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:29:14.737198    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_00557239-3c49-4666-9ffd-ecddc3405ac7/alertmanager/0.log"
May 28 15:29:14.758783 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:29:14.758752    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_00557239-3c49-4666-9ffd-ecddc3405ac7/config-reloader/0.log"
May 28 15:29:14.781371 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:29:14.781342    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_00557239-3c49-4666-9ffd-ecddc3405ac7/kube-rbac-proxy-web/0.log"
May 28 15:29:14.810433 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:29:14.810403    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_00557239-3c49-4666-9ffd-ecddc3405ac7/kube-rbac-proxy/0.log"
May 28 15:29:14.830264 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:29:14.830239    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_00557239-3c49-4666-9ffd-ecddc3405ac7/kube-rbac-proxy-metric/0.log"
May 28 15:29:14.854783 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:29:14.854757    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_00557239-3c49-4666-9ffd-ecddc3405ac7/prom-label-proxy/0.log"
May 28 15:29:14.878271 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:29:14.878239    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_00557239-3c49-4666-9ffd-ecddc3405ac7/init-config-reloader/0.log"
May 28 15:29:15.116238 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:29:15.116211    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-dmsps_f0d4089f-9f1b-43cb-be91-b5820f788ca4/node-exporter/0.log"
May 28 15:29:15.134444 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:29:15.134411    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-dmsps_f0d4089f-9f1b-43cb-be91-b5820f788ca4/kube-rbac-proxy/0.log"
May 28 15:29:15.156159 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:29:15.156137    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-dmsps_f0d4089f-9f1b-43cb-be91-b5820f788ca4/init-textfile/0.log"
May 28 15:29:15.577639 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:29:15.577608    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7779bbdd78-hkslr_ae3cc6d4-0748-46b7-afda-657acd5a79c6/prometheus-operator/0.log"
May 28 15:29:15.598078 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:29:15.598039    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7779bbdd78-hkslr_ae3cc6d4-0748-46b7-afda-657acd5a79c6/kube-rbac-proxy/0.log"
May 28 15:29:15.650253 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:29:15.650224    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7c76cf6fdb-stfkf_84e22d9e-8392-479a-8c67-1b02ef240f90/telemeter-client/0.log"
May 28 15:29:15.669408 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:29:15.669379    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7c76cf6fdb-stfkf_84e22d9e-8392-479a-8c67-1b02ef240f90/reload/0.log"
May 28 15:29:15.689075 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:29:15.689043    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7c76cf6fdb-stfkf_84e22d9e-8392-479a-8c67-1b02ef240f90/kube-rbac-proxy/0.log"
May 28 15:29:16.904476 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:29:16.904443    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-d4d8f94f9-tqpl4_7fa67c32-1825-4c11-ab7c-17a5d35ff70a/networking-console-plugin/0.log"
May 28 15:29:17.426000 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:29:17.425959    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-726pb/perf-node-gather-daemonset-rzg4s"]
May 28 15:29:17.429946 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:29:17.429922    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-726pb/perf-node-gather-daemonset-rzg4s"
May 28 15:29:17.432019 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:29:17.431996    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-726pb\"/\"kube-root-ca.crt\""
May 28 15:29:17.432361 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:29:17.432341    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-726pb\"/\"openshift-service-ca.crt\""
May 28 15:29:17.433114 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:29:17.433096    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-726pb\"/\"default-dockercfg-dtrql\""
May 28 15:29:17.438899 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:29:17.438876    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-726pb/perf-node-gather-daemonset-rzg4s"]
May 28 15:29:17.490711 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:29:17.490650    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-86zbj_8d769c1c-5bf7-49c6-bf05-531b243e935e/console-operator/2.log"
May 28 15:29:17.499039 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:29:17.499008    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-86zbj_8d769c1c-5bf7-49c6-bf05-531b243e935e/console-operator/3.log"
May 28 15:29:17.518834 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:29:17.518800    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ccda9a51-00b8-4477-bbf3-312709750538-proc\") pod \"perf-node-gather-daemonset-rzg4s\" (UID: \"ccda9a51-00b8-4477-bbf3-312709750538\") " pod="openshift-must-gather-726pb/perf-node-gather-daemonset-rzg4s"
May 28 15:29:17.518989 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:29:17.518843    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ccda9a51-00b8-4477-bbf3-312709750538-sys\") pod \"perf-node-gather-daemonset-rzg4s\" (UID: \"ccda9a51-00b8-4477-bbf3-312709750538\") " pod="openshift-must-gather-726pb/perf-node-gather-daemonset-rzg4s"
May 28 15:29:17.518989 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:29:17.518932    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t4j6p\" (UniqueName: \"kubernetes.io/projected/ccda9a51-00b8-4477-bbf3-312709750538-kube-api-access-t4j6p\") pod \"perf-node-gather-daemonset-rzg4s\" (UID: \"ccda9a51-00b8-4477-bbf3-312709750538\") " pod="openshift-must-gather-726pb/perf-node-gather-daemonset-rzg4s"
May 28 15:29:17.519072 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:29:17.519047    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ccda9a51-00b8-4477-bbf3-312709750538-lib-modules\") pod \"perf-node-gather-daemonset-rzg4s\" (UID: \"ccda9a51-00b8-4477-bbf3-312709750538\") " pod="openshift-must-gather-726pb/perf-node-gather-daemonset-rzg4s"
May 28 15:29:17.519124 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:29:17.519077    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ccda9a51-00b8-4477-bbf3-312709750538-podres\") pod \"perf-node-gather-daemonset-rzg4s\" (UID: \"ccda9a51-00b8-4477-bbf3-312709750538\") " pod="openshift-must-gather-726pb/perf-node-gather-daemonset-rzg4s"
May 28 15:29:17.620479 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:29:17.620446    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ccda9a51-00b8-4477-bbf3-312709750538-lib-modules\") pod \"perf-node-gather-daemonset-rzg4s\" (UID: \"ccda9a51-00b8-4477-bbf3-312709750538\") " pod="openshift-must-gather-726pb/perf-node-gather-daemonset-rzg4s"
May 28 15:29:17.620479 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:29:17.620483    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ccda9a51-00b8-4477-bbf3-312709750538-podres\") pod \"perf-node-gather-daemonset-rzg4s\" (UID: \"ccda9a51-00b8-4477-bbf3-312709750538\") " pod="openshift-must-gather-726pb/perf-node-gather-daemonset-rzg4s"
May 28 15:29:17.620762 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:29:17.620512    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ccda9a51-00b8-4477-bbf3-312709750538-proc\") pod \"perf-node-gather-daemonset-rzg4s\" (UID: \"ccda9a51-00b8-4477-bbf3-312709750538\") " pod="openshift-must-gather-726pb/perf-node-gather-daemonset-rzg4s"
May 28 15:29:17.620762 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:29:17.620577    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ccda9a51-00b8-4477-bbf3-312709750538-proc\") pod \"perf-node-gather-daemonset-rzg4s\" (UID: \"ccda9a51-00b8-4477-bbf3-312709750538\") " pod="openshift-must-gather-726pb/perf-node-gather-daemonset-rzg4s"
May 28 15:29:17.620762 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:29:17.620615    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ccda9a51-00b8-4477-bbf3-312709750538-podres\") pod \"perf-node-gather-daemonset-rzg4s\" (UID: \"ccda9a51-00b8-4477-bbf3-312709750538\") " pod="openshift-must-gather-726pb/perf-node-gather-daemonset-rzg4s"
May 28 15:29:17.620762 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:29:17.620625    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ccda9a51-00b8-4477-bbf3-312709750538-lib-modules\") pod \"perf-node-gather-daemonset-rzg4s\" (UID: \"ccda9a51-00b8-4477-bbf3-312709750538\") " pod="openshift-must-gather-726pb/perf-node-gather-daemonset-rzg4s"
May 28 15:29:17.620762 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:29:17.620640    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ccda9a51-00b8-4477-bbf3-312709750538-sys\") pod \"perf-node-gather-daemonset-rzg4s\" (UID: \"ccda9a51-00b8-4477-bbf3-312709750538\") " pod="openshift-must-gather-726pb/perf-node-gather-daemonset-rzg4s"
May 28 15:29:17.620762 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:29:17.620701    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ccda9a51-00b8-4477-bbf3-312709750538-sys\") pod \"perf-node-gather-daemonset-rzg4s\" (UID: \"ccda9a51-00b8-4477-bbf3-312709750538\") " pod="openshift-must-gather-726pb/perf-node-gather-daemonset-rzg4s"
May 28 15:29:17.621084 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:29:17.620763    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t4j6p\" (UniqueName: \"kubernetes.io/projected/ccda9a51-00b8-4477-bbf3-312709750538-kube-api-access-t4j6p\") pod \"perf-node-gather-daemonset-rzg4s\" (UID: \"ccda9a51-00b8-4477-bbf3-312709750538\") " pod="openshift-must-gather-726pb/perf-node-gather-daemonset-rzg4s"
May 28 15:29:17.629567 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:29:17.629548    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t4j6p\" (UniqueName: \"kubernetes.io/projected/ccda9a51-00b8-4477-bbf3-312709750538-kube-api-access-t4j6p\") pod \"perf-node-gather-daemonset-rzg4s\" (UID: \"ccda9a51-00b8-4477-bbf3-312709750538\") " pod="openshift-must-gather-726pb/perf-node-gather-daemonset-rzg4s"
May 28 15:29:17.740788 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:29:17.740700    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-726pb/perf-node-gather-daemonset-rzg4s"
May 28 15:29:17.876277 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:29:17.876247    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-726pb/perf-node-gather-daemonset-rzg4s"]
May 28 15:29:17.877548 ip-10-0-137-84 kubenswrapper[2563]: W0528 15:29:17.877516    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podccda9a51_00b8_4477_bbf3_312709750538.slice/crio-a132bc747f7a3a84ebb2b95637c43500a3ed3a615634894096a0fe6d777efdd6 WatchSource:0}: Error finding container a132bc747f7a3a84ebb2b95637c43500a3ed3a615634894096a0fe6d777efdd6: Status 404 returned error can't find the container with id a132bc747f7a3a84ebb2b95637c43500a3ed3a615634894096a0fe6d777efdd6
May 28 15:29:17.879233 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:29:17.879214    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 28 15:29:18.032988 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:29:18.032953    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6b6f566684-qm8sl_89d79ffb-d7c0-467d-b624-e329e9486b09/console/0.log"
May 28 15:29:18.071240 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:29:18.071207    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-57bd96b888-6pnmc_9cb12218-75dd-4501-af0c-45a08fe2d93f/download-server/0.log"
May 28 15:29:18.415933 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:29:18.415837    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-726pb/perf-node-gather-daemonset-rzg4s" event={"ID":"ccda9a51-00b8-4477-bbf3-312709750538","Type":"ContainerStarted","Data":"7ff917f56e2bbc4676eca79fe68bc29de3e3c074a3f8a9e500b26540d738806b"}
May 28 15:29:18.415933 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:29:18.415896    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-726pb/perf-node-gather-daemonset-rzg4s" event={"ID":"ccda9a51-00b8-4477-bbf3-312709750538","Type":"ContainerStarted","Data":"a132bc747f7a3a84ebb2b95637c43500a3ed3a615634894096a0fe6d777efdd6"}
May 28 15:29:18.416144 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:29:18.415986    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-726pb/perf-node-gather-daemonset-rzg4s"
May 28 15:29:18.435628 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:29:18.435573    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-726pb/perf-node-gather-daemonset-rzg4s" podStartSLOduration=1.435559979 podStartE2EDuration="1.435559979s" podCreationTimestamp="2026-05-28 15:29:17 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 15:29:18.433381269 +0000 UTC m=+2178.522597992" watchObservedRunningTime="2026-05-28 15:29:18.435559979 +0000 UTC m=+2178.524776744"
May 28 15:29:19.687377 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:29:19.687343    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-zctlp_bdc2b7e1-35af-42c7-8ec3-742be0e080fa/dns/0.log"
May 28 15:29:19.712993 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:29:19.712958    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-zctlp_bdc2b7e1-35af-42c7-8ec3-742be0e080fa/kube-rbac-proxy/0.log"
May 28 15:29:19.808276 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:29:19.808242    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-r8s4x_5e470d5c-c76c-452d-8add-a20856bab41f/dns-node-resolver/0.log"
May 28 15:29:20.318622 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:29:20.318593    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-55b856b77f-lrgn5_3817f2d6-18e4-4c46-81d5-e610b568bcf1/registry/0.log"
May 28 15:29:20.402373 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:29:20.402345    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-mh529_18e17dc3-da42-4b11-8f21-5eb66227c6f7/node-ca/0.log"
May 28 15:29:21.477618 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:29:21.477582    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-798958bb55-6l4qq_25884d71-fd2b-45a7-9018-6fda36c71e54/discovery/0.log"
May 28 15:29:21.529307 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:29:21.529265    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5fc8d7b98d-zbcf8_dedd0929-f9a8-4f36-b9b3-e33a9587f506/kube-auth-proxy/0.log"
May 28 15:29:21.688265 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:29:21.688231    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58b6c8fdc7-ll9jd_2fa8ea47-f07c-4e56-b9e0-67f7cd57e6d2/payload-processing/0.log"
May 28 15:29:22.248356 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:29:22.248293    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-jwwzh_2879a5eb-fff7-4733-b061-ce7d4f8016e7/serve-healthcheck-canary/0.log"
May 28 15:29:22.805619 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:29:22.805583    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hrhzw_2b173979-adf9-4e10-a9f2-58ba12012b73/kube-rbac-proxy/0.log"
May 28 15:29:22.827714 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:29:22.827666    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hrhzw_2b173979-adf9-4e10-a9f2-58ba12012b73/exporter/0.log"
May 28 15:29:22.850197 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:29:22.850175    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hrhzw_2b173979-adf9-4e10-a9f2-58ba12012b73/extractor/0.log"
May 28 15:29:24.430991 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:29:24.430951    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-726pb/perf-node-gather-daemonset-rzg4s"
May 28 15:29:24.802527 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:29:24.802493    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-856948b99f-bdt6n_be160959-19f4-48e1-938d-9181823a2263/manager/0.log"
May 28 15:29:24.845161 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:29:24.845132    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-5597c655cd-xtppj_d02f025a-7767-44dc-9787-75f02e0807ef/maas-api/0.log"
May 28 15:29:24.959931 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:29:24.959892    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-858dbf95b8-kg5l7_06209136-eb4e-43c1-a481-dae591bdc5ac/manager/1.log"
May 28 15:29:24.982648 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:29:24.982617    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-858dbf95b8-kg5l7_06209136-eb4e-43c1-a481-dae591bdc5ac/manager/2.log"
May 28 15:29:25.006154 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:29:25.006125    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-b5d999694-gjn49_55bf31bf-ca89-426d-b785-77be0930103d/manager/0.log"
May 28 15:29:25.100623 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:29:25.100533    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-68c4fbbd6f-84fd8_d6a82f62-d75b-4803-b61b-864066f6d592/postgres/0.log"
May 28 15:29:26.401240 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:29:26.401134    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-bfc7f696d-v8xrw_faafd460-717b-4391-9b11-c5d2f05ce26b/openshift-lws-operator/0.log"
May 28 15:29:32.207421 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:29:32.207394    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-l8h9g_9be2177d-67fc-4eec-aa1a-bbe5602495d5/kube-multus-additional-cni-plugins/0.log"
May 28 15:29:32.227077 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:29:32.227044    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-l8h9g_9be2177d-67fc-4eec-aa1a-bbe5602495d5/egress-router-binary-copy/0.log"
May 28 15:29:32.245894 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:29:32.245865    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-l8h9g_9be2177d-67fc-4eec-aa1a-bbe5602495d5/cni-plugins/0.log"
May 28 15:29:32.265368 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:29:32.265340    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-l8h9g_9be2177d-67fc-4eec-aa1a-bbe5602495d5/bond-cni-plugin/0.log"
May 28 15:29:32.285753 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:29:32.285722    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-l8h9g_9be2177d-67fc-4eec-aa1a-bbe5602495d5/routeoverride-cni/0.log"
May 28 15:29:32.305387 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:29:32.305361    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-l8h9g_9be2177d-67fc-4eec-aa1a-bbe5602495d5/whereabouts-cni-bincopy/0.log"
May 28 15:29:32.327365 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:29:32.327341    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-l8h9g_9be2177d-67fc-4eec-aa1a-bbe5602495d5/whereabouts-cni/0.log"
May 28 15:29:32.541166 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:29:32.541138    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-nldsr_163ec1a8-e490-49fe-91c4-5536fe100364/kube-multus/0.log"
May 28 15:29:32.685745 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:29:32.685715    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-v4dpk_b51f6e42-ac3f-47b9-8962-ec51c836ad35/network-metrics-daemon/0.log"
May 28 15:29:32.701975 ip-10-0-137-84 kubenswrapper[2563]: I0528 15:29:32.701939    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-v4dpk_b51f6e42-ac3f-47b9-8962-ec51c836ad35/kube-rbac-proxy/0.log"