Aug 04 22:20:51.797059 ip-10-0-137-117 systemd[1]: Starting Kubernetes Kubelet...
Aug 04 22:20:52.173940 ip-10-0-137-117 kubenswrapper[2580]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Aug 04 22:20:52.173940 ip-10-0-137-117 kubenswrapper[2580]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Aug 04 22:20:52.173940 ip-10-0-137-117 kubenswrapper[2580]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Aug 04 22:20:52.173940 ip-10-0-137-117 kubenswrapper[2580]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Aug 04 22:20:52.173940 ip-10-0-137-117 kubenswrapper[2580]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Aug 04 22:20:52.176501 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.176341    2580 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Aug 04 22:20:52.181864 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.181848    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 04 22:20:52.181864 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.181863    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 04 22:20:52.181931 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.181867    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 04 22:20:52.181931 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.181870    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 04 22:20:52.181931 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.181873    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 04 22:20:52.181931 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.181876    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 04 22:20:52.181931 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.181879    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 04 22:20:52.181931 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.181881    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 04 22:20:52.181931 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.181884    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 04 22:20:52.181931 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.181886    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 04 22:20:52.181931 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.181890    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 04 22:20:52.181931 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.181893    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 04 22:20:52.181931 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.181896    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 04 22:20:52.181931 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.181899    2580 feature_gate.go:328] unrecognized feature gate: Example
Aug 04 22:20:52.181931 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.181903    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 04 22:20:52.181931 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.181906    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 04 22:20:52.181931 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.181909    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 04 22:20:52.181931 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.181912    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 04 22:20:52.181931 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.181915    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 04 22:20:52.181931 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.181918    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 04 22:20:52.181931 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.181920    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 04 22:20:52.181931 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.181923    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 04 22:20:52.182400 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.181926    2580 feature_gate.go:328] unrecognized feature gate: Example2
Aug 04 22:20:52.182400 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.181928    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 04 22:20:52.182400 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.181931    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 04 22:20:52.182400 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.181934    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 04 22:20:52.182400 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.181937    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 04 22:20:52.182400 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.181941    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 04 22:20:52.182400 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.181945    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 04 22:20:52.182400 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.181948    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 04 22:20:52.182400 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.181951    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 04 22:20:52.182400 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.181955    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 04 22:20:52.182400 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.181958    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 04 22:20:52.182400 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.181960    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 04 22:20:52.182400 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.181963    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 04 22:20:52.182400 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.181965    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 04 22:20:52.182400 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.181968    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 04 22:20:52.182400 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.181970    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 04 22:20:52.182400 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.181973    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 04 22:20:52.182400 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.181976    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 04 22:20:52.182400 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.181979    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 04 22:20:52.182400 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.181981    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 04 22:20:52.182902 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.181984    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 04 22:20:52.182902 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.181987    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 04 22:20:52.182902 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.181989    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 04 22:20:52.182902 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.181992    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 04 22:20:52.182902 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.181994    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 04 22:20:52.182902 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.181997    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 04 22:20:52.182902 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.181999    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 04 22:20:52.182902 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.182002    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 04 22:20:52.182902 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.182004    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 04 22:20:52.182902 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.182007    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 04 22:20:52.182902 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.182009    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 04 22:20:52.182902 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.182012    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 04 22:20:52.182902 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.182014    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 04 22:20:52.182902 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.182018    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 04 22:20:52.182902 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.182021    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 04 22:20:52.182902 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.182024    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 04 22:20:52.182902 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.182026    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 04 22:20:52.182902 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.182029    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 04 22:20:52.182902 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.182032    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 04 22:20:52.182902 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.182034    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 04 22:20:52.182902 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.182037    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 04 22:20:52.183561 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.182040    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 04 22:20:52.183561 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.182042    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 04 22:20:52.183561 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.182045    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 04 22:20:52.183561 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.182048    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 04 22:20:52.183561 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.182050    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 04 22:20:52.183561 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.182053    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 04 22:20:52.183561 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.182055    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 04 22:20:52.183561 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.182058    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 04 22:20:52.183561 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.182061    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 04 22:20:52.183561 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.182063    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 04 22:20:52.183561 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.182066    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 04 22:20:52.183561 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.182068    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 04 22:20:52.183561 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.182071    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 04 22:20:52.183561 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.182073    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 04 22:20:52.183561 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.182077    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 04 22:20:52.183561 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.182081    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 04 22:20:52.183561 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.182085    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 04 22:20:52.183561 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.182088    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 04 22:20:52.183561 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.182090    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 04 22:20:52.184075 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.182093    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 04 22:20:52.184075 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.182095    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 04 22:20:52.184075 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.182098    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 04 22:20:52.184075 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.182101    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 04 22:20:52.184075 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.182103    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 04 22:20:52.184075 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.182106    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 04 22:20:52.184075 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.182109    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 04 22:20:52.184075 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.182112    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 04 22:20:52.184075 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.182115    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 04 22:20:52.184075 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.182117    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 04 22:20:52.184075 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.182120    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 04 22:20:52.184075 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.182122    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 04 22:20:52.184075 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.182125    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 04 22:20:52.184075 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.182127    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 04 22:20:52.184075 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.182130    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 04 22:20:52.184075 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.182132    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 04 22:20:52.184075 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.182136    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 04 22:20:52.184075 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.182854    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 04 22:20:52.184075 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.182861    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 04 22:20:52.184550 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.182865    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 04 22:20:52.184550 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.182868    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 04 22:20:52.184550 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.182871    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 04 22:20:52.184550 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.182874    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 04 22:20:52.184550 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.182877    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 04 22:20:52.184550 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.182879    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 04 22:20:52.184550 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.182882    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 04 22:20:52.184550 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.182885    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 04 22:20:52.184550 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.182888    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 04 22:20:52.184550 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.182892    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 04 22:20:52.184550 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.182895    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 04 22:20:52.184550 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.182898    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 04 22:20:52.184550 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.182901    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 04 22:20:52.184550 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.182903    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 04 22:20:52.184550 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.182906    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 04 22:20:52.184550 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.182909    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 04 22:20:52.184550 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.182912    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 04 22:20:52.184550 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.182915    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 04 22:20:52.184550 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.182918    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 04 22:20:52.184550 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.182928    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 04 22:20:52.185070 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.182933    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 04 22:20:52.185070 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.182936    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 04 22:20:52.185070 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.182939    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 04 22:20:52.185070 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.182942    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 04 22:20:52.185070 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.182944    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 04 22:20:52.185070 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.182947    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 04 22:20:52.185070 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.182950    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 04 22:20:52.185070 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.182952    2580 feature_gate.go:328] unrecognized feature gate: Example
Aug 04 22:20:52.185070 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.182955    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 04 22:20:52.185070 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.182957    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 04 22:20:52.185070 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.182960    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 04 22:20:52.185070 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.182963    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 04 22:20:52.185070 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.182965    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 04 22:20:52.185070 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.182968    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 04 22:20:52.185070 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.182971    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 04 22:20:52.185070 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.182973    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 04 22:20:52.185070 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.182978    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 04 22:20:52.185070 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.182982    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 04 22:20:52.185070 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.182985    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 04 22:20:52.185540 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.182988    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 04 22:20:52.185540 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.182991    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 04 22:20:52.185540 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.182994    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 04 22:20:52.185540 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.182998    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 04 22:20:52.185540 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.183001    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 04 22:20:52.185540 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.183004    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 04 22:20:52.185540 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.183006    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 04 22:20:52.185540 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.183009    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 04 22:20:52.185540 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.183012    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 04 22:20:52.185540 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.183015    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 04 22:20:52.185540 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.183018    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 04 22:20:52.185540 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.183022    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 04 22:20:52.185540 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.183025    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 04 22:20:52.185540 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.183028    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 04 22:20:52.185540 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.183030    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 04 22:20:52.185540 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.183033    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 04 22:20:52.185540 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.183036    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 04 22:20:52.185540 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.183039    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 04 22:20:52.185540 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.183042    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 04 22:20:52.185540 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.183044    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 04 22:20:52.186051 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.183047    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 04 22:20:52.186051 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.183049    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 04 22:20:52.186051 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.183052    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 04 22:20:52.186051 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.183054    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 04 22:20:52.186051 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.183057    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 04 22:20:52.186051 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.183060    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 04 22:20:52.186051 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.183063    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 04 22:20:52.186051 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.183065    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 04 22:20:52.186051 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.183068    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 04 22:20:52.186051 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.183070    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 04 22:20:52.186051 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.183073    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 04 22:20:52.186051 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.183076    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 04 22:20:52.186051 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.183078    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 04 22:20:52.186051 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.183081    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 04 22:20:52.186051 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.183083    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 04 22:20:52.186051 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.183086    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 04 22:20:52.186051 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.183089    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 04 22:20:52.186051 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.183092    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 04 22:20:52.186051 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.183094    2580 feature_gate.go:328] unrecognized feature gate: Example2
Aug 04 22:20:52.186051 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.183097    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 04 22:20:52.186051 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.183099    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 04 22:20:52.186564 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.183102    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 04 22:20:52.186564 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.183104    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 04 22:20:52.186564 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.183107    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 04 22:20:52.186564 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.183109    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 04 22:20:52.186564 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.183112    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 04 22:20:52.186564 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.183115    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 04 22:20:52.186564 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.183117    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 04 22:20:52.186564 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.183120    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 04 22:20:52.186564 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.183122    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 04 22:20:52.186564 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.183125    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 04 22:20:52.186564 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.183127    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 04 22:20:52.186564 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.183130    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 04 22:20:52.186564 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.183132    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 04 22:20:52.186564 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.183135    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 04 22:20:52.186564 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.183138    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 04 22:20:52.186564 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.183141    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 04 22:20:52.186564 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.183145    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 04 22:20:52.186564 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.183534    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 04 22:20:52.187027 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.183539    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 04 22:20:52.187027 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.183542    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 04 22:20:52.187027 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.183546    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 04 22:20:52.187027 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.183549    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 04 22:20:52.187027 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.183552    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 04 22:20:52.187027 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.183554    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 04 22:20:52.187027 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.183557    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 04 22:20:52.187027 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.183559    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 04 22:20:52.187027 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.183562    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 04 22:20:52.187027 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.183564    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 04 22:20:52.187027 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.183568    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 04 22:20:52.187027 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.183570    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 04 22:20:52.187027 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.183573    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 04 22:20:52.187027 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.183575    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 04 22:20:52.187027 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.183578    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 04 22:20:52.187027 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.183581    2580 feature_gate.go:328] unrecognized feature gate: Example
Aug 04 22:20:52.187027 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.183584    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 04 22:20:52.187027 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.183586    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 04 22:20:52.187027 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.183589    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 04 22:20:52.187027 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.183591    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 04 22:20:52.187522 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.183594    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 04 22:20:52.187522 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.183597    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 04 22:20:52.187522 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.183599    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 04 22:20:52.187522 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.183602    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 04 22:20:52.187522 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.183604    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 04 22:20:52.187522 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.183607    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 04 22:20:52.187522 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.183609    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 04 22:20:52.187522 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.183613    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 04 22:20:52.187522 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.183617    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 04 22:20:52.187522 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.183620    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 04 22:20:52.187522 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.183623    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 04 22:20:52.187522 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.183626    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 04 22:20:52.187522 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.183628    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 04 22:20:52.187522 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.183631    2580 feature_gate.go:328] unrecognized feature gate: Example2
Aug 04 22:20:52.187522 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.183633    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 04 22:20:52.187522 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.183636    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 04 22:20:52.187522 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.183639    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 04 22:20:52.187522 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.183641    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 04 22:20:52.187522 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.183644    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 04 22:20:52.188009 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.183646    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 04 22:20:52.188009 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.183649    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 04 22:20:52.188009 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.183652    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 04 22:20:52.188009 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.183654    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 04 22:20:52.188009 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.183657    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 04 22:20:52.188009 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.183660    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 04 22:20:52.188009 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.183662    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 04 22:20:52.188009 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.183665    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 04 22:20:52.188009 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.183668    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 04 22:20:52.188009 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.183671    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 04 22:20:52.188009 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.183673    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 04 22:20:52.188009 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.183676    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 04 22:20:52.188009 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.183678    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 04 22:20:52.188009 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.183681    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 04 22:20:52.188009 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.183684    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 04 22:20:52.188009 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.183686    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 04 22:20:52.188009 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.183689    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 04 22:20:52.188009 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.183691    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 04 22:20:52.188009 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.183695    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 04 22:20:52.188505 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.183697    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 04 22:20:52.188505 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.183700    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 04 22:20:52.188505 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.183702    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 04 22:20:52.188505 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.183705    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 04 22:20:52.188505 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.183707    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 04 22:20:52.188505 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.183710    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 04 22:20:52.188505 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.183713    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 04 22:20:52.188505 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.183715    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 04 22:20:52.188505 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.183718    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 04 22:20:52.188505 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.183721    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 04 22:20:52.188505 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.183724    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 04 22:20:52.188505 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.183727    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 04 22:20:52.188505 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.183729    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 04 22:20:52.188505 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.183732    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 04 22:20:52.188505 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.183735    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 04 22:20:52.188505 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.183737    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 04 22:20:52.188505 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.183740    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 04 22:20:52.188505 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.183742    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 04 22:20:52.188505 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.183745    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 04 22:20:52.188505 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.183747    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 04 22:20:52.189010 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.183750    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 04 22:20:52.189010 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.183755    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 04 22:20:52.189010 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.183758    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 04 22:20:52.189010 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.183761    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 04 22:20:52.189010 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.183763    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 04 22:20:52.189010 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.183766    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 04 22:20:52.189010 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.183768    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 04 22:20:52.189010 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.183784    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 04 22:20:52.189010 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.183787    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 04 22:20:52.189010 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.183789    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 04 22:20:52.189010 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.183792    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 04 22:20:52.189010 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.183795    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 04 22:20:52.189010 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.183797    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 04 22:20:52.189010 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.183800    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 04 22:20:52.189010 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.183802    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 04 22:20:52.189010 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.183805    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 04 22:20:52.189010 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.183807    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 04 22:20:52.189010 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.183810    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 04 22:20:52.189010 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.183812    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 04 22:20:52.189010 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.183815    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 04 22:20:52.189500 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.183891    2580 flags.go:64] FLAG: --address="0.0.0.0"
Aug 04 22:20:52.189500 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.183899    2580 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Aug 04 22:20:52.189500 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.183905    2580 flags.go:64] FLAG: --anonymous-auth="true"
Aug 04 22:20:52.189500 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.183910    2580 flags.go:64] FLAG: --application-metrics-count-limit="100"
Aug 04 22:20:52.189500 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.183915    2580 flags.go:64] FLAG: --authentication-token-webhook="false"
Aug 04 22:20:52.189500 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.183919    2580 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Aug 04 22:20:52.189500 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.183923    2580 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Aug 04 22:20:52.189500 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.183927    2580 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Aug 04 22:20:52.189500 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.183930    2580 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Aug 04 22:20:52.189500 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.183933    2580 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Aug 04 22:20:52.189500 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.183937    2580 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Aug 04 22:20:52.189500 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.183940    2580 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Aug 04 22:20:52.189500 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.183944    2580 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Aug 04 22:20:52.189500 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.183948    2580 flags.go:64] FLAG: --cgroup-root=""
Aug 04 22:20:52.189500 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.183951    2580 flags.go:64] FLAG: --cgroups-per-qos="true"
Aug 04 22:20:52.189500 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.183954    2580 flags.go:64] FLAG: --client-ca-file=""
Aug 04 22:20:52.189500 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.183957    2580 flags.go:64] FLAG: --cloud-provider="external"
Aug 04 22:20:52.189500 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.183961    2580 flags.go:64] FLAG: --cluster-dns="[]"
Aug 04 22:20:52.189500 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.183965    2580 flags.go:64] FLAG: --cluster-domain=""
Aug 04 22:20:52.189500 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.183968    2580 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Aug 04 22:20:52.189500 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.183971    2580 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Aug 04 22:20:52.189500 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.183974    2580 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Aug 04 22:20:52.189500 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.183977    2580 flags.go:64] FLAG: --container-log-max-files="5"
Aug 04 22:20:52.189500 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.183981    2580 flags.go:64] FLAG: --container-log-max-size="10Mi"
Aug 04 22:20:52.190091 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.183984    2580 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Aug 04 22:20:52.190091 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.183987    2580 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Aug 04 22:20:52.190091 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.183990    2580 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Aug 04 22:20:52.190091 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.183993    2580 flags.go:64] FLAG: --contention-profiling="false"
Aug 04 22:20:52.190091 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.183996    2580 flags.go:64] FLAG: --cpu-cfs-quota="true"
Aug 04 22:20:52.190091 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.183999    2580 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Aug 04 22:20:52.190091 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.184002    2580 flags.go:64] FLAG: --cpu-manager-policy="none"
Aug 04 22:20:52.190091 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.184005    2580 flags.go:64] FLAG: --cpu-manager-policy-options=""
Aug 04 22:20:52.190091 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.184009    2580 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Aug 04 22:20:52.190091 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.184012    2580 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Aug 04 22:20:52.190091 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.184015    2580 flags.go:64] FLAG: --enable-debugging-handlers="true"
Aug 04 22:20:52.190091 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.184018    2580 flags.go:64] FLAG: --enable-load-reader="false"
Aug 04 22:20:52.190091 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.184021    2580 flags.go:64] FLAG: --enable-server="true"
Aug 04 22:20:52.190091 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.184025    2580 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Aug 04 22:20:52.190091 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.184030    2580 flags.go:64] FLAG: --event-burst="100"
Aug 04 22:20:52.190091 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.184033    2580 flags.go:64] FLAG: --event-qps="50"
Aug 04 22:20:52.190091 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.184036    2580 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Aug 04 22:20:52.190091 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.184039    2580 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Aug 04 22:20:52.190091 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.184043    2580 flags.go:64] FLAG: --eviction-hard=""
Aug 04 22:20:52.190091 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.184046    2580 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Aug 04 22:20:52.190091 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.184049    2580 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Aug 04 22:20:52.190091 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.184054    2580 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Aug 04 22:20:52.190091 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.184057    2580 flags.go:64] FLAG: --eviction-soft=""
Aug 04 22:20:52.190091 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.184060    2580 flags.go:64] FLAG: --eviction-soft-grace-period=""
Aug 04 22:20:52.190091 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.184063    2580 flags.go:64] FLAG: --exit-on-lock-contention="false"
Aug 04 22:20:52.190745 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.184066    2580 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Aug 04 22:20:52.190745 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.184069    2580 flags.go:64] FLAG: --experimental-mounter-path=""
Aug 04 22:20:52.190745 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.184072    2580 flags.go:64] FLAG: --fail-cgroupv1="false"
Aug 04 22:20:52.190745 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.184074    2580 flags.go:64] FLAG: --fail-swap-on="true"
Aug 04 22:20:52.190745 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.184078    2580 flags.go:64] FLAG: --feature-gates=""
Aug 04 22:20:52.190745 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.184081    2580 flags.go:64] FLAG: --file-check-frequency="20s"
Aug 04 22:20:52.190745 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.184085    2580 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Aug 04 22:20:52.190745 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.184088    2580 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Aug 04 22:20:52.190745 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.184091    2580 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Aug 04 22:20:52.190745 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.184094    2580 flags.go:64] FLAG: --healthz-port="10248"
Aug 04 22:20:52.190745 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.184099    2580 flags.go:64] FLAG: --help="false"
Aug 04 22:20:52.190745 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.184102    2580 flags.go:64] FLAG: --hostname-override="ip-10-0-137-117.ec2.internal"
Aug 04 22:20:52.190745 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.184105    2580 flags.go:64] FLAG: --housekeeping-interval="10s"
Aug 04 22:20:52.190745 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.184108    2580 flags.go:64] FLAG: --http-check-frequency="20s"
Aug 04 22:20:52.190745 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.184111    2580 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Aug 04 22:20:52.190745 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.184115    2580 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Aug 04 22:20:52.190745 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.184118    2580 flags.go:64] FLAG: --image-gc-high-threshold="85"
Aug 04 22:20:52.190745 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.184121    2580 flags.go:64] FLAG: --image-gc-low-threshold="80"
Aug 04 22:20:52.190745 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.184124    2580 flags.go:64] FLAG: --image-service-endpoint=""
Aug 04 22:20:52.190745 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.184126    2580 flags.go:64] FLAG: --kernel-memcg-notification="false"
Aug 04 22:20:52.190745 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.184129    2580 flags.go:64] FLAG: --kube-api-burst="100"
Aug 04 22:20:52.190745 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.184133    2580 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Aug 04 22:20:52.190745 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.184136    2580 flags.go:64] FLAG: --kube-api-qps="50"
Aug 04 22:20:52.190745 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.184139    2580 flags.go:64] FLAG: --kube-reserved=""
Aug 04 22:20:52.191351 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.184142    2580 flags.go:64] FLAG: --kube-reserved-cgroup=""
Aug 04 22:20:52.191351 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.184145    2580 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Aug 04 22:20:52.191351 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.184148    2580 flags.go:64] FLAG: --kubelet-cgroups=""
Aug 04 22:20:52.191351 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.184151    2580 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Aug 04 22:20:52.191351 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.184154    2580 flags.go:64] FLAG: --lock-file=""
Aug 04 22:20:52.191351 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.184157    2580 flags.go:64] FLAG: --log-cadvisor-usage="false"
Aug 04 22:20:52.191351 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.184160    2580 flags.go:64] FLAG: --log-flush-frequency="5s"
Aug 04 22:20:52.191351 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.184163    2580 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Aug 04 22:20:52.191351 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.184168    2580 flags.go:64] FLAG: --log-json-split-stream="false"
Aug 04 22:20:52.191351 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.184171    2580 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Aug 04 22:20:52.191351 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.184174    2580 flags.go:64] FLAG: --log-text-split-stream="false"
Aug 04 22:20:52.191351 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.184176    2580 flags.go:64] FLAG: --logging-format="text"
Aug 04 22:20:52.191351 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.184179    2580 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Aug 04 22:20:52.191351 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.184182    2580 flags.go:64] FLAG: --make-iptables-util-chains="true"
Aug 04 22:20:52.191351 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.184185    2580 flags.go:64] FLAG: --manifest-url=""
Aug 04 22:20:52.191351 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.184188    2580 flags.go:64] FLAG: --manifest-url-header=""
Aug 04 22:20:52.191351 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.184192    2580 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Aug 04 22:20:52.191351 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.184195    2580 flags.go:64] FLAG: --max-open-files="1000000"
Aug 04 22:20:52.191351 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.184200    2580 flags.go:64] FLAG: --max-pods="110"
Aug 04 22:20:52.191351 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.184203    2580 flags.go:64] FLAG: --maximum-dead-containers="-1"
Aug 04 22:20:52.191351 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.184206    2580 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Aug 04 22:20:52.191351 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.184208    2580 flags.go:64] FLAG: --memory-manager-policy="None"
Aug 04 22:20:52.191351 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.184211    2580 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Aug 04 22:20:52.191351 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.184214    2580 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Aug 04 22:20:52.191351 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.184217    2580 flags.go:64] FLAG: --node-ip="0.0.0.0"
Aug 04 22:20:52.192010 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.184220    2580 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Aug 04 22:20:52.192010 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.184227    2580 flags.go:64] FLAG: --node-status-max-images="50"
Aug 04 22:20:52.192010 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.184230    2580 flags.go:64] FLAG: --node-status-update-frequency="10s"
Aug 04 22:20:52.192010 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.184233    2580 flags.go:64] FLAG: --oom-score-adj="-999"
Aug 04 22:20:52.192010 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.184236    2580 flags.go:64] FLAG: --pod-cidr=""
Aug 04 22:20:52.192010 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.184239    2580 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:267c8c33005f5dc3d4121af550b1c396e30e2928a13624d7362adfbfb7f440f8"
Aug 04 22:20:52.192010 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.184246    2580 flags.go:64] FLAG: --pod-manifest-path=""
Aug 04 22:20:52.192010 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.184249    2580 flags.go:64] FLAG: --pod-max-pids="-1"
Aug 04 22:20:52.192010 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.184252    2580 flags.go:64] FLAG: --pods-per-core="0"
Aug 04 22:20:52.192010 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.184255    2580 flags.go:64] FLAG: --port="10250"
Aug 04 22:20:52.192010 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.184257    2580 flags.go:64] FLAG: --protect-kernel-defaults="false"
Aug 04 22:20:52.192010 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.184260    2580 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-033b34e34b47853fd"
Aug 04 22:20:52.192010 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.184264    2580 flags.go:64] FLAG: --qos-reserved=""
Aug 04 22:20:52.192010 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.184267    2580 flags.go:64] FLAG: --read-only-port="10255"
Aug 04 22:20:52.192010 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.184270    2580 flags.go:64] FLAG: --register-node="true"
Aug 04 22:20:52.192010 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.184273    2580 flags.go:64] FLAG: --register-with-taints=""
Aug 04 22:20:52.192010 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.184276    2580 flags.go:64] FLAG: --registry-burst="10"
Aug 04 22:20:52.192010 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.184279    2580 flags.go:64] FLAG: --registry-qps="5"
Aug 04 22:20:52.192010 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.184282    2580 flags.go:64] FLAG: --reserved-cpus=""
Aug 04 22:20:52.192010 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.184285    2580 flags.go:64] FLAG: --reserved-memory=""
Aug 04 22:20:52.192010 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.184289    2580 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Aug 04 22:20:52.192010 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.184291    2580 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Aug 04 22:20:52.192010 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.184294    2580 flags.go:64] FLAG: --rotate-certificates="false"
Aug 04 22:20:52.192010 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.184297    2580 flags.go:64] FLAG: --rotate-server-certificates="false"
Aug 04 22:20:52.192010 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.184300    2580 flags.go:64] FLAG: --runonce="false"
Aug 04 22:20:52.192626 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.184304    2580 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Aug 04 22:20:52.192626 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.184307    2580 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Aug 04 22:20:52.192626 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.184311    2580 flags.go:64] FLAG: --seccomp-default="false"
Aug 04 22:20:52.192626 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.184313    2580 flags.go:64] FLAG: --serialize-image-pulls="true"
Aug 04 22:20:52.192626 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.184316    2580 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Aug 04 22:20:52.192626 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.184319    2580 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Aug 04 22:20:52.192626 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.184322    2580 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Aug 04 22:20:52.192626 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.184325    2580 flags.go:64] FLAG: --storage-driver-password="root"
Aug 04 22:20:52.192626 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.184328    2580 flags.go:64] FLAG: --storage-driver-secure="false"
Aug 04 22:20:52.192626 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.184331    2580 flags.go:64] FLAG: --storage-driver-table="stats"
Aug 04 22:20:52.192626 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.184334    2580 flags.go:64] FLAG: --storage-driver-user="root"
Aug 04 22:20:52.192626 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.184337    2580 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Aug 04 22:20:52.192626 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.184340    2580 flags.go:64] FLAG: --sync-frequency="1m0s"
Aug 04 22:20:52.192626 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.184344    2580 flags.go:64] FLAG: --system-cgroups=""
Aug 04 22:20:52.192626 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.184346    2580 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Aug 04 22:20:52.192626 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.184352    2580 flags.go:64] FLAG: --system-reserved-cgroup=""
Aug 04 22:20:52.192626 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.184355    2580 flags.go:64] FLAG: --tls-cert-file=""
Aug 04 22:20:52.192626 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.184357    2580 flags.go:64] FLAG: --tls-cipher-suites="[]"
Aug 04 22:20:52.192626 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.184361    2580 flags.go:64] FLAG: --tls-min-version=""
Aug 04 22:20:52.192626 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.184364    2580 flags.go:64] FLAG: --tls-private-key-file=""
Aug 04 22:20:52.192626 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.184367    2580 flags.go:64] FLAG: --topology-manager-policy="none"
Aug 04 22:20:52.192626 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.184370    2580 flags.go:64] FLAG: --topology-manager-policy-options=""
Aug 04 22:20:52.192626 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.184373    2580 flags.go:64] FLAG: --topology-manager-scope="container"
Aug 04 22:20:52.192626 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.184376    2580 flags.go:64] FLAG: --v="2"
Aug 04 22:20:52.192626 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.184380    2580 flags.go:64] FLAG: --version="false"
Aug 04 22:20:52.193241 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.184384    2580 flags.go:64] FLAG: --vmodule=""
Aug 04 22:20:52.193241 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.184388    2580 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Aug 04 22:20:52.193241 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.184406    2580 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Aug 04 22:20:52.193241 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.184518    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 04 22:20:52.193241 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.184521    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 04 22:20:52.193241 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.184524    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 04 22:20:52.193241 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.184527    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 04 22:20:52.193241 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.184531    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 04 22:20:52.193241 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.184535    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 04 22:20:52.193241 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.184539    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 04 22:20:52.193241 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.184542    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 04 22:20:52.193241 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.184544    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 04 22:20:52.193241 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.184547    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 04 22:20:52.193241 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.184550    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 04 22:20:52.193241 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.184552    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 04 22:20:52.193241 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.184555    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 04 22:20:52.193241 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.184558    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 04 22:20:52.193241 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.184561    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 04 22:20:52.193241 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.184564    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 04 22:20:52.193241 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.184567    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 04 22:20:52.193980 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.184570    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 04 22:20:52.193980 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.184579    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 04 22:20:52.193980 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.184582    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 04 22:20:52.193980 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.184585    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 04 22:20:52.193980 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.184588    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 04 22:20:52.193980 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.184590    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 04 22:20:52.193980 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.184593    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 04 22:20:52.193980 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.184596    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 04 22:20:52.193980 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.184598    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 04 22:20:52.193980 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.184601    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 04 22:20:52.193980 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.184603    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 04 22:20:52.193980 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.184606    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 04 22:20:52.193980 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.184608    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 04 22:20:52.193980 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.184611    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 04 22:20:52.193980 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.184613    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 04 22:20:52.193980 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.184616    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 04 22:20:52.193980 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.184618    2580 feature_gate.go:328] unrecognized feature gate: Example2
Aug 04 22:20:52.193980 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.184621    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 04 22:20:52.193980 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.184623    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 04 22:20:52.193980 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.184627    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 04 22:20:52.194666 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.184630    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 04 22:20:52.194666 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.184633    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 04 22:20:52.194666 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.184636    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 04 22:20:52.194666 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.184638    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 04 22:20:52.194666 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.184641    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 04 22:20:52.194666 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.184644    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 04 22:20:52.194666 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.184646    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 04 22:20:52.194666 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.184649    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 04 22:20:52.194666 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.184652    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 04 22:20:52.194666 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.184654    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 04 22:20:52.194666 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.184657    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 04 22:20:52.194666 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.184659    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 04 22:20:52.194666 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.184662    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 04 22:20:52.194666 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.184665    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 04 22:20:52.194666 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.184668    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 04 22:20:52.194666 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.184670    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 04 22:20:52.194666 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.184673    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 04 22:20:52.194666 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.184677    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 04 22:20:52.194666 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.184682    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 04 22:20:52.195167 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.184685    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 04 22:20:52.195167 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.184688    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 04 22:20:52.195167 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.184690    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 04 22:20:52.195167 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.184693    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 04 22:20:52.195167 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.184695    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 04 22:20:52.195167 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.184698    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 04 22:20:52.195167 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.184700    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 04 22:20:52.195167 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.184703    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 04 22:20:52.195167 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.184705    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 04 22:20:52.195167 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.184708    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 04 22:20:52.195167 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.184711    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 04 22:20:52.195167 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.184713    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 04 22:20:52.195167 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.184718    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 04 22:20:52.195167 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.184720    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 04 22:20:52.195167 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.184723    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 04 22:20:52.195167 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.184726    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 04 22:20:52.195167 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.184728    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 04 22:20:52.195167 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.184731    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 04 22:20:52.195167 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.184733    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 04 22:20:52.195167 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.184736    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 04 22:20:52.195653 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.184738    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 04 22:20:52.195653 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.184741    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 04 22:20:52.195653 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.184743    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 04 22:20:52.195653 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.184746    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 04 22:20:52.195653 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.184748    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 04 22:20:52.195653 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.184751    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 04 22:20:52.195653 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.184754    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 04 22:20:52.195653 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.184758    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 04 22:20:52.195653 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.184761    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 04 22:20:52.195653 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.184764    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 04 22:20:52.195653 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.184767    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 04 22:20:52.195653 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.184786    2580 feature_gate.go:328] unrecognized feature gate: Example
Aug 04 22:20:52.195653 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.184789    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 04 22:20:52.195653 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.184792    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 04 22:20:52.195653 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.184794    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 04 22:20:52.195653 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.184797    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 04 22:20:52.195653 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.184800    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 04 22:20:52.195653 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.184802    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 04 22:20:52.195653 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.184805    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 04 22:20:52.195653 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.184807    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 04 22:20:52.196175 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.184810    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 04 22:20:52.196175 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.184813    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 04 22:20:52.196175 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.184816    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 04 22:20:52.196175 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.185370    2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Aug 04 22:20:52.196175 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.192442    2580 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Aug 04 22:20:52.196175 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.192461    2580 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Aug 04 22:20:52.196175 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.192482    2580 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Aug 04 22:20:52.196175 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.192491    2580 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Aug 04 22:20:52.196175 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.192556    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 04 22:20:52.196175 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.192562    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 04 22:20:52.196175 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.192565    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 04 22:20:52.196175 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.192568    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 04 22:20:52.196175 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.192571    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 04 22:20:52.196175 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.192574    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 04 22:20:52.196525 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.192576    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 04 22:20:52.196525 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.192579    2580 feature_gate.go:328] unrecognized feature gate: Example
Aug 04 22:20:52.196525 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.192582    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 04 22:20:52.196525 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.192585    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 04 22:20:52.196525 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.192588    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 04 22:20:52.196525 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.192590    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 04 22:20:52.196525 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.192593    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 04 22:20:52.196525 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.192596    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 04 22:20:52.196525 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.192598    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 04 22:20:52.196525 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.192601    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 04 22:20:52.196525 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.192603    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 04 22:20:52.196525 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.192606    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 04 22:20:52.196525 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.192608    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 04 22:20:52.196525 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.192611    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 04 22:20:52.196525 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.192613    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 04 22:20:52.196525 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.192616    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 04 22:20:52.196525 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.192618    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 04 22:20:52.196525 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.192621    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 04 22:20:52.196525 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.192623    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 04 22:20:52.196525 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.192626    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 04 22:20:52.197027 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.192629    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 04 22:20:52.197027 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.192631    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 04 22:20:52.197027 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.192634    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 04 22:20:52.197027 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.192647    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 04 22:20:52.197027 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.192650    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 04 22:20:52.197027 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.192653    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 04 22:20:52.197027 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.192655    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 04 22:20:52.197027 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.192658    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 04 22:20:52.197027 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.192660    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 04 22:20:52.197027 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.192663    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 04 22:20:52.197027 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.192666    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 04 22:20:52.197027 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.192668    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 04 22:20:52.197027 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.192671    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 04 22:20:52.197027 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.192673    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 04 22:20:52.197027 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.192676    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 04 22:20:52.197027 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.192678    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 04 22:20:52.197027 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.192681    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 04 22:20:52.197027 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.192684    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 04 22:20:52.197027 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.192686    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 04 22:20:52.197027 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.192689    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 04 22:20:52.197502 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.192692    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 04 22:20:52.197502 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.192694    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 04 22:20:52.197502 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.192697    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 04 22:20:52.197502 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.192699    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 04 22:20:52.197502 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.192702    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 04 22:20:52.197502 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.192704    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 04 22:20:52.197502 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.192707    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 04 22:20:52.197502 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.192710    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 04 22:20:52.197502 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.192712    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 04 22:20:52.197502 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.192715    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 04 22:20:52.197502 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.192719    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 04 22:20:52.197502 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.192723    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 04 22:20:52.197502 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.192726    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 04 22:20:52.197502 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.192729    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 04 22:20:52.197502 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.192732    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 04 22:20:52.197502 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.192736    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 04 22:20:52.197502 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.192744    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 04 22:20:52.197502 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.192747    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 04 22:20:52.197502 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.192750    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 04 22:20:52.198024 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.192752    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 04 22:20:52.198024 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.192767    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 04 22:20:52.198024 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.192786    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 04 22:20:52.198024 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.192791    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 04 22:20:52.198024 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.192795    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 04 22:20:52.198024 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.192798    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 04 22:20:52.198024 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.192801    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 04 22:20:52.198024 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.192805    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 04 22:20:52.198024 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.192808    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 04 22:20:52.198024 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.192812    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 04 22:20:52.198024 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.192815    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 04 22:20:52.198024 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.192817    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 04 22:20:52.198024 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.192821    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 04 22:20:52.198024 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.192823    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 04 22:20:52.198024 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.192827    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 04 22:20:52.198024 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.192830    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 04 22:20:52.198024 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.192832    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 04 22:20:52.198024 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.192835    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 04 22:20:52.198024 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.192838    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 04 22:20:52.198024 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.192840    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 04 22:20:52.198521 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.192844    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 04 22:20:52.198521 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.192848    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 04 22:20:52.198521 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.192851    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 04 22:20:52.198521 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.192854    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 04 22:20:52.198521 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.192856    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 04 22:20:52.198521 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.192859    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 04 22:20:52.198521 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.192861    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 04 22:20:52.198521 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.192864    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 04 22:20:52.198521 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.192867    2580 feature_gate.go:328] unrecognized feature gate: Example2
Aug 04 22:20:52.198521 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.192869    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 04 22:20:52.198521 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.192878    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 04 22:20:52.198521 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.192881    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 04 22:20:52.198521 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.192884    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 04 22:20:52.198521 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.192887    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 04 22:20:52.198875 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.192892    2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Aug 04 22:20:52.198875 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.193050    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 04 22:20:52.198875 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.193056    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 04 22:20:52.198875 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.193059    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 04 22:20:52.198875 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.193062    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 04 22:20:52.198875 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.193065    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 04 22:20:52.198875 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.193069    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 04 22:20:52.198875 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.193071    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 04 22:20:52.198875 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.193074    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 04 22:20:52.198875 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.193077    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 04 22:20:52.198875 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.193079    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 04 22:20:52.198875 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.193083    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 04 22:20:52.198875 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.193085    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 04 22:20:52.198875 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.193088    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 04 22:20:52.198875 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.193090    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 04 22:20:52.199271 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.193093    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 04 22:20:52.199271 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.193095    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 04 22:20:52.199271 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.193098    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 04 22:20:52.199271 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.193102    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 04 22:20:52.199271 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.193106    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 04 22:20:52.199271 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.193109    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 04 22:20:52.199271 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.193112    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 04 22:20:52.199271 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.193114    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 04 22:20:52.199271 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.193117    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 04 22:20:52.199271 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.193119    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 04 22:20:52.199271 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.193122    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 04 22:20:52.199271 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.193124    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 04 22:20:52.199271 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.193127    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 04 22:20:52.199271 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.193129    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 04 22:20:52.199271 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.193137    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 04 22:20:52.199271 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.193140    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 04 22:20:52.199271 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.193143    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 04 22:20:52.199271 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.193145    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 04 22:20:52.199271 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.193148    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 04 22:20:52.199737 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.193150    2580 feature_gate.go:328] unrecognized feature gate: Example
Aug 04 22:20:52.199737 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.193153    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 04 22:20:52.199737 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.193155    2580 feature_gate.go:328] unrecognized feature gate: Example2
Aug 04 22:20:52.199737 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.193158    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 04 22:20:52.199737 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.193160    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 04 22:20:52.199737 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.193162    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 04 22:20:52.199737 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.193165    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 04 22:20:52.199737 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.193167    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 04 22:20:52.199737 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.193170    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 04 22:20:52.199737 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.193173    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 04 22:20:52.199737 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.193175    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 04 22:20:52.199737 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.193178    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 04 22:20:52.199737 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.193181    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 04 22:20:52.199737 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.193184    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 04 22:20:52.199737 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.193187    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 04 22:20:52.199737 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.193190    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 04 22:20:52.199737 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.193193    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 04 22:20:52.199737 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.193195    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 04 22:20:52.199737 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.193198    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 04 22:20:52.200210 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.193201    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 04 22:20:52.200210 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.193203    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 04 22:20:52.200210 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.193206    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 04 22:20:52.200210 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.193208    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 04 22:20:52.200210 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.193210    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 04 22:20:52.200210 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.193213    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 04 22:20:52.200210 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.193215    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 04 22:20:52.200210 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.193218    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 04 22:20:52.200210 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.193220    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 04 22:20:52.200210 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.193229    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 04 22:20:52.200210 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.193232    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 04 22:20:52.200210 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.193235    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 04 22:20:52.200210 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.193237    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 04 22:20:52.200210 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.193240    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 04 22:20:52.200210 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.193242    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 04 22:20:52.200210 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.193245    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 04 22:20:52.200210 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.193247    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 04 22:20:52.200210 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.193250    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 04 22:20:52.200210 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.193253    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 04 22:20:52.200210 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.193256    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 04 22:20:52.200698 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.193258    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 04 22:20:52.200698 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.193261    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 04 22:20:52.200698 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.193263    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 04 22:20:52.200698 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.193266    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 04 22:20:52.200698 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.193270    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 04 22:20:52.200698 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.193273    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 04 22:20:52.200698 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.193276    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 04 22:20:52.200698 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.193279    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 04 22:20:52.200698 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.193281    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 04 22:20:52.200698 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.193284    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 04 22:20:52.200698 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.193287    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 04 22:20:52.200698 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.193290    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 04 22:20:52.200698 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.193292    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 04 22:20:52.200698 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.193295    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 04 22:20:52.200698 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.193297    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 04 22:20:52.200698 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.193300    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 04 22:20:52.200698 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.193302    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 04 22:20:52.200698 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.193305    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 04 22:20:52.200698 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.193307    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 04 22:20:52.201208 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.193310    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 04 22:20:52.201208 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.193312    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 04 22:20:52.201208 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.193315    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 04 22:20:52.201208 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.193323    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 04 22:20:52.201208 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.193325    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 04 22:20:52.201208 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.193328    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 04 22:20:52.201208 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.193330    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 04 22:20:52.201208 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:52.193333    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 04 22:20:52.201208 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.193338    2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Aug 04 22:20:52.201208 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.196109    2580 server.go:962] "Client rotation is on, will bootstrap in background"
Aug 04 22:20:52.201208 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.198947    2580 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Aug 04 22:20:52.201208 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.200246    2580 server.go:1019] "Starting client certificate rotation"
Aug 04 22:20:52.201208 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.200353    2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Aug 04 22:20:52.201208 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.200388    2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Aug 04 22:20:52.203284 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.203270    2580 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Aug 04 22:20:52.204748 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.204728    2580 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Aug 04 22:20:52.214801 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.214785    2580 log.go:25] "Validated CRI v1 runtime API"
Aug 04 22:20:52.217139 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.217120    2580 log.go:25] "Validated CRI v1 image API"
Aug 04 22:20:52.218715 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.218697    2580 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Aug 04 22:20:52.221442 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.221421    2580 fs.go:135] Filesystem UUIDs: map[38a80602-78f4-4d57-9d0c-f5f21bce9be1:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 ead95a07-d70e-4482-87a4-d347eea97bcf:/dev/nvme0n1p4]
Aug 04 22:20:52.221510 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.221440    2580 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Aug 04 22:20:52.227200 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.227068    2580 manager.go:216] Machine: {Timestamp:2026-08-04 22:20:52.22572516 +0000 UTC m=+0.316900057 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3121945 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec23df5cfcfbd6cb74ce642646e3fee4 SystemUUID:ec23df5c-fcfb-d6cb-74ce-642646e3fee4 BootID:9a145d58-abb9-4957-aa24-c33a121c3197 Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:1a:40:24:16:cd Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:1a:40:24:16:cd Speed:0 Mtu:9001} {Name:ovs-system MacAddress:be:dc:5a:98:e5:c1 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Aug 04 22:20:52.227200 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.227194    2580 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Aug 04 22:20:52.227305 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.227272    2580 manager.go:232] Version: {KernelVersion:5.14.0-570.131.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260727-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Aug 04 22:20:52.230392 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.230364    2580 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Aug 04 22:20:52.230553 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.230397    2580 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-137-117.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Aug 04 22:20:52.231212 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.231201    2580 topology_manager.go:138] "Creating topology manager with none policy"
Aug 04 22:20:52.231249 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.231213    2580 container_manager_linux.go:309] "Creating device plugin manager"
Aug 04 22:20:52.231249 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.231225    2580 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Aug 04 22:20:52.231782 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.231760    2580 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Aug 04 22:20:52.231946 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.231927    2580 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Aug 04 22:20:52.233071 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.233050    2580 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Aug 04 22:20:52.236752 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.236735    2580 state_mem.go:36] "Initialized new in-memory state store"
Aug 04 22:20:52.236899 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.236887    2580 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Aug 04 22:20:52.236960 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.236928    2580 kubelet.go:486] "Attempting to sync node with API server"
Aug 04 22:20:52.236960 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.236950    2580 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Aug 04 22:20:52.237051 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.236965    2580 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Aug 04 22:20:52.237051 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.236977    2580 kubelet.go:398] "Adding apiserver pod source"
Aug 04 22:20:52.237051 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.236990    2580 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Aug 04 22:20:52.237404 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.237380    2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Aug 04 22:20:52.237404 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.237403    2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Aug 04 22:20:52.239449 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.239429    2580 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Aug 04 22:20:52.240807 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.240794    2580 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Aug 04 22:20:52.240859 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.240824    2580 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Aug 04 22:20:52.241969 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.241957    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Aug 04 22:20:52.242043 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.241973    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Aug 04 22:20:52.242043 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.241980    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Aug 04 22:20:52.242043 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.241985    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Aug 04 22:20:52.242043 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.241993    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Aug 04 22:20:52.242043 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.241999    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Aug 04 22:20:52.242043 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.242006    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Aug 04 22:20:52.242043 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.242011    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Aug 04 22:20:52.242043 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.242018    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Aug 04 22:20:52.242043 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.242023    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Aug 04 22:20:52.242043 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.242032    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Aug 04 22:20:52.242043 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.242037    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Aug 04 22:20:52.243139 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.243128    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Aug 04 22:20:52.243139 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.243139    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Aug 04 22:20:52.246372 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.246350    2580 server.go:1268] "Started kubelet"
Aug 04 22:20:52.246459 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.246415    2580 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Aug 04 22:20:52.246644 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.246506    2580 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Aug 04 22:20:52.246742 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.246727    2580 server_v1.go:49] "podresources" method="list" useActivePods=true
Aug 04 22:20:52.247786 ip-10-0-137-117 systemd[1]: Started Kubernetes Kubelet.
Aug 04 22:20:52.247999 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:20:52.247834    2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-137-117.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Aug 04 22:20:52.247999 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.247922    2580 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-137-117.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Aug 04 22:20:52.247999 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:20:52.247931    2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Aug 04 22:20:52.248295 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.248258    2580 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Aug 04 22:20:52.249168 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.249155    2580 server.go:310] "Adding debug handlers to kubelet server"
Aug 04 22:20:52.253430 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.253412    2580 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Aug 04 22:20:52.253513 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.253412    2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Aug 04 22:20:52.253619 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:20:52.253596    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-117.ec2.internal\" not found"
Aug 04 22:20:52.253956 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:20:52.252425    2580 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-117.ec2.internal.18c8ba43b6e3333e  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-117.ec2.internal,UID:ip-10-0-137-117.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-137-117.ec2.internal,},FirstTimestamp:2026-08-04 22:20:52.246319934 +0000 UTC m=+0.337494834,LastTimestamp:2026-08-04 22:20:52.246319934 +0000 UTC m=+0.337494834,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-117.ec2.internal,}"
Aug 04 22:20:52.256063 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.254141    2580 volume_manager.go:311] "The desired_state_of_world populator starts"
Aug 04 22:20:52.256063 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.254159    2580 volume_manager.go:313] "Starting Kubelet Volume Manager"
Aug 04 22:20:52.256063 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.254297    2580 reconstruct.go:97] "Volume reconstruction finished"
Aug 04 22:20:52.256063 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.254307    2580 reconciler.go:29] "Reconciler: start to sync state"
Aug 04 22:20:52.256063 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.254450    2580 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Aug 04 22:20:52.256708 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.256606    2580 factory.go:55] Registering systemd factory
Aug 04 22:20:52.256708 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.256653    2580 factory.go:223] Registration of the systemd container factory successfully
Aug 04 22:20:52.257238 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.257222    2580 factory.go:153] Registering CRI-O factory
Aug 04 22:20:52.257238 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.257238    2580 factory.go:223] Registration of the crio container factory successfully
Aug 04 22:20:52.257362 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.257287    2580 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Aug 04 22:20:52.257362 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.257310    2580 factory.go:103] Registering Raw factory
Aug 04 22:20:52.257362 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.257324    2580 manager.go:1196] Started watching for new ooms in manager
Aug 04 22:20:52.257724 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.257712    2580 manager.go:349] Starting recovery of all containers
Aug 04 22:20:52.260405 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:20:52.260362    2580 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Aug 04 22:20:52.263920 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:20:52.263894    2580 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-137-117.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Aug 04 22:20:52.264003 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:20:52.263921    2580 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Aug 04 22:20:52.270540 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.270521    2580 manager.go:354] Recovery completed
Aug 04 22:20:52.273051 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.273031    2580 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-9tjl2"
Aug 04 22:20:52.274523 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.274511    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 04 22:20:52.276178 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.276161    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-117.ec2.internal" event="NodeHasSufficientMemory"
Aug 04 22:20:52.276225 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.276194    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-117.ec2.internal" event="NodeHasNoDiskPressure"
Aug 04 22:20:52.276225 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.276210    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-117.ec2.internal" event="NodeHasSufficientPID"
Aug 04 22:20:52.276677 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.276663    2580 cpu_manager.go:222] "Starting CPU manager" policy="none"
Aug 04 22:20:52.276677 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.276675    2580 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Aug 04 22:20:52.276814 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.276679    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 04 22:20:52.276814 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.276693    2580 state_mem.go:36] "Initialized new in-memory state store"
Aug 04 22:20:52.277314 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.277299    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-117.ec2.internal" event="NodeHasSufficientMemory"
Aug 04 22:20:52.277380 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.277327    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-117.ec2.internal" event="NodeHasNoDiskPressure"
Aug 04 22:20:52.277380 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.277341    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-117.ec2.internal" event="NodeHasSufficientPID"
Aug 04 22:20:52.278004 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.277981    2580 policy_none.go:49] "None policy: Start"
Aug 04 22:20:52.278004 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.277999    2580 memory_manager.go:187] "Starting memorymanager" policy="None"
Aug 04 22:20:52.278112 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.278017    2580 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Aug 04 22:20:52.278112 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:20:52.278046    2580 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-117.ec2.internal.18c8ba43b8aad552  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-117.ec2.internal,UID:ip-10-0-137-117.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-137-117.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-137-117.ec2.internal,},FirstTimestamp:2026-08-04 22:20:52.276180306 +0000 UTC m=+0.367355207,LastTimestamp:2026-08-04 22:20:52.276180306 +0000 UTC m=+0.367355207,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-117.ec2.internal,}"
Aug 04 22:20:52.279037 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.279026    2580 policy_none.go:47] "Start"
Aug 04 22:20:52.280371 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.280355    2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-9tjl2"
Aug 04 22:20:52.325561 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.325407    2580 manager.go:337] "Starting Device Plugin manager"
Aug 04 22:20:52.325665 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:20:52.325590    2580 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Aug 04 22:20:52.325665 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.325606    2580 server.go:87] "Starting device plugin registration server"
Aug 04 22:20:52.325851 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.325839    2580 eviction_manager.go:189] "Eviction manager: starting control loop"
Aug 04 22:20:52.325894 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.325852    2580 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Aug 04 22:20:52.325993 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.325975    2580 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Aug 04 22:20:52.326076 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.326062    2580 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Aug 04 22:20:52.326126 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.326079    2580 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Aug 04 22:20:52.326652 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:20:52.326633    2580 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Aug 04 22:20:52.326740 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:20:52.326686    2580 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-137-117.ec2.internal\" not found"
Aug 04 22:20:52.392996 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.392946    2580 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Aug 04 22:20:52.394152 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.394108    2580 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Aug 04 22:20:52.394152 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.394152    2580 status_manager.go:244] "Starting to sync pod status with apiserver"
Aug 04 22:20:52.394275 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.394184    2580 kubelet.go:2448] "Starting kubelet main sync loop"
Aug 04 22:20:52.394275 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:20:52.394225    2580 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Aug 04 22:20:52.396817 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.396798    2580 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Aug 04 22:20:52.426901 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.426817    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 04 22:20:52.427801 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.427767    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-117.ec2.internal" event="NodeHasSufficientMemory"
Aug 04 22:20:52.427862 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.427817    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-117.ec2.internal" event="NodeHasNoDiskPressure"
Aug 04 22:20:52.427862 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.427835    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-117.ec2.internal" event="NodeHasSufficientPID"
Aug 04 22:20:52.427862 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.427857    2580 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-137-117.ec2.internal"
Aug 04 22:20:52.436623 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:52.436605    2580 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-137-117.ec2.internal"
Aug 04 22:20:52.436706 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:20:52.436635    2580 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-137-117.ec2.internal\": node \"ip-10-0-137-117.ec2.internal\" not found"
Aug 04 22:20:52.473385 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:20:52.473358    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-117.ec2.internal\" not found"
Aug 04 22:20:53.593612 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:53.593581    2580 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-117.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-137-117.ec2.internal"]
Aug 04 22:20:53.593687 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:53.593649    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 04 22:20:53.595372 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:53.595356    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-117.ec2.internal" event="NodeHasSufficientMemory"
Aug 04 22:20:53.595449 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:53.595382    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-117.ec2.internal" event="NodeHasNoDiskPressure"
Aug 04 22:20:53.595449 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:53.595394    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-117.ec2.internal" event="NodeHasSufficientPID"
Aug 04 22:20:53.596752 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:53.596740    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 04 22:20:53.596876 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:53.596861    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-117.ec2.internal"
Aug 04 22:20:53.596914 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:53.596893    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 04 22:20:53.597467 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:53.597452    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-117.ec2.internal" event="NodeHasSufficientMemory"
Aug 04 22:20:53.597543 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:53.597457    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-117.ec2.internal" event="NodeHasSufficientMemory"
Aug 04 22:20:53.597543 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:53.597504    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-117.ec2.internal" event="NodeHasNoDiskPressure"
Aug 04 22:20:53.597543 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:53.597518    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-117.ec2.internal" event="NodeHasSufficientPID"
Aug 04 22:20:53.597543 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:53.597484    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-117.ec2.internal" event="NodeHasNoDiskPressure"
Aug 04 22:20:53.597661 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:53.597552    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-117.ec2.internal" event="NodeHasSufficientPID"
Aug 04 22:20:53.599116 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:53.599101    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-117.ec2.internal"
Aug 04 22:20:53.599179 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:53.599149    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 04 22:20:53.599904 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:53.599884    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-117.ec2.internal" event="NodeHasSufficientMemory"
Aug 04 22:20:53.599997 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:53.599913    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-117.ec2.internal" event="NodeHasNoDiskPressure"
Aug 04 22:20:53.599997 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:53.599926    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-117.ec2.internal" event="NodeHasSufficientPID"
Aug 04 22:20:53.615729 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:20:53.615708    2580 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-117.ec2.internal\" not found" node="ip-10-0-137-117.ec2.internal"
Aug 04 22:20:53.617899 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:20:53.617885    2580 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-117.ec2.internal\" not found" node="ip-10-0-137-117.ec2.internal"
Aug 04 22:20:53.655452 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:53.655417    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0ee3ab39f425114f43135622c74f665d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-117.ec2.internal\" (UID: \"0ee3ab39f425114f43135622c74f665d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-117.ec2.internal"
Aug 04 22:20:53.655452 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:53.655454    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0ee3ab39f425114f43135622c74f665d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-117.ec2.internal\" (UID: \"0ee3ab39f425114f43135622c74f665d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-117.ec2.internal"
Aug 04 22:20:53.655646 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:53.655497    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8c189592264ca39220dc93ea9c07921f-config\") pod \"kube-apiserver-proxy-ip-10-0-137-117.ec2.internal\" (UID: \"8c189592264ca39220dc93ea9c07921f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-117.ec2.internal"
Aug 04 22:20:53.672059 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:20:53.672037    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-117.ec2.internal\" not found"
Aug 04 22:20:53.755782 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:53.755749    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0ee3ab39f425114f43135622c74f665d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-117.ec2.internal\" (UID: \"0ee3ab39f425114f43135622c74f665d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-117.ec2.internal"
Aug 04 22:20:53.755782 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:53.755717    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0ee3ab39f425114f43135622c74f665d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-117.ec2.internal\" (UID: \"0ee3ab39f425114f43135622c74f665d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-117.ec2.internal"
Aug 04 22:20:53.755905 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:53.755844    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0ee3ab39f425114f43135622c74f665d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-117.ec2.internal\" (UID: \"0ee3ab39f425114f43135622c74f665d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-117.ec2.internal"
Aug 04 22:20:53.755905 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:53.755865    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8c189592264ca39220dc93ea9c07921f-config\") pod \"kube-apiserver-proxy-ip-10-0-137-117.ec2.internal\" (UID: \"8c189592264ca39220dc93ea9c07921f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-117.ec2.internal"
Aug 04 22:20:53.755966 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:53.755916    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8c189592264ca39220dc93ea9c07921f-config\") pod \"kube-apiserver-proxy-ip-10-0-137-117.ec2.internal\" (UID: \"8c189592264ca39220dc93ea9c07921f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-117.ec2.internal"
Aug 04 22:20:53.755966 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:53.755939    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0ee3ab39f425114f43135622c74f665d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-117.ec2.internal\" (UID: \"0ee3ab39f425114f43135622c74f665d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-117.ec2.internal"
Aug 04 22:20:53.772867 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:20:53.772830    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-117.ec2.internal\" not found"
Aug 04 22:20:53.873746 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:20:53.873716    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-117.ec2.internal\" not found"
Aug 04 22:20:53.918918 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:53.918889    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-117.ec2.internal"
Aug 04 22:20:53.921052 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:53.921035    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-117.ec2.internal"
Aug 04 22:20:53.974085 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:20:53.974056    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-117.ec2.internal\" not found"
Aug 04 22:20:54.074670 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:20:54.074634    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-117.ec2.internal\" not found"
Aug 04 22:20:54.175208 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:20:54.175110    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-117.ec2.internal\" not found"
Aug 04 22:20:54.269463 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:54.269430    2580 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Aug 04 22:20:54.275610 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:20:54.275586    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-117.ec2.internal\" not found"
Aug 04 22:20:54.297724 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:54.297683    2580 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Aug 04 22:20:54.297904 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:54.297883    2580 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Aug 04 22:20:54.297967 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:54.297914    2580 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Aug 04 22:20:54.376296 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:20:54.376260    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-117.ec2.internal\" not found"
Aug 04 22:20:54.383451 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:54.383421    2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-08-03 22:15:53 +0000 UTC" deadline="2028-02-12 04:14:50.485976634 +0000 UTC"
Aug 04 22:20:54.383555 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:54.383452    2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13349h53m56.102527923s"
Aug 04 22:20:54.424986 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:54.424961    2580 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Aug 04 22:20:54.476633 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:20:54.476563    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-117.ec2.internal\" not found"
Aug 04 22:20:54.509811 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:54.509776    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ee3ab39f425114f43135622c74f665d.slice/crio-c4f5050c7d6c52a4e460e9c6f1ee872b04294b2ee8daf2b4f4f4c0eecefb11a5 WatchSource:0}: Error finding container c4f5050c7d6c52a4e460e9c6f1ee872b04294b2ee8daf2b4f4f4c0eecefb11a5: Status 404 returned error can't find the container with id c4f5050c7d6c52a4e460e9c6f1ee872b04294b2ee8daf2b4f4f4c0eecefb11a5
Aug 04 22:20:54.509983 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:54.509968    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c189592264ca39220dc93ea9c07921f.slice/crio-a8f04c38cadfd7aa2eb4ab27f9483ebc3f90ca1dd35fc373af350d8a206d53e5 WatchSource:0}: Error finding container a8f04c38cadfd7aa2eb4ab27f9483ebc3f90ca1dd35fc373af350d8a206d53e5: Status 404 returned error can't find the container with id a8f04c38cadfd7aa2eb4ab27f9483ebc3f90ca1dd35fc373af350d8a206d53e5
Aug 04 22:20:54.514669 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:54.514648    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 04 22:20:54.577208 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:20:54.577168    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-117.ec2.internal\" not found"
Aug 04 22:20:54.677733 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:20:54.677707    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-117.ec2.internal\" not found"
Aug 04 22:20:54.778245 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:20:54.778174    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-117.ec2.internal\" not found"
Aug 04 22:20:54.820584 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:54.820567    2580 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Aug 04 22:20:54.852536 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:54.852512    2580 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-117.ec2.internal"
Aug 04 22:20:54.868491 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:54.868469    2580 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Aug 04 22:20:54.869293 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:54.869269    2580 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-117.ec2.internal"
Aug 04 22:20:54.877063 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:54.877044    2580 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Aug 04 22:20:55.284853 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.284825    2580 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Aug 04 22:20:55.336856 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.336825    2580 apiserver.go:52] "Watching apiserver"
Aug 04 22:20:55.342982 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.342964    2580 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Aug 04 22:20:55.343353 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.343333    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-node-tuning-operator/tuned-sc4f2","openshift-multus/multus-additional-cni-plugins-p9zkw","openshift-multus/network-metrics-daemon-5h46r","openshift-network-operator/iptables-alerter-485vg","kube-system/konnectivity-agent-jpxll","kube-system/kube-apiserver-proxy-ip-10-0-137-117.ec2.internal","openshift-dns/node-resolver-mqwtk","openshift-image-registry/node-ca-xvfg9","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-117.ec2.internal","openshift-multus/multus-rzd7q","openshift-network-diagnostics/network-check-target-64rgt","openshift-ovn-kubernetes/ovnkube-node-cw6vm","kube-system/global-pull-secret-syncer-mms2l","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wtrgp"]
Aug 04 22:20:55.344828 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.344815    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-mqwtk"
Aug 04 22:20:55.345854 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.345830    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mms2l"
Aug 04 22:20:55.345956 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:20:55.345905    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mms2l" podUID="1675ffcb-004e-4aa6-9f0e-8d9c4567052a"
Aug 04 22:20:55.346977 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.346960    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5h46r"
Aug 04 22:20:55.347078 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:20:55.347029    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5h46r" podUID="14077369-fe10-4854-8785-0bfc9addb7c4"
Aug 04 22:20:55.347078 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.347063    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Aug 04 22:20:55.347189 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.347084    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-8qv7t\""
Aug 04 22:20:55.347189 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.347062    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Aug 04 22:20:55.348112 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.348097    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-485vg"
Aug 04 22:20:55.349241 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.349220    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-jpxll"
Aug 04 22:20:55.350195 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.350177    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Aug 04 22:20:55.350293 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.350209    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Aug 04 22:20:55.350293 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.350230    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Aug 04 22:20:55.350378 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.350319    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-r5scw\""
Aug 04 22:20:55.350613 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.350601    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wtrgp"
Aug 04 22:20:55.352408 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.351621    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Aug 04 22:20:55.352408 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.351651    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Aug 04 22:20:55.352408 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.351812    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-6z66p\""
Aug 04 22:20:55.352408 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.352377    2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Aug 04 22:20:55.352639 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.352424    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-xvfg9"
Aug 04 22:20:55.354703 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.352934    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-pkcxp\""
Aug 04 22:20:55.354703 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.353254    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Aug 04 22:20:55.354703 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.353789    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Aug 04 22:20:55.354703 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.354088    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Aug 04 22:20:55.355161 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.355121    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Aug 04 22:20:55.355531 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.355220    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-sc4f2"
Aug 04 22:20:55.355614 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.355513    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Aug 04 22:20:55.355741 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.355721    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-4lqvx\""
Aug 04 22:20:55.355884 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.355834    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Aug 04 22:20:55.356820 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.356801    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-p9zkw"
Aug 04 22:20:55.357338 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.357319    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Aug 04 22:20:55.357614 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.357601    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Aug 04 22:20:55.357680 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.357659    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-fbld5\""
Aug 04 22:20:55.357919 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.357906    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-rzd7q"
Aug 04 22:20:55.359059 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.359043    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Aug 04 22:20:55.359199 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.359183    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Aug 04 22:20:55.359268 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.359187    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Aug 04 22:20:55.359442 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.359384    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-dprxj\""
Aug 04 22:20:55.359497 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.359440    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Aug 04 22:20:55.359497 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.359465    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-64rgt"
Aug 04 22:20:55.359598 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:20:55.359545    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-64rgt" podUID="d04f70b8-d937-4f47-aa63-ee118a743487"
Aug 04 22:20:55.359690 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.359677    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Aug 04 22:20:55.359812 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.359797    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-s9jb9\""
Aug 04 22:20:55.359882 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.359855    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Aug 04 22:20:55.360757 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.360740    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-cw6vm"
Aug 04 22:20:55.362697 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.362675    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Aug 04 22:20:55.362793 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.362714    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Aug 04 22:20:55.362793 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.362720    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Aug 04 22:20:55.362793 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.362681    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Aug 04 22:20:55.362934 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.362906    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Aug 04 22:20:55.362934 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.362915    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Aug 04 22:20:55.363066 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.362998    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-mbhs2\""
Aug 04 22:20:55.363642 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.363623    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/708c6d09-57c2-4829-9e76-7d86874515ec-serviceca\") pod \"node-ca-xvfg9\" (UID: \"708c6d09-57c2-4829-9e76-7d86874515ec\") " pod="openshift-image-registry/node-ca-xvfg9"
Aug 04 22:20:55.363685 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.363664    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d96c63e8-991c-4331-a7fb-6f91570d0ad5-registration-dir\") pod \"aws-ebs-csi-driver-node-wtrgp\" (UID: \"d96c63e8-991c-4331-a7fb-6f91570d0ad5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wtrgp"
Aug 04 22:20:55.363721 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.363693    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d96c63e8-991c-4331-a7fb-6f91570d0ad5-etc-selinux\") pod \"aws-ebs-csi-driver-node-wtrgp\" (UID: \"d96c63e8-991c-4331-a7fb-6f91570d0ad5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wtrgp"
Aug 04 22:20:55.363752 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.363726    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lcdnw\" (UniqueName: \"kubernetes.io/projected/708c6d09-57c2-4829-9e76-7d86874515ec-kube-api-access-lcdnw\") pod \"node-ca-xvfg9\" (UID: \"708c6d09-57c2-4829-9e76-7d86874515ec\") " pod="openshift-image-registry/node-ca-xvfg9"
Aug 04 22:20:55.363752 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.363746    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/352301b4-da31-4c34-897a-35279eb5e2f0-hosts-file\") pod \"node-resolver-mqwtk\" (UID: \"352301b4-da31-4c34-897a-35279eb5e2f0\") " pod="openshift-dns/node-resolver-mqwtk"
Aug 04 22:20:55.363811 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.363767    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9532c679-cc59-47ba-a6a3-1b88c7cc4c69-etc-modprobe-d\") pod \"tuned-sc4f2\" (UID: \"9532c679-cc59-47ba-a6a3-1b88c7cc4c69\") " pod="openshift-cluster-node-tuning-operator/tuned-sc4f2"
Aug 04 22:20:55.363811 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.363785    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9532c679-cc59-47ba-a6a3-1b88c7cc4c69-etc-systemd\") pod \"tuned-sc4f2\" (UID: \"9532c679-cc59-47ba-a6a3-1b88c7cc4c69\") " pod="openshift-cluster-node-tuning-operator/tuned-sc4f2"
Aug 04 22:20:55.363919 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.363811    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/bf411845-febf-4e48-a52e-ea1741aa07cb-agent-certs\") pod \"konnectivity-agent-jpxll\" (UID: \"bf411845-febf-4e48-a52e-ea1741aa07cb\") " pod="kube-system/konnectivity-agent-jpxll"
Aug 04 22:20:55.363919 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.363842    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/708c6d09-57c2-4829-9e76-7d86874515ec-host\") pod \"node-ca-xvfg9\" (UID: \"708c6d09-57c2-4829-9e76-7d86874515ec\") " pod="openshift-image-registry/node-ca-xvfg9"
Aug 04 22:20:55.363919 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.363881    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9532c679-cc59-47ba-a6a3-1b88c7cc4c69-etc-tuned\") pod \"tuned-sc4f2\" (UID: \"9532c679-cc59-47ba-a6a3-1b88c7cc4c69\") " pod="openshift-cluster-node-tuning-operator/tuned-sc4f2"
Aug 04 22:20:55.363919 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.363906    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/289f4758-62ab-4466-95cc-0ed912f1919b-iptables-alerter-script\") pod \"iptables-alerter-485vg\" (UID: \"289f4758-62ab-4466-95cc-0ed912f1919b\") " pod="openshift-network-operator/iptables-alerter-485vg"
Aug 04 22:20:55.364104 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.363929    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d96c63e8-991c-4331-a7fb-6f91570d0ad5-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wtrgp\" (UID: \"d96c63e8-991c-4331-a7fb-6f91570d0ad5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wtrgp"
Aug 04 22:20:55.364104 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.363951    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d96c63e8-991c-4331-a7fb-6f91570d0ad5-device-dir\") pod \"aws-ebs-csi-driver-node-wtrgp\" (UID: \"d96c63e8-991c-4331-a7fb-6f91570d0ad5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wtrgp"
Aug 04 22:20:55.364104 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.363973    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1675ffcb-004e-4aa6-9f0e-8d9c4567052a-original-pull-secret\") pod \"global-pull-secret-syncer-mms2l\" (UID: \"1675ffcb-004e-4aa6-9f0e-8d9c4567052a\") " pod="kube-system/global-pull-secret-syncer-mms2l"
Aug 04 22:20:55.364104 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.363999    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/14077369-fe10-4854-8785-0bfc9addb7c4-metrics-certs\") pod \"network-metrics-daemon-5h46r\" (UID: \"14077369-fe10-4854-8785-0bfc9addb7c4\") " pod="openshift-multus/network-metrics-daemon-5h46r"
Aug 04 22:20:55.364104 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.364021    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9532c679-cc59-47ba-a6a3-1b88c7cc4c69-lib-modules\") pod \"tuned-sc4f2\" (UID: \"9532c679-cc59-47ba-a6a3-1b88c7cc4c69\") " pod="openshift-cluster-node-tuning-operator/tuned-sc4f2"
Aug 04 22:20:55.364104 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.364042    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9532c679-cc59-47ba-a6a3-1b88c7cc4c69-var-lib-kubelet\") pod \"tuned-sc4f2\" (UID: \"9532c679-cc59-47ba-a6a3-1b88c7cc4c69\") " pod="openshift-cluster-node-tuning-operator/tuned-sc4f2"
Aug 04 22:20:55.364104 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.364065    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9532c679-cc59-47ba-a6a3-1b88c7cc4c69-host\") pod \"tuned-sc4f2\" (UID: \"9532c679-cc59-47ba-a6a3-1b88c7cc4c69\") " pod="openshift-cluster-node-tuning-operator/tuned-sc4f2"
Aug 04 22:20:55.364104 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.364098    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/352301b4-da31-4c34-897a-35279eb5e2f0-tmp-dir\") pod \"node-resolver-mqwtk\" (UID: \"352301b4-da31-4c34-897a-35279eb5e2f0\") " pod="openshift-dns/node-resolver-mqwtk"
Aug 04 22:20:55.364495 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.364120    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1675ffcb-004e-4aa6-9f0e-8d9c4567052a-kubelet-config\") pod \"global-pull-secret-syncer-mms2l\" (UID: \"1675ffcb-004e-4aa6-9f0e-8d9c4567052a\") " pod="kube-system/global-pull-secret-syncer-mms2l"
Aug 04 22:20:55.364495 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.364179    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1675ffcb-004e-4aa6-9f0e-8d9c4567052a-dbus\") pod \"global-pull-secret-syncer-mms2l\" (UID: \"1675ffcb-004e-4aa6-9f0e-8d9c4567052a\") " pod="kube-system/global-pull-secret-syncer-mms2l"
Aug 04 22:20:55.364495 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.364214    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9532c679-cc59-47ba-a6a3-1b88c7cc4c69-etc-sysconfig\") pod \"tuned-sc4f2\" (UID: \"9532c679-cc59-47ba-a6a3-1b88c7cc4c69\") " pod="openshift-cluster-node-tuning-operator/tuned-sc4f2"
Aug 04 22:20:55.364495 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.364262    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9532c679-cc59-47ba-a6a3-1b88c7cc4c69-run\") pod \"tuned-sc4f2\" (UID: \"9532c679-cc59-47ba-a6a3-1b88c7cc4c69\") " pod="openshift-cluster-node-tuning-operator/tuned-sc4f2"
Aug 04 22:20:55.364495 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.364283    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9532c679-cc59-47ba-a6a3-1b88c7cc4c69-etc-sysctl-conf\") pod \"tuned-sc4f2\" (UID: \"9532c679-cc59-47ba-a6a3-1b88c7cc4c69\") " pod="openshift-cluster-node-tuning-operator/tuned-sc4f2"
Aug 04 22:20:55.364495 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.364298    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d96c63e8-991c-4331-a7fb-6f91570d0ad5-socket-dir\") pod \"aws-ebs-csi-driver-node-wtrgp\" (UID: \"d96c63e8-991c-4331-a7fb-6f91570d0ad5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wtrgp"
Aug 04 22:20:55.364495 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.364311    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9532c679-cc59-47ba-a6a3-1b88c7cc4c69-sys\") pod \"tuned-sc4f2\" (UID: \"9532c679-cc59-47ba-a6a3-1b88c7cc4c69\") " pod="openshift-cluster-node-tuning-operator/tuned-sc4f2"
Aug 04 22:20:55.364495 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.364323    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9532c679-cc59-47ba-a6a3-1b88c7cc4c69-tmp\") pod \"tuned-sc4f2\" (UID: \"9532c679-cc59-47ba-a6a3-1b88c7cc4c69\") " pod="openshift-cluster-node-tuning-operator/tuned-sc4f2"
Aug 04 22:20:55.364495 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.364344    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gvlmd\" (UniqueName: \"kubernetes.io/projected/289f4758-62ab-4466-95cc-0ed912f1919b-kube-api-access-gvlmd\") pod \"iptables-alerter-485vg\" (UID: \"289f4758-62ab-4466-95cc-0ed912f1919b\") " pod="openshift-network-operator/iptables-alerter-485vg"
Aug 04 22:20:55.364495 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.364369    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q75g4\" (UniqueName: \"kubernetes.io/projected/352301b4-da31-4c34-897a-35279eb5e2f0-kube-api-access-q75g4\") pod \"node-resolver-mqwtk\" (UID: \"352301b4-da31-4c34-897a-35279eb5e2f0\") " pod="openshift-dns/node-resolver-mqwtk"
Aug 04 22:20:55.364495 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.364393    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9532c679-cc59-47ba-a6a3-1b88c7cc4c69-etc-kubernetes\") pod \"tuned-sc4f2\" (UID: \"9532c679-cc59-47ba-a6a3-1b88c7cc4c69\") " pod="openshift-cluster-node-tuning-operator/tuned-sc4f2"
Aug 04 22:20:55.364495 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.364423    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9532c679-cc59-47ba-a6a3-1b88c7cc4c69-etc-sysctl-d\") pod \"tuned-sc4f2\" (UID: \"9532c679-cc59-47ba-a6a3-1b88c7cc4c69\") " pod="openshift-cluster-node-tuning-operator/tuned-sc4f2"
Aug 04 22:20:55.364495 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.364458    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wjrfs\" (UniqueName: \"kubernetes.io/projected/9532c679-cc59-47ba-a6a3-1b88c7cc4c69-kube-api-access-wjrfs\") pod \"tuned-sc4f2\" (UID: \"9532c679-cc59-47ba-a6a3-1b88c7cc4c69\") " pod="openshift-cluster-node-tuning-operator/tuned-sc4f2"
Aug 04 22:20:55.364495 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.364484    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/bf411845-febf-4e48-a52e-ea1741aa07cb-konnectivity-ca\") pod \"konnectivity-agent-jpxll\" (UID: \"bf411845-febf-4e48-a52e-ea1741aa07cb\") " pod="kube-system/konnectivity-agent-jpxll"
Aug 04 22:20:55.365038 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.364518    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qgdwv\" (UniqueName: \"kubernetes.io/projected/d96c63e8-991c-4331-a7fb-6f91570d0ad5-kube-api-access-qgdwv\") pod \"aws-ebs-csi-driver-node-wtrgp\" (UID: \"d96c63e8-991c-4331-a7fb-6f91570d0ad5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wtrgp"
Aug 04 22:20:55.365038 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.364554    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9bd9k\" (UniqueName: \"kubernetes.io/projected/14077369-fe10-4854-8785-0bfc9addb7c4-kube-api-access-9bd9k\") pod \"network-metrics-daemon-5h46r\" (UID: \"14077369-fe10-4854-8785-0bfc9addb7c4\") " pod="openshift-multus/network-metrics-daemon-5h46r"
Aug 04 22:20:55.365038 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.364590    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/289f4758-62ab-4466-95cc-0ed912f1919b-host-slash\") pod \"iptables-alerter-485vg\" (UID: \"289f4758-62ab-4466-95cc-0ed912f1919b\") " pod="openshift-network-operator/iptables-alerter-485vg"
Aug 04 22:20:55.365038 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.364626    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d96c63e8-991c-4331-a7fb-6f91570d0ad5-sys-fs\") pod \"aws-ebs-csi-driver-node-wtrgp\" (UID: \"d96c63e8-991c-4331-a7fb-6f91570d0ad5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wtrgp"
Aug 04 22:20:55.365838 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.365823    2580 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Aug 04 22:20:55.386206 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.386144    2580 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-k5psd"
Aug 04 22:20:55.393443 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.393422    2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-k5psd"
Aug 04 22:20:55.453947 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.453921    2580 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Aug 04 22:20:55.465657 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.465627    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/57e1c824-1681-49ad-b094-b34ae1e14ac4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cw6vm\" (UID: \"57e1c824-1681-49ad-b094-b34ae1e14ac4\") " pod="openshift-ovn-kubernetes/ovnkube-node-cw6vm"
Aug 04 22:20:55.465657 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.465659    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/57e1c824-1681-49ad-b094-b34ae1e14ac4-ovn-node-metrics-cert\") pod \"ovnkube-node-cw6vm\" (UID: \"57e1c824-1681-49ad-b094-b34ae1e14ac4\") " pod="openshift-ovn-kubernetes/ovnkube-node-cw6vm"
Aug 04 22:20:55.465818 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.465680    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/aae79032-9bea-47d8-8cb2-7e277f07ef6d-host-var-lib-cni-multus\") pod \"multus-rzd7q\" (UID: \"aae79032-9bea-47d8-8cb2-7e277f07ef6d\") " pod="openshift-multus/multus-rzd7q"
Aug 04 22:20:55.465818 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.465702    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/aae79032-9bea-47d8-8cb2-7e277f07ef6d-multus-daemon-config\") pod \"multus-rzd7q\" (UID: \"aae79032-9bea-47d8-8cb2-7e277f07ef6d\") " pod="openshift-multus/multus-rzd7q"
Aug 04 22:20:55.465818 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.465728    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9532c679-cc59-47ba-a6a3-1b88c7cc4c69-etc-kubernetes\") pod \"tuned-sc4f2\" (UID: \"9532c679-cc59-47ba-a6a3-1b88c7cc4c69\") " pod="openshift-cluster-node-tuning-operator/tuned-sc4f2"
Aug 04 22:20:55.465818 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.465745    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9532c679-cc59-47ba-a6a3-1b88c7cc4c69-etc-sysctl-d\") pod \"tuned-sc4f2\" (UID: \"9532c679-cc59-47ba-a6a3-1b88c7cc4c69\") " pod="openshift-cluster-node-tuning-operator/tuned-sc4f2"
Aug 04 22:20:55.465818 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.465760    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c0c23bef-9c00-46e2-8f50-d67322ae45e6-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-p9zkw\" (UID: \"c0c23bef-9c00-46e2-8f50-d67322ae45e6\") " pod="openshift-multus/multus-additional-cni-plugins-p9zkw"
Aug 04 22:20:55.465818 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.465784    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ltxhz\" (UniqueName: \"kubernetes.io/projected/d04f70b8-d937-4f47-aa63-ee118a743487-kube-api-access-ltxhz\") pod \"network-check-target-64rgt\" (UID: \"d04f70b8-d937-4f47-aa63-ee118a743487\") " pod="openshift-network-diagnostics/network-check-target-64rgt"
Aug 04 22:20:55.465818 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.465791    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9532c679-cc59-47ba-a6a3-1b88c7cc4c69-etc-kubernetes\") pod \"tuned-sc4f2\" (UID: \"9532c679-cc59-47ba-a6a3-1b88c7cc4c69\") " pod="openshift-cluster-node-tuning-operator/tuned-sc4f2"
Aug 04 22:20:55.465818 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.465807    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/57e1c824-1681-49ad-b094-b34ae1e14ac4-ovnkube-script-lib\") pod \"ovnkube-node-cw6vm\" (UID: \"57e1c824-1681-49ad-b094-b34ae1e14ac4\") " pod="openshift-ovn-kubernetes/ovnkube-node-cw6vm"
Aug 04 22:20:55.466043 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.465826    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/aae79032-9bea-47d8-8cb2-7e277f07ef6d-host-run-multus-certs\") pod \"multus-rzd7q\" (UID: \"aae79032-9bea-47d8-8cb2-7e277f07ef6d\") " pod="openshift-multus/multus-rzd7q"
Aug 04 22:20:55.466043 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.465846    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qgdwv\" (UniqueName: \"kubernetes.io/projected/d96c63e8-991c-4331-a7fb-6f91570d0ad5-kube-api-access-qgdwv\") pod \"aws-ebs-csi-driver-node-wtrgp\" (UID: \"d96c63e8-991c-4331-a7fb-6f91570d0ad5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wtrgp"
Aug 04 22:20:55.466043 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.465868    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d96c63e8-991c-4331-a7fb-6f91570d0ad5-sys-fs\") pod \"aws-ebs-csi-driver-node-wtrgp\" (UID: \"d96c63e8-991c-4331-a7fb-6f91570d0ad5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wtrgp"
Aug 04 22:20:55.466043 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.465911    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9532c679-cc59-47ba-a6a3-1b88c7cc4c69-etc-sysctl-d\") pod \"tuned-sc4f2\" (UID: \"9532c679-cc59-47ba-a6a3-1b88c7cc4c69\") " pod="openshift-cluster-node-tuning-operator/tuned-sc4f2"
Aug 04 22:20:55.466043 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.465908    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c0c23bef-9c00-46e2-8f50-d67322ae45e6-cni-binary-copy\") pod \"multus-additional-cni-plugins-p9zkw\" (UID: \"c0c23bef-9c00-46e2-8f50-d67322ae45e6\") " pod="openshift-multus/multus-additional-cni-plugins-p9zkw"
Aug 04 22:20:55.466043 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.465921    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d96c63e8-991c-4331-a7fb-6f91570d0ad5-sys-fs\") pod \"aws-ebs-csi-driver-node-wtrgp\" (UID: \"d96c63e8-991c-4331-a7fb-6f91570d0ad5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wtrgp"
Aug 04 22:20:55.466043 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.465947    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/57e1c824-1681-49ad-b094-b34ae1e14ac4-host-kubelet\") pod \"ovnkube-node-cw6vm\" (UID: \"57e1c824-1681-49ad-b094-b34ae1e14ac4\") " pod="openshift-ovn-kubernetes/ovnkube-node-cw6vm"
Aug 04 22:20:55.466043 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.465966    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/57e1c824-1681-49ad-b094-b34ae1e14ac4-etc-openvswitch\") pod \"ovnkube-node-cw6vm\" (UID: \"57e1c824-1681-49ad-b094-b34ae1e14ac4\") " pod="openshift-ovn-kubernetes/ovnkube-node-cw6vm"
Aug 04 22:20:55.466043 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.465981    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/aae79032-9bea-47d8-8cb2-7e277f07ef6d-host-var-lib-kubelet\") pod \"multus-rzd7q\" (UID: \"aae79032-9bea-47d8-8cb2-7e277f07ef6d\") " pod="openshift-multus/multus-rzd7q"
Aug 04 22:20:55.466043 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.465999    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/708c6d09-57c2-4829-9e76-7d86874515ec-serviceca\") pod \"node-ca-xvfg9\" (UID: \"708c6d09-57c2-4829-9e76-7d86874515ec\") " pod="openshift-image-registry/node-ca-xvfg9"
Aug 04 22:20:55.466043 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.466035    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d96c63e8-991c-4331-a7fb-6f91570d0ad5-registration-dir\") pod \"aws-ebs-csi-driver-node-wtrgp\" (UID: \"d96c63e8-991c-4331-a7fb-6f91570d0ad5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wtrgp"
Aug 04 22:20:55.466405 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.466166    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9532c679-cc59-47ba-a6a3-1b88c7cc4c69-etc-systemd\") pod \"tuned-sc4f2\" (UID: \"9532c679-cc59-47ba-a6a3-1b88c7cc4c69\") " pod="openshift-cluster-node-tuning-operator/tuned-sc4f2"
Aug 04 22:20:55.466405 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.466187    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d96c63e8-991c-4331-a7fb-6f91570d0ad5-registration-dir\") pod \"aws-ebs-csi-driver-node-wtrgp\" (UID: \"d96c63e8-991c-4331-a7fb-6f91570d0ad5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wtrgp"
Aug 04 22:20:55.466405 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.466195    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/57e1c824-1681-49ad-b094-b34ae1e14ac4-run-ovn\") pod \"ovnkube-node-cw6vm\" (UID: \"57e1c824-1681-49ad-b094-b34ae1e14ac4\") " pod="openshift-ovn-kubernetes/ovnkube-node-cw6vm"
Aug 04 22:20:55.466405 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.466236    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9532c679-cc59-47ba-a6a3-1b88c7cc4c69-etc-systemd\") pod \"tuned-sc4f2\" (UID: \"9532c679-cc59-47ba-a6a3-1b88c7cc4c69\") " pod="openshift-cluster-node-tuning-operator/tuned-sc4f2"
Aug 04 22:20:55.466405 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.466258    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/aae79032-9bea-47d8-8cb2-7e277f07ef6d-cnibin\") pod \"multus-rzd7q\" (UID: \"aae79032-9bea-47d8-8cb2-7e277f07ef6d\") " pod="openshift-multus/multus-rzd7q"
Aug 04 22:20:55.466405 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.466274    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/aae79032-9bea-47d8-8cb2-7e277f07ef6d-multus-conf-dir\") pod \"multus-rzd7q\" (UID: \"aae79032-9bea-47d8-8cb2-7e277f07ef6d\") " pod="openshift-multus/multus-rzd7q"
Aug 04 22:20:55.466405 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.466297    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/bf411845-febf-4e48-a52e-ea1741aa07cb-agent-certs\") pod \"konnectivity-agent-jpxll\" (UID: \"bf411845-febf-4e48-a52e-ea1741aa07cb\") " pod="kube-system/konnectivity-agent-jpxll"
Aug 04 22:20:55.466405 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.466316    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/aae79032-9bea-47d8-8cb2-7e277f07ef6d-host-run-netns\") pod \"multus-rzd7q\" (UID: \"aae79032-9bea-47d8-8cb2-7e277f07ef6d\") " pod="openshift-multus/multus-rzd7q"
Aug 04 22:20:55.466405 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.466331    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d96c63e8-991c-4331-a7fb-6f91570d0ad5-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wtrgp\" (UID: \"d96c63e8-991c-4331-a7fb-6f91570d0ad5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wtrgp"
Aug 04 22:20:55.466405 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.466347    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1675ffcb-004e-4aa6-9f0e-8d9c4567052a-original-pull-secret\") pod \"global-pull-secret-syncer-mms2l\" (UID: \"1675ffcb-004e-4aa6-9f0e-8d9c4567052a\") " pod="kube-system/global-pull-secret-syncer-mms2l"
Aug 04 22:20:55.466405 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.466369    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9532c679-cc59-47ba-a6a3-1b88c7cc4c69-lib-modules\") pod \"tuned-sc4f2\" (UID: \"9532c679-cc59-47ba-a6a3-1b88c7cc4c69\") " pod="openshift-cluster-node-tuning-operator/tuned-sc4f2"
Aug 04 22:20:55.466405 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.466392    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/57e1c824-1681-49ad-b094-b34ae1e14ac4-env-overrides\") pod \"ovnkube-node-cw6vm\" (UID: \"57e1c824-1681-49ad-b094-b34ae1e14ac4\") " pod="openshift-ovn-kubernetes/ovnkube-node-cw6vm"
Aug 04 22:20:55.466925 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.466416    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/352301b4-da31-4c34-897a-35279eb5e2f0-tmp-dir\") pod \"node-resolver-mqwtk\" (UID: \"352301b4-da31-4c34-897a-35279eb5e2f0\") " pod="openshift-dns/node-resolver-mqwtk"
Aug 04 22:20:55.466925 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.466401    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d96c63e8-991c-4331-a7fb-6f91570d0ad5-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wtrgp\" (UID: \"d96c63e8-991c-4331-a7fb-6f91570d0ad5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wtrgp"
Aug 04 22:20:55.466925 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:20:55.466441    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 04 22:20:55.466925 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.466453    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/708c6d09-57c2-4829-9e76-7d86874515ec-serviceca\") pod \"node-ca-xvfg9\" (UID: \"708c6d09-57c2-4829-9e76-7d86874515ec\") " pod="openshift-image-registry/node-ca-xvfg9"
Aug 04 22:20:55.466925 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.466470    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1675ffcb-004e-4aa6-9f0e-8d9c4567052a-kubelet-config\") pod \"global-pull-secret-syncer-mms2l\" (UID: \"1675ffcb-004e-4aa6-9f0e-8d9c4567052a\") " pod="kube-system/global-pull-secret-syncer-mms2l"
Aug 04 22:20:55.466925 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:20:55.466540    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1675ffcb-004e-4aa6-9f0e-8d9c4567052a-original-pull-secret podName:1675ffcb-004e-4aa6-9f0e-8d9c4567052a nodeName:}" failed. No retries permitted until 2026-08-04 22:20:55.966519501 +0000 UTC m=+2.959337224 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1675ffcb-004e-4aa6-9f0e-8d9c4567052a-original-pull-secret") pod "global-pull-secret-syncer-mms2l" (UID: "1675ffcb-004e-4aa6-9f0e-8d9c4567052a") : object "kube-system"/"original-pull-secret" not registered
Aug 04 22:20:55.466925 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.466540    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9532c679-cc59-47ba-a6a3-1b88c7cc4c69-lib-modules\") pod \"tuned-sc4f2\" (UID: \"9532c679-cc59-47ba-a6a3-1b88c7cc4c69\") " pod="openshift-cluster-node-tuning-operator/tuned-sc4f2"
Aug 04 22:20:55.466925 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.466562    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1675ffcb-004e-4aa6-9f0e-8d9c4567052a-dbus\") pod \"global-pull-secret-syncer-mms2l\" (UID: \"1675ffcb-004e-4aa6-9f0e-8d9c4567052a\") " pod="kube-system/global-pull-secret-syncer-mms2l"
Aug 04 22:20:55.466925 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.466586    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9532c679-cc59-47ba-a6a3-1b88c7cc4c69-etc-sysconfig\") pod \"tuned-sc4f2\" (UID: \"9532c679-cc59-47ba-a6a3-1b88c7cc4c69\") " pod="openshift-cluster-node-tuning-operator/tuned-sc4f2"
Aug 04 22:20:55.466925 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.466581    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1675ffcb-004e-4aa6-9f0e-8d9c4567052a-kubelet-config\") pod \"global-pull-secret-syncer-mms2l\" (UID: \"1675ffcb-004e-4aa6-9f0e-8d9c4567052a\") " pod="kube-system/global-pull-secret-syncer-mms2l"
Aug 04 22:20:55.466925 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.466621    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9532c679-cc59-47ba-a6a3-1b88c7cc4c69-etc-sysconfig\") pod \"tuned-sc4f2\" (UID: \"9532c679-cc59-47ba-a6a3-1b88c7cc4c69\") " pod="openshift-cluster-node-tuning-operator/tuned-sc4f2"
Aug 04 22:20:55.466925 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.466629    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9532c679-cc59-47ba-a6a3-1b88c7cc4c69-run\") pod \"tuned-sc4f2\" (UID: \"9532c679-cc59-47ba-a6a3-1b88c7cc4c69\") " pod="openshift-cluster-node-tuning-operator/tuned-sc4f2"
Aug 04 22:20:55.466925 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.466639    2580 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Aug 04 22:20:55.466925 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.466668    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/aae79032-9bea-47d8-8cb2-7e277f07ef6d-cni-binary-copy\") pod \"multus-rzd7q\" (UID: \"aae79032-9bea-47d8-8cb2-7e277f07ef6d\") " pod="openshift-multus/multus-rzd7q"
Aug 04 22:20:55.466925 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.466714    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/aae79032-9bea-47d8-8cb2-7e277f07ef6d-host-var-lib-cni-bin\") pod \"multus-rzd7q\" (UID: \"aae79032-9bea-47d8-8cb2-7e277f07ef6d\") " pod="openshift-multus/multus-rzd7q"
Aug 04 22:20:55.466925 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.466731    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9532c679-cc59-47ba-a6a3-1b88c7cc4c69-run\") pod \"tuned-sc4f2\" (UID: \"9532c679-cc59-47ba-a6a3-1b88c7cc4c69\") " pod="openshift-cluster-node-tuning-operator/tuned-sc4f2"
Aug 04 22:20:55.466925 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.466741    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1675ffcb-004e-4aa6-9f0e-8d9c4567052a-dbus\") pod \"global-pull-secret-syncer-mms2l\" (UID: \"1675ffcb-004e-4aa6-9f0e-8d9c4567052a\") " pod="kube-system/global-pull-secret-syncer-mms2l"
Aug 04 22:20:55.466925 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.466746    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9532c679-cc59-47ba-a6a3-1b88c7cc4c69-sys\") pod \"tuned-sc4f2\" (UID: \"9532c679-cc59-47ba-a6a3-1b88c7cc4c69\") " pod="openshift-cluster-node-tuning-operator/tuned-sc4f2"
Aug 04 22:20:55.467760 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.466769    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9532c679-cc59-47ba-a6a3-1b88c7cc4c69-tmp\") pod \"tuned-sc4f2\" (UID: \"9532c679-cc59-47ba-a6a3-1b88c7cc4c69\") " pod="openshift-cluster-node-tuning-operator/tuned-sc4f2"
Aug 04 22:20:55.467760 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.466793    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gvlmd\" (UniqueName: \"kubernetes.io/projected/289f4758-62ab-4466-95cc-0ed912f1919b-kube-api-access-gvlmd\") pod \"iptables-alerter-485vg\" (UID: \"289f4758-62ab-4466-95cc-0ed912f1919b\") " pod="openshift-network-operator/iptables-alerter-485vg"
Aug 04 22:20:55.467760 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.466818    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c0c23bef-9c00-46e2-8f50-d67322ae45e6-system-cni-dir\") pod \"multus-additional-cni-plugins-p9zkw\" (UID: \"c0c23bef-9c00-46e2-8f50-d67322ae45e6\") " pod="openshift-multus/multus-additional-cni-plugins-p9zkw"
Aug 04 22:20:55.467760 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.466827    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9532c679-cc59-47ba-a6a3-1b88c7cc4c69-sys\") pod \"tuned-sc4f2\" (UID: \"9532c679-cc59-47ba-a6a3-1b88c7cc4c69\") " pod="openshift-cluster-node-tuning-operator/tuned-sc4f2"
Aug 04 22:20:55.467760 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.466837    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/352301b4-da31-4c34-897a-35279eb5e2f0-tmp-dir\") pod \"node-resolver-mqwtk\" (UID: \"352301b4-da31-4c34-897a-35279eb5e2f0\") " pod="openshift-dns/node-resolver-mqwtk"
Aug 04 22:20:55.467760 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.466844    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/57e1c824-1681-49ad-b094-b34ae1e14ac4-host-slash\") pod \"ovnkube-node-cw6vm\" (UID: \"57e1c824-1681-49ad-b094-b34ae1e14ac4\") " pod="openshift-ovn-kubernetes/ovnkube-node-cw6vm"
Aug 04 22:20:55.467760 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.466908    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/aae79032-9bea-47d8-8cb2-7e277f07ef6d-multus-cni-dir\") pod \"multus-rzd7q\" (UID: \"aae79032-9bea-47d8-8cb2-7e277f07ef6d\") " pod="openshift-multus/multus-rzd7q"
Aug 04 22:20:55.467760 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.466937    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q75g4\" (UniqueName: \"kubernetes.io/projected/352301b4-da31-4c34-897a-35279eb5e2f0-kube-api-access-q75g4\") pod \"node-resolver-mqwtk\" (UID: \"352301b4-da31-4c34-897a-35279eb5e2f0\") " pod="openshift-dns/node-resolver-mqwtk"
Aug 04 22:20:55.467760 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.466956    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wjrfs\" (UniqueName: \"kubernetes.io/projected/9532c679-cc59-47ba-a6a3-1b88c7cc4c69-kube-api-access-wjrfs\") pod \"tuned-sc4f2\" (UID: \"9532c679-cc59-47ba-a6a3-1b88c7cc4c69\") " pod="openshift-cluster-node-tuning-operator/tuned-sc4f2"
Aug 04 22:20:55.467760 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.467077    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/57e1c824-1681-49ad-b094-b34ae1e14ac4-host-run-ovn-kubernetes\") pod \"ovnkube-node-cw6vm\" (UID: \"57e1c824-1681-49ad-b094-b34ae1e14ac4\") " pod="openshift-ovn-kubernetes/ovnkube-node-cw6vm"
Aug 04 22:20:55.467760 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.467105    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/57e1c824-1681-49ad-b094-b34ae1e14ac4-ovnkube-config\") pod \"ovnkube-node-cw6vm\" (UID: \"57e1c824-1681-49ad-b094-b34ae1e14ac4\") " pod="openshift-ovn-kubernetes/ovnkube-node-cw6vm"
Aug 04 22:20:55.467760 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.467151    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9zmzr\" (UniqueName: \"kubernetes.io/projected/aae79032-9bea-47d8-8cb2-7e277f07ef6d-kube-api-access-9zmzr\") pod \"multus-rzd7q\" (UID: \"aae79032-9bea-47d8-8cb2-7e277f07ef6d\") " pod="openshift-multus/multus-rzd7q"
Aug 04 22:20:55.467760 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.467180    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/bf411845-febf-4e48-a52e-ea1741aa07cb-konnectivity-ca\") pod \"konnectivity-agent-jpxll\" (UID: \"bf411845-febf-4e48-a52e-ea1741aa07cb\") " pod="kube-system/konnectivity-agent-jpxll"
Aug 04 22:20:55.467760 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.467200    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9bd9k\" (UniqueName: \"kubernetes.io/projected/14077369-fe10-4854-8785-0bfc9addb7c4-kube-api-access-9bd9k\") pod \"network-metrics-daemon-5h46r\" (UID: \"14077369-fe10-4854-8785-0bfc9addb7c4\") " pod="openshift-multus/network-metrics-daemon-5h46r"
Aug 04 22:20:55.467760 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.467234    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/289f4758-62ab-4466-95cc-0ed912f1919b-host-slash\") pod \"iptables-alerter-485vg\" (UID: \"289f4758-62ab-4466-95cc-0ed912f1919b\") " pod="openshift-network-operator/iptables-alerter-485vg"
Aug 04 22:20:55.467760 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.467290    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/289f4758-62ab-4466-95cc-0ed912f1919b-host-slash\") pod \"iptables-alerter-485vg\" (UID: \"289f4758-62ab-4466-95cc-0ed912f1919b\") " pod="openshift-network-operator/iptables-alerter-485vg"
Aug 04 22:20:55.467760 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.467363    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/57e1c824-1681-49ad-b094-b34ae1e14ac4-var-lib-openvswitch\") pod \"ovnkube-node-cw6vm\" (UID: \"57e1c824-1681-49ad-b094-b34ae1e14ac4\") " pod="openshift-ovn-kubernetes/ovnkube-node-cw6vm"
Aug 04 22:20:55.468604 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.467428    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/57e1c824-1681-49ad-b094-b34ae1e14ac4-node-log\") pod \"ovnkube-node-cw6vm\" (UID: \"57e1c824-1681-49ad-b094-b34ae1e14ac4\") " pod="openshift-ovn-kubernetes/ovnkube-node-cw6vm"
Aug 04 22:20:55.468604 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.467459    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/aae79032-9bea-47d8-8cb2-7e277f07ef6d-system-cni-dir\") pod \"multus-rzd7q\" (UID: \"aae79032-9bea-47d8-8cb2-7e277f07ef6d\") " pod="openshift-multus/multus-rzd7q"
Aug 04 22:20:55.468604 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.467486    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/aae79032-9bea-47d8-8cb2-7e277f07ef6d-hostroot\") pod \"multus-rzd7q\" (UID: \"aae79032-9bea-47d8-8cb2-7e277f07ef6d\") " pod="openshift-multus/multus-rzd7q"
Aug 04 22:20:55.468604 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.467549    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/aae79032-9bea-47d8-8cb2-7e277f07ef6d-etc-kubernetes\") pod \"multus-rzd7q\" (UID: \"aae79032-9bea-47d8-8cb2-7e277f07ef6d\") " pod="openshift-multus/multus-rzd7q"
Aug 04 22:20:55.468604 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.467572    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c0c23bef-9c00-46e2-8f50-d67322ae45e6-cnibin\") pod \"multus-additional-cni-plugins-p9zkw\" (UID: \"c0c23bef-9c00-46e2-8f50-d67322ae45e6\") " pod="openshift-multus/multus-additional-cni-plugins-p9zkw"
Aug 04 22:20:55.468604 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.467591    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c0c23bef-9c00-46e2-8f50-d67322ae45e6-os-release\") pod \"multus-additional-cni-plugins-p9zkw\" (UID: \"c0c23bef-9c00-46e2-8f50-d67322ae45e6\") " pod="openshift-multus/multus-additional-cni-plugins-p9zkw"
Aug 04 22:20:55.468604 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.467614    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9532c679-cc59-47ba-a6a3-1b88c7cc4c69-etc-tuned\") pod \"tuned-sc4f2\" (UID: \"9532c679-cc59-47ba-a6a3-1b88c7cc4c69\") " pod="openshift-cluster-node-tuning-operator/tuned-sc4f2"
Aug 04 22:20:55.468604 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.467644    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/289f4758-62ab-4466-95cc-0ed912f1919b-iptables-alerter-script\") pod \"iptables-alerter-485vg\" (UID: \"289f4758-62ab-4466-95cc-0ed912f1919b\") " pod="openshift-network-operator/iptables-alerter-485vg"
Aug 04 22:20:55.468604 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.467748    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xb6rt\" (UniqueName: \"kubernetes.io/projected/c0c23bef-9c00-46e2-8f50-d67322ae45e6-kube-api-access-xb6rt\") pod \"multus-additional-cni-plugins-p9zkw\" (UID: \"c0c23bef-9c00-46e2-8f50-d67322ae45e6\") " pod="openshift-multus/multus-additional-cni-plugins-p9zkw"
Aug 04 22:20:55.468604 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.467778    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/57e1c824-1681-49ad-b094-b34ae1e14ac4-run-systemd\") pod \"ovnkube-node-cw6vm\" (UID: \"57e1c824-1681-49ad-b094-b34ae1e14ac4\") " pod="openshift-ovn-kubernetes/ovnkube-node-cw6vm"
Aug 04 22:20:55.468604 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.467789    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/bf411845-febf-4e48-a52e-ea1741aa07cb-konnectivity-ca\") pod \"konnectivity-agent-jpxll\" (UID: \"bf411845-febf-4e48-a52e-ea1741aa07cb\") " pod="kube-system/konnectivity-agent-jpxll"
Aug 04 22:20:55.468604 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.467809    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d96c63e8-991c-4331-a7fb-6f91570d0ad5-etc-selinux\") pod \"aws-ebs-csi-driver-node-wtrgp\" (UID: \"d96c63e8-991c-4331-a7fb-6f91570d0ad5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wtrgp"
Aug 04 22:20:55.468604 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.467838    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lcdnw\" (UniqueName: \"kubernetes.io/projected/708c6d09-57c2-4829-9e76-7d86874515ec-kube-api-access-lcdnw\") pod \"node-ca-xvfg9\" (UID: \"708c6d09-57c2-4829-9e76-7d86874515ec\") " pod="openshift-image-registry/node-ca-xvfg9"
Aug 04 22:20:55.468604 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.467878    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/352301b4-da31-4c34-897a-35279eb5e2f0-hosts-file\") pod \"node-resolver-mqwtk\" (UID: \"352301b4-da31-4c34-897a-35279eb5e2f0\") " pod="openshift-dns/node-resolver-mqwtk"
Aug 04 22:20:55.468604 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.467905    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/708c6d09-57c2-4829-9e76-7d86874515ec-host\") pod \"node-ca-xvfg9\" (UID: \"708c6d09-57c2-4829-9e76-7d86874515ec\") " pod="openshift-image-registry/node-ca-xvfg9"
Aug 04 22:20:55.468604 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.467914    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d96c63e8-991c-4331-a7fb-6f91570d0ad5-etc-selinux\") pod \"aws-ebs-csi-driver-node-wtrgp\" (UID: \"d96c63e8-991c-4331-a7fb-6f91570d0ad5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wtrgp"
Aug 04 22:20:55.468604 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.467930    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9532c679-cc59-47ba-a6a3-1b88c7cc4c69-etc-modprobe-d\") pod \"tuned-sc4f2\" (UID: \"9532c679-cc59-47ba-a6a3-1b88c7cc4c69\") " pod="openshift-cluster-node-tuning-operator/tuned-sc4f2"
Aug 04 22:20:55.469101 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.467975    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/352301b4-da31-4c34-897a-35279eb5e2f0-hosts-file\") pod \"node-resolver-mqwtk\" (UID: \"352301b4-da31-4c34-897a-35279eb5e2f0\") " pod="openshift-dns/node-resolver-mqwtk"
Aug 04 22:20:55.469101 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.468005    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/57e1c824-1681-49ad-b094-b34ae1e14ac4-run-openvswitch\") pod \"ovnkube-node-cw6vm\" (UID: \"57e1c824-1681-49ad-b094-b34ae1e14ac4\") " pod="openshift-ovn-kubernetes/ovnkube-node-cw6vm"
Aug 04 22:20:55.469101 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.468016    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9532c679-cc59-47ba-a6a3-1b88c7cc4c69-etc-modprobe-d\") pod \"tuned-sc4f2\" (UID: \"9532c679-cc59-47ba-a6a3-1b88c7cc4c69\") " pod="openshift-cluster-node-tuning-operator/tuned-sc4f2"
Aug 04 22:20:55.469101 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.468032    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/aae79032-9bea-47d8-8cb2-7e277f07ef6d-multus-socket-dir-parent\") pod \"multus-rzd7q\" (UID: \"aae79032-9bea-47d8-8cb2-7e277f07ef6d\") " pod="openshift-multus/multus-rzd7q"
Aug 04 22:20:55.469101 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.468065    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/708c6d09-57c2-4829-9e76-7d86874515ec-host\") pod \"node-ca-xvfg9\" (UID: \"708c6d09-57c2-4829-9e76-7d86874515ec\") " pod="openshift-image-registry/node-ca-xvfg9"
Aug 04 22:20:55.469101 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.468070    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d96c63e8-991c-4331-a7fb-6f91570d0ad5-device-dir\") pod \"aws-ebs-csi-driver-node-wtrgp\" (UID: \"d96c63e8-991c-4331-a7fb-6f91570d0ad5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wtrgp"
Aug 04 22:20:55.469101 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.468111    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d96c63e8-991c-4331-a7fb-6f91570d0ad5-device-dir\") pod \"aws-ebs-csi-driver-node-wtrgp\" (UID: \"d96c63e8-991c-4331-a7fb-6f91570d0ad5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wtrgp"
Aug 04 22:20:55.469101 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.468111    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/14077369-fe10-4854-8785-0bfc9addb7c4-metrics-certs\") pod \"network-metrics-daemon-5h46r\" (UID: \"14077369-fe10-4854-8785-0bfc9addb7c4\") " pod="openshift-multus/network-metrics-daemon-5h46r"
Aug 04 22:20:55.469101 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.468153    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/289f4758-62ab-4466-95cc-0ed912f1919b-iptables-alerter-script\") pod \"iptables-alerter-485vg\" (UID: \"289f4758-62ab-4466-95cc-0ed912f1919b\") " pod="openshift-network-operator/iptables-alerter-485vg"
Aug 04 22:20:55.469101 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.468165    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9532c679-cc59-47ba-a6a3-1b88c7cc4c69-var-lib-kubelet\") pod \"tuned-sc4f2\" (UID: \"9532c679-cc59-47ba-a6a3-1b88c7cc4c69\") " pod="openshift-cluster-node-tuning-operator/tuned-sc4f2"
Aug 04 22:20:55.469101 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.468202    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9532c679-cc59-47ba-a6a3-1b88c7cc4c69-host\") pod \"tuned-sc4f2\" (UID: \"9532c679-cc59-47ba-a6a3-1b88c7cc4c69\") " pod="openshift-cluster-node-tuning-operator/tuned-sc4f2"
Aug 04 22:20:55.469101 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.468223    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c0c23bef-9c00-46e2-8f50-d67322ae45e6-tuning-conf-dir\") pod \"multus-additional-cni-plugins-p9zkw\" (UID: \"c0c23bef-9c00-46e2-8f50-d67322ae45e6\") " pod="openshift-multus/multus-additional-cni-plugins-p9zkw"
Aug 04 22:20:55.469101 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:20:55.468226    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 22:20:55.469101 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.468243    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/57e1c824-1681-49ad-b094-b34ae1e14ac4-systemd-units\") pod \"ovnkube-node-cw6vm\" (UID: \"57e1c824-1681-49ad-b094-b34ae1e14ac4\") " pod="openshift-ovn-kubernetes/ovnkube-node-cw6vm"
Aug 04 22:20:55.469101 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.468269    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/57e1c824-1681-49ad-b094-b34ae1e14ac4-host-run-netns\") pod \"ovnkube-node-cw6vm\" (UID: \"57e1c824-1681-49ad-b094-b34ae1e14ac4\") " pod="openshift-ovn-kubernetes/ovnkube-node-cw6vm"
Aug 04 22:20:55.469101 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:20:55.468281    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14077369-fe10-4854-8785-0bfc9addb7c4-metrics-certs podName:14077369-fe10-4854-8785-0bfc9addb7c4 nodeName:}" failed. No retries permitted until 2026-08-04 22:20:55.968266984 +0000 UTC m=+2.961084705 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/14077369-fe10-4854-8785-0bfc9addb7c4-metrics-certs") pod "network-metrics-daemon-5h46r" (UID: "14077369-fe10-4854-8785-0bfc9addb7c4") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 22:20:55.469101 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.468271    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9532c679-cc59-47ba-a6a3-1b88c7cc4c69-var-lib-kubelet\") pod \"tuned-sc4f2\" (UID: \"9532c679-cc59-47ba-a6a3-1b88c7cc4c69\") " pod="openshift-cluster-node-tuning-operator/tuned-sc4f2"
Aug 04 22:20:55.469604 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.468298    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9532c679-cc59-47ba-a6a3-1b88c7cc4c69-host\") pod \"tuned-sc4f2\" (UID: \"9532c679-cc59-47ba-a6a3-1b88c7cc4c69\") " pod="openshift-cluster-node-tuning-operator/tuned-sc4f2"
Aug 04 22:20:55.469604 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.468315    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/57e1c824-1681-49ad-b094-b34ae1e14ac4-host-cni-bin\") pod \"ovnkube-node-cw6vm\" (UID: \"57e1c824-1681-49ad-b094-b34ae1e14ac4\") " pod="openshift-ovn-kubernetes/ovnkube-node-cw6vm"
Aug 04 22:20:55.469604 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.468346    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/57e1c824-1681-49ad-b094-b34ae1e14ac4-host-cni-netd\") pod \"ovnkube-node-cw6vm\" (UID: \"57e1c824-1681-49ad-b094-b34ae1e14ac4\") " pod="openshift-ovn-kubernetes/ovnkube-node-cw6vm"
Aug 04 22:20:55.469604 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.468369    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-97vnt\" (UniqueName: \"kubernetes.io/projected/57e1c824-1681-49ad-b094-b34ae1e14ac4-kube-api-access-97vnt\") pod \"ovnkube-node-cw6vm\" (UID: \"57e1c824-1681-49ad-b094-b34ae1e14ac4\") " pod="openshift-ovn-kubernetes/ovnkube-node-cw6vm"
Aug 04 22:20:55.469604 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.468392    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/aae79032-9bea-47d8-8cb2-7e277f07ef6d-os-release\") pod \"multus-rzd7q\" (UID: \"aae79032-9bea-47d8-8cb2-7e277f07ef6d\") " pod="openshift-multus/multus-rzd7q"
Aug 04 22:20:55.469604 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.468414    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/aae79032-9bea-47d8-8cb2-7e277f07ef6d-host-run-k8s-cni-cncf-io\") pod \"multus-rzd7q\" (UID: \"aae79032-9bea-47d8-8cb2-7e277f07ef6d\") " pod="openshift-multus/multus-rzd7q"
Aug 04 22:20:55.469604 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.468437    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9532c679-cc59-47ba-a6a3-1b88c7cc4c69-etc-sysctl-conf\") pod \"tuned-sc4f2\" (UID: \"9532c679-cc59-47ba-a6a3-1b88c7cc4c69\") " pod="openshift-cluster-node-tuning-operator/tuned-sc4f2"
Aug 04 22:20:55.469604 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.468459    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d96c63e8-991c-4331-a7fb-6f91570d0ad5-socket-dir\") pod \"aws-ebs-csi-driver-node-wtrgp\" (UID: \"d96c63e8-991c-4331-a7fb-6f91570d0ad5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wtrgp"
Aug 04 22:20:55.469604 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.468481    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c0c23bef-9c00-46e2-8f50-d67322ae45e6-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-p9zkw\" (UID: \"c0c23bef-9c00-46e2-8f50-d67322ae45e6\") " pod="openshift-multus/multus-additional-cni-plugins-p9zkw"
Aug 04 22:20:55.469604 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.468497    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/57e1c824-1681-49ad-b094-b34ae1e14ac4-log-socket\") pod \"ovnkube-node-cw6vm\" (UID: \"57e1c824-1681-49ad-b094-b34ae1e14ac4\") " pod="openshift-ovn-kubernetes/ovnkube-node-cw6vm"
Aug 04 22:20:55.469604 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.468542    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9532c679-cc59-47ba-a6a3-1b88c7cc4c69-etc-sysctl-conf\") pod \"tuned-sc4f2\" (UID: \"9532c679-cc59-47ba-a6a3-1b88c7cc4c69\") " pod="openshift-cluster-node-tuning-operator/tuned-sc4f2"
Aug 04 22:20:55.469604 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.468577    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d96c63e8-991c-4331-a7fb-6f91570d0ad5-socket-dir\") pod \"aws-ebs-csi-driver-node-wtrgp\" (UID: \"d96c63e8-991c-4331-a7fb-6f91570d0ad5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wtrgp"
Aug 04 22:20:55.470085 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.469885    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9532c679-cc59-47ba-a6a3-1b88c7cc4c69-tmp\") pod \"tuned-sc4f2\" (UID: \"9532c679-cc59-47ba-a6a3-1b88c7cc4c69\") " pod="openshift-cluster-node-tuning-operator/tuned-sc4f2"
Aug 04 22:20:55.470085 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.469916    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9532c679-cc59-47ba-a6a3-1b88c7cc4c69-etc-tuned\") pod \"tuned-sc4f2\" (UID: \"9532c679-cc59-47ba-a6a3-1b88c7cc4c69\") " pod="openshift-cluster-node-tuning-operator/tuned-sc4f2"
Aug 04 22:20:55.470280 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.470262    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/bf411845-febf-4e48-a52e-ea1741aa07cb-agent-certs\") pod \"konnectivity-agent-jpxll\" (UID: \"bf411845-febf-4e48-a52e-ea1741aa07cb\") " pod="kube-system/konnectivity-agent-jpxll"
Aug 04 22:20:55.472530 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.472512    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qgdwv\" (UniqueName: \"kubernetes.io/projected/d96c63e8-991c-4331-a7fb-6f91570d0ad5-kube-api-access-qgdwv\") pod \"aws-ebs-csi-driver-node-wtrgp\" (UID: \"d96c63e8-991c-4331-a7fb-6f91570d0ad5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wtrgp"
Aug 04 22:20:55.480315 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.480288    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gvlmd\" (UniqueName: \"kubernetes.io/projected/289f4758-62ab-4466-95cc-0ed912f1919b-kube-api-access-gvlmd\") pod \"iptables-alerter-485vg\" (UID: \"289f4758-62ab-4466-95cc-0ed912f1919b\") " pod="openshift-network-operator/iptables-alerter-485vg"
Aug 04 22:20:55.481270 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.481245    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lcdnw\" (UniqueName: \"kubernetes.io/projected/708c6d09-57c2-4829-9e76-7d86874515ec-kube-api-access-lcdnw\") pod \"node-ca-xvfg9\" (UID: \"708c6d09-57c2-4829-9e76-7d86874515ec\") " pod="openshift-image-registry/node-ca-xvfg9"
Aug 04 22:20:55.481352 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.481261    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wjrfs\" (UniqueName: \"kubernetes.io/projected/9532c679-cc59-47ba-a6a3-1b88c7cc4c69-kube-api-access-wjrfs\") pod \"tuned-sc4f2\" (UID: \"9532c679-cc59-47ba-a6a3-1b88c7cc4c69\") " pod="openshift-cluster-node-tuning-operator/tuned-sc4f2"
Aug 04 22:20:55.481560 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.481542    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9bd9k\" (UniqueName: \"kubernetes.io/projected/14077369-fe10-4854-8785-0bfc9addb7c4-kube-api-access-9bd9k\") pod \"network-metrics-daemon-5h46r\" (UID: \"14077369-fe10-4854-8785-0bfc9addb7c4\") " pod="openshift-multus/network-metrics-daemon-5h46r"
Aug 04 22:20:55.481620 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.481602    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q75g4\" (UniqueName: \"kubernetes.io/projected/352301b4-da31-4c34-897a-35279eb5e2f0-kube-api-access-q75g4\") pod \"node-resolver-mqwtk\" (UID: \"352301b4-da31-4c34-897a-35279eb5e2f0\") " pod="openshift-dns/node-resolver-mqwtk"
Aug 04 22:20:55.498371 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.498302    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-117.ec2.internal" event={"ID":"0ee3ab39f425114f43135622c74f665d","Type":"ContainerStarted","Data":"c4f5050c7d6c52a4e460e9c6f1ee872b04294b2ee8daf2b4f4f4c0eecefb11a5"}
Aug 04 22:20:55.499393 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.499365    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-117.ec2.internal" event={"ID":"8c189592264ca39220dc93ea9c07921f","Type":"ContainerStarted","Data":"a8f04c38cadfd7aa2eb4ab27f9483ebc3f90ca1dd35fc373af350d8a206d53e5"}
Aug 04 22:20:55.569371 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.569339    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/57e1c824-1681-49ad-b094-b34ae1e14ac4-run-openvswitch\") pod \"ovnkube-node-cw6vm\" (UID: \"57e1c824-1681-49ad-b094-b34ae1e14ac4\") " pod="openshift-ovn-kubernetes/ovnkube-node-cw6vm"
Aug 04 22:20:55.569540 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.569383    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/aae79032-9bea-47d8-8cb2-7e277f07ef6d-multus-socket-dir-parent\") pod \"multus-rzd7q\" (UID: \"aae79032-9bea-47d8-8cb2-7e277f07ef6d\") " pod="openshift-multus/multus-rzd7q"
Aug 04 22:20:55.569540 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.569419    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c0c23bef-9c00-46e2-8f50-d67322ae45e6-tuning-conf-dir\") pod \"multus-additional-cni-plugins-p9zkw\" (UID: \"c0c23bef-9c00-46e2-8f50-d67322ae45e6\") " pod="openshift-multus/multus-additional-cni-plugins-p9zkw"
Aug 04 22:20:55.569540 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.569433    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/57e1c824-1681-49ad-b094-b34ae1e14ac4-run-openvswitch\") pod \"ovnkube-node-cw6vm\" (UID: \"57e1c824-1681-49ad-b094-b34ae1e14ac4\") " pod="openshift-ovn-kubernetes/ovnkube-node-cw6vm"
Aug 04 22:20:55.569540 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.569494    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/aae79032-9bea-47d8-8cb2-7e277f07ef6d-multus-socket-dir-parent\") pod \"multus-rzd7q\" (UID: \"aae79032-9bea-47d8-8cb2-7e277f07ef6d\") " pod="openshift-multus/multus-rzd7q"
Aug 04 22:20:55.569540 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.569495    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/57e1c824-1681-49ad-b094-b34ae1e14ac4-systemd-units\") pod \"ovnkube-node-cw6vm\" (UID: \"57e1c824-1681-49ad-b094-b34ae1e14ac4\") " pod="openshift-ovn-kubernetes/ovnkube-node-cw6vm"
Aug 04 22:20:55.569540 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.569443    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/57e1c824-1681-49ad-b094-b34ae1e14ac4-systemd-units\") pod \"ovnkube-node-cw6vm\" (UID: \"57e1c824-1681-49ad-b094-b34ae1e14ac4\") " pod="openshift-ovn-kubernetes/ovnkube-node-cw6vm"
Aug 04 22:20:55.569540 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.569539    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/57e1c824-1681-49ad-b094-b34ae1e14ac4-host-run-netns\") pod \"ovnkube-node-cw6vm\" (UID: \"57e1c824-1681-49ad-b094-b34ae1e14ac4\") " pod="openshift-ovn-kubernetes/ovnkube-node-cw6vm"
Aug 04 22:20:55.569850 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.569562    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/57e1c824-1681-49ad-b094-b34ae1e14ac4-host-cni-bin\") pod \"ovnkube-node-cw6vm\" (UID: \"57e1c824-1681-49ad-b094-b34ae1e14ac4\") " pod="openshift-ovn-kubernetes/ovnkube-node-cw6vm"
Aug 04 22:20:55.569850 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.569582    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/57e1c824-1681-49ad-b094-b34ae1e14ac4-host-cni-netd\") pod \"ovnkube-node-cw6vm\" (UID: \"57e1c824-1681-49ad-b094-b34ae1e14ac4\") " pod="openshift-ovn-kubernetes/ovnkube-node-cw6vm"
Aug 04 22:20:55.569850 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.569603    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-97vnt\" (UniqueName: \"kubernetes.io/projected/57e1c824-1681-49ad-b094-b34ae1e14ac4-kube-api-access-97vnt\") pod \"ovnkube-node-cw6vm\" (UID: \"57e1c824-1681-49ad-b094-b34ae1e14ac4\") " pod="openshift-ovn-kubernetes/ovnkube-node-cw6vm"
Aug 04 22:20:55.569850 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.569618    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/aae79032-9bea-47d8-8cb2-7e277f07ef6d-os-release\") pod \"multus-rzd7q\" (UID: \"aae79032-9bea-47d8-8cb2-7e277f07ef6d\") " pod="openshift-multus/multus-rzd7q"
Aug 04 22:20:55.569850 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.569632    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/aae79032-9bea-47d8-8cb2-7e277f07ef6d-host-run-k8s-cni-cncf-io\") pod \"multus-rzd7q\" (UID: \"aae79032-9bea-47d8-8cb2-7e277f07ef6d\") " pod="openshift-multus/multus-rzd7q"
Aug 04 22:20:55.569850 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.569649    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c0c23bef-9c00-46e2-8f50-d67322ae45e6-tuning-conf-dir\") pod \"multus-additional-cni-plugins-p9zkw\" (UID: \"c0c23bef-9c00-46e2-8f50-d67322ae45e6\") " pod="openshift-multus/multus-additional-cni-plugins-p9zkw"
Aug 04 22:20:55.569850 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.569658    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c0c23bef-9c00-46e2-8f50-d67322ae45e6-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-p9zkw\" (UID: \"c0c23bef-9c00-46e2-8f50-d67322ae45e6\") " pod="openshift-multus/multus-additional-cni-plugins-p9zkw"
Aug 04 22:20:55.569850 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.569685    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/57e1c824-1681-49ad-b094-b34ae1e14ac4-host-run-netns\") pod \"ovnkube-node-cw6vm\" (UID: \"57e1c824-1681-49ad-b094-b34ae1e14ac4\") " pod="openshift-ovn-kubernetes/ovnkube-node-cw6vm"
Aug 04 22:20:55.569850 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.569689    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/57e1c824-1681-49ad-b094-b34ae1e14ac4-host-cni-bin\") pod \"ovnkube-node-cw6vm\" (UID: \"57e1c824-1681-49ad-b094-b34ae1e14ac4\") " pod="openshift-ovn-kubernetes/ovnkube-node-cw6vm"
Aug 04 22:20:55.569850 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.569739    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/aae79032-9bea-47d8-8cb2-7e277f07ef6d-host-run-k8s-cni-cncf-io\") pod \"multus-rzd7q\" (UID: \"aae79032-9bea-47d8-8cb2-7e277f07ef6d\") " pod="openshift-multus/multus-rzd7q"
Aug 04 22:20:55.569850 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.569743    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/aae79032-9bea-47d8-8cb2-7e277f07ef6d-os-release\") pod \"multus-rzd7q\" (UID: \"aae79032-9bea-47d8-8cb2-7e277f07ef6d\") " pod="openshift-multus/multus-rzd7q"
Aug 04 22:20:55.570438 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.569861    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/57e1c824-1681-49ad-b094-b34ae1e14ac4-log-socket\") pod \"ovnkube-node-cw6vm\" (UID: \"57e1c824-1681-49ad-b094-b34ae1e14ac4\") " pod="openshift-ovn-kubernetes/ovnkube-node-cw6vm"
Aug 04 22:20:55.570438 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.569895    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/57e1c824-1681-49ad-b094-b34ae1e14ac4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cw6vm\" (UID: \"57e1c824-1681-49ad-b094-b34ae1e14ac4\") " pod="openshift-ovn-kubernetes/ovnkube-node-cw6vm"
Aug 04 22:20:55.570438 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.569924    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/57e1c824-1681-49ad-b094-b34ae1e14ac4-ovn-node-metrics-cert\") pod \"ovnkube-node-cw6vm\" (UID: \"57e1c824-1681-49ad-b094-b34ae1e14ac4\") " pod="openshift-ovn-kubernetes/ovnkube-node-cw6vm"
Aug 04 22:20:55.570438 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.569950    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/aae79032-9bea-47d8-8cb2-7e277f07ef6d-host-var-lib-cni-multus\") pod \"multus-rzd7q\" (UID: \"aae79032-9bea-47d8-8cb2-7e277f07ef6d\") " pod="openshift-multus/multus-rzd7q"
Aug 04 22:20:55.570438 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.569966    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/57e1c824-1681-49ad-b094-b34ae1e14ac4-host-cni-netd\") pod \"ovnkube-node-cw6vm\" (UID: \"57e1c824-1681-49ad-b094-b34ae1e14ac4\") " pod="openshift-ovn-kubernetes/ovnkube-node-cw6vm"
Aug 04 22:20:55.570438 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.569973    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/aae79032-9bea-47d8-8cb2-7e277f07ef6d-multus-daemon-config\") pod \"multus-rzd7q\" (UID: \"aae79032-9bea-47d8-8cb2-7e277f07ef6d\") " pod="openshift-multus/multus-rzd7q"
Aug 04 22:20:55.570438 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.570010    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c0c23bef-9c00-46e2-8f50-d67322ae45e6-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-p9zkw\" (UID: \"c0c23bef-9c00-46e2-8f50-d67322ae45e6\") " pod="openshift-multus/multus-additional-cni-plugins-p9zkw"
Aug 04 22:20:55.570438 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.570020    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/57e1c824-1681-49ad-b094-b34ae1e14ac4-log-socket\") pod \"ovnkube-node-cw6vm\" (UID: \"57e1c824-1681-49ad-b094-b34ae1e14ac4\") " pod="openshift-ovn-kubernetes/ovnkube-node-cw6vm"
Aug 04 22:20:55.570438 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.570037    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ltxhz\" (UniqueName: \"kubernetes.io/projected/d04f70b8-d937-4f47-aa63-ee118a743487-kube-api-access-ltxhz\") pod \"network-check-target-64rgt\" (UID: \"d04f70b8-d937-4f47-aa63-ee118a743487\") " pod="openshift-network-diagnostics/network-check-target-64rgt"
Aug 04 22:20:55.570438 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.570059    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/57e1c824-1681-49ad-b094-b34ae1e14ac4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cw6vm\" (UID: \"57e1c824-1681-49ad-b094-b34ae1e14ac4\") " pod="openshift-ovn-kubernetes/ovnkube-node-cw6vm"
Aug 04 22:20:55.570438 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.570062    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/57e1c824-1681-49ad-b094-b34ae1e14ac4-ovnkube-script-lib\") pod \"ovnkube-node-cw6vm\" (UID: \"57e1c824-1681-49ad-b094-b34ae1e14ac4\") " pod="openshift-ovn-kubernetes/ovnkube-node-cw6vm"
Aug 04 22:20:55.570438 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.570107    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/aae79032-9bea-47d8-8cb2-7e277f07ef6d-host-run-multus-certs\") pod \"multus-rzd7q\" (UID: \"aae79032-9bea-47d8-8cb2-7e277f07ef6d\") " pod="openshift-multus/multus-rzd7q"
Aug 04 22:20:55.570438 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.570174    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c0c23bef-9c00-46e2-8f50-d67322ae45e6-cni-binary-copy\") pod \"multus-additional-cni-plugins-p9zkw\" (UID: \"c0c23bef-9c00-46e2-8f50-d67322ae45e6\") " pod="openshift-multus/multus-additional-cni-plugins-p9zkw"
Aug 04 22:20:55.570438 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.570194    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/57e1c824-1681-49ad-b094-b34ae1e14ac4-host-kubelet\") pod \"ovnkube-node-cw6vm\" (UID: \"57e1c824-1681-49ad-b094-b34ae1e14ac4\") " pod="openshift-ovn-kubernetes/ovnkube-node-cw6vm"
Aug 04 22:20:55.570438 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.570218    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/57e1c824-1681-49ad-b094-b34ae1e14ac4-etc-openvswitch\") pod \"ovnkube-node-cw6vm\" (UID: \"57e1c824-1681-49ad-b094-b34ae1e14ac4\") " pod="openshift-ovn-kubernetes/ovnkube-node-cw6vm"
Aug 04 22:20:55.570438 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.570241    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/aae79032-9bea-47d8-8cb2-7e277f07ef6d-host-var-lib-kubelet\") pod \"multus-rzd7q\" (UID: \"aae79032-9bea-47d8-8cb2-7e277f07ef6d\") " pod="openshift-multus/multus-rzd7q"
Aug 04 22:20:55.570438 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.570267    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/57e1c824-1681-49ad-b094-b34ae1e14ac4-run-ovn\") pod \"ovnkube-node-cw6vm\" (UID: \"57e1c824-1681-49ad-b094-b34ae1e14ac4\") " pod="openshift-ovn-kubernetes/ovnkube-node-cw6vm"
Aug 04 22:20:55.571242 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.570289    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/aae79032-9bea-47d8-8cb2-7e277f07ef6d-cnibin\") pod \"multus-rzd7q\" (UID: \"aae79032-9bea-47d8-8cb2-7e277f07ef6d\") " pod="openshift-multus/multus-rzd7q"
Aug 04 22:20:55.571242 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.570318    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/aae79032-9bea-47d8-8cb2-7e277f07ef6d-multus-conf-dir\") pod \"multus-rzd7q\" (UID: \"aae79032-9bea-47d8-8cb2-7e277f07ef6d\") " pod="openshift-multus/multus-rzd7q"
Aug 04 22:20:55.571242 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.570342    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/aae79032-9bea-47d8-8cb2-7e277f07ef6d-host-run-netns\") pod \"multus-rzd7q\" (UID: \"aae79032-9bea-47d8-8cb2-7e277f07ef6d\") " pod="openshift-multus/multus-rzd7q"
Aug 04 22:20:55.571242 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.570380    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/57e1c824-1681-49ad-b094-b34ae1e14ac4-env-overrides\") pod \"ovnkube-node-cw6vm\" (UID: \"57e1c824-1681-49ad-b094-b34ae1e14ac4\") " pod="openshift-ovn-kubernetes/ovnkube-node-cw6vm"
Aug 04 22:20:55.571242 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.570413    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/aae79032-9bea-47d8-8cb2-7e277f07ef6d-cni-binary-copy\") pod \"multus-rzd7q\" (UID: \"aae79032-9bea-47d8-8cb2-7e277f07ef6d\") " pod="openshift-multus/multus-rzd7q"
Aug 04 22:20:55.571242 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.570443    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/aae79032-9bea-47d8-8cb2-7e277f07ef6d-host-var-lib-cni-bin\") pod \"multus-rzd7q\" (UID: \"aae79032-9bea-47d8-8cb2-7e277f07ef6d\") " pod="openshift-multus/multus-rzd7q"
Aug 04 22:20:55.571242 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.570473    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c0c23bef-9c00-46e2-8f50-d67322ae45e6-system-cni-dir\") pod \"multus-additional-cni-plugins-p9zkw\" (UID: \"c0c23bef-9c00-46e2-8f50-d67322ae45e6\") " pod="openshift-multus/multus-additional-cni-plugins-p9zkw"
Aug 04 22:20:55.571242 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.570480    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c0c23bef-9c00-46e2-8f50-d67322ae45e6-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-p9zkw\" (UID: \"c0c23bef-9c00-46e2-8f50-d67322ae45e6\") " pod="openshift-multus/multus-additional-cni-plugins-p9zkw"
Aug 04 22:20:55.571242 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.570497    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/57e1c824-1681-49ad-b094-b34ae1e14ac4-host-slash\") pod \"ovnkube-node-cw6vm\" (UID: \"57e1c824-1681-49ad-b094-b34ae1e14ac4\") " pod="openshift-ovn-kubernetes/ovnkube-node-cw6vm"
Aug 04 22:20:55.571242 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.570535    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/aae79032-9bea-47d8-8cb2-7e277f07ef6d-multus-cni-dir\") pod \"multus-rzd7q\" (UID: \"aae79032-9bea-47d8-8cb2-7e277f07ef6d\") " pod="openshift-multus/multus-rzd7q"
Aug 04 22:20:55.571242 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.570570    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/aae79032-9bea-47d8-8cb2-7e277f07ef6d-host-run-multus-certs\") pod \"multus-rzd7q\" (UID: \"aae79032-9bea-47d8-8cb2-7e277f07ef6d\") " pod="openshift-multus/multus-rzd7q"
Aug 04 22:20:55.571242 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.570582    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/57e1c824-1681-49ad-b094-b34ae1e14ac4-host-run-ovn-kubernetes\") pod \"ovnkube-node-cw6vm\" (UID: \"57e1c824-1681-49ad-b094-b34ae1e14ac4\") " pod="openshift-ovn-kubernetes/ovnkube-node-cw6vm"
Aug 04 22:20:55.571242 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.570612    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/57e1c824-1681-49ad-b094-b34ae1e14ac4-ovnkube-config\") pod \"ovnkube-node-cw6vm\" (UID: \"57e1c824-1681-49ad-b094-b34ae1e14ac4\") " pod="openshift-ovn-kubernetes/ovnkube-node-cw6vm"
Aug 04 22:20:55.571242 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.570636    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9zmzr\" (UniqueName: \"kubernetes.io/projected/aae79032-9bea-47d8-8cb2-7e277f07ef6d-kube-api-access-9zmzr\") pod \"multus-rzd7q\" (UID: \"aae79032-9bea-47d8-8cb2-7e277f07ef6d\") " pod="openshift-multus/multus-rzd7q"
Aug 04 22:20:55.571242 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.570668    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/57e1c824-1681-49ad-b094-b34ae1e14ac4-var-lib-openvswitch\") pod \"ovnkube-node-cw6vm\" (UID: \"57e1c824-1681-49ad-b094-b34ae1e14ac4\") " pod="openshift-ovn-kubernetes/ovnkube-node-cw6vm"
Aug 04 22:20:55.571242 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.570684    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/57e1c824-1681-49ad-b094-b34ae1e14ac4-node-log\") pod \"ovnkube-node-cw6vm\" (UID: \"57e1c824-1681-49ad-b094-b34ae1e14ac4\") " pod="openshift-ovn-kubernetes/ovnkube-node-cw6vm"
Aug 04 22:20:55.571242 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.570718    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/aae79032-9bea-47d8-8cb2-7e277f07ef6d-system-cni-dir\") pod \"multus-rzd7q\" (UID: \"aae79032-9bea-47d8-8cb2-7e277f07ef6d\") " pod="openshift-multus/multus-rzd7q"
Aug 04 22:20:55.571242 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.570743    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/aae79032-9bea-47d8-8cb2-7e277f07ef6d-hostroot\") pod \"multus-rzd7q\" (UID: \"aae79032-9bea-47d8-8cb2-7e277f07ef6d\") " pod="openshift-multus/multus-rzd7q"
Aug 04 22:20:55.572035 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.570758    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/aae79032-9bea-47d8-8cb2-7e277f07ef6d-etc-kubernetes\") pod \"multus-rzd7q\" (UID: \"aae79032-9bea-47d8-8cb2-7e277f07ef6d\") " pod="openshift-multus/multus-rzd7q"
Aug 04 22:20:55.572035 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.570756    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/57e1c824-1681-49ad-b094-b34ae1e14ac4-ovnkube-script-lib\") pod \"ovnkube-node-cw6vm\" (UID: \"57e1c824-1681-49ad-b094-b34ae1e14ac4\") " pod="openshift-ovn-kubernetes/ovnkube-node-cw6vm"
Aug 04 22:20:55.572035 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.570775    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c0c23bef-9c00-46e2-8f50-d67322ae45e6-cnibin\") pod \"multus-additional-cni-plugins-p9zkw\" (UID: \"c0c23bef-9c00-46e2-8f50-d67322ae45e6\") " pod="openshift-multus/multus-additional-cni-plugins-p9zkw"
Aug 04 22:20:55.572035 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.570803    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c0c23bef-9c00-46e2-8f50-d67322ae45e6-cnibin\") pod \"multus-additional-cni-plugins-p9zkw\" (UID: \"c0c23bef-9c00-46e2-8f50-d67322ae45e6\") " pod="openshift-multus/multus-additional-cni-plugins-p9zkw"
Aug 04 22:20:55.572035 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.570812    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c0c23bef-9c00-46e2-8f50-d67322ae45e6-os-release\") pod \"multus-additional-cni-plugins-p9zkw\" (UID: \"c0c23bef-9c00-46e2-8f50-d67322ae45e6\") " pod="openshift-multus/multus-additional-cni-plugins-p9zkw"
Aug 04 22:20:55.572035 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.570845    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xb6rt\" (UniqueName: \"kubernetes.io/projected/c0c23bef-9c00-46e2-8f50-d67322ae45e6-kube-api-access-xb6rt\") pod \"multus-additional-cni-plugins-p9zkw\" (UID: \"c0c23bef-9c00-46e2-8f50-d67322ae45e6\") " pod="openshift-multus/multus-additional-cni-plugins-p9zkw"
Aug 04 22:20:55.572035 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.570866    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/57e1c824-1681-49ad-b094-b34ae1e14ac4-host-run-ovn-kubernetes\") pod \"ovnkube-node-cw6vm\" (UID: \"57e1c824-1681-49ad-b094-b34ae1e14ac4\") " pod="openshift-ovn-kubernetes/ovnkube-node-cw6vm"
Aug 04 22:20:55.572035 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.570535    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/57e1c824-1681-49ad-b094-b34ae1e14ac4-host-slash\") pod \"ovnkube-node-cw6vm\" (UID: \"57e1c824-1681-49ad-b094-b34ae1e14ac4\") " pod="openshift-ovn-kubernetes/ovnkube-node-cw6vm"
Aug 04 22:20:55.572035 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.570872    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/57e1c824-1681-49ad-b094-b34ae1e14ac4-run-systemd\") pod \"ovnkube-node-cw6vm\" (UID: \"57e1c824-1681-49ad-b094-b34ae1e14ac4\") " pod="openshift-ovn-kubernetes/ovnkube-node-cw6vm"
Aug 04 22:20:55.572035 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.570957    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/aae79032-9bea-47d8-8cb2-7e277f07ef6d-multus-daemon-config\") pod \"multus-rzd7q\" (UID: \"aae79032-9bea-47d8-8cb2-7e277f07ef6d\") " pod="openshift-multus/multus-rzd7q"
Aug 04 22:20:55.572035 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.570848    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/aae79032-9bea-47d8-8cb2-7e277f07ef6d-multus-cni-dir\") pod \"multus-rzd7q\" (UID: \"aae79032-9bea-47d8-8cb2-7e277f07ef6d\") " pod="openshift-multus/multus-rzd7q"
Aug 04 22:20:55.572035 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.570964    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/57e1c824-1681-49ad-b094-b34ae1e14ac4-run-systemd\") pod \"ovnkube-node-cw6vm\" (UID: \"57e1c824-1681-49ad-b094-b34ae1e14ac4\") " pod="openshift-ovn-kubernetes/ovnkube-node-cw6vm"
Aug 04 22:20:55.572035 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.571042    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c0c23bef-9c00-46e2-8f50-d67322ae45e6-os-release\") pod \"multus-additional-cni-plugins-p9zkw\" (UID: \"c0c23bef-9c00-46e2-8f50-d67322ae45e6\") " pod="openshift-multus/multus-additional-cni-plugins-p9zkw"
Aug 04 22:20:55.572035 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.570019    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/aae79032-9bea-47d8-8cb2-7e277f07ef6d-host-var-lib-cni-multus\") pod \"multus-rzd7q\" (UID: \"aae79032-9bea-47d8-8cb2-7e277f07ef6d\") " pod="openshift-multus/multus-rzd7q"
Aug 04 22:20:55.572035 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.571122    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/aae79032-9bea-47d8-8cb2-7e277f07ef6d-multus-conf-dir\") pod \"multus-rzd7q\" (UID: \"aae79032-9bea-47d8-8cb2-7e277f07ef6d\") " pod="openshift-multus/multus-rzd7q"
Aug 04 22:20:55.572035 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.571181    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/57e1c824-1681-49ad-b094-b34ae1e14ac4-host-kubelet\") pod \"ovnkube-node-cw6vm\" (UID: \"57e1c824-1681-49ad-b094-b34ae1e14ac4\") " pod="openshift-ovn-kubernetes/ovnkube-node-cw6vm"
Aug 04 22:20:55.572035 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.571222    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/57e1c824-1681-49ad-b094-b34ae1e14ac4-etc-openvswitch\") pod \"ovnkube-node-cw6vm\" (UID: \"57e1c824-1681-49ad-b094-b34ae1e14ac4\") " pod="openshift-ovn-kubernetes/ovnkube-node-cw6vm"
Aug 04 22:20:55.572035 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.571282    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/aae79032-9bea-47d8-8cb2-7e277f07ef6d-host-var-lib-cni-bin\") pod \"multus-rzd7q\" (UID: \"aae79032-9bea-47d8-8cb2-7e277f07ef6d\") " pod="openshift-multus/multus-rzd7q"
Aug 04 22:20:55.572918 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.571321    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/57e1c824-1681-49ad-b094-b34ae1e14ac4-node-log\") pod \"ovnkube-node-cw6vm\" (UID: \"57e1c824-1681-49ad-b094-b34ae1e14ac4\") " pod="openshift-ovn-kubernetes/ovnkube-node-cw6vm"
Aug 04 22:20:55.572918 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.571365    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/57e1c824-1681-49ad-b094-b34ae1e14ac4-ovnkube-config\") pod \"ovnkube-node-cw6vm\" (UID: \"57e1c824-1681-49ad-b094-b34ae1e14ac4\") " pod="openshift-ovn-kubernetes/ovnkube-node-cw6vm"
Aug 04 22:20:55.572918 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.571445    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/aae79032-9bea-47d8-8cb2-7e277f07ef6d-system-cni-dir\") pod \"multus-rzd7q\" (UID: \"aae79032-9bea-47d8-8cb2-7e277f07ef6d\") " pod="openshift-multus/multus-rzd7q"
Aug 04 22:20:55.572918 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.571458    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c0c23bef-9c00-46e2-8f50-d67322ae45e6-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-p9zkw\" (UID: \"c0c23bef-9c00-46e2-8f50-d67322ae45e6\") " pod="openshift-multus/multus-additional-cni-plugins-p9zkw"
Aug 04 22:20:55.572918 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.571522    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/aae79032-9bea-47d8-8cb2-7e277f07ef6d-hostroot\") pod \"multus-rzd7q\" (UID: \"aae79032-9bea-47d8-8cb2-7e277f07ef6d\") " pod="openshift-multus/multus-rzd7q"
Aug 04 22:20:55.572918 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.571523    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/aae79032-9bea-47d8-8cb2-7e277f07ef6d-etc-kubernetes\") pod \"multus-rzd7q\" (UID: \"aae79032-9bea-47d8-8cb2-7e277f07ef6d\") " pod="openshift-multus/multus-rzd7q"
Aug 04 22:20:55.572918 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.571555    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/aae79032-9bea-47d8-8cb2-7e277f07ef6d-host-run-netns\") pod \"multus-rzd7q\" (UID: \"aae79032-9bea-47d8-8cb2-7e277f07ef6d\") " pod="openshift-multus/multus-rzd7q"
Aug 04 22:20:55.572918 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.571564    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/57e1c824-1681-49ad-b094-b34ae1e14ac4-var-lib-openvswitch\") pod \"ovnkube-node-cw6vm\" (UID: \"57e1c824-1681-49ad-b094-b34ae1e14ac4\") " pod="openshift-ovn-kubernetes/ovnkube-node-cw6vm"
Aug 04 22:20:55.572918 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.571614    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/aae79032-9bea-47d8-8cb2-7e277f07ef6d-host-var-lib-kubelet\") pod \"multus-rzd7q\" (UID: \"aae79032-9bea-47d8-8cb2-7e277f07ef6d\") " pod="openshift-multus/multus-rzd7q"
Aug 04 22:20:55.572918 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.571654    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/57e1c824-1681-49ad-b094-b34ae1e14ac4-run-ovn\") pod \"ovnkube-node-cw6vm\" (UID: \"57e1c824-1681-49ad-b094-b34ae1e14ac4\") " pod="openshift-ovn-kubernetes/ovnkube-node-cw6vm"
Aug 04 22:20:55.572918 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.571676    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/aae79032-9bea-47d8-8cb2-7e277f07ef6d-cni-binary-copy\") pod \"multus-rzd7q\" (UID: \"aae79032-9bea-47d8-8cb2-7e277f07ef6d\") " pod="openshift-multus/multus-rzd7q"
Aug 04 22:20:55.572918 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.571700    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/aae79032-9bea-47d8-8cb2-7e277f07ef6d-cnibin\") pod \"multus-rzd7q\" (UID: \"aae79032-9bea-47d8-8cb2-7e277f07ef6d\") " pod="openshift-multus/multus-rzd7q"
Aug 04 22:20:55.572918 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.571713    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c0c23bef-9c00-46e2-8f50-d67322ae45e6-cni-binary-copy\") pod \"multus-additional-cni-plugins-p9zkw\" (UID: \"c0c23bef-9c00-46e2-8f50-d67322ae45e6\") " pod="openshift-multus/multus-additional-cni-plugins-p9zkw"
Aug 04 22:20:55.572918 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.571717    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c0c23bef-9c00-46e2-8f50-d67322ae45e6-system-cni-dir\") pod \"multus-additional-cni-plugins-p9zkw\" (UID: \"c0c23bef-9c00-46e2-8f50-d67322ae45e6\") " pod="openshift-multus/multus-additional-cni-plugins-p9zkw"
Aug 04 22:20:55.572918 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.571876    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/57e1c824-1681-49ad-b094-b34ae1e14ac4-env-overrides\") pod \"ovnkube-node-cw6vm\" (UID: \"57e1c824-1681-49ad-b094-b34ae1e14ac4\") " pod="openshift-ovn-kubernetes/ovnkube-node-cw6vm"
Aug 04 22:20:55.574273 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.574250    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/57e1c824-1681-49ad-b094-b34ae1e14ac4-ovn-node-metrics-cert\") pod \"ovnkube-node-cw6vm\" (UID: \"57e1c824-1681-49ad-b094-b34ae1e14ac4\") " pod="openshift-ovn-kubernetes/ovnkube-node-cw6vm"
Aug 04 22:20:55.575790 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:20:55.575768    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 04 22:20:55.575886 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:20:55.575797    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 04 22:20:55.575886 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:20:55.575811    2580 projected.go:196] Error preparing data for projected volume kube-api-access-ltxhz for pod openshift-network-diagnostics/network-check-target-64rgt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 22:20:55.575886 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:20:55.575872    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d04f70b8-d937-4f47-aa63-ee118a743487-kube-api-access-ltxhz podName:d04f70b8-d937-4f47-aa63-ee118a743487 nodeName:}" failed. No retries permitted until 2026-08-04 22:20:56.075852282 +0000 UTC m=+3.068670010 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-ltxhz" (UniqueName: "kubernetes.io/projected/d04f70b8-d937-4f47-aa63-ee118a743487-kube-api-access-ltxhz") pod "network-check-target-64rgt" (UID: "d04f70b8-d937-4f47-aa63-ee118a743487") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 22:20:55.578142 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.578090    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-97vnt\" (UniqueName: \"kubernetes.io/projected/57e1c824-1681-49ad-b094-b34ae1e14ac4-kube-api-access-97vnt\") pod \"ovnkube-node-cw6vm\" (UID: \"57e1c824-1681-49ad-b094-b34ae1e14ac4\") " pod="openshift-ovn-kubernetes/ovnkube-node-cw6vm"
Aug 04 22:20:55.578247 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.578124    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xb6rt\" (UniqueName: \"kubernetes.io/projected/c0c23bef-9c00-46e2-8f50-d67322ae45e6-kube-api-access-xb6rt\") pod \"multus-additional-cni-plugins-p9zkw\" (UID: \"c0c23bef-9c00-46e2-8f50-d67322ae45e6\") " pod="openshift-multus/multus-additional-cni-plugins-p9zkw"
Aug 04 22:20:55.578742 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.578722    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9zmzr\" (UniqueName: \"kubernetes.io/projected/aae79032-9bea-47d8-8cb2-7e277f07ef6d-kube-api-access-9zmzr\") pod \"multus-rzd7q\" (UID: \"aae79032-9bea-47d8-8cb2-7e277f07ef6d\") " pod="openshift-multus/multus-rzd7q"
Aug 04 22:20:55.655619 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.655577    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-mqwtk"
Aug 04 22:20:55.662866 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.662838    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-485vg"
Aug 04 22:20:55.670906 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.670885    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-jpxll"
Aug 04 22:20:55.674607 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.674580    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wtrgp"
Aug 04 22:20:55.680194 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.680173    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-xvfg9"
Aug 04 22:20:55.689755 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.689734    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-sc4f2"
Aug 04 22:20:55.697225 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.697207    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-p9zkw"
Aug 04 22:20:55.713027 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.713008    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-rzd7q"
Aug 04 22:20:55.716843 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.716824    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-cw6vm"
Aug 04 22:20:55.972974 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.972881    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/14077369-fe10-4854-8785-0bfc9addb7c4-metrics-certs\") pod \"network-metrics-daemon-5h46r\" (UID: \"14077369-fe10-4854-8785-0bfc9addb7c4\") " pod="openshift-multus/network-metrics-daemon-5h46r"
Aug 04 22:20:55.972974 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:55.972970    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1675ffcb-004e-4aa6-9f0e-8d9c4567052a-original-pull-secret\") pod \"global-pull-secret-syncer-mms2l\" (UID: \"1675ffcb-004e-4aa6-9f0e-8d9c4567052a\") " pod="kube-system/global-pull-secret-syncer-mms2l"
Aug 04 22:20:55.973198 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:20:55.973050    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 22:20:55.973198 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:20:55.973087    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 04 22:20:55.973198 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:20:55.973144    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14077369-fe10-4854-8785-0bfc9addb7c4-metrics-certs podName:14077369-fe10-4854-8785-0bfc9addb7c4 nodeName:}" failed. No retries permitted until 2026-08-04 22:20:56.973108436 +0000 UTC m=+3.965926159 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/14077369-fe10-4854-8785-0bfc9addb7c4-metrics-certs") pod "network-metrics-daemon-5h46r" (UID: "14077369-fe10-4854-8785-0bfc9addb7c4") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 22:20:55.973198 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:20:55.973167    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1675ffcb-004e-4aa6-9f0e-8d9c4567052a-original-pull-secret podName:1675ffcb-004e-4aa6-9f0e-8d9c4567052a nodeName:}" failed. No retries permitted until 2026-08-04 22:20:56.973156334 +0000 UTC m=+3.965974049 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1675ffcb-004e-4aa6-9f0e-8d9c4567052a-original-pull-secret") pod "global-pull-secret-syncer-mms2l" (UID: "1675ffcb-004e-4aa6-9f0e-8d9c4567052a") : object "kube-system"/"original-pull-secret" not registered
Aug 04 22:20:56.173660 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:56.173623    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ltxhz\" (UniqueName: \"kubernetes.io/projected/d04f70b8-d937-4f47-aa63-ee118a743487-kube-api-access-ltxhz\") pod \"network-check-target-64rgt\" (UID: \"d04f70b8-d937-4f47-aa63-ee118a743487\") " pod="openshift-network-diagnostics/network-check-target-64rgt"
Aug 04 22:20:56.173845 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:20:56.173804    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 04 22:20:56.173845 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:20:56.173828    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 04 22:20:56.173845 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:20:56.173840    2580 projected.go:196] Error preparing data for projected volume kube-api-access-ltxhz for pod openshift-network-diagnostics/network-check-target-64rgt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 22:20:56.173977 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:20:56.173908    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d04f70b8-d937-4f47-aa63-ee118a743487-kube-api-access-ltxhz podName:d04f70b8-d937-4f47-aa63-ee118a743487 nodeName:}" failed. No retries permitted until 2026-08-04 22:20:57.173887737 +0000 UTC m=+4.166705457 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-ltxhz" (UniqueName: "kubernetes.io/projected/d04f70b8-d937-4f47-aa63-ee118a743487-kube-api-access-ltxhz") pod "network-check-target-64rgt" (UID: "d04f70b8-d937-4f47-aa63-ee118a743487") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 22:20:56.189640 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:56.189606    2580 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Aug 04 22:20:56.395521 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:56.395446    2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-08-03 22:15:55 +0000 UTC" deadline="2028-04-07 20:56:19.02826657 +0000 UTC"
Aug 04 22:20:56.395521 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:56.395513    2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14686h35m22.63275657s"
Aug 04 22:20:56.575228 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:56.575191    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd96c63e8_991c_4331_a7fb_6f91570d0ad5.slice/crio-da701c939dacb13ccf2a93aa656967cb5b26f3b9704b72ea02a3e0cbb6d885a5 WatchSource:0}: Error finding container da701c939dacb13ccf2a93aa656967cb5b26f3b9704b72ea02a3e0cbb6d885a5: Status 404 returned error can't find the container with id da701c939dacb13ccf2a93aa656967cb5b26f3b9704b72ea02a3e0cbb6d885a5
Aug 04 22:20:56.576938 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:56.576730    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod289f4758_62ab_4466_95cc_0ed912f1919b.slice/crio-2fbbe53348a203a3ba59a9b3c40eb4cc8906e396e1f3df708621b394d0e858ae WatchSource:0}: Error finding container 2fbbe53348a203a3ba59a9b3c40eb4cc8906e396e1f3df708621b394d0e858ae: Status 404 returned error can't find the container with id 2fbbe53348a203a3ba59a9b3c40eb4cc8906e396e1f3df708621b394d0e858ae
Aug 04 22:20:56.580059 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:56.580023    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod708c6d09_57c2_4829_9e76_7d86874515ec.slice/crio-2964c5f3af59a9441b92c42f32fb2f6e6412aa45e7715eeeba3026ff9799c0b9 WatchSource:0}: Error finding container 2964c5f3af59a9441b92c42f32fb2f6e6412aa45e7715eeeba3026ff9799c0b9: Status 404 returned error can't find the container with id 2964c5f3af59a9441b92c42f32fb2f6e6412aa45e7715eeeba3026ff9799c0b9
Aug 04 22:20:56.589658 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:56.589634    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaae79032_9bea_47d8_8cb2_7e277f07ef6d.slice/crio-b0416af4e441bc9f39fcf1adc03021e8e39b770a9805588075c945975ac72746 WatchSource:0}: Error finding container b0416af4e441bc9f39fcf1adc03021e8e39b770a9805588075c945975ac72746: Status 404 returned error can't find the container with id b0416af4e441bc9f39fcf1adc03021e8e39b770a9805588075c945975ac72746
Aug 04 22:20:56.591303 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:56.591184    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57e1c824_1681_49ad_b094_b34ae1e14ac4.slice/crio-d8d4fe7ded92a648cb1a7ca1300f848afa7cde755982bf7761381fbfde1b5f7c WatchSource:0}: Error finding container d8d4fe7ded92a648cb1a7ca1300f848afa7cde755982bf7761381fbfde1b5f7c: Status 404 returned error can't find the container with id d8d4fe7ded92a648cb1a7ca1300f848afa7cde755982bf7761381fbfde1b5f7c
Aug 04 22:20:56.592060 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:56.591940    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9532c679_cc59_47ba_a6a3_1b88c7cc4c69.slice/crio-acc325369cb9f8ffbf6b5b9b28099ad9a1410af220173d8330f6f5438e6671ce WatchSource:0}: Error finding container acc325369cb9f8ffbf6b5b9b28099ad9a1410af220173d8330f6f5438e6671ce: Status 404 returned error can't find the container with id acc325369cb9f8ffbf6b5b9b28099ad9a1410af220173d8330f6f5438e6671ce
Aug 04 22:20:56.593694 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:56.593356    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf411845_febf_4e48_a52e_ea1741aa07cb.slice/crio-0b90040d57c91309b8e43fc1b7bddf68a7aa0b3b043d13de557aa02b403d09ae WatchSource:0}: Error finding container 0b90040d57c91309b8e43fc1b7bddf68a7aa0b3b043d13de557aa02b403d09ae: Status 404 returned error can't find the container with id 0b90040d57c91309b8e43fc1b7bddf68a7aa0b3b043d13de557aa02b403d09ae
Aug 04 22:20:56.593895 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:56.593874    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0c23bef_9c00_46e2_8f50_d67322ae45e6.slice/crio-ce129a9d183403e4fb1376024f6b3ec986ce2255cf0d83f8bceefc5be4060210 WatchSource:0}: Error finding container ce129a9d183403e4fb1376024f6b3ec986ce2255cf0d83f8bceefc5be4060210: Status 404 returned error can't find the container with id ce129a9d183403e4fb1376024f6b3ec986ce2255cf0d83f8bceefc5be4060210
Aug 04 22:20:56.594587 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:20:56.594544    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod352301b4_da31_4c34_897a_35279eb5e2f0.slice/crio-51a8cdc168208f74a50f3ef838f500adb20dde35e16cc4d68a098a0f9e957bef WatchSource:0}: Error finding container 51a8cdc168208f74a50f3ef838f500adb20dde35e16cc4d68a098a0f9e957bef: Status 404 returned error can't find the container with id 51a8cdc168208f74a50f3ef838f500adb20dde35e16cc4d68a098a0f9e957bef
Aug 04 22:20:56.979753 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:56.979528    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/14077369-fe10-4854-8785-0bfc9addb7c4-metrics-certs\") pod \"network-metrics-daemon-5h46r\" (UID: \"14077369-fe10-4854-8785-0bfc9addb7c4\") " pod="openshift-multus/network-metrics-daemon-5h46r"
Aug 04 22:20:56.979905 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:56.979807    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1675ffcb-004e-4aa6-9f0e-8d9c4567052a-original-pull-secret\") pod \"global-pull-secret-syncer-mms2l\" (UID: \"1675ffcb-004e-4aa6-9f0e-8d9c4567052a\") " pod="kube-system/global-pull-secret-syncer-mms2l"
Aug 04 22:20:56.979905 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:20:56.979675    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 22:20:56.979905 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:20:56.979883    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14077369-fe10-4854-8785-0bfc9addb7c4-metrics-certs podName:14077369-fe10-4854-8785-0bfc9addb7c4 nodeName:}" failed. No retries permitted until 2026-08-04 22:20:58.979863875 +0000 UTC m=+5.972681598 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/14077369-fe10-4854-8785-0bfc9addb7c4-metrics-certs") pod "network-metrics-daemon-5h46r" (UID: "14077369-fe10-4854-8785-0bfc9addb7c4") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 22:20:56.979905 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:20:56.979903    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 04 22:20:56.980058 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:20:56.979941    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1675ffcb-004e-4aa6-9f0e-8d9c4567052a-original-pull-secret podName:1675ffcb-004e-4aa6-9f0e-8d9c4567052a nodeName:}" failed. No retries permitted until 2026-08-04 22:20:58.979931498 +0000 UTC m=+5.972749209 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1675ffcb-004e-4aa6-9f0e-8d9c4567052a-original-pull-secret") pod "global-pull-secret-syncer-mms2l" (UID: "1675ffcb-004e-4aa6-9f0e-8d9c4567052a") : object "kube-system"/"original-pull-secret" not registered
Aug 04 22:20:57.181919 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:57.181830    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ltxhz\" (UniqueName: \"kubernetes.io/projected/d04f70b8-d937-4f47-aa63-ee118a743487-kube-api-access-ltxhz\") pod \"network-check-target-64rgt\" (UID: \"d04f70b8-d937-4f47-aa63-ee118a743487\") " pod="openshift-network-diagnostics/network-check-target-64rgt"
Aug 04 22:20:57.182088 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:20:57.182012    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 04 22:20:57.182088 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:20:57.182033    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 04 22:20:57.182088 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:20:57.182046    2580 projected.go:196] Error preparing data for projected volume kube-api-access-ltxhz for pod openshift-network-diagnostics/network-check-target-64rgt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 22:20:57.182266 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:20:57.182104    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d04f70b8-d937-4f47-aa63-ee118a743487-kube-api-access-ltxhz podName:d04f70b8-d937-4f47-aa63-ee118a743487 nodeName:}" failed. No retries permitted until 2026-08-04 22:20:59.182086081 +0000 UTC m=+6.174903804 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-ltxhz" (UniqueName: "kubernetes.io/projected/d04f70b8-d937-4f47-aa63-ee118a743487-kube-api-access-ltxhz") pod "network-check-target-64rgt" (UID: "d04f70b8-d937-4f47-aa63-ee118a743487") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 22:20:57.396278 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:57.396232    2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-08-03 22:15:55 +0000 UTC" deadline="2028-01-20 19:28:02.15471223 +0000 UTC"
Aug 04 22:20:57.396278 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:57.396276    2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12813h7m4.758441566s"
Aug 04 22:20:57.496112 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:57.496032    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mms2l"
Aug 04 22:20:57.496289 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:20:57.496183    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mms2l" podUID="1675ffcb-004e-4aa6-9f0e-8d9c4567052a"
Aug 04 22:20:57.496901 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:57.496580    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5h46r"
Aug 04 22:20:57.496901 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:20:57.496683    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5h46r" podUID="14077369-fe10-4854-8785-0bfc9addb7c4"
Aug 04 22:20:57.496901 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:57.496739    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-64rgt"
Aug 04 22:20:57.496901 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:20:57.496800    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-64rgt" podUID="d04f70b8-d937-4f47-aa63-ee118a743487"
Aug 04 22:20:57.515415 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:57.515337    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-rzd7q" event={"ID":"aae79032-9bea-47d8-8cb2-7e277f07ef6d","Type":"ContainerStarted","Data":"b0416af4e441bc9f39fcf1adc03021e8e39b770a9805588075c945975ac72746"}
Aug 04 22:20:57.524806 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:57.524770    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-mqwtk" event={"ID":"352301b4-da31-4c34-897a-35279eb5e2f0","Type":"ContainerStarted","Data":"51a8cdc168208f74a50f3ef838f500adb20dde35e16cc4d68a098a0f9e957bef"}
Aug 04 22:20:57.534175 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:57.534065    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-jpxll" event={"ID":"bf411845-febf-4e48-a52e-ea1741aa07cb","Type":"ContainerStarted","Data":"0b90040d57c91309b8e43fc1b7bddf68a7aa0b3b043d13de557aa02b403d09ae"}
Aug 04 22:20:57.544429 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:57.544393    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-sc4f2" event={"ID":"9532c679-cc59-47ba-a6a3-1b88c7cc4c69","Type":"ContainerStarted","Data":"acc325369cb9f8ffbf6b5b9b28099ad9a1410af220173d8330f6f5438e6671ce"}
Aug 04 22:20:57.564510 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:57.564385    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-xvfg9" event={"ID":"708c6d09-57c2-4829-9e76-7d86874515ec","Type":"ContainerStarted","Data":"2964c5f3af59a9441b92c42f32fb2f6e6412aa45e7715eeeba3026ff9799c0b9"}
Aug 04 22:20:57.571406 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:57.571339    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-485vg" event={"ID":"289f4758-62ab-4466-95cc-0ed912f1919b","Type":"ContainerStarted","Data":"2fbbe53348a203a3ba59a9b3c40eb4cc8906e396e1f3df708621b394d0e858ae"}
Aug 04 22:20:57.580556 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:57.580456    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wtrgp" event={"ID":"d96c63e8-991c-4331-a7fb-6f91570d0ad5","Type":"ContainerStarted","Data":"da701c939dacb13ccf2a93aa656967cb5b26f3b9704b72ea02a3e0cbb6d885a5"}
Aug 04 22:20:57.590702 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:57.589953    2580 generic.go:356] "Generic (PLEG): container finished" podID="0ee3ab39f425114f43135622c74f665d" containerID="e7b72a7a0cd439bb7505f602a616c994015d394fcb4c84ed19346f38070dfcb6" exitCode=0
Aug 04 22:20:57.590702 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:57.590159    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-117.ec2.internal" event={"ID":"0ee3ab39f425114f43135622c74f665d","Type":"ContainerDied","Data":"e7b72a7a0cd439bb7505f602a616c994015d394fcb4c84ed19346f38070dfcb6"}
Aug 04 22:20:57.596102 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:57.596066    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-117.ec2.internal" event={"ID":"8c189592264ca39220dc93ea9c07921f","Type":"ContainerStarted","Data":"2cfb8402934098fb98a5e3e73c73ae76a322a6e517a5089ecf3fc118720106ef"}
Aug 04 22:20:57.616628 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:57.616555    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p9zkw" event={"ID":"c0c23bef-9c00-46e2-8f50-d67322ae45e6","Type":"ContainerStarted","Data":"ce129a9d183403e4fb1376024f6b3ec986ce2255cf0d83f8bceefc5be4060210"}
Aug 04 22:20:57.637673 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:57.637636    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cw6vm" event={"ID":"57e1c824-1681-49ad-b094-b34ae1e14ac4","Type":"ContainerStarted","Data":"d8d4fe7ded92a648cb1a7ca1300f848afa7cde755982bf7761381fbfde1b5f7c"}
Aug 04 22:20:58.649297 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:58.649166    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-117.ec2.internal" event={"ID":"0ee3ab39f425114f43135622c74f665d","Type":"ContainerStarted","Data":"8777106915d847ecd802005f37412f9d099f783ba0be8ee211fadd3df337e795"}
Aug 04 22:20:58.668178 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:58.666001    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-117.ec2.internal" podStartSLOduration=4.665981135 podStartE2EDuration="4.665981135s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 22:20:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 22:20:57.619166792 +0000 UTC m=+4.611984521" watchObservedRunningTime="2026-08-04 22:20:58.665981135 +0000 UTC m=+5.658798865"
Aug 04 22:20:58.668178 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:58.666198    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-117.ec2.internal" podStartSLOduration=4.666192598 podStartE2EDuration="4.666192598s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 22:20:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 22:20:58.665554853 +0000 UTC m=+5.658372582" watchObservedRunningTime="2026-08-04 22:20:58.666192598 +0000 UTC m=+5.659010327"
Aug 04 22:20:59.003172 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:59.002944    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/14077369-fe10-4854-8785-0bfc9addb7c4-metrics-certs\") pod \"network-metrics-daemon-5h46r\" (UID: \"14077369-fe10-4854-8785-0bfc9addb7c4\") " pod="openshift-multus/network-metrics-daemon-5h46r"
Aug 04 22:20:59.003172 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:59.003034    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1675ffcb-004e-4aa6-9f0e-8d9c4567052a-original-pull-secret\") pod \"global-pull-secret-syncer-mms2l\" (UID: \"1675ffcb-004e-4aa6-9f0e-8d9c4567052a\") " pod="kube-system/global-pull-secret-syncer-mms2l"
Aug 04 22:20:59.003392 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:20:59.003174    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 04 22:20:59.003392 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:20:59.003244    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1675ffcb-004e-4aa6-9f0e-8d9c4567052a-original-pull-secret podName:1675ffcb-004e-4aa6-9f0e-8d9c4567052a nodeName:}" failed. No retries permitted until 2026-08-04 22:21:03.003226642 +0000 UTC m=+9.996044362 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1675ffcb-004e-4aa6-9f0e-8d9c4567052a-original-pull-secret") pod "global-pull-secret-syncer-mms2l" (UID: "1675ffcb-004e-4aa6-9f0e-8d9c4567052a") : object "kube-system"/"original-pull-secret" not registered
Aug 04 22:20:59.003933 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:20:59.003627    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 22:20:59.003933 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:20:59.003676    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14077369-fe10-4854-8785-0bfc9addb7c4-metrics-certs podName:14077369-fe10-4854-8785-0bfc9addb7c4 nodeName:}" failed. No retries permitted until 2026-08-04 22:21:03.003662772 +0000 UTC m=+9.996480481 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/14077369-fe10-4854-8785-0bfc9addb7c4-metrics-certs") pod "network-metrics-daemon-5h46r" (UID: "14077369-fe10-4854-8785-0bfc9addb7c4") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 22:20:59.205483 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:59.205443    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ltxhz\" (UniqueName: \"kubernetes.io/projected/d04f70b8-d937-4f47-aa63-ee118a743487-kube-api-access-ltxhz\") pod \"network-check-target-64rgt\" (UID: \"d04f70b8-d937-4f47-aa63-ee118a743487\") " pod="openshift-network-diagnostics/network-check-target-64rgt"
Aug 04 22:20:59.205666 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:20:59.205604    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 04 22:20:59.205666 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:20:59.205628    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 04 22:20:59.205666 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:20:59.205640    2580 projected.go:196] Error preparing data for projected volume kube-api-access-ltxhz for pod openshift-network-diagnostics/network-check-target-64rgt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 22:20:59.205824 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:20:59.205702    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d04f70b8-d937-4f47-aa63-ee118a743487-kube-api-access-ltxhz podName:d04f70b8-d937-4f47-aa63-ee118a743487 nodeName:}" failed. No retries permitted until 2026-08-04 22:21:03.205684139 +0000 UTC m=+10.198501862 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-ltxhz" (UniqueName: "kubernetes.io/projected/d04f70b8-d937-4f47-aa63-ee118a743487-kube-api-access-ltxhz") pod "network-check-target-64rgt" (UID: "d04f70b8-d937-4f47-aa63-ee118a743487") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 22:20:59.494307 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:59.494267    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mms2l"
Aug 04 22:20:59.494510 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:20:59.494398    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mms2l" podUID="1675ffcb-004e-4aa6-9f0e-8d9c4567052a"
Aug 04 22:20:59.494819 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:59.494796    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5h46r"
Aug 04 22:20:59.494957 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:20:59.494908    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5h46r" podUID="14077369-fe10-4854-8785-0bfc9addb7c4"
Aug 04 22:20:59.495246 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:20:59.495228    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-64rgt"
Aug 04 22:20:59.495370 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:20:59.495349    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-64rgt" podUID="d04f70b8-d937-4f47-aa63-ee118a743487"
Aug 04 22:21:01.494950 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:01.494233    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mms2l"
Aug 04 22:21:01.494950 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:21:01.494358    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mms2l" podUID="1675ffcb-004e-4aa6-9f0e-8d9c4567052a"
Aug 04 22:21:01.494950 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:01.494685    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-64rgt"
Aug 04 22:21:01.494950 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:21:01.494771    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-64rgt" podUID="d04f70b8-d937-4f47-aa63-ee118a743487"
Aug 04 22:21:01.494950 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:01.494830    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5h46r"
Aug 04 22:21:01.494950 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:21:01.494910    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5h46r" podUID="14077369-fe10-4854-8785-0bfc9addb7c4"
Aug 04 22:21:03.038114 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:03.038069    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1675ffcb-004e-4aa6-9f0e-8d9c4567052a-original-pull-secret\") pod \"global-pull-secret-syncer-mms2l\" (UID: \"1675ffcb-004e-4aa6-9f0e-8d9c4567052a\") " pod="kube-system/global-pull-secret-syncer-mms2l"
Aug 04 22:21:03.038579 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:03.038154    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/14077369-fe10-4854-8785-0bfc9addb7c4-metrics-certs\") pod \"network-metrics-daemon-5h46r\" (UID: \"14077369-fe10-4854-8785-0bfc9addb7c4\") " pod="openshift-multus/network-metrics-daemon-5h46r"
Aug 04 22:21:03.038579 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:21:03.038257    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 04 22:21:03.038579 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:21:03.038273    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 22:21:03.038579 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:21:03.038331    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14077369-fe10-4854-8785-0bfc9addb7c4-metrics-certs podName:14077369-fe10-4854-8785-0bfc9addb7c4 nodeName:}" failed. No retries permitted until 2026-08-04 22:21:11.038310621 +0000 UTC m=+18.031128341 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/14077369-fe10-4854-8785-0bfc9addb7c4-metrics-certs") pod "network-metrics-daemon-5h46r" (UID: "14077369-fe10-4854-8785-0bfc9addb7c4") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 22:21:03.038579 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:21:03.038359    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1675ffcb-004e-4aa6-9f0e-8d9c4567052a-original-pull-secret podName:1675ffcb-004e-4aa6-9f0e-8d9c4567052a nodeName:}" failed. No retries permitted until 2026-08-04 22:21:11.038349076 +0000 UTC m=+18.031166786 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1675ffcb-004e-4aa6-9f0e-8d9c4567052a-original-pull-secret") pod "global-pull-secret-syncer-mms2l" (UID: "1675ffcb-004e-4aa6-9f0e-8d9c4567052a") : object "kube-system"/"original-pull-secret" not registered
Aug 04 22:21:03.239759 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:03.239719    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ltxhz\" (UniqueName: \"kubernetes.io/projected/d04f70b8-d937-4f47-aa63-ee118a743487-kube-api-access-ltxhz\") pod \"network-check-target-64rgt\" (UID: \"d04f70b8-d937-4f47-aa63-ee118a743487\") " pod="openshift-network-diagnostics/network-check-target-64rgt"
Aug 04 22:21:03.239958 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:21:03.239884    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 04 22:21:03.239958 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:21:03.239908    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 04 22:21:03.239958 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:21:03.239923    2580 projected.go:196] Error preparing data for projected volume kube-api-access-ltxhz for pod openshift-network-diagnostics/network-check-target-64rgt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 22:21:03.240119 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:21:03.239991    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d04f70b8-d937-4f47-aa63-ee118a743487-kube-api-access-ltxhz podName:d04f70b8-d937-4f47-aa63-ee118a743487 nodeName:}" failed. No retries permitted until 2026-08-04 22:21:11.239969775 +0000 UTC m=+18.232787481 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-ltxhz" (UniqueName: "kubernetes.io/projected/d04f70b8-d937-4f47-aa63-ee118a743487-kube-api-access-ltxhz") pod "network-check-target-64rgt" (UID: "d04f70b8-d937-4f47-aa63-ee118a743487") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 22:21:03.494704 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:03.494667    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mms2l"
Aug 04 22:21:03.494864 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:21:03.494786    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mms2l" podUID="1675ffcb-004e-4aa6-9f0e-8d9c4567052a"
Aug 04 22:21:03.494864 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:03.494792    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5h46r"
Aug 04 22:21:03.494864 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:03.494825    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-64rgt"
Aug 04 22:21:03.494989 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:21:03.494897    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5h46r" podUID="14077369-fe10-4854-8785-0bfc9addb7c4"
Aug 04 22:21:03.494989 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:21:03.494969    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-64rgt" podUID="d04f70b8-d937-4f47-aa63-ee118a743487"
Aug 04 22:21:05.493045 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:05.492989    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-64rgt"
Aug 04 22:21:05.493511 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:05.493192    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5h46r"
Aug 04 22:21:05.493511 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:21:05.493214    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-64rgt" podUID="d04f70b8-d937-4f47-aa63-ee118a743487"
Aug 04 22:21:05.493511 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:05.493228    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mms2l"
Aug 04 22:21:05.493511 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:21:05.493329    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5h46r" podUID="14077369-fe10-4854-8785-0bfc9addb7c4"
Aug 04 22:21:05.493511 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:21:05.493415    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mms2l" podUID="1675ffcb-004e-4aa6-9f0e-8d9c4567052a"
Aug 04 22:21:07.492825 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:07.492792    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mms2l"
Aug 04 22:21:07.492825 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:07.492825    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5h46r"
Aug 04 22:21:07.493325 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:21:07.492920    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mms2l" podUID="1675ffcb-004e-4aa6-9f0e-8d9c4567052a"
Aug 04 22:21:07.493325 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:07.493013    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-64rgt"
Aug 04 22:21:07.493325 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:21:07.493003    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5h46r" podUID="14077369-fe10-4854-8785-0bfc9addb7c4"
Aug 04 22:21:07.493325 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:21:07.493102    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-64rgt" podUID="d04f70b8-d937-4f47-aa63-ee118a743487"
Aug 04 22:21:09.493337 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:09.493300    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mms2l"
Aug 04 22:21:09.493714 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:09.493351    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-64rgt"
Aug 04 22:21:09.493714 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:09.493314    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5h46r"
Aug 04 22:21:09.493714 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:21:09.493436    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mms2l" podUID="1675ffcb-004e-4aa6-9f0e-8d9c4567052a"
Aug 04 22:21:09.493714 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:21:09.493528    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5h46r" podUID="14077369-fe10-4854-8785-0bfc9addb7c4"
Aug 04 22:21:09.493714 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:21:09.493586    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-64rgt" podUID="d04f70b8-d937-4f47-aa63-ee118a743487"
Aug 04 22:21:11.104047 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:11.104012    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/14077369-fe10-4854-8785-0bfc9addb7c4-metrics-certs\") pod \"network-metrics-daemon-5h46r\" (UID: \"14077369-fe10-4854-8785-0bfc9addb7c4\") " pod="openshift-multus/network-metrics-daemon-5h46r"
Aug 04 22:21:11.104505 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:11.104099    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1675ffcb-004e-4aa6-9f0e-8d9c4567052a-original-pull-secret\") pod \"global-pull-secret-syncer-mms2l\" (UID: \"1675ffcb-004e-4aa6-9f0e-8d9c4567052a\") " pod="kube-system/global-pull-secret-syncer-mms2l"
Aug 04 22:21:11.104505 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:21:11.104213    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 22:21:11.104505 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:21:11.104231    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 04 22:21:11.104505 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:21:11.104298    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14077369-fe10-4854-8785-0bfc9addb7c4-metrics-certs podName:14077369-fe10-4854-8785-0bfc9addb7c4 nodeName:}" failed. No retries permitted until 2026-08-04 22:21:27.104273945 +0000 UTC m=+34.097091651 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/14077369-fe10-4854-8785-0bfc9addb7c4-metrics-certs") pod "network-metrics-daemon-5h46r" (UID: "14077369-fe10-4854-8785-0bfc9addb7c4") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 22:21:11.104505 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:21:11.104320    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1675ffcb-004e-4aa6-9f0e-8d9c4567052a-original-pull-secret podName:1675ffcb-004e-4aa6-9f0e-8d9c4567052a nodeName:}" failed. No retries permitted until 2026-08-04 22:21:27.104309511 +0000 UTC m=+34.097127217 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1675ffcb-004e-4aa6-9f0e-8d9c4567052a-original-pull-secret") pod "global-pull-secret-syncer-mms2l" (UID: "1675ffcb-004e-4aa6-9f0e-8d9c4567052a") : object "kube-system"/"original-pull-secret" not registered
Aug 04 22:21:11.305628 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:11.305587    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ltxhz\" (UniqueName: \"kubernetes.io/projected/d04f70b8-d937-4f47-aa63-ee118a743487-kube-api-access-ltxhz\") pod \"network-check-target-64rgt\" (UID: \"d04f70b8-d937-4f47-aa63-ee118a743487\") " pod="openshift-network-diagnostics/network-check-target-64rgt"
Aug 04 22:21:11.305803 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:21:11.305774    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 04 22:21:11.305855 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:21:11.305803    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 04 22:21:11.305855 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:21:11.305817    2580 projected.go:196] Error preparing data for projected volume kube-api-access-ltxhz for pod openshift-network-diagnostics/network-check-target-64rgt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 22:21:11.305962 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:21:11.305885    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d04f70b8-d937-4f47-aa63-ee118a743487-kube-api-access-ltxhz podName:d04f70b8-d937-4f47-aa63-ee118a743487 nodeName:}" failed. No retries permitted until 2026-08-04 22:21:27.305864935 +0000 UTC m=+34.298682656 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-ltxhz" (UniqueName: "kubernetes.io/projected/d04f70b8-d937-4f47-aa63-ee118a743487-kube-api-access-ltxhz") pod "network-check-target-64rgt" (UID: "d04f70b8-d937-4f47-aa63-ee118a743487") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 22:21:11.493331 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:11.493242    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5h46r"
Aug 04 22:21:11.493479 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:11.493242    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mms2l"
Aug 04 22:21:11.493479 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:11.493392    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-64rgt"
Aug 04 22:21:11.493479 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:21:11.493384    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5h46r" podUID="14077369-fe10-4854-8785-0bfc9addb7c4"
Aug 04 22:21:11.493612 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:21:11.493494    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mms2l" podUID="1675ffcb-004e-4aa6-9f0e-8d9c4567052a"
Aug 04 22:21:11.493612 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:21:11.493585    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-64rgt" podUID="d04f70b8-d937-4f47-aa63-ee118a743487"
Aug 04 22:21:13.494125 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:13.494092    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mms2l"
Aug 04 22:21:13.494596 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:13.494198    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5h46r"
Aug 04 22:21:13.494596 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:21:13.494201    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mms2l" podUID="1675ffcb-004e-4aa6-9f0e-8d9c4567052a"
Aug 04 22:21:13.494596 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:13.494220    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-64rgt"
Aug 04 22:21:13.494596 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:21:13.494287    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5h46r" podUID="14077369-fe10-4854-8785-0bfc9addb7c4"
Aug 04 22:21:13.494596 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:21:13.494362    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-64rgt" podUID="d04f70b8-d937-4f47-aa63-ee118a743487"
Aug 04 22:21:15.493643 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:15.493191    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-64rgt"
Aug 04 22:21:15.494282 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:15.493191    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5h46r"
Aug 04 22:21:15.494282 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:21:15.493755    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-64rgt" podUID="d04f70b8-d937-4f47-aa63-ee118a743487"
Aug 04 22:21:15.494282 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:15.493197    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mms2l"
Aug 04 22:21:15.494282 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:21:15.493820    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5h46r" podUID="14077369-fe10-4854-8785-0bfc9addb7c4"
Aug 04 22:21:15.494282 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:21:15.493868    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mms2l" podUID="1675ffcb-004e-4aa6-9f0e-8d9c4567052a"
Aug 04 22:21:15.686334 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:15.686295    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-mqwtk" event={"ID":"352301b4-da31-4c34-897a-35279eb5e2f0","Type":"ContainerStarted","Data":"e6ff9f9a863101401b835aea00c89bd86d6bc2607d6f7aa9f29fa0c52b175143"}
Aug 04 22:21:15.687873 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:15.687849    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-jpxll" event={"ID":"bf411845-febf-4e48-a52e-ea1741aa07cb","Type":"ContainerStarted","Data":"7c2c87529d8887fc62791a61fb36acf56d9d29f0a45a967c9e7506beef1a5933"}
Aug 04 22:21:15.689480 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:15.689453    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-sc4f2" event={"ID":"9532c679-cc59-47ba-a6a3-1b88c7cc4c69","Type":"ContainerStarted","Data":"ecf905ca0b6d1bceea0293205193a4f12704cec519111c038198509dc03d9bba"}
Aug 04 22:21:15.690976 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:15.690952    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-xvfg9" event={"ID":"708c6d09-57c2-4829-9e76-7d86874515ec","Type":"ContainerStarted","Data":"01b62b749278c326638ec21fb786c7d859c16f7f37f708898eb78e5bca18fcdd"}
Aug 04 22:21:15.692261 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:15.692243    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wtrgp" event={"ID":"d96c63e8-991c-4331-a7fb-6f91570d0ad5","Type":"ContainerStarted","Data":"b108df8b7fb18a5b76e43b46d78e54bc405d8ac8f769269400e2b4b5d32eb365"}
Aug 04 22:21:15.693529 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:15.693509    2580 generic.go:356] "Generic (PLEG): container finished" podID="c0c23bef-9c00-46e2-8f50-d67322ae45e6" containerID="4f31c12d87c80fe7bbd7d466388e31bf191b09eb235cbca4bf1688cbdffc6faf" exitCode=0
Aug 04 22:21:15.693609 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:15.693586    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p9zkw" event={"ID":"c0c23bef-9c00-46e2-8f50-d67322ae45e6","Type":"ContainerDied","Data":"4f31c12d87c80fe7bbd7d466388e31bf191b09eb235cbca4bf1688cbdffc6faf"}
Aug 04 22:21:15.696617 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:15.696598    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cw6vm" event={"ID":"57e1c824-1681-49ad-b094-b34ae1e14ac4","Type":"ContainerStarted","Data":"a365dd6d6ad6479e8bd2edb31f026df325900c56bb524c3feac98556b9d2c387"}
Aug 04 22:21:15.696715 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:15.696667    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cw6vm" event={"ID":"57e1c824-1681-49ad-b094-b34ae1e14ac4","Type":"ContainerStarted","Data":"52a49421bb9eb006ff7633c6d0db411948f02b859cf1d87b26f15f2ae1b73383"}
Aug 04 22:21:15.696777 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:15.696715    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cw6vm" event={"ID":"57e1c824-1681-49ad-b094-b34ae1e14ac4","Type":"ContainerStarted","Data":"5acc377813acb64a44b6690795ebb3d695177120ef86c281c8b18d5a30e41e50"}
Aug 04 22:21:15.696777 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:15.696753    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cw6vm" event={"ID":"57e1c824-1681-49ad-b094-b34ae1e14ac4","Type":"ContainerStarted","Data":"321cdf403fda4dc74d1c7ab369b34f4123a38f9c48837e586078e2e2f290442f"}
Aug 04 22:21:15.696866 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:15.696800    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cw6vm" event={"ID":"57e1c824-1681-49ad-b094-b34ae1e14ac4","Type":"ContainerStarted","Data":"35d5210452a88d9b8ad821d36b3b59b48ffbdc584792910b9dedcc6d98c3b05e"}
Aug 04 22:21:15.696866 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:15.696834    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cw6vm" event={"ID":"57e1c824-1681-49ad-b094-b34ae1e14ac4","Type":"ContainerStarted","Data":"3fe3f9811561dc751759a8c1bdfb7be9c471859e9b0d7b14cd6cce4fda8acffe"}
Aug 04 22:21:15.697918 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:15.697899    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-rzd7q" event={"ID":"aae79032-9bea-47d8-8cb2-7e277f07ef6d","Type":"ContainerStarted","Data":"998fb801270c689ebe12933f8d0020a475b835fdb1e36908f9eaa64cd6568725"}
Aug 04 22:21:15.699774 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:15.699741    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-mqwtk" podStartSLOduration=4.326743797 podStartE2EDuration="22.699731767s" totalImagesPullingTime="18.37298797s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 22:20:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 22:21:15.69950586 +0000 UTC m=+22.692323579" watchObservedRunningTime="2026-08-04 22:21:15.699731767 +0000 UTC m=+22.692549494"
Aug 04 22:21:15.726715 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:15.726650    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-sc4f2" podStartSLOduration=4.354719196 podStartE2EDuration="22.72663596s" totalImagesPullingTime="18.371916764s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 22:20:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 22:21:15.726285999 +0000 UTC m=+22.719103727" watchObservedRunningTime="2026-08-04 22:21:15.72663596 +0000 UTC m=+22.719453687"
Aug 04 22:21:15.726920 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:15.726872    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-jpxll" podStartSLOduration=4.353890701 podStartE2EDuration="22.726867401s" totalImagesPullingTime="18.3729767s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 22:20:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 22:21:15.711726342 +0000 UTC m=+22.704544071" watchObservedRunningTime="2026-08-04 22:21:15.726867401 +0000 UTC m=+22.719685128"
Aug 04 22:21:15.759998 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:15.759939    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-rzd7q" podStartSLOduration=4.31138846 podStartE2EDuration="22.759924777s" totalImagesPullingTime="18.448536317s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 22:20:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 22:21:15.740798931 +0000 UTC m=+22.733616660" watchObservedRunningTime="2026-08-04 22:21:15.759924777 +0000 UTC m=+22.752742511"
Aug 04 22:21:15.783681 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:15.783533    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-xvfg9" podStartSLOduration=4.402445739 podStartE2EDuration="22.783506121s" totalImagesPullingTime="18.381060382s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 22:20:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 22:21:15.759919965 +0000 UTC m=+22.752737692" watchObservedRunningTime="2026-08-04 22:21:15.783506121 +0000 UTC m=+22.776323850"
Aug 04 22:21:16.022349 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:16.022305    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-jpxll"
Aug 04 22:21:16.023095 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:16.023067    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-jpxll"
Aug 04 22:21:16.616464 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:16.616430    2580 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Aug 04 22:21:16.701934 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:16.701898    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-485vg" event={"ID":"289f4758-62ab-4466-95cc-0ed912f1919b","Type":"ContainerStarted","Data":"1cb7f1ee32cdfdc3f099fe6cc3684886aa6e8f03769677651a1aa8af390feb2f"}
Aug 04 22:21:16.703745 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:16.703719    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wtrgp" event={"ID":"d96c63e8-991c-4331-a7fb-6f91570d0ad5","Type":"ContainerStarted","Data":"c0bde03ab5a2b99abc51870b2d2f58da5f07f7d6682549e1a895ff1c369ff441"}
Aug 04 22:21:16.704374 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:16.704353    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-jpxll"
Aug 04 22:21:16.704826 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:16.704808    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-jpxll"
Aug 04 22:21:16.715797 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:16.715756    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-485vg" podStartSLOduration=5.326775981 podStartE2EDuration="23.715740096s" totalImagesPullingTime="18.388964115s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 22:20:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 22:21:16.71528769 +0000 UTC m=+23.708105411" watchObservedRunningTime="2026-08-04 22:21:16.715740096 +0000 UTC m=+23.708557824"
Aug 04 22:21:17.437729 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:17.437612    2580 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-08-04T22:21:16.616450256Z","UUID":"82a748ab-c16d-44e4-9502-7ad59c83bc21","Handler":null,"Name":"","Endpoint":""}
Aug 04 22:21:17.439444 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:17.439417    2580 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Aug 04 22:21:17.439583 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:17.439462    2580 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Aug 04 22:21:17.493301 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:17.493268    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-64rgt"
Aug 04 22:21:17.493534 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:17.493268    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mms2l"
Aug 04 22:21:17.493534 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:21:17.493471    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mms2l" podUID="1675ffcb-004e-4aa6-9f0e-8d9c4567052a"
Aug 04 22:21:17.493534 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:21:17.493369    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-64rgt" podUID="d04f70b8-d937-4f47-aa63-ee118a743487"
Aug 04 22:21:17.493534 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:17.493268    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5h46r"
Aug 04 22:21:17.493715 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:21:17.493608    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5h46r" podUID="14077369-fe10-4854-8785-0bfc9addb7c4"
Aug 04 22:21:18.711479 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:18.711384    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cw6vm" event={"ID":"57e1c824-1681-49ad-b094-b34ae1e14ac4","Type":"ContainerStarted","Data":"6e8fd0f120202f15dd5bde8d8d335f0777d940cc99f8db71e49b4bf597b4004b"}
Aug 04 22:21:18.713351 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:18.713316    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wtrgp" event={"ID":"d96c63e8-991c-4331-a7fb-6f91570d0ad5","Type":"ContainerStarted","Data":"efd20f72df81aa63ff54f2d585ad1b6fa4cfd96c5f0c1e4bb80d8df72540e7b0"}
Aug 04 22:21:18.733109 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:18.733059    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wtrgp" podStartSLOduration=4.212568729 podStartE2EDuration="25.733044336s" totalImagesPullingTime="21.520475607s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 22:20:53 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 22:21:18.732572723 +0000 UTC m=+25.725390442" watchObservedRunningTime="2026-08-04 22:21:18.733044336 +0000 UTC m=+25.725862064"
Aug 04 22:21:19.493100 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:19.492876    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-64rgt"
Aug 04 22:21:19.493306 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:19.492876    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5h46r"
Aug 04 22:21:19.493306 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:19.492933    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mms2l"
Aug 04 22:21:19.493306 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:21:19.493218    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-64rgt" podUID="d04f70b8-d937-4f47-aa63-ee118a743487"
Aug 04 22:21:19.493478 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:21:19.493312    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mms2l" podUID="1675ffcb-004e-4aa6-9f0e-8d9c4567052a"
Aug 04 22:21:19.493478 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:21:19.493397    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5h46r" podUID="14077369-fe10-4854-8785-0bfc9addb7c4"
Aug 04 22:21:20.721395 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:20.721357    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cw6vm" event={"ID":"57e1c824-1681-49ad-b094-b34ae1e14ac4","Type":"ContainerStarted","Data":"76d2efbfb65a15b3895bd90383f1e9a85dd916f37548b70dcc0f55ab40f80b94"}
Aug 04 22:21:20.722287 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:20.721620    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cw6vm"
Aug 04 22:21:20.736950 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:20.736922    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cw6vm"
Aug 04 22:21:20.745376 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:20.745327    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-cw6vm" podStartSLOduration=9.30125014 podStartE2EDuration="27.745312418s" totalImagesPullingTime="18.444062278s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 22:20:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 22:21:20.7447681 +0000 UTC m=+27.737585839" watchObservedRunningTime="2026-08-04 22:21:20.745312418 +0000 UTC m=+27.738130146"
Aug 04 22:21:21.493552 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:21.493337    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-64rgt"
Aug 04 22:21:21.493730 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:21.493337    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mms2l"
Aug 04 22:21:21.493730 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:21:21.493653    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-64rgt" podUID="d04f70b8-d937-4f47-aa63-ee118a743487"
Aug 04 22:21:21.493730 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:21.493413    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5h46r"
Aug 04 22:21:21.493730 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:21:21.493714    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mms2l" podUID="1675ffcb-004e-4aa6-9f0e-8d9c4567052a"
Aug 04 22:21:21.493925 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:21:21.493787    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5h46r" podUID="14077369-fe10-4854-8785-0bfc9addb7c4"
Aug 04 22:21:21.724625 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:21.724501    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cw6vm"
Aug 04 22:21:21.724625 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:21.724588    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cw6vm"
Aug 04 22:21:21.743454 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:21.743396    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cw6vm"
Aug 04 22:21:22.148829 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:22.148637    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-64rgt"]
Aug 04 22:21:22.148829 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:22.148755    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-64rgt"
Aug 04 22:21:22.149078 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:21:22.148861    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-64rgt" podUID="d04f70b8-d937-4f47-aa63-ee118a743487"
Aug 04 22:21:22.152376 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:22.152114    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-mms2l"]
Aug 04 22:21:22.152376 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:22.152228    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mms2l"
Aug 04 22:21:22.152376 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:21:22.152337    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mms2l" podUID="1675ffcb-004e-4aa6-9f0e-8d9c4567052a"
Aug 04 22:21:22.152889 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:22.152855    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-5h46r"]
Aug 04 22:21:22.153024 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:22.152954    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5h46r"
Aug 04 22:21:22.153106 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:21:22.153057    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5h46r" podUID="14077369-fe10-4854-8785-0bfc9addb7c4"
Aug 04 22:21:23.494169 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:23.494112    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5h46r"
Aug 04 22:21:23.494169 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:23.494173    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-64rgt"
Aug 04 22:21:23.494735 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:21:23.494226    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5h46r" podUID="14077369-fe10-4854-8785-0bfc9addb7c4"
Aug 04 22:21:23.494735 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:21:23.494287    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-64rgt" podUID="d04f70b8-d937-4f47-aa63-ee118a743487"
Aug 04 22:21:23.732588 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:23.732549    2580 generic.go:356] "Generic (PLEG): container finished" podID="c0c23bef-9c00-46e2-8f50-d67322ae45e6" containerID="f86466bf2925a818eebee0afc7d0aada7e3e520ab5cd3348bc17e67432ef0bab" exitCode=0
Aug 04 22:21:23.732756 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:23.732637    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p9zkw" event={"ID":"c0c23bef-9c00-46e2-8f50-d67322ae45e6","Type":"ContainerDied","Data":"f86466bf2925a818eebee0afc7d0aada7e3e520ab5cd3348bc17e67432ef0bab"}
Aug 04 22:21:24.492815 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:24.492790    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mms2l"
Aug 04 22:21:24.493016 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:21:24.492886    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mms2l" podUID="1675ffcb-004e-4aa6-9f0e-8d9c4567052a"
Aug 04 22:21:25.493797 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:25.493615    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5h46r"
Aug 04 22:21:25.494201 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:25.493615    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-64rgt"
Aug 04 22:21:25.494201 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:21:25.493910    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5h46r" podUID="14077369-fe10-4854-8785-0bfc9addb7c4"
Aug 04 22:21:25.494201 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:21:25.493938    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-64rgt" podUID="d04f70b8-d937-4f47-aa63-ee118a743487"
Aug 04 22:21:25.738275 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:25.738240    2580 generic.go:356] "Generic (PLEG): container finished" podID="c0c23bef-9c00-46e2-8f50-d67322ae45e6" containerID="d57653dfc8bd74081202f3b0ae224c6817f22e38e033821bd1937057852d433d" exitCode=0
Aug 04 22:21:25.738430 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:25.738297    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p9zkw" event={"ID":"c0c23bef-9c00-46e2-8f50-d67322ae45e6","Type":"ContainerDied","Data":"d57653dfc8bd74081202f3b0ae224c6817f22e38e033821bd1937057852d433d"}
Aug 04 22:21:26.493537 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:26.493502    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mms2l"
Aug 04 22:21:26.493724 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:21:26.493638    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mms2l" podUID="1675ffcb-004e-4aa6-9f0e-8d9c4567052a"
Aug 04 22:21:27.119586 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:27.119479    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/14077369-fe10-4854-8785-0bfc9addb7c4-metrics-certs\") pod \"network-metrics-daemon-5h46r\" (UID: \"14077369-fe10-4854-8785-0bfc9addb7c4\") " pod="openshift-multus/network-metrics-daemon-5h46r"
Aug 04 22:21:27.119586 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:27.119546    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1675ffcb-004e-4aa6-9f0e-8d9c4567052a-original-pull-secret\") pod \"global-pull-secret-syncer-mms2l\" (UID: \"1675ffcb-004e-4aa6-9f0e-8d9c4567052a\") " pod="kube-system/global-pull-secret-syncer-mms2l"
Aug 04 22:21:27.120001 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:21:27.119631    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 04 22:21:27.120001 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:21:27.119638    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 22:21:27.120001 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:21:27.119685    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1675ffcb-004e-4aa6-9f0e-8d9c4567052a-original-pull-secret podName:1675ffcb-004e-4aa6-9f0e-8d9c4567052a nodeName:}" failed. No retries permitted until 2026-08-04 22:21:59.119672009 +0000 UTC m=+66.112489718 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1675ffcb-004e-4aa6-9f0e-8d9c4567052a-original-pull-secret") pod "global-pull-secret-syncer-mms2l" (UID: "1675ffcb-004e-4aa6-9f0e-8d9c4567052a") : object "kube-system"/"original-pull-secret" not registered
Aug 04 22:21:27.120001 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:21:27.119699    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14077369-fe10-4854-8785-0bfc9addb7c4-metrics-certs podName:14077369-fe10-4854-8785-0bfc9addb7c4 nodeName:}" failed. No retries permitted until 2026-08-04 22:21:59.119692493 +0000 UTC m=+66.112510199 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/14077369-fe10-4854-8785-0bfc9addb7c4-metrics-certs") pod "network-metrics-daemon-5h46r" (UID: "14077369-fe10-4854-8785-0bfc9addb7c4") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 22:21:27.320739 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:27.320708    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ltxhz\" (UniqueName: \"kubernetes.io/projected/d04f70b8-d937-4f47-aa63-ee118a743487-kube-api-access-ltxhz\") pod \"network-check-target-64rgt\" (UID: \"d04f70b8-d937-4f47-aa63-ee118a743487\") " pod="openshift-network-diagnostics/network-check-target-64rgt"
Aug 04 22:21:27.320916 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:21:27.320901    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 04 22:21:27.320985 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:21:27.320929    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 04 22:21:27.320985 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:21:27.320942    2580 projected.go:196] Error preparing data for projected volume kube-api-access-ltxhz for pod openshift-network-diagnostics/network-check-target-64rgt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 22:21:27.321146 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:21:27.321037    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d04f70b8-d937-4f47-aa63-ee118a743487-kube-api-access-ltxhz podName:d04f70b8-d937-4f47-aa63-ee118a743487 nodeName:}" failed. No retries permitted until 2026-08-04 22:21:59.32099177 +0000 UTC m=+66.313809499 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-ltxhz" (UniqueName: "kubernetes.io/projected/d04f70b8-d937-4f47-aa63-ee118a743487-kube-api-access-ltxhz") pod "network-check-target-64rgt" (UID: "d04f70b8-d937-4f47-aa63-ee118a743487") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 22:21:27.493174 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:27.493109    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5h46r"
Aug 04 22:21:27.493381 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:21:27.493251    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5h46r" podUID="14077369-fe10-4854-8785-0bfc9addb7c4"
Aug 04 22:21:27.493381 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:27.493305    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-64rgt"
Aug 04 22:21:27.493498 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:21:27.493387    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-64rgt" podUID="d04f70b8-d937-4f47-aa63-ee118a743487"
Aug 04 22:21:27.744704 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:27.744625    2580 generic.go:356] "Generic (PLEG): container finished" podID="c0c23bef-9c00-46e2-8f50-d67322ae45e6" containerID="34a9daf2e56dd33540075653a0c32aaaedcdb2d128e93bb570e3ab2b5693fb10" exitCode=0
Aug 04 22:21:27.744704 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:27.744676    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p9zkw" event={"ID":"c0c23bef-9c00-46e2-8f50-d67322ae45e6","Type":"ContainerDied","Data":"34a9daf2e56dd33540075653a0c32aaaedcdb2d128e93bb570e3ab2b5693fb10"}
Aug 04 22:21:27.842961 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:27.842933    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-117.ec2.internal" event="NodeReady"
Aug 04 22:21:27.843166 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:27.843108    2580 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Aug 04 22:21:27.876406 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:27.876369    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-f77f48c6d-ghcnq"]
Aug 04 22:21:27.897818 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:27.897790    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-77b66db774-9npzs"]
Aug 04 22:21:27.897987 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:27.897907    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-f77f48c6d-ghcnq"
Aug 04 22:21:27.900014 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:27.899975    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Aug 04 22:21:27.900171 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:27.900030    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Aug 04 22:21:27.900171 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:27.900079    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-fgls5\""
Aug 04 22:21:27.921940 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:27.921912    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-f77f48c6d-ghcnq"]
Aug 04 22:21:27.921940 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:27.921947    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-77b66db774-9npzs"]
Aug 04 22:21:27.922115 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:27.922028    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-77b66db774-9npzs"
Aug 04 22:21:27.922115 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:27.922040    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-8nwrx"]
Aug 04 22:21:27.924046 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:27.924030    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-h7b97\""
Aug 04 22:21:27.924395 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:27.924378    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Aug 04 22:21:27.924544 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:27.924529    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Aug 04 22:21:27.924621 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:27.924549    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Aug 04 22:21:27.932410 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:27.932389    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Aug 04 22:21:27.941875 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:27.941852    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-l57vw"]
Aug 04 22:21:27.941989 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:27.941972    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8nwrx"
Aug 04 22:21:27.944160 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:27.944116    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Aug 04 22:21:27.944160 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:27.944153    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-d46fp\""
Aug 04 22:21:27.944311 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:27.944144    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Aug 04 22:21:27.954005 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:27.953988    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-8nwrx"]
Aug 04 22:21:27.954097 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:27.954017    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-l57vw"]
Aug 04 22:21:27.954146 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:27.954105    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-l57vw"
Aug 04 22:21:27.956380 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:27.956362    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Aug 04 22:21:27.956499 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:27.956412    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Aug 04 22:21:27.956557 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:27.956517    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Aug 04 22:21:27.956617 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:27.956602    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-qld8r\""
Aug 04 22:21:28.025736 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:28.025649    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-grghf\" (UniqueName: \"kubernetes.io/projected/069b448c-edde-423c-b08d-4cac577c09e5-kube-api-access-grghf\") pod \"image-registry-77b66db774-9npzs\" (UID: \"069b448c-edde-423c-b08d-4cac577c09e5\") " pod="openshift-image-registry/image-registry-77b66db774-9npzs"
Aug 04 22:21:28.025736 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:28.025689    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/771ddd03-8847-4587-bd07-96d0b0dccac5-nginx-conf\") pod \"networking-console-plugin-f77f48c6d-ghcnq\" (UID: \"771ddd03-8847-4587-bd07-96d0b0dccac5\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-ghcnq"
Aug 04 22:21:28.025736 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:28.025710    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cj6cs\" (UniqueName: \"kubernetes.io/projected/3363c6ec-b200-4050-b9bc-aa06ea7fad77-kube-api-access-cj6cs\") pod \"dns-default-8nwrx\" (UID: \"3363c6ec-b200-4050-b9bc-aa06ea7fad77\") " pod="openshift-dns/dns-default-8nwrx"
Aug 04 22:21:28.025736 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:28.025734    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/069b448c-edde-423c-b08d-4cac577c09e5-image-registry-private-configuration\") pod \"image-registry-77b66db774-9npzs\" (UID: \"069b448c-edde-423c-b08d-4cac577c09e5\") " pod="openshift-image-registry/image-registry-77b66db774-9npzs"
Aug 04 22:21:28.026011 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:28.025780    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/069b448c-edde-423c-b08d-4cac577c09e5-trusted-ca\") pod \"image-registry-77b66db774-9npzs\" (UID: \"069b448c-edde-423c-b08d-4cac577c09e5\") " pod="openshift-image-registry/image-registry-77b66db774-9npzs"
Aug 04 22:21:28.026011 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:28.025831    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/069b448c-edde-423c-b08d-4cac577c09e5-installation-pull-secrets\") pod \"image-registry-77b66db774-9npzs\" (UID: \"069b448c-edde-423c-b08d-4cac577c09e5\") " pod="openshift-image-registry/image-registry-77b66db774-9npzs"
Aug 04 22:21:28.026011 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:28.025856    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/069b448c-edde-423c-b08d-4cac577c09e5-bound-sa-token\") pod \"image-registry-77b66db774-9npzs\" (UID: \"069b448c-edde-423c-b08d-4cac577c09e5\") " pod="openshift-image-registry/image-registry-77b66db774-9npzs"
Aug 04 22:21:28.026011 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:28.025886    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/069b448c-edde-423c-b08d-4cac577c09e5-registry-tls\") pod \"image-registry-77b66db774-9npzs\" (UID: \"069b448c-edde-423c-b08d-4cac577c09e5\") " pod="openshift-image-registry/image-registry-77b66db774-9npzs"
Aug 04 22:21:28.026011 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:28.025902    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/069b448c-edde-423c-b08d-4cac577c09e5-ca-trust-extracted\") pod \"image-registry-77b66db774-9npzs\" (UID: \"069b448c-edde-423c-b08d-4cac577c09e5\") " pod="openshift-image-registry/image-registry-77b66db774-9npzs"
Aug 04 22:21:28.026011 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:28.025919    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3363c6ec-b200-4050-b9bc-aa06ea7fad77-tmp-dir\") pod \"dns-default-8nwrx\" (UID: \"3363c6ec-b200-4050-b9bc-aa06ea7fad77\") " pod="openshift-dns/dns-default-8nwrx"
Aug 04 22:21:28.026011 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:28.025943    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9jxlq\" (UniqueName: \"kubernetes.io/projected/c8c35a7c-9cad-4e67-aa5d-eee422ea3178-kube-api-access-9jxlq\") pod \"ingress-canary-l57vw\" (UID: \"c8c35a7c-9cad-4e67-aa5d-eee422ea3178\") " pod="openshift-ingress-canary/ingress-canary-l57vw"
Aug 04 22:21:28.026011 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:28.025957    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3363c6ec-b200-4050-b9bc-aa06ea7fad77-metrics-tls\") pod \"dns-default-8nwrx\" (UID: \"3363c6ec-b200-4050-b9bc-aa06ea7fad77\") " pod="openshift-dns/dns-default-8nwrx"
Aug 04 22:21:28.026011 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:28.025980    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/069b448c-edde-423c-b08d-4cac577c09e5-registry-certificates\") pod \"image-registry-77b66db774-9npzs\" (UID: \"069b448c-edde-423c-b08d-4cac577c09e5\") " pod="openshift-image-registry/image-registry-77b66db774-9npzs"
Aug 04 22:21:28.026011 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:28.026010    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c8c35a7c-9cad-4e67-aa5d-eee422ea3178-cert\") pod \"ingress-canary-l57vw\" (UID: \"c8c35a7c-9cad-4e67-aa5d-eee422ea3178\") " pod="openshift-ingress-canary/ingress-canary-l57vw"
Aug 04 22:21:28.026328 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:28.026033    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/771ddd03-8847-4587-bd07-96d0b0dccac5-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-ghcnq\" (UID: \"771ddd03-8847-4587-bd07-96d0b0dccac5\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-ghcnq"
Aug 04 22:21:28.026328 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:28.026072    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3363c6ec-b200-4050-b9bc-aa06ea7fad77-config-volume\") pod \"dns-default-8nwrx\" (UID: \"3363c6ec-b200-4050-b9bc-aa06ea7fad77\") " pod="openshift-dns/dns-default-8nwrx"
Aug 04 22:21:28.126515 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:28.126481    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9jxlq\" (UniqueName: \"kubernetes.io/projected/c8c35a7c-9cad-4e67-aa5d-eee422ea3178-kube-api-access-9jxlq\") pod \"ingress-canary-l57vw\" (UID: \"c8c35a7c-9cad-4e67-aa5d-eee422ea3178\") " pod="openshift-ingress-canary/ingress-canary-l57vw"
Aug 04 22:21:28.126515 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:28.126515    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3363c6ec-b200-4050-b9bc-aa06ea7fad77-metrics-tls\") pod \"dns-default-8nwrx\" (UID: \"3363c6ec-b200-4050-b9bc-aa06ea7fad77\") " pod="openshift-dns/dns-default-8nwrx"
Aug 04 22:21:28.127380 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:28.126546    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/069b448c-edde-423c-b08d-4cac577c09e5-registry-certificates\") pod \"image-registry-77b66db774-9npzs\" (UID: \"069b448c-edde-423c-b08d-4cac577c09e5\") " pod="openshift-image-registry/image-registry-77b66db774-9npzs"
Aug 04 22:21:28.127380 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:28.126565    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c8c35a7c-9cad-4e67-aa5d-eee422ea3178-cert\") pod \"ingress-canary-l57vw\" (UID: \"c8c35a7c-9cad-4e67-aa5d-eee422ea3178\") " pod="openshift-ingress-canary/ingress-canary-l57vw"
Aug 04 22:21:28.127380 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:28.126593    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/771ddd03-8847-4587-bd07-96d0b0dccac5-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-ghcnq\" (UID: \"771ddd03-8847-4587-bd07-96d0b0dccac5\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-ghcnq"
Aug 04 22:21:28.127380 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:28.126613    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3363c6ec-b200-4050-b9bc-aa06ea7fad77-config-volume\") pod \"dns-default-8nwrx\" (UID: \"3363c6ec-b200-4050-b9bc-aa06ea7fad77\") " pod="openshift-dns/dns-default-8nwrx"
Aug 04 22:21:28.127380 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:28.126639    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-grghf\" (UniqueName: \"kubernetes.io/projected/069b448c-edde-423c-b08d-4cac577c09e5-kube-api-access-grghf\") pod \"image-registry-77b66db774-9npzs\" (UID: \"069b448c-edde-423c-b08d-4cac577c09e5\") " pod="openshift-image-registry/image-registry-77b66db774-9npzs"
Aug 04 22:21:28.127380 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:28.126677    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/771ddd03-8847-4587-bd07-96d0b0dccac5-nginx-conf\") pod \"networking-console-plugin-f77f48c6d-ghcnq\" (UID: \"771ddd03-8847-4587-bd07-96d0b0dccac5\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-ghcnq"
Aug 04 22:21:28.127380 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:21:28.126638    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Aug 04 22:21:28.127380 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:28.126701    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cj6cs\" (UniqueName: \"kubernetes.io/projected/3363c6ec-b200-4050-b9bc-aa06ea7fad77-kube-api-access-cj6cs\") pod \"dns-default-8nwrx\" (UID: \"3363c6ec-b200-4050-b9bc-aa06ea7fad77\") " pod="openshift-dns/dns-default-8nwrx"
Aug 04 22:21:28.127380 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:21:28.126706    2580 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Aug 04 22:21:28.127380 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:28.126729    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/069b448c-edde-423c-b08d-4cac577c09e5-image-registry-private-configuration\") pod \"image-registry-77b66db774-9npzs\" (UID: \"069b448c-edde-423c-b08d-4cac577c09e5\") " pod="openshift-image-registry/image-registry-77b66db774-9npzs"
Aug 04 22:21:28.127380 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:21:28.126761    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3363c6ec-b200-4050-b9bc-aa06ea7fad77-metrics-tls podName:3363c6ec-b200-4050-b9bc-aa06ea7fad77 nodeName:}" failed. No retries permitted until 2026-08-04 22:21:28.626737397 +0000 UTC m=+35.619555105 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3363c6ec-b200-4050-b9bc-aa06ea7fad77-metrics-tls") pod "dns-default-8nwrx" (UID: "3363c6ec-b200-4050-b9bc-aa06ea7fad77") : secret "dns-default-metrics-tls" not found
Aug 04 22:21:28.127380 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:21:28.126810    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/771ddd03-8847-4587-bd07-96d0b0dccac5-networking-console-plugin-cert podName:771ddd03-8847-4587-bd07-96d0b0dccac5 nodeName:}" failed. No retries permitted until 2026-08-04 22:21:28.626799479 +0000 UTC m=+35.619617185 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/771ddd03-8847-4587-bd07-96d0b0dccac5-networking-console-plugin-cert") pod "networking-console-plugin-f77f48c6d-ghcnq" (UID: "771ddd03-8847-4587-bd07-96d0b0dccac5") : secret "networking-console-plugin-cert" not found
Aug 04 22:21:28.127380 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:28.126829    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/069b448c-edde-423c-b08d-4cac577c09e5-trusted-ca\") pod \"image-registry-77b66db774-9npzs\" (UID: \"069b448c-edde-423c-b08d-4cac577c09e5\") " pod="openshift-image-registry/image-registry-77b66db774-9npzs"
Aug 04 22:21:28.127380 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:28.126875    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/069b448c-edde-423c-b08d-4cac577c09e5-installation-pull-secrets\") pod \"image-registry-77b66db774-9npzs\" (UID: \"069b448c-edde-423c-b08d-4cac577c09e5\") " pod="openshift-image-registry/image-registry-77b66db774-9npzs"
Aug 04 22:21:28.127380 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:28.126911    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/069b448c-edde-423c-b08d-4cac577c09e5-bound-sa-token\") pod \"image-registry-77b66db774-9npzs\" (UID: \"069b448c-edde-423c-b08d-4cac577c09e5\") " pod="openshift-image-registry/image-registry-77b66db774-9npzs"
Aug 04 22:21:28.127380 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:28.126958    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/069b448c-edde-423c-b08d-4cac577c09e5-registry-tls\") pod \"image-registry-77b66db774-9npzs\" (UID: \"069b448c-edde-423c-b08d-4cac577c09e5\") " pod="openshift-image-registry/image-registry-77b66db774-9npzs"
Aug 04 22:21:28.128118 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:28.126983    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/069b448c-edde-423c-b08d-4cac577c09e5-ca-trust-extracted\") pod \"image-registry-77b66db774-9npzs\" (UID: \"069b448c-edde-423c-b08d-4cac577c09e5\") " pod="openshift-image-registry/image-registry-77b66db774-9npzs"
Aug 04 22:21:28.128118 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:28.127010    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3363c6ec-b200-4050-b9bc-aa06ea7fad77-tmp-dir\") pod \"dns-default-8nwrx\" (UID: \"3363c6ec-b200-4050-b9bc-aa06ea7fad77\") " pod="openshift-dns/dns-default-8nwrx"
Aug 04 22:21:28.128118 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:28.127253    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/069b448c-edde-423c-b08d-4cac577c09e5-registry-certificates\") pod \"image-registry-77b66db774-9npzs\" (UID: \"069b448c-edde-423c-b08d-4cac577c09e5\") " pod="openshift-image-registry/image-registry-77b66db774-9npzs"
Aug 04 22:21:28.128118 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:28.127329    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3363c6ec-b200-4050-b9bc-aa06ea7fad77-config-volume\") pod \"dns-default-8nwrx\" (UID: \"3363c6ec-b200-4050-b9bc-aa06ea7fad77\") " pod="openshift-dns/dns-default-8nwrx"
Aug 04 22:21:28.128118 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:28.127335    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3363c6ec-b200-4050-b9bc-aa06ea7fad77-tmp-dir\") pod \"dns-default-8nwrx\" (UID: \"3363c6ec-b200-4050-b9bc-aa06ea7fad77\") " pod="openshift-dns/dns-default-8nwrx"
Aug 04 22:21:28.128118 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:21:28.127420    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Aug 04 22:21:28.128118 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:21:28.127436    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77b66db774-9npzs: secret "image-registry-tls" not found
Aug 04 22:21:28.128118 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:21:28.127479    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/069b448c-edde-423c-b08d-4cac577c09e5-registry-tls podName:069b448c-edde-423c-b08d-4cac577c09e5 nodeName:}" failed. No retries permitted until 2026-08-04 22:21:28.627462919 +0000 UTC m=+35.620280628 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/069b448c-edde-423c-b08d-4cac577c09e5-registry-tls") pod "image-registry-77b66db774-9npzs" (UID: "069b448c-edde-423c-b08d-4cac577c09e5") : secret "image-registry-tls" not found
Aug 04 22:21:28.128118 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:28.127577    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/771ddd03-8847-4587-bd07-96d0b0dccac5-nginx-conf\") pod \"networking-console-plugin-f77f48c6d-ghcnq\" (UID: \"771ddd03-8847-4587-bd07-96d0b0dccac5\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-ghcnq"
Aug 04 22:21:28.128118 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:28.127782    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/069b448c-edde-423c-b08d-4cac577c09e5-ca-trust-extracted\") pod \"image-registry-77b66db774-9npzs\" (UID: \"069b448c-edde-423c-b08d-4cac577c09e5\") " pod="openshift-image-registry/image-registry-77b66db774-9npzs"
Aug 04 22:21:28.128484 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:28.128206    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/069b448c-edde-423c-b08d-4cac577c09e5-trusted-ca\") pod \"image-registry-77b66db774-9npzs\" (UID: \"069b448c-edde-423c-b08d-4cac577c09e5\") " pod="openshift-image-registry/image-registry-77b66db774-9npzs"
Aug 04 22:21:28.131021 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:28.130994    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/069b448c-edde-423c-b08d-4cac577c09e5-installation-pull-secrets\") pod \"image-registry-77b66db774-9npzs\" (UID: \"069b448c-edde-423c-b08d-4cac577c09e5\") " pod="openshift-image-registry/image-registry-77b66db774-9npzs"
Aug 04 22:21:28.131125 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:28.131002    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c8c35a7c-9cad-4e67-aa5d-eee422ea3178-cert\") pod \"ingress-canary-l57vw\" (UID: \"c8c35a7c-9cad-4e67-aa5d-eee422ea3178\") " pod="openshift-ingress-canary/ingress-canary-l57vw"
Aug 04 22:21:28.131125 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:28.131031    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/069b448c-edde-423c-b08d-4cac577c09e5-image-registry-private-configuration\") pod \"image-registry-77b66db774-9npzs\" (UID: \"069b448c-edde-423c-b08d-4cac577c09e5\") " pod="openshift-image-registry/image-registry-77b66db774-9npzs"
Aug 04 22:21:28.134920 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:28.134893    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9jxlq\" (UniqueName: \"kubernetes.io/projected/c8c35a7c-9cad-4e67-aa5d-eee422ea3178-kube-api-access-9jxlq\") pod \"ingress-canary-l57vw\" (UID: \"c8c35a7c-9cad-4e67-aa5d-eee422ea3178\") " pod="openshift-ingress-canary/ingress-canary-l57vw"
Aug 04 22:21:28.135229 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:28.135199    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/069b448c-edde-423c-b08d-4cac577c09e5-bound-sa-token\") pod \"image-registry-77b66db774-9npzs\" (UID: \"069b448c-edde-423c-b08d-4cac577c09e5\") " pod="openshift-image-registry/image-registry-77b66db774-9npzs"
Aug 04 22:21:28.135463 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:28.135446    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-grghf\" (UniqueName: \"kubernetes.io/projected/069b448c-edde-423c-b08d-4cac577c09e5-kube-api-access-grghf\") pod \"image-registry-77b66db774-9npzs\" (UID: \"069b448c-edde-423c-b08d-4cac577c09e5\") " pod="openshift-image-registry/image-registry-77b66db774-9npzs"
Aug 04 22:21:28.135646 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:28.135629    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cj6cs\" (UniqueName: \"kubernetes.io/projected/3363c6ec-b200-4050-b9bc-aa06ea7fad77-kube-api-access-cj6cs\") pod \"dns-default-8nwrx\" (UID: \"3363c6ec-b200-4050-b9bc-aa06ea7fad77\") " pod="openshift-dns/dns-default-8nwrx"
Aug 04 22:21:28.262318 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:28.262282    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-l57vw"
Aug 04 22:21:28.455762 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:28.455720    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-l57vw"]
Aug 04 22:21:28.459936 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:21:28.459903    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8c35a7c_9cad_4e67_aa5d_eee422ea3178.slice/crio-142182e57dfc7b8057b6eedf39c28bd33a57ba94a7f8d31be7e20c9b5eaf50a3 WatchSource:0}: Error finding container 142182e57dfc7b8057b6eedf39c28bd33a57ba94a7f8d31be7e20c9b5eaf50a3: Status 404 returned error can't find the container with id 142182e57dfc7b8057b6eedf39c28bd33a57ba94a7f8d31be7e20c9b5eaf50a3
Aug 04 22:21:28.493381 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:28.493349    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mms2l"
Aug 04 22:21:28.495554 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:28.495528    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Aug 04 22:21:28.631636 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:28.631601    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/069b448c-edde-423c-b08d-4cac577c09e5-registry-tls\") pod \"image-registry-77b66db774-9npzs\" (UID: \"069b448c-edde-423c-b08d-4cac577c09e5\") " pod="openshift-image-registry/image-registry-77b66db774-9npzs"
Aug 04 22:21:28.631849 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:28.631654    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3363c6ec-b200-4050-b9bc-aa06ea7fad77-metrics-tls\") pod \"dns-default-8nwrx\" (UID: \"3363c6ec-b200-4050-b9bc-aa06ea7fad77\") " pod="openshift-dns/dns-default-8nwrx"
Aug 04 22:21:28.631849 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:28.631701    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/771ddd03-8847-4587-bd07-96d0b0dccac5-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-ghcnq\" (UID: \"771ddd03-8847-4587-bd07-96d0b0dccac5\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-ghcnq"
Aug 04 22:21:28.631849 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:21:28.631753    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Aug 04 22:21:28.631849 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:21:28.631773    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77b66db774-9npzs: secret "image-registry-tls" not found
Aug 04 22:21:28.631849 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:21:28.631816    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Aug 04 22:21:28.631849 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:21:28.631823    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/069b448c-edde-423c-b08d-4cac577c09e5-registry-tls podName:069b448c-edde-423c-b08d-4cac577c09e5 nodeName:}" failed. No retries permitted until 2026-08-04 22:21:29.631808479 +0000 UTC m=+36.624626185 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/069b448c-edde-423c-b08d-4cac577c09e5-registry-tls") pod "image-registry-77b66db774-9npzs" (UID: "069b448c-edde-423c-b08d-4cac577c09e5") : secret "image-registry-tls" not found
Aug 04 22:21:28.632094 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:21:28.631875    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3363c6ec-b200-4050-b9bc-aa06ea7fad77-metrics-tls podName:3363c6ec-b200-4050-b9bc-aa06ea7fad77 nodeName:}" failed. No retries permitted until 2026-08-04 22:21:29.631862314 +0000 UTC m=+36.624680020 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3363c6ec-b200-4050-b9bc-aa06ea7fad77-metrics-tls") pod "dns-default-8nwrx" (UID: "3363c6ec-b200-4050-b9bc-aa06ea7fad77") : secret "dns-default-metrics-tls" not found
Aug 04 22:21:28.632094 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:21:28.631878    2580 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Aug 04 22:21:28.632094 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:21:28.631932    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/771ddd03-8847-4587-bd07-96d0b0dccac5-networking-console-plugin-cert podName:771ddd03-8847-4587-bd07-96d0b0dccac5 nodeName:}" failed. No retries permitted until 2026-08-04 22:21:29.631917814 +0000 UTC m=+36.624735524 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/771ddd03-8847-4587-bd07-96d0b0dccac5-networking-console-plugin-cert") pod "networking-console-plugin-f77f48c6d-ghcnq" (UID: "771ddd03-8847-4587-bd07-96d0b0dccac5") : secret "networking-console-plugin-cert" not found
Aug 04 22:21:28.749160 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:28.748921    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-l57vw" event={"ID":"c8c35a7c-9cad-4e67-aa5d-eee422ea3178","Type":"ContainerStarted","Data":"142182e57dfc7b8057b6eedf39c28bd33a57ba94a7f8d31be7e20c9b5eaf50a3"}
Aug 04 22:21:29.493633 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:29.493589    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5h46r"
Aug 04 22:21:29.494328 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:29.493589    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-64rgt"
Aug 04 22:21:29.496581 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:29.496559    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Aug 04 22:21:29.497541 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:29.497350    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Aug 04 22:21:29.497541 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:29.497391    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-5596r\""
Aug 04 22:21:29.497541 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:29.497475    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-j2l9z\""
Aug 04 22:21:29.497541 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:29.497543    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Aug 04 22:21:29.641619 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:29.641581    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/771ddd03-8847-4587-bd07-96d0b0dccac5-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-ghcnq\" (UID: \"771ddd03-8847-4587-bd07-96d0b0dccac5\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-ghcnq"
Aug 04 22:21:29.641811 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:29.641703    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/069b448c-edde-423c-b08d-4cac577c09e5-registry-tls\") pod \"image-registry-77b66db774-9npzs\" (UID: \"069b448c-edde-423c-b08d-4cac577c09e5\") " pod="openshift-image-registry/image-registry-77b66db774-9npzs"
Aug 04 22:21:29.641811 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:29.641741    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3363c6ec-b200-4050-b9bc-aa06ea7fad77-metrics-tls\") pod \"dns-default-8nwrx\" (UID: \"3363c6ec-b200-4050-b9bc-aa06ea7fad77\") " pod="openshift-dns/dns-default-8nwrx"
Aug 04 22:21:29.641811 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:21:29.641761    2580 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Aug 04 22:21:29.641811 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:21:29.641809    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Aug 04 22:21:29.642020 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:21:29.641828    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/771ddd03-8847-4587-bd07-96d0b0dccac5-networking-console-plugin-cert podName:771ddd03-8847-4587-bd07-96d0b0dccac5 nodeName:}" failed. No retries permitted until 2026-08-04 22:21:31.641808219 +0000 UTC m=+38.634625935 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/771ddd03-8847-4587-bd07-96d0b0dccac5-networking-console-plugin-cert") pod "networking-console-plugin-f77f48c6d-ghcnq" (UID: "771ddd03-8847-4587-bd07-96d0b0dccac5") : secret "networking-console-plugin-cert" not found
Aug 04 22:21:29.642020 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:21:29.641853    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3363c6ec-b200-4050-b9bc-aa06ea7fad77-metrics-tls podName:3363c6ec-b200-4050-b9bc-aa06ea7fad77 nodeName:}" failed. No retries permitted until 2026-08-04 22:21:31.641842099 +0000 UTC m=+38.634659805 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3363c6ec-b200-4050-b9bc-aa06ea7fad77-metrics-tls") pod "dns-default-8nwrx" (UID: "3363c6ec-b200-4050-b9bc-aa06ea7fad77") : secret "dns-default-metrics-tls" not found
Aug 04 22:21:29.642020 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:21:29.641853    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Aug 04 22:21:29.642020 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:21:29.641874    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77b66db774-9npzs: secret "image-registry-tls" not found
Aug 04 22:21:29.642020 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:21:29.641927    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/069b448c-edde-423c-b08d-4cac577c09e5-registry-tls podName:069b448c-edde-423c-b08d-4cac577c09e5 nodeName:}" failed. No retries permitted until 2026-08-04 22:21:31.641911496 +0000 UTC m=+38.634729222 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/069b448c-edde-423c-b08d-4cac577c09e5-registry-tls") pod "image-registry-77b66db774-9npzs" (UID: "069b448c-edde-423c-b08d-4cac577c09e5") : secret "image-registry-tls" not found
Aug 04 22:21:31.662902 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:31.662859    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/069b448c-edde-423c-b08d-4cac577c09e5-registry-tls\") pod \"image-registry-77b66db774-9npzs\" (UID: \"069b448c-edde-423c-b08d-4cac577c09e5\") " pod="openshift-image-registry/image-registry-77b66db774-9npzs"
Aug 04 22:21:31.663416 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:31.662918    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3363c6ec-b200-4050-b9bc-aa06ea7fad77-metrics-tls\") pod \"dns-default-8nwrx\" (UID: \"3363c6ec-b200-4050-b9bc-aa06ea7fad77\") " pod="openshift-dns/dns-default-8nwrx"
Aug 04 22:21:31.663416 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:31.662962    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/771ddd03-8847-4587-bd07-96d0b0dccac5-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-ghcnq\" (UID: \"771ddd03-8847-4587-bd07-96d0b0dccac5\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-ghcnq"
Aug 04 22:21:31.663416 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:21:31.663038    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Aug 04 22:21:31.663416 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:21:31.663065    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77b66db774-9npzs: secret "image-registry-tls" not found
Aug 04 22:21:31.663416 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:21:31.663087    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Aug 04 22:21:31.663416 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:21:31.663150    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/069b448c-edde-423c-b08d-4cac577c09e5-registry-tls podName:069b448c-edde-423c-b08d-4cac577c09e5 nodeName:}" failed. No retries permitted until 2026-08-04 22:21:35.663114555 +0000 UTC m=+42.655932269 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/069b448c-edde-423c-b08d-4cac577c09e5-registry-tls") pod "image-registry-77b66db774-9npzs" (UID: "069b448c-edde-423c-b08d-4cac577c09e5") : secret "image-registry-tls" not found
Aug 04 22:21:31.663416 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:21:31.663092    2580 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Aug 04 22:21:31.663416 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:21:31.663171    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3363c6ec-b200-4050-b9bc-aa06ea7fad77-metrics-tls podName:3363c6ec-b200-4050-b9bc-aa06ea7fad77 nodeName:}" failed. No retries permitted until 2026-08-04 22:21:35.663161677 +0000 UTC m=+42.655979387 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3363c6ec-b200-4050-b9bc-aa06ea7fad77-metrics-tls") pod "dns-default-8nwrx" (UID: "3363c6ec-b200-4050-b9bc-aa06ea7fad77") : secret "dns-default-metrics-tls" not found
Aug 04 22:21:31.663416 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:21:31.663203    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/771ddd03-8847-4587-bd07-96d0b0dccac5-networking-console-plugin-cert podName:771ddd03-8847-4587-bd07-96d0b0dccac5 nodeName:}" failed. No retries permitted until 2026-08-04 22:21:35.663184204 +0000 UTC m=+42.656001911 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/771ddd03-8847-4587-bd07-96d0b0dccac5-networking-console-plugin-cert") pod "networking-console-plugin-f77f48c6d-ghcnq" (UID: "771ddd03-8847-4587-bd07-96d0b0dccac5") : secret "networking-console-plugin-cert" not found
Aug 04 22:21:31.759419 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:31.759375    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-l57vw" event={"ID":"c8c35a7c-9cad-4e67-aa5d-eee422ea3178","Type":"ContainerStarted","Data":"567a0d3e7b486e0fe1a773bda1180467df869c58bb5e5c9dc082957e0593fe57"}
Aug 04 22:21:31.775730 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:31.775671    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-l57vw" podStartSLOduration=1.989068016 podStartE2EDuration="4.775648619s" totalImagesPullingTime="2.786580603s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 22:21:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 22:21:31.774452076 +0000 UTC m=+38.767269804" watchObservedRunningTime="2026-08-04 22:21:31.775648619 +0000 UTC m=+38.768466347"
Aug 04 22:21:33.767163 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:33.767111    2580 generic.go:356] "Generic (PLEG): container finished" podID="c0c23bef-9c00-46e2-8f50-d67322ae45e6" containerID="d053439e70178952b79347cc2b9a915adcf4e11a10202286446850f70b177a55" exitCode=0
Aug 04 22:21:33.767532 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:33.767179    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p9zkw" event={"ID":"c0c23bef-9c00-46e2-8f50-d67322ae45e6","Type":"ContainerDied","Data":"d053439e70178952b79347cc2b9a915adcf4e11a10202286446850f70b177a55"}
Aug 04 22:21:34.772269 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:34.772230    2580 generic.go:356] "Generic (PLEG): container finished" podID="c0c23bef-9c00-46e2-8f50-d67322ae45e6" containerID="49a3a314c266e1bfee701ea4dbb4fef236881e612f073f21bb7647d63a09833a" exitCode=0
Aug 04 22:21:34.772650 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:34.772286    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p9zkw" event={"ID":"c0c23bef-9c00-46e2-8f50-d67322ae45e6","Type":"ContainerDied","Data":"49a3a314c266e1bfee701ea4dbb4fef236881e612f073f21bb7647d63a09833a"}
Aug 04 22:21:35.692456 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:35.692419    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/069b448c-edde-423c-b08d-4cac577c09e5-registry-tls\") pod \"image-registry-77b66db774-9npzs\" (UID: \"069b448c-edde-423c-b08d-4cac577c09e5\") " pod="openshift-image-registry/image-registry-77b66db774-9npzs"
Aug 04 22:21:35.692456 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:35.692463    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3363c6ec-b200-4050-b9bc-aa06ea7fad77-metrics-tls\") pod \"dns-default-8nwrx\" (UID: \"3363c6ec-b200-4050-b9bc-aa06ea7fad77\") " pod="openshift-dns/dns-default-8nwrx"
Aug 04 22:21:35.692721 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:35.692495    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/771ddd03-8847-4587-bd07-96d0b0dccac5-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-ghcnq\" (UID: \"771ddd03-8847-4587-bd07-96d0b0dccac5\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-ghcnq"
Aug 04 22:21:35.692721 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:21:35.692578    2580 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Aug 04 22:21:35.692721 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:21:35.692585    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Aug 04 22:21:35.692721 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:21:35.692588    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Aug 04 22:21:35.692721 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:21:35.692640    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77b66db774-9npzs: secret "image-registry-tls" not found
Aug 04 22:21:35.692721 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:21:35.692629    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/771ddd03-8847-4587-bd07-96d0b0dccac5-networking-console-plugin-cert podName:771ddd03-8847-4587-bd07-96d0b0dccac5 nodeName:}" failed. No retries permitted until 2026-08-04 22:21:43.692615792 +0000 UTC m=+50.685433499 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/771ddd03-8847-4587-bd07-96d0b0dccac5-networking-console-plugin-cert") pod "networking-console-plugin-f77f48c6d-ghcnq" (UID: "771ddd03-8847-4587-bd07-96d0b0dccac5") : secret "networking-console-plugin-cert" not found
Aug 04 22:21:35.692721 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:21:35.692676    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3363c6ec-b200-4050-b9bc-aa06ea7fad77-metrics-tls podName:3363c6ec-b200-4050-b9bc-aa06ea7fad77 nodeName:}" failed. No retries permitted until 2026-08-04 22:21:43.692663638 +0000 UTC m=+50.685481345 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3363c6ec-b200-4050-b9bc-aa06ea7fad77-metrics-tls") pod "dns-default-8nwrx" (UID: "3363c6ec-b200-4050-b9bc-aa06ea7fad77") : secret "dns-default-metrics-tls" not found
Aug 04 22:21:35.692721 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:21:35.692691    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/069b448c-edde-423c-b08d-4cac577c09e5-registry-tls podName:069b448c-edde-423c-b08d-4cac577c09e5 nodeName:}" failed. No retries permitted until 2026-08-04 22:21:43.692681855 +0000 UTC m=+50.685499562 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/069b448c-edde-423c-b08d-4cac577c09e5-registry-tls") pod "image-registry-77b66db774-9npzs" (UID: "069b448c-edde-423c-b08d-4cac577c09e5") : secret "image-registry-tls" not found
Aug 04 22:21:35.777978 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:35.777943    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p9zkw" event={"ID":"c0c23bef-9c00-46e2-8f50-d67322ae45e6","Type":"ContainerStarted","Data":"5fdfe71182a86acce37c97e6903294aa8cbc4eaf11b6270667eef49eea8f2ef4"}
Aug 04 22:21:35.799194 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:35.799119    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-p9zkw" podStartSLOduration=9.48384674 podStartE2EDuration="42.79910405s" totalImagesPullingTime="33.31525731s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 22:20:53 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 22:21:35.797337879 +0000 UTC m=+42.790155608" watchObservedRunningTime="2026-08-04 22:21:35.79910405 +0000 UTC m=+42.791921779"
Aug 04 22:21:43.755566 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:43.755507    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/069b448c-edde-423c-b08d-4cac577c09e5-registry-tls\") pod \"image-registry-77b66db774-9npzs\" (UID: \"069b448c-edde-423c-b08d-4cac577c09e5\") " pod="openshift-image-registry/image-registry-77b66db774-9npzs"
Aug 04 22:21:43.755566 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:43.755578    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3363c6ec-b200-4050-b9bc-aa06ea7fad77-metrics-tls\") pod \"dns-default-8nwrx\" (UID: \"3363c6ec-b200-4050-b9bc-aa06ea7fad77\") " pod="openshift-dns/dns-default-8nwrx"
Aug 04 22:21:43.756079 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:43.755631    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/771ddd03-8847-4587-bd07-96d0b0dccac5-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-ghcnq\" (UID: \"771ddd03-8847-4587-bd07-96d0b0dccac5\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-ghcnq"
Aug 04 22:21:43.756079 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:21:43.755672    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Aug 04 22:21:43.756079 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:21:43.755693    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77b66db774-9npzs: secret "image-registry-tls" not found
Aug 04 22:21:43.756079 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:21:43.755733    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Aug 04 22:21:43.756079 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:21:43.755749    2580 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Aug 04 22:21:43.756079 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:21:43.755773    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/069b448c-edde-423c-b08d-4cac577c09e5-registry-tls podName:069b448c-edde-423c-b08d-4cac577c09e5 nodeName:}" failed. No retries permitted until 2026-08-04 22:21:59.755752758 +0000 UTC m=+66.748570481 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/069b448c-edde-423c-b08d-4cac577c09e5-registry-tls") pod "image-registry-77b66db774-9npzs" (UID: "069b448c-edde-423c-b08d-4cac577c09e5") : secret "image-registry-tls" not found
Aug 04 22:21:43.756079 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:21:43.755790    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3363c6ec-b200-4050-b9bc-aa06ea7fad77-metrics-tls podName:3363c6ec-b200-4050-b9bc-aa06ea7fad77 nodeName:}" failed. No retries permitted until 2026-08-04 22:21:59.755781745 +0000 UTC m=+66.748599452 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3363c6ec-b200-4050-b9bc-aa06ea7fad77-metrics-tls") pod "dns-default-8nwrx" (UID: "3363c6ec-b200-4050-b9bc-aa06ea7fad77") : secret "dns-default-metrics-tls" not found
Aug 04 22:21:43.756079 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:21:43.755803    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/771ddd03-8847-4587-bd07-96d0b0dccac5-networking-console-plugin-cert podName:771ddd03-8847-4587-bd07-96d0b0dccac5 nodeName:}" failed. No retries permitted until 2026-08-04 22:21:59.755796067 +0000 UTC m=+66.748613772 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/771ddd03-8847-4587-bd07-96d0b0dccac5-networking-console-plugin-cert") pod "networking-console-plugin-f77f48c6d-ghcnq" (UID: "771ddd03-8847-4587-bd07-96d0b0dccac5") : secret "networking-console-plugin-cert" not found
Aug 04 22:21:53.743441 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:53.743414    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cw6vm"
Aug 04 22:21:59.160370 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:59.160325    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/14077369-fe10-4854-8785-0bfc9addb7c4-metrics-certs\") pod \"network-metrics-daemon-5h46r\" (UID: \"14077369-fe10-4854-8785-0bfc9addb7c4\") " pod="openshift-multus/network-metrics-daemon-5h46r"
Aug 04 22:21:59.160774 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:59.160431    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1675ffcb-004e-4aa6-9f0e-8d9c4567052a-original-pull-secret\") pod \"global-pull-secret-syncer-mms2l\" (UID: \"1675ffcb-004e-4aa6-9f0e-8d9c4567052a\") " pod="kube-system/global-pull-secret-syncer-mms2l"
Aug 04 22:21:59.162699 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:59.162682    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Aug 04 22:21:59.162747 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:59.162710    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Aug 04 22:21:59.170515 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:21:59.170484    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Aug 04 22:21:59.170638 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:21:59.170554    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14077369-fe10-4854-8785-0bfc9addb7c4-metrics-certs podName:14077369-fe10-4854-8785-0bfc9addb7c4 nodeName:}" failed. No retries permitted until 2026-08-04 22:23:03.170536393 +0000 UTC m=+130.163354112 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/14077369-fe10-4854-8785-0bfc9addb7c4-metrics-certs") pod "network-metrics-daemon-5h46r" (UID: "14077369-fe10-4854-8785-0bfc9addb7c4") : secret "metrics-daemon-secret" not found
Aug 04 22:21:59.173782 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:59.173754    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1675ffcb-004e-4aa6-9f0e-8d9c4567052a-original-pull-secret\") pod \"global-pull-secret-syncer-mms2l\" (UID: \"1675ffcb-004e-4aa6-9f0e-8d9c4567052a\") " pod="kube-system/global-pull-secret-syncer-mms2l"
Aug 04 22:21:59.362152 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:59.362101    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ltxhz\" (UniqueName: \"kubernetes.io/projected/d04f70b8-d937-4f47-aa63-ee118a743487-kube-api-access-ltxhz\") pod \"network-check-target-64rgt\" (UID: \"d04f70b8-d937-4f47-aa63-ee118a743487\") " pod="openshift-network-diagnostics/network-check-target-64rgt"
Aug 04 22:21:59.364817 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:59.364797    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Aug 04 22:21:59.374449 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:59.374420    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Aug 04 22:21:59.385422 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:59.385391    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ltxhz\" (UniqueName: \"kubernetes.io/projected/d04f70b8-d937-4f47-aa63-ee118a743487-kube-api-access-ltxhz\") pod \"network-check-target-64rgt\" (UID: \"d04f70b8-d937-4f47-aa63-ee118a743487\") " pod="openshift-network-diagnostics/network-check-target-64rgt"
Aug 04 22:21:59.404293 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:59.404260    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mms2l"
Aug 04 22:21:59.514441 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:59.514415    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-j2l9z\""
Aug 04 22:21:59.520963 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:59.520942    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-mms2l"]
Aug 04 22:21:59.523037 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:59.523017    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-64rgt"
Aug 04 22:21:59.524562 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:21:59.524541    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1675ffcb_004e_4aa6_9f0e_8d9c4567052a.slice/crio-9d66cebee86c4f2603d210256dbdefc03c28303cb7cf829a6218cbb9c1daf44f WatchSource:0}: Error finding container 9d66cebee86c4f2603d210256dbdefc03c28303cb7cf829a6218cbb9c1daf44f: Status 404 returned error can't find the container with id 9d66cebee86c4f2603d210256dbdefc03c28303cb7cf829a6218cbb9c1daf44f
Aug 04 22:21:59.637306 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:59.637265    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-64rgt"]
Aug 04 22:21:59.642795 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:21:59.642769    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd04f70b8_d937_4f47_aa63_ee118a743487.slice/crio-95d221b3da64aa10846fae703e1d20ebc3301076c872d32e55762f2fdf3deba7 WatchSource:0}: Error finding container 95d221b3da64aa10846fae703e1d20ebc3301076c872d32e55762f2fdf3deba7: Status 404 returned error can't find the container with id 95d221b3da64aa10846fae703e1d20ebc3301076c872d32e55762f2fdf3deba7
Aug 04 22:21:59.765525 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:59.765446    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3363c6ec-b200-4050-b9bc-aa06ea7fad77-metrics-tls\") pod \"dns-default-8nwrx\" (UID: \"3363c6ec-b200-4050-b9bc-aa06ea7fad77\") " pod="openshift-dns/dns-default-8nwrx"
Aug 04 22:21:59.765525 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:59.765488    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/771ddd03-8847-4587-bd07-96d0b0dccac5-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-ghcnq\" (UID: \"771ddd03-8847-4587-bd07-96d0b0dccac5\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-ghcnq"
Aug 04 22:21:59.765690 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:59.765533    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/069b448c-edde-423c-b08d-4cac577c09e5-registry-tls\") pod \"image-registry-77b66db774-9npzs\" (UID: \"069b448c-edde-423c-b08d-4cac577c09e5\") " pod="openshift-image-registry/image-registry-77b66db774-9npzs"
Aug 04 22:21:59.765690 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:21:59.765594    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Aug 04 22:21:59.765690 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:21:59.765617    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Aug 04 22:21:59.765690 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:21:59.765628    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77b66db774-9npzs: secret "image-registry-tls" not found
Aug 04 22:21:59.765690 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:21:59.765647    2580 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Aug 04 22:21:59.765690 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:21:59.765653    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3363c6ec-b200-4050-b9bc-aa06ea7fad77-metrics-tls podName:3363c6ec-b200-4050-b9bc-aa06ea7fad77 nodeName:}" failed. No retries permitted until 2026-08-04 22:22:31.765637584 +0000 UTC m=+98.758455291 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3363c6ec-b200-4050-b9bc-aa06ea7fad77-metrics-tls") pod "dns-default-8nwrx" (UID: "3363c6ec-b200-4050-b9bc-aa06ea7fad77") : secret "dns-default-metrics-tls" not found
Aug 04 22:21:59.765870 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:21:59.765713    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/069b448c-edde-423c-b08d-4cac577c09e5-registry-tls podName:069b448c-edde-423c-b08d-4cac577c09e5 nodeName:}" failed. No retries permitted until 2026-08-04 22:22:31.765698186 +0000 UTC m=+98.758515893 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/069b448c-edde-423c-b08d-4cac577c09e5-registry-tls") pod "image-registry-77b66db774-9npzs" (UID: "069b448c-edde-423c-b08d-4cac577c09e5") : secret "image-registry-tls" not found
Aug 04 22:21:59.765870 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:21:59.765724    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/771ddd03-8847-4587-bd07-96d0b0dccac5-networking-console-plugin-cert podName:771ddd03-8847-4587-bd07-96d0b0dccac5 nodeName:}" failed. No retries permitted until 2026-08-04 22:22:31.765718006 +0000 UTC m=+98.758535712 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/771ddd03-8847-4587-bd07-96d0b0dccac5-networking-console-plugin-cert") pod "networking-console-plugin-f77f48c6d-ghcnq" (UID: "771ddd03-8847-4587-bd07-96d0b0dccac5") : secret "networking-console-plugin-cert" not found
Aug 04 22:21:59.834963 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:59.834931    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-mms2l" event={"ID":"1675ffcb-004e-4aa6-9f0e-8d9c4567052a","Type":"ContainerStarted","Data":"9d66cebee86c4f2603d210256dbdefc03c28303cb7cf829a6218cbb9c1daf44f"}
Aug 04 22:21:59.836039 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:21:59.836012    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-64rgt" event={"ID":"d04f70b8-d937-4f47-aa63-ee118a743487","Type":"ContainerStarted","Data":"95d221b3da64aa10846fae703e1d20ebc3301076c872d32e55762f2fdf3deba7"}
Aug 04 22:22:04.850859 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:22:04.850821    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-mms2l" event={"ID":"1675ffcb-004e-4aa6-9f0e-8d9c4567052a","Type":"ContainerStarted","Data":"8eb4bf2689b338af658130e8d58b3e2a266d83b6375f2f4ca2c3fb7cb1d58026"}
Aug 04 22:22:04.852397 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:22:04.852372    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-64rgt" event={"ID":"d04f70b8-d937-4f47-aa63-ee118a743487","Type":"ContainerStarted","Data":"2c2e9f40ef43c4a632e06b437518fee16bf45be4a87e408272684b4e82c5cf6a"}
Aug 04 22:22:04.852518 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:22:04.852503    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-64rgt"
Aug 04 22:22:04.866638 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:22:04.866581    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-mms2l" podStartSLOduration=66.735514144 podStartE2EDuration="1m11.866563438s" totalImagesPullingTime="5.131049294s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 22:20:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 22:22:04.866404691 +0000 UTC m=+71.859222418" watchObservedRunningTime="2026-08-04 22:22:04.866563438 +0000 UTC m=+71.859381166"
Aug 04 22:22:04.881593 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:22:04.881545    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-64rgt" podStartSLOduration=66.872388177 podStartE2EDuration="1m11.881529592s" totalImagesPullingTime="5.009141415s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 22:20:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 22:22:04.880421165 +0000 UTC m=+71.873238906" watchObservedRunningTime="2026-08-04 22:22:04.881529592 +0000 UTC m=+71.874347321"
Aug 04 22:22:31.812506 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:22:31.812473    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/069b448c-edde-423c-b08d-4cac577c09e5-registry-tls\") pod \"image-registry-77b66db774-9npzs\" (UID: \"069b448c-edde-423c-b08d-4cac577c09e5\") " pod="openshift-image-registry/image-registry-77b66db774-9npzs"
Aug 04 22:22:31.812970 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:22:31.812516    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3363c6ec-b200-4050-b9bc-aa06ea7fad77-metrics-tls\") pod \"dns-default-8nwrx\" (UID: \"3363c6ec-b200-4050-b9bc-aa06ea7fad77\") " pod="openshift-dns/dns-default-8nwrx"
Aug 04 22:22:31.812970 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:22:31.812540    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/771ddd03-8847-4587-bd07-96d0b0dccac5-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-ghcnq\" (UID: \"771ddd03-8847-4587-bd07-96d0b0dccac5\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-ghcnq"
Aug 04 22:22:31.812970 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:22:31.812625    2580 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Aug 04 22:22:31.812970 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:22:31.812638    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Aug 04 22:22:31.812970 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:22:31.812687    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/771ddd03-8847-4587-bd07-96d0b0dccac5-networking-console-plugin-cert podName:771ddd03-8847-4587-bd07-96d0b0dccac5 nodeName:}" failed. No retries permitted until 2026-08-04 22:23:35.812673999 +0000 UTC m=+162.805491705 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/771ddd03-8847-4587-bd07-96d0b0dccac5-networking-console-plugin-cert") pod "networking-console-plugin-f77f48c6d-ghcnq" (UID: "771ddd03-8847-4587-bd07-96d0b0dccac5") : secret "networking-console-plugin-cert" not found
Aug 04 22:22:31.812970 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:22:31.812703    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Aug 04 22:22:31.812970 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:22:31.812723    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77b66db774-9npzs: secret "image-registry-tls" not found
Aug 04 22:22:31.812970 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:22:31.812711    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3363c6ec-b200-4050-b9bc-aa06ea7fad77-metrics-tls podName:3363c6ec-b200-4050-b9bc-aa06ea7fad77 nodeName:}" failed. No retries permitted until 2026-08-04 22:23:35.812693825 +0000 UTC m=+162.805511534 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3363c6ec-b200-4050-b9bc-aa06ea7fad77-metrics-tls") pod "dns-default-8nwrx" (UID: "3363c6ec-b200-4050-b9bc-aa06ea7fad77") : secret "dns-default-metrics-tls" not found
Aug 04 22:22:31.812970 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:22:31.812791    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/069b448c-edde-423c-b08d-4cac577c09e5-registry-tls podName:069b448c-edde-423c-b08d-4cac577c09e5 nodeName:}" failed. No retries permitted until 2026-08-04 22:23:35.812776574 +0000 UTC m=+162.805594282 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/069b448c-edde-423c-b08d-4cac577c09e5-registry-tls") pod "image-registry-77b66db774-9npzs" (UID: "069b448c-edde-423c-b08d-4cac577c09e5") : secret "image-registry-tls" not found
Aug 04 22:22:35.858149 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:22:35.858103    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-64rgt"
Aug 04 22:23:03.240149 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:23:03.240092    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/14077369-fe10-4854-8785-0bfc9addb7c4-metrics-certs\") pod \"network-metrics-daemon-5h46r\" (UID: \"14077369-fe10-4854-8785-0bfc9addb7c4\") " pod="openshift-multus/network-metrics-daemon-5h46r"
Aug 04 22:23:03.240635 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:23:03.240245    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Aug 04 22:23:03.240635 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:23:03.240320    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14077369-fe10-4854-8785-0bfc9addb7c4-metrics-certs podName:14077369-fe10-4854-8785-0bfc9addb7c4 nodeName:}" failed. No retries permitted until 2026-08-04 22:25:05.240303584 +0000 UTC m=+252.233121290 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/14077369-fe10-4854-8785-0bfc9addb7c4-metrics-certs") pod "network-metrics-daemon-5h46r" (UID: "14077369-fe10-4854-8785-0bfc9addb7c4") : secret "metrics-daemon-secret" not found
Aug 04 22:23:30.908044 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:23:30.907984    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-f77f48c6d-ghcnq" podUID="771ddd03-8847-4587-bd07-96d0b0dccac5"
Aug 04 22:23:30.931965 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:23:30.931937    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-77b66db774-9npzs" podUID="069b448c-edde-423c-b08d-4cac577c09e5"
Aug 04 22:23:30.950552 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:23:30.950530    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-8nwrx" podUID="3363c6ec-b200-4050-b9bc-aa06ea7fad77"
Aug 04 22:23:31.049688 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:23:31.049658    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-77b66db774-9npzs"
Aug 04 22:23:31.049688 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:23:31.049677    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-f77f48c6d-ghcnq"
Aug 04 22:23:31.049852 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:23:31.049659    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8nwrx"
Aug 04 22:23:32.505927 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:23:32.505875    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-5h46r" podUID="14077369-fe10-4854-8785-0bfc9addb7c4"
Aug 04 22:23:35.864694 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:23:35.864657    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/069b448c-edde-423c-b08d-4cac577c09e5-registry-tls\") pod \"image-registry-77b66db774-9npzs\" (UID: \"069b448c-edde-423c-b08d-4cac577c09e5\") " pod="openshift-image-registry/image-registry-77b66db774-9npzs"
Aug 04 22:23:35.864694 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:23:35.864699    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3363c6ec-b200-4050-b9bc-aa06ea7fad77-metrics-tls\") pod \"dns-default-8nwrx\" (UID: \"3363c6ec-b200-4050-b9bc-aa06ea7fad77\") " pod="openshift-dns/dns-default-8nwrx"
Aug 04 22:23:35.865295 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:23:35.864733    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/771ddd03-8847-4587-bd07-96d0b0dccac5-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-ghcnq\" (UID: \"771ddd03-8847-4587-bd07-96d0b0dccac5\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-ghcnq"
Aug 04 22:23:35.865295 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:23:35.864820    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Aug 04 22:23:35.865295 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:23:35.864832    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Aug 04 22:23:35.865295 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:23:35.864915    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3363c6ec-b200-4050-b9bc-aa06ea7fad77-metrics-tls podName:3363c6ec-b200-4050-b9bc-aa06ea7fad77 nodeName:}" failed. No retries permitted until 2026-08-04 22:25:37.864895025 +0000 UTC m=+284.857712733 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3363c6ec-b200-4050-b9bc-aa06ea7fad77-metrics-tls") pod "dns-default-8nwrx" (UID: "3363c6ec-b200-4050-b9bc-aa06ea7fad77") : secret "dns-default-metrics-tls" not found
Aug 04 22:23:35.865295 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:23:35.864841    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77b66db774-9npzs: secret "image-registry-tls" not found
Aug 04 22:23:35.865295 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:23:35.864979    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/069b448c-edde-423c-b08d-4cac577c09e5-registry-tls podName:069b448c-edde-423c-b08d-4cac577c09e5 nodeName:}" failed. No retries permitted until 2026-08-04 22:25:37.864967091 +0000 UTC m=+284.857784830 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/069b448c-edde-423c-b08d-4cac577c09e5-registry-tls") pod "image-registry-77b66db774-9npzs" (UID: "069b448c-edde-423c-b08d-4cac577c09e5") : secret "image-registry-tls" not found
Aug 04 22:23:35.865295 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:23:35.864822    2580 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Aug 04 22:23:35.865295 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:23:35.865023    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/771ddd03-8847-4587-bd07-96d0b0dccac5-networking-console-plugin-cert podName:771ddd03-8847-4587-bd07-96d0b0dccac5 nodeName:}" failed. No retries permitted until 2026-08-04 22:25:37.865013866 +0000 UTC m=+284.857831594 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/771ddd03-8847-4587-bd07-96d0b0dccac5-networking-console-plugin-cert") pod "networking-console-plugin-f77f48c6d-ghcnq" (UID: "771ddd03-8847-4587-bd07-96d0b0dccac5") : secret "networking-console-plugin-cert" not found
Aug 04 22:23:46.493034 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:23:46.492953    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5h46r"
Aug 04 22:25:05.272878 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:05.272832    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/14077369-fe10-4854-8785-0bfc9addb7c4-metrics-certs\") pod \"network-metrics-daemon-5h46r\" (UID: \"14077369-fe10-4854-8785-0bfc9addb7c4\") " pod="openshift-multus/network-metrics-daemon-5h46r"
Aug 04 22:25:05.273362 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:25:05.272947    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Aug 04 22:25:05.273362 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:25:05.272996    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14077369-fe10-4854-8785-0bfc9addb7c4-metrics-certs podName:14077369-fe10-4854-8785-0bfc9addb7c4 nodeName:}" failed. No retries permitted until 2026-08-04 22:27:07.272983774 +0000 UTC m=+374.265801481 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/14077369-fe10-4854-8785-0bfc9addb7c4-metrics-certs") pod "network-metrics-daemon-5h46r" (UID: "14077369-fe10-4854-8785-0bfc9addb7c4") : secret "metrics-daemon-secret" not found
Aug 04 22:25:21.542373 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:21.542286    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-784f97bcf6-g68vv"]
Aug 04 22:25:21.544367 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:21.544347    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-2ksv9"]
Aug 04 22:25:21.544490 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:21.544463    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-g68vv"
Aug 04 22:25:21.546257 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:21.546239    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-lvpr4"]
Aug 04 22:25:21.546395 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:21.546377    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-2ksv9"
Aug 04 22:25:21.547118 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:21.547100    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Aug 04 22:25:21.547204 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:21.547171    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Aug 04 22:25:21.547530 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:21.547516    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Aug 04 22:25:21.547659 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:21.547648    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-jffz6\""
Aug 04 22:25:21.547712 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:21.547696    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Aug 04 22:25:21.547964 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:21.547942    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-lvpr4"
Aug 04 22:25:21.550109 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:21.550090    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Aug 04 22:25:21.550270 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:21.550253    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Aug 04 22:25:21.550382 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:21.550357    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Aug 04 22:25:21.550443 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:21.550425    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Aug 04 22:25:21.550537 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:21.550522    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Aug 04 22:25:21.550597 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:21.550542    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-9ktkc\""
Aug 04 22:25:21.550597 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:21.550550    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-sqljb\""
Aug 04 22:25:21.550846 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:21.550828    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Aug 04 22:25:21.551643 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:21.551629    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Aug 04 22:25:21.558455 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:21.558407    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-784f97bcf6-g68vv"]
Aug 04 22:25:21.559419 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:21.559398    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-lvpr4"]
Aug 04 22:25:21.561040 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:21.561020    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-2ksv9"]
Aug 04 22:25:21.577353 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:21.577327    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ghz4n\" (UniqueName: \"kubernetes.io/projected/320ff4f5-8627-4ceb-adf1-829cf2b570dd-kube-api-access-ghz4n\") pod \"cluster-samples-operator-559cbf5745-lvpr4\" (UID: \"320ff4f5-8627-4ceb-adf1-829cf2b570dd\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-lvpr4"
Aug 04 22:25:21.577440 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:21.577374    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/968aa3c2-b641-483d-a1b0-d0efc3df099e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-2ksv9\" (UID: \"968aa3c2-b641-483d-a1b0-d0efc3df099e\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-2ksv9"
Aug 04 22:25:21.577440 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:21.577419    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/320ff4f5-8627-4ceb-adf1-829cf2b570dd-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-lvpr4\" (UID: \"320ff4f5-8627-4ceb-adf1-829cf2b570dd\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-lvpr4"
Aug 04 22:25:21.577515 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:21.577444    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m8nph\" (UniqueName: \"kubernetes.io/projected/968aa3c2-b641-483d-a1b0-d0efc3df099e-kube-api-access-m8nph\") pod \"cluster-monitoring-operator-6f55c4f58d-2ksv9\" (UID: \"968aa3c2-b641-483d-a1b0-d0efc3df099e\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-2ksv9"
Aug 04 22:25:21.577515 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:21.577467    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/968aa3c2-b641-483d-a1b0-d0efc3df099e-telemetry-config\") pod \"cluster-monitoring-operator-6f55c4f58d-2ksv9\" (UID: \"968aa3c2-b641-483d-a1b0-d0efc3df099e\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-2ksv9"
Aug 04 22:25:21.577515 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:21.577496    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bn2xt\" (UniqueName: \"kubernetes.io/projected/e43db356-a90d-4670-8f61-0d95a0c859af-kube-api-access-bn2xt\") pod \"service-ca-operator-784f97bcf6-g68vv\" (UID: \"e43db356-a90d-4670-8f61-0d95a0c859af\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-g68vv"
Aug 04 22:25:21.577604 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:21.577534    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e43db356-a90d-4670-8f61-0d95a0c859af-serving-cert\") pod \"service-ca-operator-784f97bcf6-g68vv\" (UID: \"e43db356-a90d-4670-8f61-0d95a0c859af\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-g68vv"
Aug 04 22:25:21.577604 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:21.577549    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e43db356-a90d-4670-8f61-0d95a0c859af-config\") pod \"service-ca-operator-784f97bcf6-g68vv\" (UID: \"e43db356-a90d-4670-8f61-0d95a0c859af\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-g68vv"
Aug 04 22:25:21.635180 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:21.635152    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-2pxjd"]
Aug 04 22:25:21.637320 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:21.637301    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-2pxjd"
Aug 04 22:25:21.639586 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:21.639560    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Aug 04 22:25:21.639799 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:21.639776    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-tnprd\""
Aug 04 22:25:21.639955 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:21.639938    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Aug 04 22:25:21.658481 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:21.658464    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-2pxjd"]
Aug 04 22:25:21.678392 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:21.678371    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e43db356-a90d-4670-8f61-0d95a0c859af-serving-cert\") pod \"service-ca-operator-784f97bcf6-g68vv\" (UID: \"e43db356-a90d-4670-8f61-0d95a0c859af\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-g68vv"
Aug 04 22:25:21.678484 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:21.678398    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e43db356-a90d-4670-8f61-0d95a0c859af-config\") pod \"service-ca-operator-784f97bcf6-g68vv\" (UID: \"e43db356-a90d-4670-8f61-0d95a0c859af\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-g68vv"
Aug 04 22:25:21.678484 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:21.678437    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ghz4n\" (UniqueName: \"kubernetes.io/projected/320ff4f5-8627-4ceb-adf1-829cf2b570dd-kube-api-access-ghz4n\") pod \"cluster-samples-operator-559cbf5745-lvpr4\" (UID: \"320ff4f5-8627-4ceb-adf1-829cf2b570dd\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-lvpr4"
Aug 04 22:25:21.678574 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:21.678480    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/968aa3c2-b641-483d-a1b0-d0efc3df099e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-2ksv9\" (UID: \"968aa3c2-b641-483d-a1b0-d0efc3df099e\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-2ksv9"
Aug 04 22:25:21.678574 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:21.678508    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/320ff4f5-8627-4ceb-adf1-829cf2b570dd-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-lvpr4\" (UID: \"320ff4f5-8627-4ceb-adf1-829cf2b570dd\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-lvpr4"
Aug 04 22:25:21.678574 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:21.678531    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m8nph\" (UniqueName: \"kubernetes.io/projected/968aa3c2-b641-483d-a1b0-d0efc3df099e-kube-api-access-m8nph\") pod \"cluster-monitoring-operator-6f55c4f58d-2ksv9\" (UID: \"968aa3c2-b641-483d-a1b0-d0efc3df099e\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-2ksv9"
Aug 04 22:25:21.678574 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:21.678558    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/968aa3c2-b641-483d-a1b0-d0efc3df099e-telemetry-config\") pod \"cluster-monitoring-operator-6f55c4f58d-2ksv9\" (UID: \"968aa3c2-b641-483d-a1b0-d0efc3df099e\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-2ksv9"
Aug 04 22:25:21.678764 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:21.678591    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bn2xt\" (UniqueName: \"kubernetes.io/projected/e43db356-a90d-4670-8f61-0d95a0c859af-kube-api-access-bn2xt\") pod \"service-ca-operator-784f97bcf6-g68vv\" (UID: \"e43db356-a90d-4670-8f61-0d95a0c859af\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-g68vv"
Aug 04 22:25:21.678764 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:25:21.678630    2580 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Aug 04 22:25:21.678764 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:25:21.678642    2580 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Aug 04 22:25:21.678764 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:21.678645    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6k7c9\" (UniqueName: \"kubernetes.io/projected/d8b1f339-0748-481e-82fd-24b4e76a721a-kube-api-access-6k7c9\") pod \"volume-data-source-validator-5b8776669-2pxjd\" (UID: \"d8b1f339-0748-481e-82fd-24b4e76a721a\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-2pxjd"
Aug 04 22:25:21.678764 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:25:21.678692    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/968aa3c2-b641-483d-a1b0-d0efc3df099e-cluster-monitoring-operator-tls podName:968aa3c2-b641-483d-a1b0-d0efc3df099e nodeName:}" failed. No retries permitted until 2026-08-04 22:25:22.178672835 +0000 UTC m=+269.171490551 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/968aa3c2-b641-483d-a1b0-d0efc3df099e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6f55c4f58d-2ksv9" (UID: "968aa3c2-b641-483d-a1b0-d0efc3df099e") : secret "cluster-monitoring-operator-tls" not found
Aug 04 22:25:21.678764 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:25:21.678744    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/320ff4f5-8627-4ceb-adf1-829cf2b570dd-samples-operator-tls podName:320ff4f5-8627-4ceb-adf1-829cf2b570dd nodeName:}" failed. No retries permitted until 2026-08-04 22:25:22.178725004 +0000 UTC m=+269.171542726 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/320ff4f5-8627-4ceb-adf1-829cf2b570dd-samples-operator-tls") pod "cluster-samples-operator-559cbf5745-lvpr4" (UID: "320ff4f5-8627-4ceb-adf1-829cf2b570dd") : secret "samples-operator-tls" not found
Aug 04 22:25:21.679100 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:21.679084    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e43db356-a90d-4670-8f61-0d95a0c859af-config\") pod \"service-ca-operator-784f97bcf6-g68vv\" (UID: \"e43db356-a90d-4670-8f61-0d95a0c859af\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-g68vv"
Aug 04 22:25:21.679391 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:21.679371    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/968aa3c2-b641-483d-a1b0-d0efc3df099e-telemetry-config\") pod \"cluster-monitoring-operator-6f55c4f58d-2ksv9\" (UID: \"968aa3c2-b641-483d-a1b0-d0efc3df099e\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-2ksv9"
Aug 04 22:25:21.680659 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:21.680644    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e43db356-a90d-4670-8f61-0d95a0c859af-serving-cert\") pod \"service-ca-operator-784f97bcf6-g68vv\" (UID: \"e43db356-a90d-4670-8f61-0d95a0c859af\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-g68vv"
Aug 04 22:25:21.690187 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:21.690164    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bn2xt\" (UniqueName: \"kubernetes.io/projected/e43db356-a90d-4670-8f61-0d95a0c859af-kube-api-access-bn2xt\") pod \"service-ca-operator-784f97bcf6-g68vv\" (UID: \"e43db356-a90d-4670-8f61-0d95a0c859af\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-g68vv"
Aug 04 22:25:21.690558 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:21.690540    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ghz4n\" (UniqueName: \"kubernetes.io/projected/320ff4f5-8627-4ceb-adf1-829cf2b570dd-kube-api-access-ghz4n\") pod \"cluster-samples-operator-559cbf5745-lvpr4\" (UID: \"320ff4f5-8627-4ceb-adf1-829cf2b570dd\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-lvpr4"
Aug 04 22:25:21.691292 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:21.691268    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m8nph\" (UniqueName: \"kubernetes.io/projected/968aa3c2-b641-483d-a1b0-d0efc3df099e-kube-api-access-m8nph\") pod \"cluster-monitoring-operator-6f55c4f58d-2ksv9\" (UID: \"968aa3c2-b641-483d-a1b0-d0efc3df099e\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-2ksv9"
Aug 04 22:25:21.779808 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:21.779763    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6k7c9\" (UniqueName: \"kubernetes.io/projected/d8b1f339-0748-481e-82fd-24b4e76a721a-kube-api-access-6k7c9\") pod \"volume-data-source-validator-5b8776669-2pxjd\" (UID: \"d8b1f339-0748-481e-82fd-24b4e76a721a\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-2pxjd"
Aug 04 22:25:21.791181 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:21.787906    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6k7c9\" (UniqueName: \"kubernetes.io/projected/d8b1f339-0748-481e-82fd-24b4e76a721a-kube-api-access-6k7c9\") pod \"volume-data-source-validator-5b8776669-2pxjd\" (UID: \"d8b1f339-0748-481e-82fd-24b4e76a721a\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-2pxjd"
Aug 04 22:25:21.856154 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:21.856113    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-g68vv"
Aug 04 22:25:21.945701 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:21.945664    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-2pxjd"
Aug 04 22:25:21.970615 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:21.970587    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-784f97bcf6-g68vv"]
Aug 04 22:25:21.973560 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:25:21.973530    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode43db356_a90d_4670_8f61_0d95a0c859af.slice/crio-2b2de1d008b0a4fe89a4bd29505d506feb686056b9a7ca54ee3dbbb184317443 WatchSource:0}: Error finding container 2b2de1d008b0a4fe89a4bd29505d506feb686056b9a7ca54ee3dbbb184317443: Status 404 returned error can't find the container with id 2b2de1d008b0a4fe89a4bd29505d506feb686056b9a7ca54ee3dbbb184317443
Aug 04 22:25:22.062195 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:22.062166    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-2pxjd"]
Aug 04 22:25:22.064899 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:25:22.064870    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8b1f339_0748_481e_82fd_24b4e76a721a.slice/crio-2a83926b4f9c951347a71f7cd2ab2b50bb90f41d9c8a22e8bcb0da542b95d575 WatchSource:0}: Error finding container 2a83926b4f9c951347a71f7cd2ab2b50bb90f41d9c8a22e8bcb0da542b95d575: Status 404 returned error can't find the container with id 2a83926b4f9c951347a71f7cd2ab2b50bb90f41d9c8a22e8bcb0da542b95d575
Aug 04 22:25:22.183486 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:22.183395    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/968aa3c2-b641-483d-a1b0-d0efc3df099e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-2ksv9\" (UID: \"968aa3c2-b641-483d-a1b0-d0efc3df099e\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-2ksv9"
Aug 04 22:25:22.183486 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:22.183431    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/320ff4f5-8627-4ceb-adf1-829cf2b570dd-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-lvpr4\" (UID: \"320ff4f5-8627-4ceb-adf1-829cf2b570dd\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-lvpr4"
Aug 04 22:25:22.183682 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:25:22.183562    2580 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Aug 04 22:25:22.183682 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:25:22.183627    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/968aa3c2-b641-483d-a1b0-d0efc3df099e-cluster-monitoring-operator-tls podName:968aa3c2-b641-483d-a1b0-d0efc3df099e nodeName:}" failed. No retries permitted until 2026-08-04 22:25:23.183613089 +0000 UTC m=+270.176430797 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/968aa3c2-b641-483d-a1b0-d0efc3df099e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6f55c4f58d-2ksv9" (UID: "968aa3c2-b641-483d-a1b0-d0efc3df099e") : secret "cluster-monitoring-operator-tls" not found
Aug 04 22:25:22.183682 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:25:22.183567    2580 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Aug 04 22:25:22.183801 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:25:22.183693    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/320ff4f5-8627-4ceb-adf1-829cf2b570dd-samples-operator-tls podName:320ff4f5-8627-4ceb-adf1-829cf2b570dd nodeName:}" failed. No retries permitted until 2026-08-04 22:25:23.183680999 +0000 UTC m=+270.176498707 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/320ff4f5-8627-4ceb-adf1-829cf2b570dd-samples-operator-tls") pod "cluster-samples-operator-559cbf5745-lvpr4" (UID: "320ff4f5-8627-4ceb-adf1-829cf2b570dd") : secret "samples-operator-tls" not found
Aug 04 22:25:22.314979 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:22.314938    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-2pxjd" event={"ID":"d8b1f339-0748-481e-82fd-24b4e76a721a","Type":"ContainerStarted","Data":"2a83926b4f9c951347a71f7cd2ab2b50bb90f41d9c8a22e8bcb0da542b95d575"}
Aug 04 22:25:22.315947 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:22.315920    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-g68vv" event={"ID":"e43db356-a90d-4670-8f61-0d95a0c859af","Type":"ContainerStarted","Data":"2b2de1d008b0a4fe89a4bd29505d506feb686056b9a7ca54ee3dbbb184317443"}
Aug 04 22:25:23.192448 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:23.192155    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/968aa3c2-b641-483d-a1b0-d0efc3df099e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-2ksv9\" (UID: \"968aa3c2-b641-483d-a1b0-d0efc3df099e\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-2ksv9"
Aug 04 22:25:23.192448 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:23.192211    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/320ff4f5-8627-4ceb-adf1-829cf2b570dd-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-lvpr4\" (UID: \"320ff4f5-8627-4ceb-adf1-829cf2b570dd\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-lvpr4"
Aug 04 22:25:23.192448 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:25:23.192284    2580 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Aug 04 22:25:23.192448 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:25:23.192348    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/968aa3c2-b641-483d-a1b0-d0efc3df099e-cluster-monitoring-operator-tls podName:968aa3c2-b641-483d-a1b0-d0efc3df099e nodeName:}" failed. No retries permitted until 2026-08-04 22:25:25.192330853 +0000 UTC m=+272.185148579 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/968aa3c2-b641-483d-a1b0-d0efc3df099e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6f55c4f58d-2ksv9" (UID: "968aa3c2-b641-483d-a1b0-d0efc3df099e") : secret "cluster-monitoring-operator-tls" not found
Aug 04 22:25:23.192448 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:25:23.192389    2580 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Aug 04 22:25:23.192448 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:25:23.192422    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/320ff4f5-8627-4ceb-adf1-829cf2b570dd-samples-operator-tls podName:320ff4f5-8627-4ceb-adf1-829cf2b570dd nodeName:}" failed. No retries permitted until 2026-08-04 22:25:25.192412454 +0000 UTC m=+272.185230181 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/320ff4f5-8627-4ceb-adf1-829cf2b570dd-samples-operator-tls") pod "cluster-samples-operator-559cbf5745-lvpr4" (UID: "320ff4f5-8627-4ceb-adf1-829cf2b570dd") : secret "samples-operator-tls" not found
Aug 04 22:25:24.323753 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:24.323717    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-2pxjd" event={"ID":"d8b1f339-0748-481e-82fd-24b4e76a721a","Type":"ContainerStarted","Data":"c1b0756966f4bed56c0f765c25fd4b2ac7fcf438071e6a42eea3c675d62586a5"}
Aug 04 22:25:24.337806 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:24.337759    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-2pxjd" podStartSLOduration=2.078806834 podStartE2EDuration="3.337744319s" totalImagesPullingTime="1.258937485s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 22:25:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 22:25:24.336574497 +0000 UTC m=+271.329392223" watchObservedRunningTime="2026-08-04 22:25:24.337744319 +0000 UTC m=+271.330562100"
Aug 04 22:25:25.210710 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:25.210666    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/968aa3c2-b641-483d-a1b0-d0efc3df099e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-2ksv9\" (UID: \"968aa3c2-b641-483d-a1b0-d0efc3df099e\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-2ksv9"
Aug 04 22:25:25.210886 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:25.210721    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/320ff4f5-8627-4ceb-adf1-829cf2b570dd-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-lvpr4\" (UID: \"320ff4f5-8627-4ceb-adf1-829cf2b570dd\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-lvpr4"
Aug 04 22:25:25.210886 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:25:25.210812    2580 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Aug 04 22:25:25.210886 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:25:25.210851    2580 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Aug 04 22:25:25.210886 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:25:25.210881    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/968aa3c2-b641-483d-a1b0-d0efc3df099e-cluster-monitoring-operator-tls podName:968aa3c2-b641-483d-a1b0-d0efc3df099e nodeName:}" failed. No retries permitted until 2026-08-04 22:25:29.210864299 +0000 UTC m=+276.203682022 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/968aa3c2-b641-483d-a1b0-d0efc3df099e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6f55c4f58d-2ksv9" (UID: "968aa3c2-b641-483d-a1b0-d0efc3df099e") : secret "cluster-monitoring-operator-tls" not found
Aug 04 22:25:25.211030 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:25:25.210896    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/320ff4f5-8627-4ceb-adf1-829cf2b570dd-samples-operator-tls podName:320ff4f5-8627-4ceb-adf1-829cf2b570dd nodeName:}" failed. No retries permitted until 2026-08-04 22:25:29.210889843 +0000 UTC m=+276.203707549 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/320ff4f5-8627-4ceb-adf1-829cf2b570dd-samples-operator-tls") pod "cluster-samples-operator-559cbf5745-lvpr4" (UID: "320ff4f5-8627-4ceb-adf1-829cf2b570dd") : secret "samples-operator-tls" not found
Aug 04 22:25:25.327885 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:25.327849    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-g68vv" event={"ID":"e43db356-a90d-4670-8f61-0d95a0c859af","Type":"ContainerStarted","Data":"1fc5a081962117ffa0eb7e160b3121123a4960286becf8a68000e6d98a03b60c"}
Aug 04 22:25:25.342598 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:25.342545    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-g68vv" podStartSLOduration=1.8337518529999999 podStartE2EDuration="4.342524506s" totalImagesPullingTime="2.508772653s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 22:25:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 22:25:25.341305916 +0000 UTC m=+272.334123644" watchObservedRunningTime="2026-08-04 22:25:25.342524506 +0000 UTC m=+272.335342236"
Aug 04 22:25:26.233251 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:26.233216    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-68bc745d87-spbzw"]
Aug 04 22:25:26.235494 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:26.235479    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-spbzw"
Aug 04 22:25:26.237683 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:26.237664    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Aug 04 22:25:26.237766 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:26.237665    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Aug 04 22:25:26.238513 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:26.238499    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-txtmn\""
Aug 04 22:25:26.245669 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:26.245650    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-68bc745d87-spbzw"]
Aug 04 22:25:26.318038 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:26.318008    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nwhtn\" (UniqueName: \"kubernetes.io/projected/37b7e9b0-a02f-4c37-8657-57c38ccfe473-kube-api-access-nwhtn\") pod \"migrator-68bc745d87-spbzw\" (UID: \"37b7e9b0-a02f-4c37-8657-57c38ccfe473\") " pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-spbzw"
Aug 04 22:25:26.418914 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:26.418877    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nwhtn\" (UniqueName: \"kubernetes.io/projected/37b7e9b0-a02f-4c37-8657-57c38ccfe473-kube-api-access-nwhtn\") pod \"migrator-68bc745d87-spbzw\" (UID: \"37b7e9b0-a02f-4c37-8657-57c38ccfe473\") " pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-spbzw"
Aug 04 22:25:26.426688 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:26.426665    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nwhtn\" (UniqueName: \"kubernetes.io/projected/37b7e9b0-a02f-4c37-8657-57c38ccfe473-kube-api-access-nwhtn\") pod \"migrator-68bc745d87-spbzw\" (UID: \"37b7e9b0-a02f-4c37-8657-57c38ccfe473\") " pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-spbzw"
Aug 04 22:25:26.545890 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:26.545868    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-spbzw"
Aug 04 22:25:26.640352 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:26.640323    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-grmx8"]
Aug 04 22:25:26.642645 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:26.642623    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-grmx8"
Aug 04 22:25:26.645212 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:26.645013    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Aug 04 22:25:26.645212 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:26.645012    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Aug 04 22:25:26.645212 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:26.645178    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Aug 04 22:25:26.645422 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:26.645247    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Aug 04 22:25:26.645495 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:26.645477    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-bbwrp\""
Aug 04 22:25:26.656017 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:26.655999    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-grmx8"]
Aug 04 22:25:26.669801 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:26.669780    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-68bc745d87-spbzw"]
Aug 04 22:25:26.672476 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:25:26.672454    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37b7e9b0_a02f_4c37_8657_57c38ccfe473.slice/crio-9445c6fc25f137b233a0e996c580c08be7ae746cc2bd3bdfe0de88d50366ab8e WatchSource:0}: Error finding container 9445c6fc25f137b233a0e996c580c08be7ae746cc2bd3bdfe0de88d50366ab8e: Status 404 returned error can't find the container with id 9445c6fc25f137b233a0e996c580c08be7ae746cc2bd3bdfe0de88d50366ab8e
Aug 04 22:25:26.722161 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:26.722119    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8e27a6cd-73a0-4a34-ab89-c83cd76657f7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-grmx8\" (UID: \"8e27a6cd-73a0-4a34-ab89-c83cd76657f7\") " pod="openshift-insights/insights-runtime-extractor-grmx8"
Aug 04 22:25:26.722284 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:26.722172    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-79mnw\" (UniqueName: \"kubernetes.io/projected/8e27a6cd-73a0-4a34-ab89-c83cd76657f7-kube-api-access-79mnw\") pod \"insights-runtime-extractor-grmx8\" (UID: \"8e27a6cd-73a0-4a34-ab89-c83cd76657f7\") " pod="openshift-insights/insights-runtime-extractor-grmx8"
Aug 04 22:25:26.722284 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:26.722191    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8e27a6cd-73a0-4a34-ab89-c83cd76657f7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-grmx8\" (UID: \"8e27a6cd-73a0-4a34-ab89-c83cd76657f7\") " pod="openshift-insights/insights-runtime-extractor-grmx8"
Aug 04 22:25:26.722284 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:26.722271    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/8e27a6cd-73a0-4a34-ab89-c83cd76657f7-data-volume\") pod \"insights-runtime-extractor-grmx8\" (UID: \"8e27a6cd-73a0-4a34-ab89-c83cd76657f7\") " pod="openshift-insights/insights-runtime-extractor-grmx8"
Aug 04 22:25:26.722443 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:26.722374    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/8e27a6cd-73a0-4a34-ab89-c83cd76657f7-crio-socket\") pod \"insights-runtime-extractor-grmx8\" (UID: \"8e27a6cd-73a0-4a34-ab89-c83cd76657f7\") " pod="openshift-insights/insights-runtime-extractor-grmx8"
Aug 04 22:25:26.822897 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:26.822827    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-79mnw\" (UniqueName: \"kubernetes.io/projected/8e27a6cd-73a0-4a34-ab89-c83cd76657f7-kube-api-access-79mnw\") pod \"insights-runtime-extractor-grmx8\" (UID: \"8e27a6cd-73a0-4a34-ab89-c83cd76657f7\") " pod="openshift-insights/insights-runtime-extractor-grmx8"
Aug 04 22:25:26.822897 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:26.822856    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8e27a6cd-73a0-4a34-ab89-c83cd76657f7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-grmx8\" (UID: \"8e27a6cd-73a0-4a34-ab89-c83cd76657f7\") " pod="openshift-insights/insights-runtime-extractor-grmx8"
Aug 04 22:25:26.822897 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:26.822876    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/8e27a6cd-73a0-4a34-ab89-c83cd76657f7-data-volume\") pod \"insights-runtime-extractor-grmx8\" (UID: \"8e27a6cd-73a0-4a34-ab89-c83cd76657f7\") " pod="openshift-insights/insights-runtime-extractor-grmx8"
Aug 04 22:25:26.823124 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:25:26.822962    2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Aug 04 22:25:26.823124 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:25:26.823042    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8e27a6cd-73a0-4a34-ab89-c83cd76657f7-kube-rbac-proxy-cm podName:8e27a6cd-73a0-4a34-ab89-c83cd76657f7 nodeName:}" failed. No retries permitted until 2026-08-04 22:25:27.323022343 +0000 UTC m=+274.315840050 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8e27a6cd-73a0-4a34-ab89-c83cd76657f7-kube-rbac-proxy-cm") pod "insights-runtime-extractor-grmx8" (UID: "8e27a6cd-73a0-4a34-ab89-c83cd76657f7") : configmap "kube-rbac-proxy" not found
Aug 04 22:25:26.823124 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:26.823105    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/8e27a6cd-73a0-4a34-ab89-c83cd76657f7-crio-socket\") pod \"insights-runtime-extractor-grmx8\" (UID: \"8e27a6cd-73a0-4a34-ab89-c83cd76657f7\") " pod="openshift-insights/insights-runtime-extractor-grmx8"
Aug 04 22:25:26.823311 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:26.823195    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/8e27a6cd-73a0-4a34-ab89-c83cd76657f7-crio-socket\") pod \"insights-runtime-extractor-grmx8\" (UID: \"8e27a6cd-73a0-4a34-ab89-c83cd76657f7\") " pod="openshift-insights/insights-runtime-extractor-grmx8"
Aug 04 22:25:26.823311 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:26.823220    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8e27a6cd-73a0-4a34-ab89-c83cd76657f7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-grmx8\" (UID: \"8e27a6cd-73a0-4a34-ab89-c83cd76657f7\") " pod="openshift-insights/insights-runtime-extractor-grmx8"
Aug 04 22:25:26.823311 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:26.823231    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/8e27a6cd-73a0-4a34-ab89-c83cd76657f7-data-volume\") pod \"insights-runtime-extractor-grmx8\" (UID: \"8e27a6cd-73a0-4a34-ab89-c83cd76657f7\") " pod="openshift-insights/insights-runtime-extractor-grmx8"
Aug 04 22:25:26.823409 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:25:26.823330    2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Aug 04 22:25:26.823409 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:25:26.823374    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e27a6cd-73a0-4a34-ab89-c83cd76657f7-insights-runtime-extractor-tls podName:8e27a6cd-73a0-4a34-ab89-c83cd76657f7 nodeName:}" failed. No retries permitted until 2026-08-04 22:25:27.323358862 +0000 UTC m=+274.316176570 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8e27a6cd-73a0-4a34-ab89-c83cd76657f7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-grmx8" (UID: "8e27a6cd-73a0-4a34-ab89-c83cd76657f7") : secret "insights-runtime-extractor-tls" not found
Aug 04 22:25:26.830687 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:26.830669    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-79mnw\" (UniqueName: \"kubernetes.io/projected/8e27a6cd-73a0-4a34-ab89-c83cd76657f7-kube-api-access-79mnw\") pod \"insights-runtime-extractor-grmx8\" (UID: \"8e27a6cd-73a0-4a34-ab89-c83cd76657f7\") " pod="openshift-insights/insights-runtime-extractor-grmx8"
Aug 04 22:25:27.327462 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:27.327423    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8e27a6cd-73a0-4a34-ab89-c83cd76657f7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-grmx8\" (UID: \"8e27a6cd-73a0-4a34-ab89-c83cd76657f7\") " pod="openshift-insights/insights-runtime-extractor-grmx8"
Aug 04 22:25:27.327740 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:27.327476    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8e27a6cd-73a0-4a34-ab89-c83cd76657f7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-grmx8\" (UID: \"8e27a6cd-73a0-4a34-ab89-c83cd76657f7\") " pod="openshift-insights/insights-runtime-extractor-grmx8"
Aug 04 22:25:27.327740 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:25:27.327630    2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Aug 04 22:25:27.327740 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:25:27.327713    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8e27a6cd-73a0-4a34-ab89-c83cd76657f7-kube-rbac-proxy-cm podName:8e27a6cd-73a0-4a34-ab89-c83cd76657f7 nodeName:}" failed. No retries permitted until 2026-08-04 22:25:28.327696368 +0000 UTC m=+275.320514102 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8e27a6cd-73a0-4a34-ab89-c83cd76657f7-kube-rbac-proxy-cm") pod "insights-runtime-extractor-grmx8" (UID: "8e27a6cd-73a0-4a34-ab89-c83cd76657f7") : configmap "kube-rbac-proxy" not found
Aug 04 22:25:27.327931 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:25:27.327631    2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Aug 04 22:25:27.327931 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:25:27.327819    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e27a6cd-73a0-4a34-ab89-c83cd76657f7-insights-runtime-extractor-tls podName:8e27a6cd-73a0-4a34-ab89-c83cd76657f7 nodeName:}" failed. No retries permitted until 2026-08-04 22:25:28.327801062 +0000 UTC m=+275.320618783 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8e27a6cd-73a0-4a34-ab89-c83cd76657f7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-grmx8" (UID: "8e27a6cd-73a0-4a34-ab89-c83cd76657f7") : secret "insights-runtime-extractor-tls" not found
Aug 04 22:25:27.333739 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:27.333707    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-spbzw" event={"ID":"37b7e9b0-a02f-4c37-8657-57c38ccfe473","Type":"ContainerStarted","Data":"9445c6fc25f137b233a0e996c580c08be7ae746cc2bd3bdfe0de88d50366ab8e"}
Aug 04 22:25:28.333767 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:28.333728    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8e27a6cd-73a0-4a34-ab89-c83cd76657f7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-grmx8\" (UID: \"8e27a6cd-73a0-4a34-ab89-c83cd76657f7\") " pod="openshift-insights/insights-runtime-extractor-grmx8"
Aug 04 22:25:28.334150 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:25:28.333803    2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Aug 04 22:25:28.334150 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:28.333825    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8e27a6cd-73a0-4a34-ab89-c83cd76657f7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-grmx8\" (UID: \"8e27a6cd-73a0-4a34-ab89-c83cd76657f7\") " pod="openshift-insights/insights-runtime-extractor-grmx8"
Aug 04 22:25:28.334150 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:25:28.333864    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8e27a6cd-73a0-4a34-ab89-c83cd76657f7-kube-rbac-proxy-cm podName:8e27a6cd-73a0-4a34-ab89-c83cd76657f7 nodeName:}" failed. No retries permitted until 2026-08-04 22:25:30.333847748 +0000 UTC m=+277.326665467 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8e27a6cd-73a0-4a34-ab89-c83cd76657f7-kube-rbac-proxy-cm") pod "insights-runtime-extractor-grmx8" (UID: "8e27a6cd-73a0-4a34-ab89-c83cd76657f7") : configmap "kube-rbac-proxy" not found
Aug 04 22:25:28.334150 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:25:28.333896    2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Aug 04 22:25:28.334150 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:25:28.333928    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e27a6cd-73a0-4a34-ab89-c83cd76657f7-insights-runtime-extractor-tls podName:8e27a6cd-73a0-4a34-ab89-c83cd76657f7 nodeName:}" failed. No retries permitted until 2026-08-04 22:25:30.333917708 +0000 UTC m=+277.326735414 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8e27a6cd-73a0-4a34-ab89-c83cd76657f7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-grmx8" (UID: "8e27a6cd-73a0-4a34-ab89-c83cd76657f7") : secret "insights-runtime-extractor-tls" not found
Aug 04 22:25:28.337661 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:28.337637    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-spbzw" event={"ID":"37b7e9b0-a02f-4c37-8657-57c38ccfe473","Type":"ContainerStarted","Data":"f8a2a7bebab0faacf8f63f5350bac225f52cc6d265aedfdb811d1c555f9fcc4a"}
Aug 04 22:25:28.337765 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:28.337694    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-spbzw" event={"ID":"37b7e9b0-a02f-4c37-8657-57c38ccfe473","Type":"ContainerStarted","Data":"becfe7ce2dfb8b97b522927572ed9c25ac14b24b51aed22a6832338338fd066b"}
Aug 04 22:25:28.352019 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:28.351981    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-spbzw" podStartSLOduration=1.280034927 podStartE2EDuration="2.351968511s" totalImagesPullingTime="1.071933584s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 22:25:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 22:25:28.350700771 +0000 UTC m=+275.343518500" watchObservedRunningTime="2026-08-04 22:25:28.351968511 +0000 UTC m=+275.344786216"
Aug 04 22:25:28.408591 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:28.408564    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-98c88fbb5-qh5kr"]
Aug 04 22:25:28.410739 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:28.410722    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-98c88fbb5-qh5kr"
Aug 04 22:25:28.413029 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:28.413010    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Aug 04 22:25:28.413123 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:28.413036    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-ccrr7\""
Aug 04 22:25:28.413123 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:28.413047    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Aug 04 22:25:28.413123 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:28.413057    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Aug 04 22:25:28.413123 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:28.413036    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Aug 04 22:25:28.421235 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:28.421217    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-98c88fbb5-qh5kr"]
Aug 04 22:25:28.434545 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:28.434527    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/e0c59650-1dbf-4428-9183-5a2be72934b1-signing-key\") pod \"service-ca-98c88fbb5-qh5kr\" (UID: \"e0c59650-1dbf-4428-9183-5a2be72934b1\") " pod="openshift-service-ca/service-ca-98c88fbb5-qh5kr"
Aug 04 22:25:28.434639 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:28.434576    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v6g5g\" (UniqueName: \"kubernetes.io/projected/e0c59650-1dbf-4428-9183-5a2be72934b1-kube-api-access-v6g5g\") pod \"service-ca-98c88fbb5-qh5kr\" (UID: \"e0c59650-1dbf-4428-9183-5a2be72934b1\") " pod="openshift-service-ca/service-ca-98c88fbb5-qh5kr"
Aug 04 22:25:28.434639 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:28.434603    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/e0c59650-1dbf-4428-9183-5a2be72934b1-signing-cabundle\") pod \"service-ca-98c88fbb5-qh5kr\" (UID: \"e0c59650-1dbf-4428-9183-5a2be72934b1\") " pod="openshift-service-ca/service-ca-98c88fbb5-qh5kr"
Aug 04 22:25:28.535785 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:28.535761    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/e0c59650-1dbf-4428-9183-5a2be72934b1-signing-key\") pod \"service-ca-98c88fbb5-qh5kr\" (UID: \"e0c59650-1dbf-4428-9183-5a2be72934b1\") " pod="openshift-service-ca/service-ca-98c88fbb5-qh5kr"
Aug 04 22:25:28.535881 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:28.535833    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v6g5g\" (UniqueName: \"kubernetes.io/projected/e0c59650-1dbf-4428-9183-5a2be72934b1-kube-api-access-v6g5g\") pod \"service-ca-98c88fbb5-qh5kr\" (UID: \"e0c59650-1dbf-4428-9183-5a2be72934b1\") " pod="openshift-service-ca/service-ca-98c88fbb5-qh5kr"
Aug 04 22:25:28.535881 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:28.535869    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/e0c59650-1dbf-4428-9183-5a2be72934b1-signing-cabundle\") pod \"service-ca-98c88fbb5-qh5kr\" (UID: \"e0c59650-1dbf-4428-9183-5a2be72934b1\") " pod="openshift-service-ca/service-ca-98c88fbb5-qh5kr"
Aug 04 22:25:28.537323 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:28.537298    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/e0c59650-1dbf-4428-9183-5a2be72934b1-signing-cabundle\") pod \"service-ca-98c88fbb5-qh5kr\" (UID: \"e0c59650-1dbf-4428-9183-5a2be72934b1\") " pod="openshift-service-ca/service-ca-98c88fbb5-qh5kr"
Aug 04 22:25:28.538329 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:28.538306    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/e0c59650-1dbf-4428-9183-5a2be72934b1-signing-key\") pod \"service-ca-98c88fbb5-qh5kr\" (UID: \"e0c59650-1dbf-4428-9183-5a2be72934b1\") " pod="openshift-service-ca/service-ca-98c88fbb5-qh5kr"
Aug 04 22:25:28.543457 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:28.543438    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v6g5g\" (UniqueName: \"kubernetes.io/projected/e0c59650-1dbf-4428-9183-5a2be72934b1-kube-api-access-v6g5g\") pod \"service-ca-98c88fbb5-qh5kr\" (UID: \"e0c59650-1dbf-4428-9183-5a2be72934b1\") " pod="openshift-service-ca/service-ca-98c88fbb5-qh5kr"
Aug 04 22:25:28.719079 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:28.719018    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-98c88fbb5-qh5kr"
Aug 04 22:25:28.835658 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:28.835630    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-98c88fbb5-qh5kr"]
Aug 04 22:25:28.838626 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:25:28.838603    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0c59650_1dbf_4428_9183_5a2be72934b1.slice/crio-090e615fd6a22caf5befc4700a38c93180b8b2cd3dcf4ad273777d3780bee43a WatchSource:0}: Error finding container 090e615fd6a22caf5befc4700a38c93180b8b2cd3dcf4ad273777d3780bee43a: Status 404 returned error can't find the container with id 090e615fd6a22caf5befc4700a38c93180b8b2cd3dcf4ad273777d3780bee43a
Aug 04 22:25:29.245584 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:29.245543    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/320ff4f5-8627-4ceb-adf1-829cf2b570dd-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-lvpr4\" (UID: \"320ff4f5-8627-4ceb-adf1-829cf2b570dd\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-lvpr4"
Aug 04 22:25:29.245741 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:29.245663    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/968aa3c2-b641-483d-a1b0-d0efc3df099e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-2ksv9\" (UID: \"968aa3c2-b641-483d-a1b0-d0efc3df099e\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-2ksv9"
Aug 04 22:25:29.245741 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:25:29.245686    2580 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Aug 04 22:25:29.245829 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:25:29.245744    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/320ff4f5-8627-4ceb-adf1-829cf2b570dd-samples-operator-tls podName:320ff4f5-8627-4ceb-adf1-829cf2b570dd nodeName:}" failed. No retries permitted until 2026-08-04 22:25:37.245730713 +0000 UTC m=+284.238548422 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/320ff4f5-8627-4ceb-adf1-829cf2b570dd-samples-operator-tls") pod "cluster-samples-operator-559cbf5745-lvpr4" (UID: "320ff4f5-8627-4ceb-adf1-829cf2b570dd") : secret "samples-operator-tls" not found
Aug 04 22:25:29.245877 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:25:29.245825    2580 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Aug 04 22:25:29.245913 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:25:29.245886    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/968aa3c2-b641-483d-a1b0-d0efc3df099e-cluster-monitoring-operator-tls podName:968aa3c2-b641-483d-a1b0-d0efc3df099e nodeName:}" failed. No retries permitted until 2026-08-04 22:25:37.245870046 +0000 UTC m=+284.238687756 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/968aa3c2-b641-483d-a1b0-d0efc3df099e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6f55c4f58d-2ksv9" (UID: "968aa3c2-b641-483d-a1b0-d0efc3df099e") : secret "cluster-monitoring-operator-tls" not found
Aug 04 22:25:29.342456 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:29.342431    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-98c88fbb5-qh5kr" event={"ID":"e0c59650-1dbf-4428-9183-5a2be72934b1","Type":"ContainerStarted","Data":"1265eab77923febeb93cef97c1a87aa92af66eb016a58618aafd5a35d5163818"}
Aug 04 22:25:29.342900 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:29.342505    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-98c88fbb5-qh5kr" event={"ID":"e0c59650-1dbf-4428-9183-5a2be72934b1","Type":"ContainerStarted","Data":"090e615fd6a22caf5befc4700a38c93180b8b2cd3dcf4ad273777d3780bee43a"}
Aug 04 22:25:29.370151 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:29.370098    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-98c88fbb5-qh5kr" podStartSLOduration=1.370085219 podStartE2EDuration="1.370085219s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 22:25:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 22:25:29.369690331 +0000 UTC m=+276.362508059" watchObservedRunningTime="2026-08-04 22:25:29.370085219 +0000 UTC m=+276.362903001"
Aug 04 22:25:29.421821 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:29.421802    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-mqwtk_352301b4-da31-4c34-897a-35279eb5e2f0/dns-node-resolver/0.log"
Aug 04 22:25:30.354736 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:30.354711    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8e27a6cd-73a0-4a34-ab89-c83cd76657f7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-grmx8\" (UID: \"8e27a6cd-73a0-4a34-ab89-c83cd76657f7\") " pod="openshift-insights/insights-runtime-extractor-grmx8"
Aug 04 22:25:30.355116 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:30.354744    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8e27a6cd-73a0-4a34-ab89-c83cd76657f7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-grmx8\" (UID: \"8e27a6cd-73a0-4a34-ab89-c83cd76657f7\") " pod="openshift-insights/insights-runtime-extractor-grmx8"
Aug 04 22:25:30.355116 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:25:30.354817    2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Aug 04 22:25:30.355116 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:25:30.354863    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8e27a6cd-73a0-4a34-ab89-c83cd76657f7-kube-rbac-proxy-cm podName:8e27a6cd-73a0-4a34-ab89-c83cd76657f7 nodeName:}" failed. No retries permitted until 2026-08-04 22:25:34.354851104 +0000 UTC m=+281.347668810 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8e27a6cd-73a0-4a34-ab89-c83cd76657f7-kube-rbac-proxy-cm") pod "insights-runtime-extractor-grmx8" (UID: "8e27a6cd-73a0-4a34-ab89-c83cd76657f7") : configmap "kube-rbac-proxy" not found
Aug 04 22:25:30.355116 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:25:30.354868    2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Aug 04 22:25:30.355116 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:25:30.354927    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e27a6cd-73a0-4a34-ab89-c83cd76657f7-insights-runtime-extractor-tls podName:8e27a6cd-73a0-4a34-ab89-c83cd76657f7 nodeName:}" failed. No retries permitted until 2026-08-04 22:25:34.354907886 +0000 UTC m=+281.347725605 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8e27a6cd-73a0-4a34-ab89-c83cd76657f7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-grmx8" (UID: "8e27a6cd-73a0-4a34-ab89-c83cd76657f7") : secret "insights-runtime-extractor-tls" not found
Aug 04 22:25:30.621151 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:30.621057    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-xvfg9_708c6d09-57c2-4829-9e76-7d86874515ec/node-ca/0.log"
Aug 04 22:25:31.020557 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:31.020482    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-l57vw_c8c35a7c-9cad-4e67-aa5d-eee422ea3178/serve-healthcheck-canary/0.log"
Aug 04 22:25:31.620395 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:31.620371    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-68bc745d87-spbzw_37b7e9b0-a02f-4c37-8657-57c38ccfe473/migrator/0.log"
Aug 04 22:25:31.820381 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:31.820316    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-68bc745d87-spbzw_37b7e9b0-a02f-4c37-8657-57c38ccfe473/graceful-termination/0.log"
Aug 04 22:25:34.050895 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:25:34.050840    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-f77f48c6d-ghcnq" podUID="771ddd03-8847-4587-bd07-96d0b0dccac5"
Aug 04 22:25:34.050895 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:25:34.050876    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-8nwrx" podUID="3363c6ec-b200-4050-b9bc-aa06ea7fad77"
Aug 04 22:25:34.050895 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:25:34.050851    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-77b66db774-9npzs" podUID="069b448c-edde-423c-b08d-4cac577c09e5"
Aug 04 22:25:34.355602 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:34.355533    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-77b66db774-9npzs"
Aug 04 22:25:34.355602 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:34.355551    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8nwrx"
Aug 04 22:25:34.355775 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:34.355544    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-f77f48c6d-ghcnq"
Aug 04 22:25:34.393242 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:34.393224    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8e27a6cd-73a0-4a34-ab89-c83cd76657f7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-grmx8\" (UID: \"8e27a6cd-73a0-4a34-ab89-c83cd76657f7\") " pod="openshift-insights/insights-runtime-extractor-grmx8"
Aug 04 22:25:34.393328 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:34.393308    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8e27a6cd-73a0-4a34-ab89-c83cd76657f7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-grmx8\" (UID: \"8e27a6cd-73a0-4a34-ab89-c83cd76657f7\") " pod="openshift-insights/insights-runtime-extractor-grmx8"
Aug 04 22:25:34.393386 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:25:34.393332    2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Aug 04 22:25:34.393421 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:25:34.393388    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8e27a6cd-73a0-4a34-ab89-c83cd76657f7-kube-rbac-proxy-cm podName:8e27a6cd-73a0-4a34-ab89-c83cd76657f7 nodeName:}" failed. No retries permitted until 2026-08-04 22:25:42.393374465 +0000 UTC m=+289.386192175 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8e27a6cd-73a0-4a34-ab89-c83cd76657f7-kube-rbac-proxy-cm") pod "insights-runtime-extractor-grmx8" (UID: "8e27a6cd-73a0-4a34-ab89-c83cd76657f7") : configmap "kube-rbac-proxy" not found
Aug 04 22:25:34.393421 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:25:34.393406    2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Aug 04 22:25:34.393496 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:25:34.393444    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e27a6cd-73a0-4a34-ab89-c83cd76657f7-insights-runtime-extractor-tls podName:8e27a6cd-73a0-4a34-ab89-c83cd76657f7 nodeName:}" failed. No retries permitted until 2026-08-04 22:25:42.393432934 +0000 UTC m=+289.386250640 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8e27a6cd-73a0-4a34-ab89-c83cd76657f7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-grmx8" (UID: "8e27a6cd-73a0-4a34-ab89-c83cd76657f7") : secret "insights-runtime-extractor-tls" not found
Aug 04 22:25:37.315230 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:37.315199    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/320ff4f5-8627-4ceb-adf1-829cf2b570dd-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-lvpr4\" (UID: \"320ff4f5-8627-4ceb-adf1-829cf2b570dd\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-lvpr4"
Aug 04 22:25:37.315724 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:37.315262    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/968aa3c2-b641-483d-a1b0-d0efc3df099e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-2ksv9\" (UID: \"968aa3c2-b641-483d-a1b0-d0efc3df099e\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-2ksv9"
Aug 04 22:25:37.315724 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:25:37.315338    2580 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Aug 04 22:25:37.315724 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:25:37.315424    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/968aa3c2-b641-483d-a1b0-d0efc3df099e-cluster-monitoring-operator-tls podName:968aa3c2-b641-483d-a1b0-d0efc3df099e nodeName:}" failed. No retries permitted until 2026-08-04 22:25:53.315410682 +0000 UTC m=+300.308228387 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/968aa3c2-b641-483d-a1b0-d0efc3df099e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6f55c4f58d-2ksv9" (UID: "968aa3c2-b641-483d-a1b0-d0efc3df099e") : secret "cluster-monitoring-operator-tls" not found
Aug 04 22:25:37.317778 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:37.317755    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/320ff4f5-8627-4ceb-adf1-829cf2b570dd-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-lvpr4\" (UID: \"320ff4f5-8627-4ceb-adf1-829cf2b570dd\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-lvpr4"
Aug 04 22:25:37.467822 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:37.467798    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-lvpr4"
Aug 04 22:25:37.582828 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:37.582756    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-lvpr4"]
Aug 04 22:25:37.919908 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:37.919847    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/069b448c-edde-423c-b08d-4cac577c09e5-registry-tls\") pod \"image-registry-77b66db774-9npzs\" (UID: \"069b448c-edde-423c-b08d-4cac577c09e5\") " pod="openshift-image-registry/image-registry-77b66db774-9npzs"
Aug 04 22:25:37.920029 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:37.919916    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3363c6ec-b200-4050-b9bc-aa06ea7fad77-metrics-tls\") pod \"dns-default-8nwrx\" (UID: \"3363c6ec-b200-4050-b9bc-aa06ea7fad77\") " pod="openshift-dns/dns-default-8nwrx"
Aug 04 22:25:37.920029 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:37.919947    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/771ddd03-8847-4587-bd07-96d0b0dccac5-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-ghcnq\" (UID: \"771ddd03-8847-4587-bd07-96d0b0dccac5\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-ghcnq"
Aug 04 22:25:37.920095 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:25:37.920025    2580 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Aug 04 22:25:37.920095 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:25:37.920087    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/771ddd03-8847-4587-bd07-96d0b0dccac5-networking-console-plugin-cert podName:771ddd03-8847-4587-bd07-96d0b0dccac5 nodeName:}" failed. No retries permitted until 2026-08-04 22:27:39.920069328 +0000 UTC m=+406.912887048 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/771ddd03-8847-4587-bd07-96d0b0dccac5-networking-console-plugin-cert") pod "networking-console-plugin-f77f48c6d-ghcnq" (UID: "771ddd03-8847-4587-bd07-96d0b0dccac5") : secret "networking-console-plugin-cert" not found
Aug 04 22:25:37.922177 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:37.922155    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3363c6ec-b200-4050-b9bc-aa06ea7fad77-metrics-tls\") pod \"dns-default-8nwrx\" (UID: \"3363c6ec-b200-4050-b9bc-aa06ea7fad77\") " pod="openshift-dns/dns-default-8nwrx"
Aug 04 22:25:37.922314 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:37.922269    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/069b448c-edde-423c-b08d-4cac577c09e5-registry-tls\") pod \"image-registry-77b66db774-9npzs\" (UID: \"069b448c-edde-423c-b08d-4cac577c09e5\") " pod="openshift-image-registry/image-registry-77b66db774-9npzs"
Aug 04 22:25:37.957968 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:37.957945    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-h7b97\""
Aug 04 22:25:37.958065 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:37.957946    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-d46fp\""
Aug 04 22:25:37.965979 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:37.965962    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-77b66db774-9npzs"
Aug 04 22:25:37.967146 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:37.967121    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8nwrx"
Aug 04 22:25:38.107747 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:38.107674    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-77b66db774-9npzs"]
Aug 04 22:25:38.111682 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:25:38.111648    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod069b448c_edde_423c_b08d_4cac577c09e5.slice/crio-730f521092216627a55ca327edd80f1febdb51a511a27ff336a9ea480f7a9d63 WatchSource:0}: Error finding container 730f521092216627a55ca327edd80f1febdb51a511a27ff336a9ea480f7a9d63: Status 404 returned error can't find the container with id 730f521092216627a55ca327edd80f1febdb51a511a27ff336a9ea480f7a9d63
Aug 04 22:25:38.119710 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:38.119689    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-8nwrx"]
Aug 04 22:25:38.122840 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:25:38.122810    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3363c6ec_b200_4050_b9bc_aa06ea7fad77.slice/crio-d7a5ebb4eeaaa0ca67836c18781e519fc0a338c50fe279d5c5e61d97b60aeb53 WatchSource:0}: Error finding container d7a5ebb4eeaaa0ca67836c18781e519fc0a338c50fe279d5c5e61d97b60aeb53: Status 404 returned error can't find the container with id d7a5ebb4eeaaa0ca67836c18781e519fc0a338c50fe279d5c5e61d97b60aeb53
Aug 04 22:25:38.368630 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:38.368591    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8nwrx" event={"ID":"3363c6ec-b200-4050-b9bc-aa06ea7fad77","Type":"ContainerStarted","Data":"d7a5ebb4eeaaa0ca67836c18781e519fc0a338c50fe279d5c5e61d97b60aeb53"}
Aug 04 22:25:38.369901 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:38.369870    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-lvpr4" event={"ID":"320ff4f5-8627-4ceb-adf1-829cf2b570dd","Type":"ContainerStarted","Data":"2571fce567014640f1b0640216b51fe6a2deb743992619bf949ac74110bf2e82"}
Aug 04 22:25:38.371578 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:38.371549    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-77b66db774-9npzs" event={"ID":"069b448c-edde-423c-b08d-4cac577c09e5","Type":"ContainerStarted","Data":"d9c332a228c2416a7d8636f361d12e948dfdf9d0af7e36b60c237e91cffd4ef9"}
Aug 04 22:25:38.371679 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:38.371586    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-77b66db774-9npzs" event={"ID":"069b448c-edde-423c-b08d-4cac577c09e5","Type":"ContainerStarted","Data":"730f521092216627a55ca327edd80f1febdb51a511a27ff336a9ea480f7a9d63"}
Aug 04 22:25:38.371752 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:38.371693    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-77b66db774-9npzs"
Aug 04 22:25:38.391647 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:38.390176    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-77b66db774-9npzs" podStartSLOduration=285.390157927 podStartE2EDuration="4m45.390157927s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 22:20:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 22:25:38.38905308 +0000 UTC m=+285.381870811" watchObservedRunningTime="2026-08-04 22:25:38.390157927 +0000 UTC m=+285.382975655"
Aug 04 22:25:40.380660 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:40.380623    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8nwrx" event={"ID":"3363c6ec-b200-4050-b9bc-aa06ea7fad77","Type":"ContainerStarted","Data":"4f0e1190df6086cda58d3b5f3432c59f151979b2f0707e5ae990f8ca233ab60c"}
Aug 04 22:25:40.381070 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:40.380685    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8nwrx" event={"ID":"3363c6ec-b200-4050-b9bc-aa06ea7fad77","Type":"ContainerStarted","Data":"39eaea9b789617ba267fd0125e14f53fa53fa4c842242d40261d56c588585ba9"}
Aug 04 22:25:40.381070 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:40.380713    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-8nwrx"
Aug 04 22:25:40.382354 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:40.382332    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-lvpr4" event={"ID":"320ff4f5-8627-4ceb-adf1-829cf2b570dd","Type":"ContainerStarted","Data":"6afa46c6744872c9957b539c1841ee3a34e3a523317e3740c9ed0501d11dc8f2"}
Aug 04 22:25:40.382432 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:40.382377    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-lvpr4" event={"ID":"320ff4f5-8627-4ceb-adf1-829cf2b570dd","Type":"ContainerStarted","Data":"235a8794d0108d2fc78b18365ddcec33478b5d6d4861c0dad3d2deb9e5b3f2c0"}
Aug 04 22:25:40.396327 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:40.396276    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-8nwrx" podStartSLOduration=251.61636955 podStartE2EDuration="4m13.396260351s" totalImagesPullingTime="1.779890801s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 22:21:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 22:25:40.395326416 +0000 UTC m=+287.388144144" watchObservedRunningTime="2026-08-04 22:25:40.396260351 +0000 UTC m=+287.389078078"
Aug 04 22:25:40.415955 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:40.415907    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-lvpr4" podStartSLOduration=17.132528976 podStartE2EDuration="19.415888161s" totalImagesPullingTime="2.283359185s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 22:25:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 22:25:40.414441973 +0000 UTC m=+287.407259700" watchObservedRunningTime="2026-08-04 22:25:40.415888161 +0000 UTC m=+287.408705890"
Aug 04 22:25:42.458298 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:42.458268    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8e27a6cd-73a0-4a34-ab89-c83cd76657f7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-grmx8\" (UID: \"8e27a6cd-73a0-4a34-ab89-c83cd76657f7\") " pod="openshift-insights/insights-runtime-extractor-grmx8"
Aug 04 22:25:42.458298 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:42.458304    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8e27a6cd-73a0-4a34-ab89-c83cd76657f7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-grmx8\" (UID: \"8e27a6cd-73a0-4a34-ab89-c83cd76657f7\") " pod="openshift-insights/insights-runtime-extractor-grmx8"
Aug 04 22:25:42.458749 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:42.458734    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8e27a6cd-73a0-4a34-ab89-c83cd76657f7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-grmx8\" (UID: \"8e27a6cd-73a0-4a34-ab89-c83cd76657f7\") " pod="openshift-insights/insights-runtime-extractor-grmx8"
Aug 04 22:25:42.460498 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:42.460477    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8e27a6cd-73a0-4a34-ab89-c83cd76657f7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-grmx8\" (UID: \"8e27a6cd-73a0-4a34-ab89-c83cd76657f7\") " pod="openshift-insights/insights-runtime-extractor-grmx8"
Aug 04 22:25:42.551761 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:42.551730    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-grmx8"
Aug 04 22:25:42.671156 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:42.671110    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-grmx8"]
Aug 04 22:25:42.674368 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:25:42.674334    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e27a6cd_73a0_4a34_ab89_c83cd76657f7.slice/crio-f1d055646427e2e981038de769d1b631aa8a9c342e9a88c902c404d3c0cd809e WatchSource:0}: Error finding container f1d055646427e2e981038de769d1b631aa8a9c342e9a88c902c404d3c0cd809e: Status 404 returned error can't find the container with id f1d055646427e2e981038de769d1b631aa8a9c342e9a88c902c404d3c0cd809e
Aug 04 22:25:43.393814 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:43.393774    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-grmx8" event={"ID":"8e27a6cd-73a0-4a34-ab89-c83cd76657f7","Type":"ContainerStarted","Data":"9a76a915460fca5c6d695d990f5d9090fc818f9c53784982251574b3c70784b0"}
Aug 04 22:25:43.393997 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:43.393846    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-grmx8" event={"ID":"8e27a6cd-73a0-4a34-ab89-c83cd76657f7","Type":"ContainerStarted","Data":"f1d055646427e2e981038de769d1b631aa8a9c342e9a88c902c404d3c0cd809e"}
Aug 04 22:25:44.398048 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:44.398007    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-grmx8" event={"ID":"8e27a6cd-73a0-4a34-ab89-c83cd76657f7","Type":"ContainerStarted","Data":"c2f7df204fa3ab18ec7db4911b61816a65910edbea951a7213fd3b58870170db"}
Aug 04 22:25:45.402773 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:45.402738    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-grmx8" event={"ID":"8e27a6cd-73a0-4a34-ab89-c83cd76657f7","Type":"ContainerStarted","Data":"8428803f1641fa73b991972b90387c6faabea7f1059a7c1b500a528dee4b71dd"}
Aug 04 22:25:45.419426 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:45.419380    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-grmx8" podStartSLOduration=17.194980249 podStartE2EDuration="19.419367889s" totalImagesPullingTime="2.22438764s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 22:25:26 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 22:25:45.418426602 +0000 UTC m=+292.411244330" watchObservedRunningTime="2026-08-04 22:25:45.419367889 +0000 UTC m=+292.412185616"
Aug 04 22:25:49.494162 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:25:49.494110    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-5h46r" podUID="14077369-fe10-4854-8785-0bfc9addb7c4"
Aug 04 22:25:50.387270 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:50.387245    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-8nwrx"
Aug 04 22:25:53.332504 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:53.332449    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/968aa3c2-b641-483d-a1b0-d0efc3df099e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-2ksv9\" (UID: \"968aa3c2-b641-483d-a1b0-d0efc3df099e\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-2ksv9"
Aug 04 22:25:53.334836 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:53.334812    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/968aa3c2-b641-483d-a1b0-d0efc3df099e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-2ksv9\" (UID: \"968aa3c2-b641-483d-a1b0-d0efc3df099e\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-2ksv9"
Aug 04 22:25:53.364363 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:53.364337    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-sqljb\""
Aug 04 22:25:53.372191 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:53.372171    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-2ksv9"
Aug 04 22:25:53.382493 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:53.382473    2580 kubelet.go:1648] "Image garbage collection succeeded"
Aug 04 22:25:53.521740 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:53.513378    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-2ksv9"]
Aug 04 22:25:53.521740 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:25:53.515675    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod968aa3c2_b641_483d_a1b0_d0efc3df099e.slice/crio-78baf87b622790a7e86e2604b7ddf49ea274830dc1231ef834420b66dc40f308 WatchSource:0}: Error finding container 78baf87b622790a7e86e2604b7ddf49ea274830dc1231ef834420b66dc40f308: Status 404 returned error can't find the container with id 78baf87b622790a7e86e2604b7ddf49ea274830dc1231ef834420b66dc40f308
Aug 04 22:25:54.436269 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:54.436213    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-2ksv9" event={"ID":"968aa3c2-b641-483d-a1b0-d0efc3df099e","Type":"ContainerStarted","Data":"78baf87b622790a7e86e2604b7ddf49ea274830dc1231ef834420b66dc40f308"}
Aug 04 22:25:55.441180 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:55.441066    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-2ksv9" event={"ID":"968aa3c2-b641-483d-a1b0-d0efc3df099e","Type":"ContainerStarted","Data":"c875ec10a0d9298edeca39360e45801604b8fd8ecbb609ccb01b52e10d8ab94c"}
Aug 04 22:25:55.458518 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:55.458467    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-2ksv9" podStartSLOduration=32.845010603 podStartE2EDuration="34.458453558s" totalImagesPullingTime="1.613442955s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 22:25:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 22:25:55.457167314 +0000 UTC m=+302.449985033" watchObservedRunningTime="2026-08-04 22:25:55.458453558 +0000 UTC m=+302.451271286"
Aug 04 22:25:55.598906 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:55.598872    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-b9n5f"]
Aug 04 22:25:55.601905 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:55.601888    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-b9n5f"
Aug 04 22:25:55.603844 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:55.603818    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Aug 04 22:25:55.603844 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:55.603819    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-rq9s8\""
Aug 04 22:25:55.609429 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:55.609400    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-b9n5f"]
Aug 04 22:25:55.751721 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:55.751634    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/5db3e8ee-b5a7-4695-b6a6-fab544a17e1b-tls-certificates\") pod \"prometheus-operator-admission-webhook-66685ff6d4-b9n5f\" (UID: \"5db3e8ee-b5a7-4695-b6a6-fab544a17e1b\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-b9n5f"
Aug 04 22:25:55.852143 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:55.852100    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/5db3e8ee-b5a7-4695-b6a6-fab544a17e1b-tls-certificates\") pod \"prometheus-operator-admission-webhook-66685ff6d4-b9n5f\" (UID: \"5db3e8ee-b5a7-4695-b6a6-fab544a17e1b\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-b9n5f"
Aug 04 22:25:55.854490 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:55.854464    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/5db3e8ee-b5a7-4695-b6a6-fab544a17e1b-tls-certificates\") pod \"prometheus-operator-admission-webhook-66685ff6d4-b9n5f\" (UID: \"5db3e8ee-b5a7-4695-b6a6-fab544a17e1b\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-b9n5f"
Aug 04 22:25:55.911635 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:55.911608    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-b9n5f"
Aug 04 22:25:56.028750 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:56.028680    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-b9n5f"]
Aug 04 22:25:56.031162 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:25:56.031107    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5db3e8ee_b5a7_4695_b6a6_fab544a17e1b.slice/crio-8d7a8b232a6568237f8bd75084555e5586ef5006e5c37e82a59ef66f71b8f915 WatchSource:0}: Error finding container 8d7a8b232a6568237f8bd75084555e5586ef5006e5c37e82a59ef66f71b8f915: Status 404 returned error can't find the container with id 8d7a8b232a6568237f8bd75084555e5586ef5006e5c37e82a59ef66f71b8f915
Aug 04 22:25:56.033098 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:56.033084    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 04 22:25:56.445597 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:56.445563    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-b9n5f" event={"ID":"5db3e8ee-b5a7-4695-b6a6-fab544a17e1b","Type":"ContainerStarted","Data":"8d7a8b232a6568237f8bd75084555e5586ef5006e5c37e82a59ef66f71b8f915"}
Aug 04 22:25:57.450415 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:57.450320    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-b9n5f" event={"ID":"5db3e8ee-b5a7-4695-b6a6-fab544a17e1b","Type":"ContainerStarted","Data":"064eb67f51c356df9b7235878fea02a7d16b5cc0f3d3345f4e80a8b6632a72be"}
Aug 04 22:25:57.450816 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:57.450522    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-b9n5f"
Aug 04 22:25:57.455090 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:57.455068    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-b9n5f"
Aug 04 22:25:57.467813 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:57.467774    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-b9n5f" podStartSLOduration=1.349711514 podStartE2EDuration="2.467761651s" totalImagesPullingTime="1.118050137s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 22:25:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 22:25:57.466072174 +0000 UTC m=+304.458889904" watchObservedRunningTime="2026-08-04 22:25:57.467761651 +0000 UTC m=+304.460579379"
Aug 04 22:25:57.657775 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:57.657737    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-758d7cb874-b5799"]
Aug 04 22:25:57.660872 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:57.660852    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-758d7cb874-b5799"
Aug 04 22:25:57.663261 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:57.663238    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Aug 04 22:25:57.663380 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:57.663271    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Aug 04 22:25:57.663380 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:57.663306    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-b2xps\""
Aug 04 22:25:57.663380 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:57.663312    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Aug 04 22:25:57.669789 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:57.669768    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-758d7cb874-b5799"]
Aug 04 22:25:57.767484 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:57.767417    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jzs62\" (UniqueName: \"kubernetes.io/projected/6760248f-2efd-431a-9e9f-920cd406b973-kube-api-access-jzs62\") pod \"prometheus-operator-758d7cb874-b5799\" (UID: \"6760248f-2efd-431a-9e9f-920cd406b973\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-b5799"
Aug 04 22:25:57.767484 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:57.767452    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6760248f-2efd-431a-9e9f-920cd406b973-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-758d7cb874-b5799\" (UID: \"6760248f-2efd-431a-9e9f-920cd406b973\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-b5799"
Aug 04 22:25:57.767667 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:57.767488    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/6760248f-2efd-431a-9e9f-920cd406b973-prometheus-operator-tls\") pod \"prometheus-operator-758d7cb874-b5799\" (UID: \"6760248f-2efd-431a-9e9f-920cd406b973\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-b5799"
Aug 04 22:25:57.767667 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:57.767551    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6760248f-2efd-431a-9e9f-920cd406b973-metrics-client-ca\") pod \"prometheus-operator-758d7cb874-b5799\" (UID: \"6760248f-2efd-431a-9e9f-920cd406b973\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-b5799"
Aug 04 22:25:57.868197 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:57.868154    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/6760248f-2efd-431a-9e9f-920cd406b973-prometheus-operator-tls\") pod \"prometheus-operator-758d7cb874-b5799\" (UID: \"6760248f-2efd-431a-9e9f-920cd406b973\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-b5799"
Aug 04 22:25:57.868197 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:57.868200    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6760248f-2efd-431a-9e9f-920cd406b973-metrics-client-ca\") pod \"prometheus-operator-758d7cb874-b5799\" (UID: \"6760248f-2efd-431a-9e9f-920cd406b973\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-b5799"
Aug 04 22:25:57.868411 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:57.868258    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jzs62\" (UniqueName: \"kubernetes.io/projected/6760248f-2efd-431a-9e9f-920cd406b973-kube-api-access-jzs62\") pod \"prometheus-operator-758d7cb874-b5799\" (UID: \"6760248f-2efd-431a-9e9f-920cd406b973\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-b5799"
Aug 04 22:25:57.868411 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:57.868280    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6760248f-2efd-431a-9e9f-920cd406b973-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-758d7cb874-b5799\" (UID: \"6760248f-2efd-431a-9e9f-920cd406b973\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-b5799"
Aug 04 22:25:57.868411 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:25:57.868332    2580 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Aug 04 22:25:57.868411 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:25:57.868409    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6760248f-2efd-431a-9e9f-920cd406b973-prometheus-operator-tls podName:6760248f-2efd-431a-9e9f-920cd406b973 nodeName:}" failed. No retries permitted until 2026-08-04 22:25:58.368387926 +0000 UTC m=+305.361205653 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/6760248f-2efd-431a-9e9f-920cd406b973-prometheus-operator-tls") pod "prometheus-operator-758d7cb874-b5799" (UID: "6760248f-2efd-431a-9e9f-920cd406b973") : secret "prometheus-operator-tls" not found
Aug 04 22:25:57.869078 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:57.869055    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6760248f-2efd-431a-9e9f-920cd406b973-metrics-client-ca\") pod \"prometheus-operator-758d7cb874-b5799\" (UID: \"6760248f-2efd-431a-9e9f-920cd406b973\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-b5799"
Aug 04 22:25:57.870791 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:57.870774    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6760248f-2efd-431a-9e9f-920cd406b973-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-758d7cb874-b5799\" (UID: \"6760248f-2efd-431a-9e9f-920cd406b973\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-b5799"
Aug 04 22:25:57.876715 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:57.876694    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jzs62\" (UniqueName: \"kubernetes.io/projected/6760248f-2efd-431a-9e9f-920cd406b973-kube-api-access-jzs62\") pod \"prometheus-operator-758d7cb874-b5799\" (UID: \"6760248f-2efd-431a-9e9f-920cd406b973\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-b5799"
Aug 04 22:25:57.971737 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:57.971705    2580 patch_prober.go:28] interesting pod/image-registry-77b66db774-9npzs container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Aug 04 22:25:57.971890 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:57.971760    2580 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-77b66db774-9npzs" podUID="069b448c-edde-423c-b08d-4cac577c09e5" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Aug 04 22:25:58.372787 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:58.372748    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/6760248f-2efd-431a-9e9f-920cd406b973-prometheus-operator-tls\") pod \"prometheus-operator-758d7cb874-b5799\" (UID: \"6760248f-2efd-431a-9e9f-920cd406b973\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-b5799"
Aug 04 22:25:58.375083 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:58.375050    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/6760248f-2efd-431a-9e9f-920cd406b973-prometheus-operator-tls\") pod \"prometheus-operator-758d7cb874-b5799\" (UID: \"6760248f-2efd-431a-9e9f-920cd406b973\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-b5799"
Aug 04 22:25:58.570413 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:58.570385    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-758d7cb874-b5799"
Aug 04 22:25:58.728874 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:58.728841    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-758d7cb874-b5799"]
Aug 04 22:25:58.731843 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:25:58.731812    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6760248f_2efd_431a_9e9f_920cd406b973.slice/crio-df3f44cca9c6e37d749b66ddda1a45c6e99b94919e6af94c32046a5f7d2e29f8 WatchSource:0}: Error finding container df3f44cca9c6e37d749b66ddda1a45c6e99b94919e6af94c32046a5f7d2e29f8: Status 404 returned error can't find the container with id df3f44cca9c6e37d749b66ddda1a45c6e99b94919e6af94c32046a5f7d2e29f8
Aug 04 22:25:59.381226 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:59.381188    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-77b66db774-9npzs"
Aug 04 22:25:59.459037 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:25:59.459004    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-758d7cb874-b5799" event={"ID":"6760248f-2efd-431a-9e9f-920cd406b973","Type":"ContainerStarted","Data":"df3f44cca9c6e37d749b66ddda1a45c6e99b94919e6af94c32046a5f7d2e29f8"}
Aug 04 22:26:00.463828 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:00.463802    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-758d7cb874-b5799" event={"ID":"6760248f-2efd-431a-9e9f-920cd406b973","Type":"ContainerStarted","Data":"9f6613de04c2642cb9dcc32392a15d2502f9f29db523ccd3d271425066927c51"}
Aug 04 22:26:00.493250 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:00.493227    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5h46r"
Aug 04 22:26:01.469103 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:01.469069    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-758d7cb874-b5799" event={"ID":"6760248f-2efd-431a-9e9f-920cd406b973","Type":"ContainerStarted","Data":"35bc2d1c62465e48842ae4b8f9a851ce2f80367afe6bc2312e7c82064f7f07ad"}
Aug 04 22:26:01.486666 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:01.486621    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-758d7cb874-b5799" podStartSLOduration=2.852894514 podStartE2EDuration="4.486606909s" totalImagesPullingTime="1.633712395s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 22:25:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 22:26:01.485688911 +0000 UTC m=+308.478506640" watchObservedRunningTime="2026-08-04 22:26:01.486606909 +0000 UTC m=+308.479424636"
Aug 04 22:26:03.004383 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:03.004349    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-kfzjb"]
Aug 04 22:26:03.006681 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:03.006662    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-kfzjb"
Aug 04 22:26:03.008847 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:03.008804    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Aug 04 22:26:03.008847 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:03.008816    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Aug 04 22:26:03.008847 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:03.008846    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Aug 04 22:26:03.009068 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:03.008825    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-hmr7p\""
Aug 04 22:26:03.109490 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:03.109458    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/37f4874f-ae9c-4bd4-90db-135afcf9df5d-node-exporter-accelerators-collector-config\") pod \"node-exporter-kfzjb\" (UID: \"37f4874f-ae9c-4bd4-90db-135afcf9df5d\") " pod="openshift-monitoring/node-exporter-kfzjb"
Aug 04 22:26:03.109622 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:03.109507    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/37f4874f-ae9c-4bd4-90db-135afcf9df5d-node-exporter-wtmp\") pod \"node-exporter-kfzjb\" (UID: \"37f4874f-ae9c-4bd4-90db-135afcf9df5d\") " pod="openshift-monitoring/node-exporter-kfzjb"
Aug 04 22:26:03.109622 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:03.109534    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/37f4874f-ae9c-4bd4-90db-135afcf9df5d-node-exporter-textfile\") pod \"node-exporter-kfzjb\" (UID: \"37f4874f-ae9c-4bd4-90db-135afcf9df5d\") " pod="openshift-monitoring/node-exporter-kfzjb"
Aug 04 22:26:03.109622 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:03.109568    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/37f4874f-ae9c-4bd4-90db-135afcf9df5d-metrics-client-ca\") pod \"node-exporter-kfzjb\" (UID: \"37f4874f-ae9c-4bd4-90db-135afcf9df5d\") " pod="openshift-monitoring/node-exporter-kfzjb"
Aug 04 22:26:03.109735 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:03.109689    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/37f4874f-ae9c-4bd4-90db-135afcf9df5d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kfzjb\" (UID: \"37f4874f-ae9c-4bd4-90db-135afcf9df5d\") " pod="openshift-monitoring/node-exporter-kfzjb"
Aug 04 22:26:03.109735 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:03.109729    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/37f4874f-ae9c-4bd4-90db-135afcf9df5d-sys\") pod \"node-exporter-kfzjb\" (UID: \"37f4874f-ae9c-4bd4-90db-135afcf9df5d\") " pod="openshift-monitoring/node-exporter-kfzjb"
Aug 04 22:26:03.109805 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:03.109757    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wlt42\" (UniqueName: \"kubernetes.io/projected/37f4874f-ae9c-4bd4-90db-135afcf9df5d-kube-api-access-wlt42\") pod \"node-exporter-kfzjb\" (UID: \"37f4874f-ae9c-4bd4-90db-135afcf9df5d\") " pod="openshift-monitoring/node-exporter-kfzjb"
Aug 04 22:26:03.109805 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:03.109786    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/37f4874f-ae9c-4bd4-90db-135afcf9df5d-root\") pod \"node-exporter-kfzjb\" (UID: \"37f4874f-ae9c-4bd4-90db-135afcf9df5d\") " pod="openshift-monitoring/node-exporter-kfzjb"
Aug 04 22:26:03.109877 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:03.109814    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/37f4874f-ae9c-4bd4-90db-135afcf9df5d-node-exporter-tls\") pod \"node-exporter-kfzjb\" (UID: \"37f4874f-ae9c-4bd4-90db-135afcf9df5d\") " pod="openshift-monitoring/node-exporter-kfzjb"
Aug 04 22:26:03.210656 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:03.210630    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/37f4874f-ae9c-4bd4-90db-135afcf9df5d-node-exporter-textfile\") pod \"node-exporter-kfzjb\" (UID: \"37f4874f-ae9c-4bd4-90db-135afcf9df5d\") " pod="openshift-monitoring/node-exporter-kfzjb"
Aug 04 22:26:03.210780 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:03.210669    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/37f4874f-ae9c-4bd4-90db-135afcf9df5d-metrics-client-ca\") pod \"node-exporter-kfzjb\" (UID: \"37f4874f-ae9c-4bd4-90db-135afcf9df5d\") " pod="openshift-monitoring/node-exporter-kfzjb"
Aug 04 22:26:03.210780 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:03.210704    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/37f4874f-ae9c-4bd4-90db-135afcf9df5d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kfzjb\" (UID: \"37f4874f-ae9c-4bd4-90db-135afcf9df5d\") " pod="openshift-monitoring/node-exporter-kfzjb"
Aug 04 22:26:03.210780 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:03.210723    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/37f4874f-ae9c-4bd4-90db-135afcf9df5d-sys\") pod \"node-exporter-kfzjb\" (UID: \"37f4874f-ae9c-4bd4-90db-135afcf9df5d\") " pod="openshift-monitoring/node-exporter-kfzjb"
Aug 04 22:26:03.210780 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:03.210739    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wlt42\" (UniqueName: \"kubernetes.io/projected/37f4874f-ae9c-4bd4-90db-135afcf9df5d-kube-api-access-wlt42\") pod \"node-exporter-kfzjb\" (UID: \"37f4874f-ae9c-4bd4-90db-135afcf9df5d\") " pod="openshift-monitoring/node-exporter-kfzjb"
Aug 04 22:26:03.210780 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:03.210756    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/37f4874f-ae9c-4bd4-90db-135afcf9df5d-root\") pod \"node-exporter-kfzjb\" (UID: \"37f4874f-ae9c-4bd4-90db-135afcf9df5d\") " pod="openshift-monitoring/node-exporter-kfzjb"
Aug 04 22:26:03.210780 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:03.210772    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/37f4874f-ae9c-4bd4-90db-135afcf9df5d-node-exporter-tls\") pod \"node-exporter-kfzjb\" (UID: \"37f4874f-ae9c-4bd4-90db-135afcf9df5d\") " pod="openshift-monitoring/node-exporter-kfzjb"
Aug 04 22:26:03.211086 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:03.210797    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/37f4874f-ae9c-4bd4-90db-135afcf9df5d-node-exporter-accelerators-collector-config\") pod \"node-exporter-kfzjb\" (UID: \"37f4874f-ae9c-4bd4-90db-135afcf9df5d\") " pod="openshift-monitoring/node-exporter-kfzjb"
Aug 04 22:26:03.211086 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:03.210840    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/37f4874f-ae9c-4bd4-90db-135afcf9df5d-node-exporter-wtmp\") pod \"node-exporter-kfzjb\" (UID: \"37f4874f-ae9c-4bd4-90db-135afcf9df5d\") " pod="openshift-monitoring/node-exporter-kfzjb"
Aug 04 22:26:03.211086 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:03.210884    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/37f4874f-ae9c-4bd4-90db-135afcf9df5d-root\") pod \"node-exporter-kfzjb\" (UID: \"37f4874f-ae9c-4bd4-90db-135afcf9df5d\") " pod="openshift-monitoring/node-exporter-kfzjb"
Aug 04 22:26:03.211086 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:03.210843    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/37f4874f-ae9c-4bd4-90db-135afcf9df5d-sys\") pod \"node-exporter-kfzjb\" (UID: \"37f4874f-ae9c-4bd4-90db-135afcf9df5d\") " pod="openshift-monitoring/node-exporter-kfzjb"
Aug 04 22:26:03.211086 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:26:03.210997    2580 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Aug 04 22:26:03.211086 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:03.211004    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/37f4874f-ae9c-4bd4-90db-135afcf9df5d-node-exporter-wtmp\") pod \"node-exporter-kfzjb\" (UID: \"37f4874f-ae9c-4bd4-90db-135afcf9df5d\") " pod="openshift-monitoring/node-exporter-kfzjb"
Aug 04 22:26:03.211086 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:03.211016    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/37f4874f-ae9c-4bd4-90db-135afcf9df5d-node-exporter-textfile\") pod \"node-exporter-kfzjb\" (UID: \"37f4874f-ae9c-4bd4-90db-135afcf9df5d\") " pod="openshift-monitoring/node-exporter-kfzjb"
Aug 04 22:26:03.211086 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:26:03.211050    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37f4874f-ae9c-4bd4-90db-135afcf9df5d-node-exporter-tls podName:37f4874f-ae9c-4bd4-90db-135afcf9df5d nodeName:}" failed. No retries permitted until 2026-08-04 22:26:03.711032011 +0000 UTC m=+310.703849717 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/37f4874f-ae9c-4bd4-90db-135afcf9df5d-node-exporter-tls") pod "node-exporter-kfzjb" (UID: "37f4874f-ae9c-4bd4-90db-135afcf9df5d") : secret "node-exporter-tls" not found
Aug 04 22:26:03.211478 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:03.211386    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/37f4874f-ae9c-4bd4-90db-135afcf9df5d-node-exporter-accelerators-collector-config\") pod \"node-exporter-kfzjb\" (UID: \"37f4874f-ae9c-4bd4-90db-135afcf9df5d\") " pod="openshift-monitoring/node-exporter-kfzjb"
Aug 04 22:26:03.211478 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:03.211405    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/37f4874f-ae9c-4bd4-90db-135afcf9df5d-metrics-client-ca\") pod \"node-exporter-kfzjb\" (UID: \"37f4874f-ae9c-4bd4-90db-135afcf9df5d\") " pod="openshift-monitoring/node-exporter-kfzjb"
Aug 04 22:26:03.213367 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:03.213330    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/37f4874f-ae9c-4bd4-90db-135afcf9df5d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kfzjb\" (UID: \"37f4874f-ae9c-4bd4-90db-135afcf9df5d\") " pod="openshift-monitoring/node-exporter-kfzjb"
Aug 04 22:26:03.221542 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:03.221515    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wlt42\" (UniqueName: \"kubernetes.io/projected/37f4874f-ae9c-4bd4-90db-135afcf9df5d-kube-api-access-wlt42\") pod \"node-exporter-kfzjb\" (UID: \"37f4874f-ae9c-4bd4-90db-135afcf9df5d\") " pod="openshift-monitoring/node-exporter-kfzjb"
Aug 04 22:26:03.715439 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:03.715405    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/37f4874f-ae9c-4bd4-90db-135afcf9df5d-node-exporter-tls\") pod \"node-exporter-kfzjb\" (UID: \"37f4874f-ae9c-4bd4-90db-135afcf9df5d\") " pod="openshift-monitoring/node-exporter-kfzjb"
Aug 04 22:26:03.717668 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:03.717641    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/37f4874f-ae9c-4bd4-90db-135afcf9df5d-node-exporter-tls\") pod \"node-exporter-kfzjb\" (UID: \"37f4874f-ae9c-4bd4-90db-135afcf9df5d\") " pod="openshift-monitoring/node-exporter-kfzjb"
Aug 04 22:26:03.917298 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:03.917259    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-kfzjb"
Aug 04 22:26:03.927464 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:26:03.927441    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37f4874f_ae9c_4bd4_90db_135afcf9df5d.slice/crio-8dd6d3bbfb4ab7b16d4536a588f4f5eddc9f51adf89467569770f2061fd33249 WatchSource:0}: Error finding container 8dd6d3bbfb4ab7b16d4536a588f4f5eddc9f51adf89467569770f2061fd33249: Status 404 returned error can't find the container with id 8dd6d3bbfb4ab7b16d4536a588f4f5eddc9f51adf89467569770f2061fd33249
Aug 04 22:26:04.070206 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:04.070173    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Aug 04 22:26:04.073458 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:04.073437    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Aug 04 22:26:04.075595 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:04.075566    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Aug 04 22:26:04.075694 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:04.075566    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Aug 04 22:26:04.075694 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:04.075567    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Aug 04 22:26:04.075694 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:04.075607    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Aug 04 22:26:04.075987 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:04.075957    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Aug 04 22:26:04.076090 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:04.076026    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Aug 04 22:26:04.076090 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:04.076052    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Aug 04 22:26:04.076233 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:04.075964    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-fbk4w\""
Aug 04 22:26:04.076233 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:04.076157    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Aug 04 22:26:04.076407 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:04.076390    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Aug 04 22:26:04.087198 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:04.087177    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Aug 04 22:26:04.218063 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:04.218029    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/581da9eb-d79f-40a2-af76-6758135a8b9c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"581da9eb-d79f-40a2-af76-6758135a8b9c\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 22:26:04.218063 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:04.218061    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/581da9eb-d79f-40a2-af76-6758135a8b9c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"581da9eb-d79f-40a2-af76-6758135a8b9c\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 22:26:04.218318 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:04.218095    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xgdhk\" (UniqueName: \"kubernetes.io/projected/581da9eb-d79f-40a2-af76-6758135a8b9c-kube-api-access-xgdhk\") pod \"alertmanager-main-0\" (UID: \"581da9eb-d79f-40a2-af76-6758135a8b9c\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 22:26:04.218318 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:04.218168    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/581da9eb-d79f-40a2-af76-6758135a8b9c-config-out\") pod \"alertmanager-main-0\" (UID: \"581da9eb-d79f-40a2-af76-6758135a8b9c\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 22:26:04.218318 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:04.218194    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/581da9eb-d79f-40a2-af76-6758135a8b9c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"581da9eb-d79f-40a2-af76-6758135a8b9c\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 22:26:04.218318 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:04.218211    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/581da9eb-d79f-40a2-af76-6758135a8b9c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"581da9eb-d79f-40a2-af76-6758135a8b9c\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 22:26:04.218318 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:04.218230    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/581da9eb-d79f-40a2-af76-6758135a8b9c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"581da9eb-d79f-40a2-af76-6758135a8b9c\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 22:26:04.218318 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:04.218256    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/581da9eb-d79f-40a2-af76-6758135a8b9c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"581da9eb-d79f-40a2-af76-6758135a8b9c\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 22:26:04.218318 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:04.218272    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/581da9eb-d79f-40a2-af76-6758135a8b9c-config-volume\") pod \"alertmanager-main-0\" (UID: \"581da9eb-d79f-40a2-af76-6758135a8b9c\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 22:26:04.218318 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:04.218296    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/581da9eb-d79f-40a2-af76-6758135a8b9c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"581da9eb-d79f-40a2-af76-6758135a8b9c\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 22:26:04.218692 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:04.218334    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/581da9eb-d79f-40a2-af76-6758135a8b9c-web-config\") pod \"alertmanager-main-0\" (UID: \"581da9eb-d79f-40a2-af76-6758135a8b9c\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 22:26:04.218692 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:04.218404    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/581da9eb-d79f-40a2-af76-6758135a8b9c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"581da9eb-d79f-40a2-af76-6758135a8b9c\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 22:26:04.218692 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:04.218432    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/581da9eb-d79f-40a2-af76-6758135a8b9c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"581da9eb-d79f-40a2-af76-6758135a8b9c\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 22:26:04.319290 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:04.319251    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/581da9eb-d79f-40a2-af76-6758135a8b9c-config-out\") pod \"alertmanager-main-0\" (UID: \"581da9eb-d79f-40a2-af76-6758135a8b9c\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 22:26:04.319461 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:04.319297    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/581da9eb-d79f-40a2-af76-6758135a8b9c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"581da9eb-d79f-40a2-af76-6758135a8b9c\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 22:26:04.319461 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:04.319324    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/581da9eb-d79f-40a2-af76-6758135a8b9c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"581da9eb-d79f-40a2-af76-6758135a8b9c\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 22:26:04.319461 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:04.319354    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/581da9eb-d79f-40a2-af76-6758135a8b9c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"581da9eb-d79f-40a2-af76-6758135a8b9c\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 22:26:04.319461 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:04.319398    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/581da9eb-d79f-40a2-af76-6758135a8b9c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"581da9eb-d79f-40a2-af76-6758135a8b9c\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 22:26:04.319461 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:04.319428    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/581da9eb-d79f-40a2-af76-6758135a8b9c-config-volume\") pod \"alertmanager-main-0\" (UID: \"581da9eb-d79f-40a2-af76-6758135a8b9c\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 22:26:04.319461 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:04.319454    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/581da9eb-d79f-40a2-af76-6758135a8b9c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"581da9eb-d79f-40a2-af76-6758135a8b9c\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 22:26:04.319766 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:04.319476    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/581da9eb-d79f-40a2-af76-6758135a8b9c-web-config\") pod \"alertmanager-main-0\" (UID: \"581da9eb-d79f-40a2-af76-6758135a8b9c\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 22:26:04.319766 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:04.319507    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/581da9eb-d79f-40a2-af76-6758135a8b9c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"581da9eb-d79f-40a2-af76-6758135a8b9c\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 22:26:04.319766 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:04.319534    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/581da9eb-d79f-40a2-af76-6758135a8b9c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"581da9eb-d79f-40a2-af76-6758135a8b9c\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 22:26:04.319766 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:04.319572    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/581da9eb-d79f-40a2-af76-6758135a8b9c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"581da9eb-d79f-40a2-af76-6758135a8b9c\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 22:26:04.319766 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:04.319596    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/581da9eb-d79f-40a2-af76-6758135a8b9c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"581da9eb-d79f-40a2-af76-6758135a8b9c\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 22:26:04.319766 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:04.319656    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xgdhk\" (UniqueName: \"kubernetes.io/projected/581da9eb-d79f-40a2-af76-6758135a8b9c-kube-api-access-xgdhk\") pod \"alertmanager-main-0\" (UID: \"581da9eb-d79f-40a2-af76-6758135a8b9c\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 22:26:04.320053 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:26:04.320034    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/581da9eb-d79f-40a2-af76-6758135a8b9c-alertmanager-trusted-ca-bundle podName:581da9eb-d79f-40a2-af76-6758135a8b9c nodeName:}" failed. No retries permitted until 2026-08-04 22:26:04.820010479 +0000 UTC m=+311.812828192 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/581da9eb-d79f-40a2-af76-6758135a8b9c-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "581da9eb-d79f-40a2-af76-6758135a8b9c") : configmap references non-existent config key: ca-bundle.crt
Aug 04 22:26:04.321440 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:04.321378    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/581da9eb-d79f-40a2-af76-6758135a8b9c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"581da9eb-d79f-40a2-af76-6758135a8b9c\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 22:26:04.321557 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:04.321517    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/581da9eb-d79f-40a2-af76-6758135a8b9c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"581da9eb-d79f-40a2-af76-6758135a8b9c\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 22:26:04.322746 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:04.322714    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/581da9eb-d79f-40a2-af76-6758135a8b9c-config-out\") pod \"alertmanager-main-0\" (UID: \"581da9eb-d79f-40a2-af76-6758135a8b9c\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 22:26:04.323736 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:04.323358    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/581da9eb-d79f-40a2-af76-6758135a8b9c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"581da9eb-d79f-40a2-af76-6758135a8b9c\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 22:26:04.323736 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:04.323589    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/581da9eb-d79f-40a2-af76-6758135a8b9c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"581da9eb-d79f-40a2-af76-6758135a8b9c\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 22:26:04.323736 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:04.323698    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/581da9eb-d79f-40a2-af76-6758135a8b9c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"581da9eb-d79f-40a2-af76-6758135a8b9c\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 22:26:04.323736 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:04.323723    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/581da9eb-d79f-40a2-af76-6758135a8b9c-config-volume\") pod \"alertmanager-main-0\" (UID: \"581da9eb-d79f-40a2-af76-6758135a8b9c\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 22:26:04.324450 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:04.324410    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/581da9eb-d79f-40a2-af76-6758135a8b9c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"581da9eb-d79f-40a2-af76-6758135a8b9c\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 22:26:04.324691 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:04.324663    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/581da9eb-d79f-40a2-af76-6758135a8b9c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"581da9eb-d79f-40a2-af76-6758135a8b9c\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 22:26:04.325629 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:04.325607    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/581da9eb-d79f-40a2-af76-6758135a8b9c-web-config\") pod \"alertmanager-main-0\" (UID: \"581da9eb-d79f-40a2-af76-6758135a8b9c\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 22:26:04.326295 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:04.326277    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/581da9eb-d79f-40a2-af76-6758135a8b9c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"581da9eb-d79f-40a2-af76-6758135a8b9c\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 22:26:04.328227 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:04.328208    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xgdhk\" (UniqueName: \"kubernetes.io/projected/581da9eb-d79f-40a2-af76-6758135a8b9c-kube-api-access-xgdhk\") pod \"alertmanager-main-0\" (UID: \"581da9eb-d79f-40a2-af76-6758135a8b9c\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 22:26:04.481805 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:04.481763    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kfzjb" event={"ID":"37f4874f-ae9c-4bd4-90db-135afcf9df5d","Type":"ContainerStarted","Data":"8dd6d3bbfb4ab7b16d4536a588f4f5eddc9f51adf89467569770f2061fd33249"}
Aug 04 22:26:04.824459 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:04.824418    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/581da9eb-d79f-40a2-af76-6758135a8b9c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"581da9eb-d79f-40a2-af76-6758135a8b9c\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 22:26:04.825475 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:04.825448    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/581da9eb-d79f-40a2-af76-6758135a8b9c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"581da9eb-d79f-40a2-af76-6758135a8b9c\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 22:26:04.985416 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:04.985384    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Aug 04 22:26:05.117281 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:05.117235    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Aug 04 22:26:05.119810 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:26:05.119785    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod581da9eb_d79f_40a2_af76_6758135a8b9c.slice/crio-9553f5da60c5e13e28990285c27739776fd9fe162d370a34e2e94574a2862c93 WatchSource:0}: Error finding container 9553f5da60c5e13e28990285c27739776fd9fe162d370a34e2e94574a2862c93: Status 404 returned error can't find the container with id 9553f5da60c5e13e28990285c27739776fd9fe162d370a34e2e94574a2862c93
Aug 04 22:26:05.485817 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:05.485746    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"581da9eb-d79f-40a2-af76-6758135a8b9c","Type":"ContainerStarted","Data":"9553f5da60c5e13e28990285c27739776fd9fe162d370a34e2e94574a2862c93"}
Aug 04 22:26:05.487256 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:05.487233    2580 generic.go:356] "Generic (PLEG): container finished" podID="37f4874f-ae9c-4bd4-90db-135afcf9df5d" containerID="b940bbb958289c2e83df1a49d257d28aaa543a8fcd11d4ed7a2704bd580ffdef" exitCode=0
Aug 04 22:26:05.487352 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:05.487263    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kfzjb" event={"ID":"37f4874f-ae9c-4bd4-90db-135afcf9df5d","Type":"ContainerDied","Data":"b940bbb958289c2e83df1a49d257d28aaa543a8fcd11d4ed7a2704bd580ffdef"}
Aug 04 22:26:06.493677 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:06.493575    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kfzjb" event={"ID":"37f4874f-ae9c-4bd4-90db-135afcf9df5d","Type":"ContainerStarted","Data":"533d985146490c0542316cbae01e74f519277957954475df3cdea2e869509a87"}
Aug 04 22:26:06.493677 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:06.493636    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kfzjb" event={"ID":"37f4874f-ae9c-4bd4-90db-135afcf9df5d","Type":"ContainerStarted","Data":"535cd4fdbe65c78c2bf620235a98c900b6f8a86efa62ba7b16a9614d6b5c6579"}
Aug 04 22:26:06.495183 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:06.495157    2580 generic.go:356] "Generic (PLEG): container finished" podID="581da9eb-d79f-40a2-af76-6758135a8b9c" containerID="4b3759fc06b41b22308796b759003e481d27f1f0ffc170846c253c0b63521123" exitCode=0
Aug 04 22:26:06.495287 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:06.495209    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"581da9eb-d79f-40a2-af76-6758135a8b9c","Type":"ContainerDied","Data":"4b3759fc06b41b22308796b759003e481d27f1f0ffc170846c253c0b63521123"}
Aug 04 22:26:06.516103 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:06.516066    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-kfzjb" podStartSLOduration=3.512037767 podStartE2EDuration="4.516050548s" totalImagesPullingTime="934.984655ms" totalInitContainerRuntime="69.028126ms" isStatefulPod=true podCreationTimestamp="2026-08-04 22:26:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 22:26:06.514790673 +0000 UTC m=+313.507608400" watchObservedRunningTime="2026-08-04 22:26:06.516050548 +0000 UTC m=+313.508868277"
Aug 04 22:26:08.187532 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:08.187508    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-55bf74f97-hnnqg"]
Aug 04 22:26:08.190044 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:08.190024    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-55bf74f97-hnnqg"
Aug 04 22:26:08.192184 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:08.192164    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Aug 04 22:26:08.193279 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:08.193201    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-c2c92\""
Aug 04 22:26:08.193279 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:08.193239    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Aug 04 22:26:08.193433 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:08.193293    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Aug 04 22:26:08.193433 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:08.193239    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Aug 04 22:26:08.194147 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:08.194109    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Aug 04 22:26:08.199556 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:08.199537    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Aug 04 22:26:08.209724 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:08.209704    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-55bf74f97-hnnqg"]
Aug 04 22:26:08.353795 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:08.353759    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-88fhd\" (UniqueName: \"kubernetes.io/projected/12682642-ca12-4b49-9204-4e69d19e16d2-kube-api-access-88fhd\") pod \"telemeter-client-55bf74f97-hnnqg\" (UID: \"12682642-ca12-4b49-9204-4e69d19e16d2\") " pod="openshift-monitoring/telemeter-client-55bf74f97-hnnqg"
Aug 04 22:26:08.353896 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:08.353831    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/12682642-ca12-4b49-9204-4e69d19e16d2-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-55bf74f97-hnnqg\" (UID: \"12682642-ca12-4b49-9204-4e69d19e16d2\") " pod="openshift-monitoring/telemeter-client-55bf74f97-hnnqg"
Aug 04 22:26:08.353896 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:08.353878    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/12682642-ca12-4b49-9204-4e69d19e16d2-telemeter-client-tls\") pod \"telemeter-client-55bf74f97-hnnqg\" (UID: \"12682642-ca12-4b49-9204-4e69d19e16d2\") " pod="openshift-monitoring/telemeter-client-55bf74f97-hnnqg"
Aug 04 22:26:08.353992 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:08.353940    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/12682642-ca12-4b49-9204-4e69d19e16d2-telemeter-trusted-ca-bundle\") pod \"telemeter-client-55bf74f97-hnnqg\" (UID: \"12682642-ca12-4b49-9204-4e69d19e16d2\") " pod="openshift-monitoring/telemeter-client-55bf74f97-hnnqg"
Aug 04 22:26:08.353992 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:08.353970    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/12682642-ca12-4b49-9204-4e69d19e16d2-serving-certs-ca-bundle\") pod \"telemeter-client-55bf74f97-hnnqg\" (UID: \"12682642-ca12-4b49-9204-4e69d19e16d2\") " pod="openshift-monitoring/telemeter-client-55bf74f97-hnnqg"
Aug 04 22:26:08.354076 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:08.354001    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/12682642-ca12-4b49-9204-4e69d19e16d2-federate-client-tls\") pod \"telemeter-client-55bf74f97-hnnqg\" (UID: \"12682642-ca12-4b49-9204-4e69d19e16d2\") " pod="openshift-monitoring/telemeter-client-55bf74f97-hnnqg"
Aug 04 22:26:08.354076 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:08.354057    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/12682642-ca12-4b49-9204-4e69d19e16d2-secret-telemeter-client\") pod \"telemeter-client-55bf74f97-hnnqg\" (UID: \"12682642-ca12-4b49-9204-4e69d19e16d2\") " pod="openshift-monitoring/telemeter-client-55bf74f97-hnnqg"
Aug 04 22:26:08.354162 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:08.354106    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/12682642-ca12-4b49-9204-4e69d19e16d2-metrics-client-ca\") pod \"telemeter-client-55bf74f97-hnnqg\" (UID: \"12682642-ca12-4b49-9204-4e69d19e16d2\") " pod="openshift-monitoring/telemeter-client-55bf74f97-hnnqg"
Aug 04 22:26:08.454683 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:08.454627    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/12682642-ca12-4b49-9204-4e69d19e16d2-metrics-client-ca\") pod \"telemeter-client-55bf74f97-hnnqg\" (UID: \"12682642-ca12-4b49-9204-4e69d19e16d2\") " pod="openshift-monitoring/telemeter-client-55bf74f97-hnnqg"
Aug 04 22:26:08.454683 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:08.454665    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-88fhd\" (UniqueName: \"kubernetes.io/projected/12682642-ca12-4b49-9204-4e69d19e16d2-kube-api-access-88fhd\") pod \"telemeter-client-55bf74f97-hnnqg\" (UID: \"12682642-ca12-4b49-9204-4e69d19e16d2\") " pod="openshift-monitoring/telemeter-client-55bf74f97-hnnqg"
Aug 04 22:26:08.454840 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:08.454695    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/12682642-ca12-4b49-9204-4e69d19e16d2-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-55bf74f97-hnnqg\" (UID: \"12682642-ca12-4b49-9204-4e69d19e16d2\") " pod="openshift-monitoring/telemeter-client-55bf74f97-hnnqg"
Aug 04 22:26:08.454840 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:08.454713    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/12682642-ca12-4b49-9204-4e69d19e16d2-telemeter-client-tls\") pod \"telemeter-client-55bf74f97-hnnqg\" (UID: \"12682642-ca12-4b49-9204-4e69d19e16d2\") " pod="openshift-monitoring/telemeter-client-55bf74f97-hnnqg"
Aug 04 22:26:08.454935 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:08.454833    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/12682642-ca12-4b49-9204-4e69d19e16d2-telemeter-trusted-ca-bundle\") pod \"telemeter-client-55bf74f97-hnnqg\" (UID: \"12682642-ca12-4b49-9204-4e69d19e16d2\") " pod="openshift-monitoring/telemeter-client-55bf74f97-hnnqg"
Aug 04 22:26:08.454935 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:08.454879    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/12682642-ca12-4b49-9204-4e69d19e16d2-serving-certs-ca-bundle\") pod \"telemeter-client-55bf74f97-hnnqg\" (UID: \"12682642-ca12-4b49-9204-4e69d19e16d2\") " pod="openshift-monitoring/telemeter-client-55bf74f97-hnnqg"
Aug 04 22:26:08.454935 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:08.454916    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/12682642-ca12-4b49-9204-4e69d19e16d2-federate-client-tls\") pod \"telemeter-client-55bf74f97-hnnqg\" (UID: \"12682642-ca12-4b49-9204-4e69d19e16d2\") " pod="openshift-monitoring/telemeter-client-55bf74f97-hnnqg"
Aug 04 22:26:08.455081 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:08.454953    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/12682642-ca12-4b49-9204-4e69d19e16d2-secret-telemeter-client\") pod \"telemeter-client-55bf74f97-hnnqg\" (UID: \"12682642-ca12-4b49-9204-4e69d19e16d2\") " pod="openshift-monitoring/telemeter-client-55bf74f97-hnnqg"
Aug 04 22:26:08.455578 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:08.455548    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/12682642-ca12-4b49-9204-4e69d19e16d2-metrics-client-ca\") pod \"telemeter-client-55bf74f97-hnnqg\" (UID: \"12682642-ca12-4b49-9204-4e69d19e16d2\") " pod="openshift-monitoring/telemeter-client-55bf74f97-hnnqg"
Aug 04 22:26:08.455578 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:08.455568    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/12682642-ca12-4b49-9204-4e69d19e16d2-serving-certs-ca-bundle\") pod \"telemeter-client-55bf74f97-hnnqg\" (UID: \"12682642-ca12-4b49-9204-4e69d19e16d2\") " pod="openshift-monitoring/telemeter-client-55bf74f97-hnnqg"
Aug 04 22:26:08.455753 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:08.455654    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/12682642-ca12-4b49-9204-4e69d19e16d2-telemeter-trusted-ca-bundle\") pod \"telemeter-client-55bf74f97-hnnqg\" (UID: \"12682642-ca12-4b49-9204-4e69d19e16d2\") " pod="openshift-monitoring/telemeter-client-55bf74f97-hnnqg"
Aug 04 22:26:08.457077 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:08.457060    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/12682642-ca12-4b49-9204-4e69d19e16d2-telemeter-client-tls\") pod \"telemeter-client-55bf74f97-hnnqg\" (UID: \"12682642-ca12-4b49-9204-4e69d19e16d2\") " pod="openshift-monitoring/telemeter-client-55bf74f97-hnnqg"
Aug 04 22:26:08.457165 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:08.457119    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/12682642-ca12-4b49-9204-4e69d19e16d2-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-55bf74f97-hnnqg\" (UID: \"12682642-ca12-4b49-9204-4e69d19e16d2\") " pod="openshift-monitoring/telemeter-client-55bf74f97-hnnqg"
Aug 04 22:26:08.457992 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:08.457970    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/12682642-ca12-4b49-9204-4e69d19e16d2-federate-client-tls\") pod \"telemeter-client-55bf74f97-hnnqg\" (UID: \"12682642-ca12-4b49-9204-4e69d19e16d2\") " pod="openshift-monitoring/telemeter-client-55bf74f97-hnnqg"
Aug 04 22:26:08.458074 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:08.458022    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/12682642-ca12-4b49-9204-4e69d19e16d2-secret-telemeter-client\") pod \"telemeter-client-55bf74f97-hnnqg\" (UID: \"12682642-ca12-4b49-9204-4e69d19e16d2\") " pod="openshift-monitoring/telemeter-client-55bf74f97-hnnqg"
Aug 04 22:26:08.466115 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:08.466096    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-88fhd\" (UniqueName: \"kubernetes.io/projected/12682642-ca12-4b49-9204-4e69d19e16d2-kube-api-access-88fhd\") pod \"telemeter-client-55bf74f97-hnnqg\" (UID: \"12682642-ca12-4b49-9204-4e69d19e16d2\") " pod="openshift-monitoring/telemeter-client-55bf74f97-hnnqg"
Aug 04 22:26:08.501919 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:08.501902    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-55bf74f97-hnnqg"
Aug 04 22:26:08.505029 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:08.504991    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"581da9eb-d79f-40a2-af76-6758135a8b9c","Type":"ContainerStarted","Data":"d8528a1c0072e0b2f6ed08643bb51382d9bdc3f9ea89b8fcec1fd621114292c3"}
Aug 04 22:26:08.505116 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:08.505075    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"581da9eb-d79f-40a2-af76-6758135a8b9c","Type":"ContainerStarted","Data":"d48cd5bdcd85ede9097ab14a671dde3a77934082a6a50ce5266ee4c3de7610b8"}
Aug 04 22:26:08.505116 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:08.505101    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"581da9eb-d79f-40a2-af76-6758135a8b9c","Type":"ContainerStarted","Data":"89546ca4b10842a73302b8c28363ac18f7256a87ac612f8668156716043bc6dc"}
Aug 04 22:26:08.505246 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:08.505124    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"581da9eb-d79f-40a2-af76-6758135a8b9c","Type":"ContainerStarted","Data":"11b8d4e1df550e53a7ddb5be1aef209b146423eee5ed417add70f77efc3571ca"}
Aug 04 22:26:08.505246 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:08.505168    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"581da9eb-d79f-40a2-af76-6758135a8b9c","Type":"ContainerStarted","Data":"c953f45b3317bc5a7324899e03af2877575418190c800d158d026695b9cd2f20"}
Aug 04 22:26:08.631884 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:08.631855    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-55bf74f97-hnnqg"]
Aug 04 22:26:08.635487 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:26:08.635461    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12682642_ca12_4b49_9204_4e69d19e16d2.slice/crio-0ddd61be77317440dc90a3a69a94c7a1904504cd57c8591d181928f1b7bfe45c WatchSource:0}: Error finding container 0ddd61be77317440dc90a3a69a94c7a1904504cd57c8591d181928f1b7bfe45c: Status 404 returned error can't find the container with id 0ddd61be77317440dc90a3a69a94c7a1904504cd57c8591d181928f1b7bfe45c
Aug 04 22:26:09.510104 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:09.510063    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-55bf74f97-hnnqg" event={"ID":"12682642-ca12-4b49-9204-4e69d19e16d2","Type":"ContainerStarted","Data":"0ddd61be77317440dc90a3a69a94c7a1904504cd57c8591d181928f1b7bfe45c"}
Aug 04 22:26:09.514021 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:09.513991    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"581da9eb-d79f-40a2-af76-6758135a8b9c","Type":"ContainerStarted","Data":"eed7a835572f78b5f64a7cbed4cb34b29ac24d0cbe92d60f134281821a094916"}
Aug 04 22:26:09.540125 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:09.540073    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=1.8894923719999999 podStartE2EDuration="5.540058215s" totalImagesPullingTime="3.633562871s" totalInitContainerRuntime="17.002972ms" isStatefulPod=false podCreationTimestamp="2026-08-04 22:26:04 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 22:26:09.538893515 +0000 UTC m=+316.531711274" watchObservedRunningTime="2026-08-04 22:26:09.540058215 +0000 UTC m=+316.532875922"
Aug 04 22:26:09.704542 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:09.704455    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-77b66db774-9npzs"]
Aug 04 22:26:11.523434 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:11.523395    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-55bf74f97-hnnqg" event={"ID":"12682642-ca12-4b49-9204-4e69d19e16d2","Type":"ContainerStarted","Data":"55385571cc10608dad8d8489fe508aaaf68d89132a0da3aa12b270f8d87bbef9"}
Aug 04 22:26:11.523882 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:11.523460    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-55bf74f97-hnnqg" event={"ID":"12682642-ca12-4b49-9204-4e69d19e16d2","Type":"ContainerStarted","Data":"e01261227ef0dabac7d94e7d028e881638749584192866652d40c2ab01929018"}
Aug 04 22:26:11.523882 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:11.523487    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-55bf74f97-hnnqg" event={"ID":"12682642-ca12-4b49-9204-4e69d19e16d2","Type":"ContainerStarted","Data":"33b022cc25ba84f6b73694093d6882690e5639ab88a1e3108ef33960c3687724"}
Aug 04 22:26:11.543178 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:11.543102    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-55bf74f97-hnnqg" podStartSLOduration=1.538273063 podStartE2EDuration="3.54308486s" totalImagesPullingTime="2.004811797s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 22:26:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 22:26:11.541982128 +0000 UTC m=+318.534799878" watchObservedRunningTime="2026-08-04 22:26:11.54308486 +0000 UTC m=+318.535902581"
Aug 04 22:26:18.668068 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:18.668039    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-77c974ffcf-78rnm"]
Aug 04 22:26:18.671307 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:18.671291    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-77c974ffcf-78rnm"
Aug 04 22:26:18.673676 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:18.673623    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Aug 04 22:26:18.673676 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:18.673667    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Aug 04 22:26:18.673847 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:18.673763    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-td674\""
Aug 04 22:26:18.682103 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:18.682083    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-77c974ffcf-78rnm"]
Aug 04 22:26:18.735161 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:18.735119    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fb4jp\" (UniqueName: \"kubernetes.io/projected/fe4d127d-9108-4f27-b7ed-0af0cb582a83-kube-api-access-fb4jp\") pod \"downloads-77c974ffcf-78rnm\" (UID: \"fe4d127d-9108-4f27-b7ed-0af0cb582a83\") " pod="openshift-console/downloads-77c974ffcf-78rnm"
Aug 04 22:26:18.835826 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:18.835790    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fb4jp\" (UniqueName: \"kubernetes.io/projected/fe4d127d-9108-4f27-b7ed-0af0cb582a83-kube-api-access-fb4jp\") pod \"downloads-77c974ffcf-78rnm\" (UID: \"fe4d127d-9108-4f27-b7ed-0af0cb582a83\") " pod="openshift-console/downloads-77c974ffcf-78rnm"
Aug 04 22:26:18.843525 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:18.843495    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fb4jp\" (UniqueName: \"kubernetes.io/projected/fe4d127d-9108-4f27-b7ed-0af0cb582a83-kube-api-access-fb4jp\") pod \"downloads-77c974ffcf-78rnm\" (UID: \"fe4d127d-9108-4f27-b7ed-0af0cb582a83\") " pod="openshift-console/downloads-77c974ffcf-78rnm"
Aug 04 22:26:18.980668 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:18.980604    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-77c974ffcf-78rnm"
Aug 04 22:26:19.104455 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:19.104426    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-77c974ffcf-78rnm"]
Aug 04 22:26:19.107367 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:26:19.107339    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe4d127d_9108_4f27_b7ed_0af0cb582a83.slice/crio-0e7c3c4bfd269291e5f279af39bd2a58b22c8c9c6b310fc3eced58c91d5f2604 WatchSource:0}: Error finding container 0e7c3c4bfd269291e5f279af39bd2a58b22c8c9c6b310fc3eced58c91d5f2604: Status 404 returned error can't find the container with id 0e7c3c4bfd269291e5f279af39bd2a58b22c8c9c6b310fc3eced58c91d5f2604
Aug 04 22:26:19.550578 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:19.550548    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-77c974ffcf-78rnm" event={"ID":"fe4d127d-9108-4f27-b7ed-0af0cb582a83","Type":"ContainerStarted","Data":"0e7c3c4bfd269291e5f279af39bd2a58b22c8c9c6b310fc3eced58c91d5f2604"}
Aug 04 22:26:29.599868 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:29.599833    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-8598756487-mzsl4"]
Aug 04 22:26:29.605032 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:29.605009    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8598756487-mzsl4"
Aug 04 22:26:29.607388 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:29.607368    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Aug 04 22:26:29.608071 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:29.608045    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Aug 04 22:26:29.608189 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:29.608068    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Aug 04 22:26:29.608189 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:29.608093    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Aug 04 22:26:29.608320 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:29.608218    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-4zs98\""
Aug 04 22:26:29.608320 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:29.608219    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Aug 04 22:26:29.612215 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:29.612193    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8598756487-mzsl4"]
Aug 04 22:26:29.733301 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:29.733269    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e798691e-9513-451f-9b09-1cc6380e9626-service-ca\") pod \"console-8598756487-mzsl4\" (UID: \"e798691e-9513-451f-9b09-1cc6380e9626\") " pod="openshift-console/console-8598756487-mzsl4"
Aug 04 22:26:29.733462 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:29.733325    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e798691e-9513-451f-9b09-1cc6380e9626-oauth-serving-cert\") pod \"console-8598756487-mzsl4\" (UID: \"e798691e-9513-451f-9b09-1cc6380e9626\") " pod="openshift-console/console-8598756487-mzsl4"
Aug 04 22:26:29.733462 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:29.733364    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e798691e-9513-451f-9b09-1cc6380e9626-console-oauth-config\") pod \"console-8598756487-mzsl4\" (UID: \"e798691e-9513-451f-9b09-1cc6380e9626\") " pod="openshift-console/console-8598756487-mzsl4"
Aug 04 22:26:29.733571 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:29.733460    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r2jf9\" (UniqueName: \"kubernetes.io/projected/e798691e-9513-451f-9b09-1cc6380e9626-kube-api-access-r2jf9\") pod \"console-8598756487-mzsl4\" (UID: \"e798691e-9513-451f-9b09-1cc6380e9626\") " pod="openshift-console/console-8598756487-mzsl4"
Aug 04 22:26:29.733616 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:29.733571    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e798691e-9513-451f-9b09-1cc6380e9626-console-config\") pod \"console-8598756487-mzsl4\" (UID: \"e798691e-9513-451f-9b09-1cc6380e9626\") " pod="openshift-console/console-8598756487-mzsl4"
Aug 04 22:26:29.733616 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:29.733596    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e798691e-9513-451f-9b09-1cc6380e9626-console-serving-cert\") pod \"console-8598756487-mzsl4\" (UID: \"e798691e-9513-451f-9b09-1cc6380e9626\") " pod="openshift-console/console-8598756487-mzsl4"
Aug 04 22:26:29.834462 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:29.834425    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e798691e-9513-451f-9b09-1cc6380e9626-service-ca\") pod \"console-8598756487-mzsl4\" (UID: \"e798691e-9513-451f-9b09-1cc6380e9626\") " pod="openshift-console/console-8598756487-mzsl4"
Aug 04 22:26:29.834603 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:29.834522    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e798691e-9513-451f-9b09-1cc6380e9626-oauth-serving-cert\") pod \"console-8598756487-mzsl4\" (UID: \"e798691e-9513-451f-9b09-1cc6380e9626\") " pod="openshift-console/console-8598756487-mzsl4"
Aug 04 22:26:29.834603 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:29.834570    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e798691e-9513-451f-9b09-1cc6380e9626-console-oauth-config\") pod \"console-8598756487-mzsl4\" (UID: \"e798691e-9513-451f-9b09-1cc6380e9626\") " pod="openshift-console/console-8598756487-mzsl4"
Aug 04 22:26:29.834694 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:29.834620    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r2jf9\" (UniqueName: \"kubernetes.io/projected/e798691e-9513-451f-9b09-1cc6380e9626-kube-api-access-r2jf9\") pod \"console-8598756487-mzsl4\" (UID: \"e798691e-9513-451f-9b09-1cc6380e9626\") " pod="openshift-console/console-8598756487-mzsl4"
Aug 04 22:26:29.834798 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:29.834689    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e798691e-9513-451f-9b09-1cc6380e9626-console-config\") pod \"console-8598756487-mzsl4\" (UID: \"e798691e-9513-451f-9b09-1cc6380e9626\") " pod="openshift-console/console-8598756487-mzsl4"
Aug 04 22:26:29.834798 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:29.834719    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e798691e-9513-451f-9b09-1cc6380e9626-console-serving-cert\") pod \"console-8598756487-mzsl4\" (UID: \"e798691e-9513-451f-9b09-1cc6380e9626\") " pod="openshift-console/console-8598756487-mzsl4"
Aug 04 22:26:29.835282 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:29.835252    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e798691e-9513-451f-9b09-1cc6380e9626-service-ca\") pod \"console-8598756487-mzsl4\" (UID: \"e798691e-9513-451f-9b09-1cc6380e9626\") " pod="openshift-console/console-8598756487-mzsl4"
Aug 04 22:26:29.835397 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:29.835292    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e798691e-9513-451f-9b09-1cc6380e9626-oauth-serving-cert\") pod \"console-8598756487-mzsl4\" (UID: \"e798691e-9513-451f-9b09-1cc6380e9626\") " pod="openshift-console/console-8598756487-mzsl4"
Aug 04 22:26:29.835459 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:29.835407    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e798691e-9513-451f-9b09-1cc6380e9626-console-config\") pod \"console-8598756487-mzsl4\" (UID: \"e798691e-9513-451f-9b09-1cc6380e9626\") " pod="openshift-console/console-8598756487-mzsl4"
Aug 04 22:26:29.837290 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:29.837266    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e798691e-9513-451f-9b09-1cc6380e9626-console-oauth-config\") pod \"console-8598756487-mzsl4\" (UID: \"e798691e-9513-451f-9b09-1cc6380e9626\") " pod="openshift-console/console-8598756487-mzsl4"
Aug 04 22:26:29.837290 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:29.837278    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e798691e-9513-451f-9b09-1cc6380e9626-console-serving-cert\") pod \"console-8598756487-mzsl4\" (UID: \"e798691e-9513-451f-9b09-1cc6380e9626\") " pod="openshift-console/console-8598756487-mzsl4"
Aug 04 22:26:29.842880 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:29.842859    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r2jf9\" (UniqueName: \"kubernetes.io/projected/e798691e-9513-451f-9b09-1cc6380e9626-kube-api-access-r2jf9\") pod \"console-8598756487-mzsl4\" (UID: \"e798691e-9513-451f-9b09-1cc6380e9626\") " pod="openshift-console/console-8598756487-mzsl4"
Aug 04 22:26:29.917188 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:29.917103    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8598756487-mzsl4"
Aug 04 22:26:34.385186 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:34.385152    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7bbbdbb76b-gx2vd"]
Aug 04 22:26:34.390010 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:34.389990    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bbbdbb76b-gx2vd"
Aug 04 22:26:34.397410 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:34.397383    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7bbbdbb76b-gx2vd"]
Aug 04 22:26:34.398462 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:34.398437    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Aug 04 22:26:34.476011 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:34.475979    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/71351feb-8c6b-490c-b5bd-1d342838901c-console-oauth-config\") pod \"console-7bbbdbb76b-gx2vd\" (UID: \"71351feb-8c6b-490c-b5bd-1d342838901c\") " pod="openshift-console/console-7bbbdbb76b-gx2vd"
Aug 04 22:26:34.476213 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:34.476018    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/71351feb-8c6b-490c-b5bd-1d342838901c-service-ca\") pod \"console-7bbbdbb76b-gx2vd\" (UID: \"71351feb-8c6b-490c-b5bd-1d342838901c\") " pod="openshift-console/console-7bbbdbb76b-gx2vd"
Aug 04 22:26:34.476213 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:34.476093    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/71351feb-8c6b-490c-b5bd-1d342838901c-trusted-ca-bundle\") pod \"console-7bbbdbb76b-gx2vd\" (UID: \"71351feb-8c6b-490c-b5bd-1d342838901c\") " pod="openshift-console/console-7bbbdbb76b-gx2vd"
Aug 04 22:26:34.476213 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:34.476156    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/71351feb-8c6b-490c-b5bd-1d342838901c-oauth-serving-cert\") pod \"console-7bbbdbb76b-gx2vd\" (UID: \"71351feb-8c6b-490c-b5bd-1d342838901c\") " pod="openshift-console/console-7bbbdbb76b-gx2vd"
Aug 04 22:26:34.476213 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:34.476213    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qtg9v\" (UniqueName: \"kubernetes.io/projected/71351feb-8c6b-490c-b5bd-1d342838901c-kube-api-access-qtg9v\") pod \"console-7bbbdbb76b-gx2vd\" (UID: \"71351feb-8c6b-490c-b5bd-1d342838901c\") " pod="openshift-console/console-7bbbdbb76b-gx2vd"
Aug 04 22:26:34.476460 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:34.476261    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/71351feb-8c6b-490c-b5bd-1d342838901c-console-serving-cert\") pod \"console-7bbbdbb76b-gx2vd\" (UID: \"71351feb-8c6b-490c-b5bd-1d342838901c\") " pod="openshift-console/console-7bbbdbb76b-gx2vd"
Aug 04 22:26:34.476460 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:34.476343    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/71351feb-8c6b-490c-b5bd-1d342838901c-console-config\") pod \"console-7bbbdbb76b-gx2vd\" (UID: \"71351feb-8c6b-490c-b5bd-1d342838901c\") " pod="openshift-console/console-7bbbdbb76b-gx2vd"
Aug 04 22:26:34.577306 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:34.577275    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/71351feb-8c6b-490c-b5bd-1d342838901c-oauth-serving-cert\") pod \"console-7bbbdbb76b-gx2vd\" (UID: \"71351feb-8c6b-490c-b5bd-1d342838901c\") " pod="openshift-console/console-7bbbdbb76b-gx2vd"
Aug 04 22:26:34.577461 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:34.577318    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qtg9v\" (UniqueName: \"kubernetes.io/projected/71351feb-8c6b-490c-b5bd-1d342838901c-kube-api-access-qtg9v\") pod \"console-7bbbdbb76b-gx2vd\" (UID: \"71351feb-8c6b-490c-b5bd-1d342838901c\") " pod="openshift-console/console-7bbbdbb76b-gx2vd"
Aug 04 22:26:34.577461 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:34.577360    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/71351feb-8c6b-490c-b5bd-1d342838901c-console-serving-cert\") pod \"console-7bbbdbb76b-gx2vd\" (UID: \"71351feb-8c6b-490c-b5bd-1d342838901c\") " pod="openshift-console/console-7bbbdbb76b-gx2vd"
Aug 04 22:26:34.577461 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:34.577414    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/71351feb-8c6b-490c-b5bd-1d342838901c-console-config\") pod \"console-7bbbdbb76b-gx2vd\" (UID: \"71351feb-8c6b-490c-b5bd-1d342838901c\") " pod="openshift-console/console-7bbbdbb76b-gx2vd"
Aug 04 22:26:34.577461 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:34.577452    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/71351feb-8c6b-490c-b5bd-1d342838901c-console-oauth-config\") pod \"console-7bbbdbb76b-gx2vd\" (UID: \"71351feb-8c6b-490c-b5bd-1d342838901c\") " pod="openshift-console/console-7bbbdbb76b-gx2vd"
Aug 04 22:26:34.577681 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:34.577468    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/71351feb-8c6b-490c-b5bd-1d342838901c-service-ca\") pod \"console-7bbbdbb76b-gx2vd\" (UID: \"71351feb-8c6b-490c-b5bd-1d342838901c\") " pod="openshift-console/console-7bbbdbb76b-gx2vd"
Aug 04 22:26:34.577681 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:34.577499    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/71351feb-8c6b-490c-b5bd-1d342838901c-trusted-ca-bundle\") pod \"console-7bbbdbb76b-gx2vd\" (UID: \"71351feb-8c6b-490c-b5bd-1d342838901c\") " pod="openshift-console/console-7bbbdbb76b-gx2vd"
Aug 04 22:26:34.578232 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:34.578162    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/71351feb-8c6b-490c-b5bd-1d342838901c-console-config\") pod \"console-7bbbdbb76b-gx2vd\" (UID: \"71351feb-8c6b-490c-b5bd-1d342838901c\") " pod="openshift-console/console-7bbbdbb76b-gx2vd"
Aug 04 22:26:34.578232 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:34.578168    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/71351feb-8c6b-490c-b5bd-1d342838901c-oauth-serving-cert\") pod \"console-7bbbdbb76b-gx2vd\" (UID: \"71351feb-8c6b-490c-b5bd-1d342838901c\") " pod="openshift-console/console-7bbbdbb76b-gx2vd"
Aug 04 22:26:34.578432 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:34.578406    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/71351feb-8c6b-490c-b5bd-1d342838901c-service-ca\") pod \"console-7bbbdbb76b-gx2vd\" (UID: \"71351feb-8c6b-490c-b5bd-1d342838901c\") " pod="openshift-console/console-7bbbdbb76b-gx2vd"
Aug 04 22:26:34.578554 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:34.578510    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/71351feb-8c6b-490c-b5bd-1d342838901c-trusted-ca-bundle\") pod \"console-7bbbdbb76b-gx2vd\" (UID: \"71351feb-8c6b-490c-b5bd-1d342838901c\") " pod="openshift-console/console-7bbbdbb76b-gx2vd"
Aug 04 22:26:34.580171 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:34.580149    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/71351feb-8c6b-490c-b5bd-1d342838901c-console-serving-cert\") pod \"console-7bbbdbb76b-gx2vd\" (UID: \"71351feb-8c6b-490c-b5bd-1d342838901c\") " pod="openshift-console/console-7bbbdbb76b-gx2vd"
Aug 04 22:26:34.580315 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:34.580295    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/71351feb-8c6b-490c-b5bd-1d342838901c-console-oauth-config\") pod \"console-7bbbdbb76b-gx2vd\" (UID: \"71351feb-8c6b-490c-b5bd-1d342838901c\") " pod="openshift-console/console-7bbbdbb76b-gx2vd"
Aug 04 22:26:34.585553 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:34.585533    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qtg9v\" (UniqueName: \"kubernetes.io/projected/71351feb-8c6b-490c-b5bd-1d342838901c-kube-api-access-qtg9v\") pod \"console-7bbbdbb76b-gx2vd\" (UID: \"71351feb-8c6b-490c-b5bd-1d342838901c\") " pod="openshift-console/console-7bbbdbb76b-gx2vd"
Aug 04 22:26:34.702039 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:34.701964    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bbbdbb76b-gx2vd"
Aug 04 22:26:34.727472 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:34.727441    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-77b66db774-9npzs" podUID="069b448c-edde-423c-b08d-4cac577c09e5" containerName="registry" containerID="cri-o://d9c332a228c2416a7d8636f361d12e948dfdf9d0af7e36b60c237e91cffd4ef9" gracePeriod=30
Aug 04 22:26:35.980343 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:35.980318    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-77b66db774-9npzs"
Aug 04 22:26:35.989700 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:35.989677    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7bbbdbb76b-gx2vd"]
Aug 04 22:26:35.991765 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:26:35.991736    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71351feb_8c6b_490c_b5bd_1d342838901c.slice/crio-febaa8dfc9c155b272ca89580f9680eaaa3d5c298086d3eeab3d5ebcd535cdc3 WatchSource:0}: Error finding container febaa8dfc9c155b272ca89580f9680eaaa3d5c298086d3eeab3d5ebcd535cdc3: Status 404 returned error can't find the container with id febaa8dfc9c155b272ca89580f9680eaaa3d5c298086d3eeab3d5ebcd535cdc3
Aug 04 22:26:36.004431 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:36.004406    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8598756487-mzsl4"]
Aug 04 22:26:36.007955 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:26:36.007923    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode798691e_9513_451f_9b09_1cc6380e9626.slice/crio-1660363caa0a048fd1f340ef01d9c4774ebf9f1d699cac168a00b2dfb3a465c1 WatchSource:0}: Error finding container 1660363caa0a048fd1f340ef01d9c4774ebf9f1d699cac168a00b2dfb3a465c1: Status 404 returned error can't find the container with id 1660363caa0a048fd1f340ef01d9c4774ebf9f1d699cac168a00b2dfb3a465c1
Aug 04 22:26:36.094084 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:36.094017    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/069b448c-edde-423c-b08d-4cac577c09e5-ca-trust-extracted\") pod \"069b448c-edde-423c-b08d-4cac577c09e5\" (UID: \"069b448c-edde-423c-b08d-4cac577c09e5\") "
Aug 04 22:26:36.094084 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:36.094064    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/069b448c-edde-423c-b08d-4cac577c09e5-registry-certificates\") pod \"069b448c-edde-423c-b08d-4cac577c09e5\" (UID: \"069b448c-edde-423c-b08d-4cac577c09e5\") "
Aug 04 22:26:36.094285 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:36.094091    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/069b448c-edde-423c-b08d-4cac577c09e5-registry-tls\") pod \"069b448c-edde-423c-b08d-4cac577c09e5\" (UID: \"069b448c-edde-423c-b08d-4cac577c09e5\") "
Aug 04 22:26:36.094285 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:36.094148    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/069b448c-edde-423c-b08d-4cac577c09e5-trusted-ca\") pod \"069b448c-edde-423c-b08d-4cac577c09e5\" (UID: \"069b448c-edde-423c-b08d-4cac577c09e5\") "
Aug 04 22:26:36.094285 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:36.094188    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/069b448c-edde-423c-b08d-4cac577c09e5-installation-pull-secrets\") pod \"069b448c-edde-423c-b08d-4cac577c09e5\" (UID: \"069b448c-edde-423c-b08d-4cac577c09e5\") "
Aug 04 22:26:36.094435 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:36.094287    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/069b448c-edde-423c-b08d-4cac577c09e5-image-registry-private-configuration\") pod \"069b448c-edde-423c-b08d-4cac577c09e5\" (UID: \"069b448c-edde-423c-b08d-4cac577c09e5\") "
Aug 04 22:26:36.094435 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:36.094385    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-grghf\" (UniqueName: \"kubernetes.io/projected/069b448c-edde-423c-b08d-4cac577c09e5-kube-api-access-grghf\") pod \"069b448c-edde-423c-b08d-4cac577c09e5\" (UID: \"069b448c-edde-423c-b08d-4cac577c09e5\") "
Aug 04 22:26:36.094535 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:36.094448    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/069b448c-edde-423c-b08d-4cac577c09e5-bound-sa-token\") pod \"069b448c-edde-423c-b08d-4cac577c09e5\" (UID: \"069b448c-edde-423c-b08d-4cac577c09e5\") "
Aug 04 22:26:36.094535 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:36.094454    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/069b448c-edde-423c-b08d-4cac577c09e5-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "069b448c-edde-423c-b08d-4cac577c09e5" (UID: "069b448c-edde-423c-b08d-4cac577c09e5"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 22:26:36.094627 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:36.094603    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/069b448c-edde-423c-b08d-4cac577c09e5-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "069b448c-edde-423c-b08d-4cac577c09e5" (UID: "069b448c-edde-423c-b08d-4cac577c09e5"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 22:26:36.094809 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:36.094737    2580 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/069b448c-edde-423c-b08d-4cac577c09e5-registry-certificates\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
Aug 04 22:26:36.094809 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:36.094764    2580 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/069b448c-edde-423c-b08d-4cac577c09e5-trusted-ca\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
Aug 04 22:26:36.096954 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:36.096923    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/069b448c-edde-423c-b08d-4cac577c09e5-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "069b448c-edde-423c-b08d-4cac577c09e5" (UID: "069b448c-edde-423c-b08d-4cac577c09e5"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 22:26:36.097051 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:36.097030    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/069b448c-edde-423c-b08d-4cac577c09e5-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "069b448c-edde-423c-b08d-4cac577c09e5" (UID: "069b448c-edde-423c-b08d-4cac577c09e5"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 22:26:36.097111 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:36.097083    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/069b448c-edde-423c-b08d-4cac577c09e5-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "069b448c-edde-423c-b08d-4cac577c09e5" (UID: "069b448c-edde-423c-b08d-4cac577c09e5"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 22:26:36.097196 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:36.097144    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/069b448c-edde-423c-b08d-4cac577c09e5-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "069b448c-edde-423c-b08d-4cac577c09e5" (UID: "069b448c-edde-423c-b08d-4cac577c09e5"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 22:26:36.097279 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:36.097259    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/069b448c-edde-423c-b08d-4cac577c09e5-kube-api-access-grghf" (OuterVolumeSpecName: "kube-api-access-grghf") pod "069b448c-edde-423c-b08d-4cac577c09e5" (UID: "069b448c-edde-423c-b08d-4cac577c09e5"). InnerVolumeSpecName "kube-api-access-grghf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 22:26:36.102696 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:36.102675    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/069b448c-edde-423c-b08d-4cac577c09e5-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "069b448c-edde-423c-b08d-4cac577c09e5" (UID: "069b448c-edde-423c-b08d-4cac577c09e5"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 22:26:36.195382 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:36.195350    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-grghf\" (UniqueName: \"kubernetes.io/projected/069b448c-edde-423c-b08d-4cac577c09e5-kube-api-access-grghf\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
Aug 04 22:26:36.195382 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:36.195381    2580 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/069b448c-edde-423c-b08d-4cac577c09e5-bound-sa-token\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
Aug 04 22:26:36.195564 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:36.195393    2580 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/069b448c-edde-423c-b08d-4cac577c09e5-ca-trust-extracted\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
Aug 04 22:26:36.195564 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:36.195404    2580 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/069b448c-edde-423c-b08d-4cac577c09e5-registry-tls\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
Aug 04 22:26:36.195564 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:36.195416    2580 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/069b448c-edde-423c-b08d-4cac577c09e5-installation-pull-secrets\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
Aug 04 22:26:36.195564 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:36.195427    2580 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/069b448c-edde-423c-b08d-4cac577c09e5-image-registry-private-configuration\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
Aug 04 22:26:36.625250 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:36.625206    2580 generic.go:356] "Generic (PLEG): container finished" podID="e43db356-a90d-4670-8f61-0d95a0c859af" containerID="1fc5a081962117ffa0eb7e160b3121123a4960286becf8a68000e6d98a03b60c" exitCode=0
Aug 04 22:26:36.625438 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:36.625304    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-g68vv" event={"ID":"e43db356-a90d-4670-8f61-0d95a0c859af","Type":"ContainerDied","Data":"1fc5a081962117ffa0eb7e160b3121123a4960286becf8a68000e6d98a03b60c"}
Aug 04 22:26:36.625793 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:36.625769    2580 scope.go:117] "RemoveContainer" containerID="1fc5a081962117ffa0eb7e160b3121123a4960286becf8a68000e6d98a03b60c"
Aug 04 22:26:36.627122 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:36.627080    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-77c974ffcf-78rnm" event={"ID":"fe4d127d-9108-4f27-b7ed-0af0cb582a83","Type":"ContainerStarted","Data":"0f2df5b882efc54eb8e2b56808c0304a82db7ddf7ce8c8c6328e2274fdd5e685"}
Aug 04 22:26:36.627273 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:36.627226    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-77c974ffcf-78rnm"
Aug 04 22:26:36.629414 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:36.628657    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bbbdbb76b-gx2vd" event={"ID":"71351feb-8c6b-490c-b5bd-1d342838901c","Type":"ContainerStarted","Data":"febaa8dfc9c155b272ca89580f9680eaaa3d5c298086d3eeab3d5ebcd535cdc3"}
Aug 04 22:26:36.630277 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:36.630254    2580 generic.go:356] "Generic (PLEG): container finished" podID="069b448c-edde-423c-b08d-4cac577c09e5" containerID="d9c332a228c2416a7d8636f361d12e948dfdf9d0af7e36b60c237e91cffd4ef9" exitCode=0
Aug 04 22:26:36.630363 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:36.630296    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-77b66db774-9npzs"
Aug 04 22:26:36.630363 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:36.630330    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-77b66db774-9npzs" event={"ID":"069b448c-edde-423c-b08d-4cac577c09e5","Type":"ContainerDied","Data":"d9c332a228c2416a7d8636f361d12e948dfdf9d0af7e36b60c237e91cffd4ef9"}
Aug 04 22:26:36.630469 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:36.630371    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-77b66db774-9npzs" event={"ID":"069b448c-edde-423c-b08d-4cac577c09e5","Type":"ContainerDied","Data":"730f521092216627a55ca327edd80f1febdb51a511a27ff336a9ea480f7a9d63"}
Aug 04 22:26:36.630469 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:36.630399    2580 scope.go:117] "RemoveContainer" containerID="d9c332a228c2416a7d8636f361d12e948dfdf9d0af7e36b60c237e91cffd4ef9"
Aug 04 22:26:36.632280 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:36.632254    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8598756487-mzsl4" event={"ID":"e798691e-9513-451f-9b09-1cc6380e9626","Type":"ContainerStarted","Data":"1660363caa0a048fd1f340ef01d9c4774ebf9f1d699cac168a00b2dfb3a465c1"}
Aug 04 22:26:36.642723 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:36.642706    2580 scope.go:117] "RemoveContainer" containerID="d9c332a228c2416a7d8636f361d12e948dfdf9d0af7e36b60c237e91cffd4ef9"
Aug 04 22:26:36.643245 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:26:36.643165    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d9c332a228c2416a7d8636f361d12e948dfdf9d0af7e36b60c237e91cffd4ef9\": container with ID starting with d9c332a228c2416a7d8636f361d12e948dfdf9d0af7e36b60c237e91cffd4ef9 not found: ID does not exist" containerID="d9c332a228c2416a7d8636f361d12e948dfdf9d0af7e36b60c237e91cffd4ef9"
Aug 04 22:26:36.643245 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:36.643204    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d9c332a228c2416a7d8636f361d12e948dfdf9d0af7e36b60c237e91cffd4ef9"} err="failed to get container status \"d9c332a228c2416a7d8636f361d12e948dfdf9d0af7e36b60c237e91cffd4ef9\": rpc error: code = NotFound desc = could not find container \"d9c332a228c2416a7d8636f361d12e948dfdf9d0af7e36b60c237e91cffd4ef9\": container with ID starting with d9c332a228c2416a7d8636f361d12e948dfdf9d0af7e36b60c237e91cffd4ef9 not found: ID does not exist"
Aug 04 22:26:36.644121 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:36.644079    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-77c974ffcf-78rnm"
Aug 04 22:26:36.663325 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:36.663272    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-77c974ffcf-78rnm" podStartSLOduration=1.836849403 podStartE2EDuration="18.663252681s" totalImagesPullingTime="16.826403278s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 22:26:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 22:26:36.660853849 +0000 UTC m=+343.653671600" watchObservedRunningTime="2026-08-04 22:26:36.663252681 +0000 UTC m=+343.656070410"
Aug 04 22:26:36.675459 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:36.675435    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-77b66db774-9npzs"]
Aug 04 22:26:36.678851 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:36.678828    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-77b66db774-9npzs"]
Aug 04 22:26:37.503514 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:37.502933    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="069b448c-edde-423c-b08d-4cac577c09e5" path="/var/lib/kubelet/pods/069b448c-edde-423c-b08d-4cac577c09e5/volumes"
Aug 04 22:26:37.642164 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:37.641939    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-g68vv" event={"ID":"e43db356-a90d-4670-8f61-0d95a0c859af","Type":"ContainerStarted","Data":"46ccfd317fcd43bec0a6146a30bfc532b8eb9d4c8ca70f7315305556ff67e04d"}
Aug 04 22:26:40.660751 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:40.660667    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bbbdbb76b-gx2vd" event={"ID":"71351feb-8c6b-490c-b5bd-1d342838901c","Type":"ContainerStarted","Data":"6e8cce377be888a15a409b58fe68ac1a2b80bb43982c078e7d27a8e0c03dceb2"}
Aug 04 22:26:40.663105 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:40.663070    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8598756487-mzsl4" event={"ID":"e798691e-9513-451f-9b09-1cc6380e9626","Type":"ContainerStarted","Data":"a691af9bd1be9461a931691bf963fa8cdc07fe64f045254cfe3c2b8724250709"}
Aug 04 22:26:40.677851 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:40.677152    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7bbbdbb76b-gx2vd" podStartSLOduration=2.204896271 podStartE2EDuration="6.67711552s" totalImagesPullingTime="4.472219249s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 22:26:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 22:26:40.676241949 +0000 UTC m=+347.669059678" watchObservedRunningTime="2026-08-04 22:26:40.67711552 +0000 UTC m=+347.669933258"
Aug 04 22:26:40.691810 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:40.691439    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-8598756487-mzsl4" podStartSLOduration=7.229023578 podStartE2EDuration="11.691420888s" totalImagesPullingTime="4.46239731s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 22:26:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 22:26:40.691291338 +0000 UTC m=+347.684109068" watchObservedRunningTime="2026-08-04 22:26:40.691420888 +0000 UTC m=+347.684238619"
Aug 04 22:26:42.987147 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:42.987104    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_581da9eb-d79f-40a2-af76-6758135a8b9c/init-config-reloader/0.log"
Aug 04 22:26:43.187065 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:43.187034    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_581da9eb-d79f-40a2-af76-6758135a8b9c/alertmanager/0.log"
Aug 04 22:26:43.387944 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:43.387912    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_581da9eb-d79f-40a2-af76-6758135a8b9c/config-reloader/0.log"
Aug 04 22:26:43.587119 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:43.587085    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_581da9eb-d79f-40a2-af76-6758135a8b9c/kube-rbac-proxy-web/0.log"
Aug 04 22:26:43.786815 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:43.786750    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_581da9eb-d79f-40a2-af76-6758135a8b9c/kube-rbac-proxy/0.log"
Aug 04 22:26:43.986952 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:43.986918    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_581da9eb-d79f-40a2-af76-6758135a8b9c/kube-rbac-proxy-metric/0.log"
Aug 04 22:26:44.186437 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:44.186408    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_581da9eb-d79f-40a2-af76-6758135a8b9c/prom-label-proxy/0.log"
Aug 04 22:26:44.389231 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:44.389200    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6f55c4f58d-2ksv9_968aa3c2-b641-483d-a1b0-d0efc3df099e/cluster-monitoring-operator/0.log"
Aug 04 22:26:44.702760 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:44.702727    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7bbbdbb76b-gx2vd"
Aug 04 22:26:44.702929 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:44.702793    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7bbbdbb76b-gx2vd"
Aug 04 22:26:44.707925 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:44.707901    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7bbbdbb76b-gx2vd"
Aug 04 22:26:45.686646 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:45.686570    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7bbbdbb76b-gx2vd"
Aug 04 22:26:45.731109 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:45.731069    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8598756487-mzsl4"]
Aug 04 22:26:46.786859 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:46.786829    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kfzjb_37f4874f-ae9c-4bd4-90db-135afcf9df5d/init-textfile/0.log"
Aug 04 22:26:46.986834 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:46.986802    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kfzjb_37f4874f-ae9c-4bd4-90db-135afcf9df5d/node-exporter/0.log"
Aug 04 22:26:47.187449 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:47.187419    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kfzjb_37f4874f-ae9c-4bd4-90db-135afcf9df5d/kube-rbac-proxy/0.log"
Aug 04 22:26:49.389420 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:49.389386    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-758d7cb874-b5799_6760248f-2efd-431a-9e9f-920cd406b973/prometheus-operator/0.log"
Aug 04 22:26:49.586034 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:49.586006    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-758d7cb874-b5799_6760248f-2efd-431a-9e9f-920cd406b973/kube-rbac-proxy/0.log"
Aug 04 22:26:49.786241 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:49.786165    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-66685ff6d4-b9n5f_5db3e8ee-b5a7-4695-b6a6-fab544a17e1b/prometheus-operator-admission-webhook/0.log"
Aug 04 22:26:49.917771 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:49.917736    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-8598756487-mzsl4"
Aug 04 22:26:49.986236 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:49.986201    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-55bf74f97-hnnqg_12682642-ca12-4b49-9204-4e69d19e16d2/telemeter-client/0.log"
Aug 04 22:26:50.186985 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:50.186954    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-55bf74f97-hnnqg_12682642-ca12-4b49-9204-4e69d19e16d2/reload/0.log"
Aug 04 22:26:50.386063 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:50.386036    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-55bf74f97-hnnqg_12682642-ca12-4b49-9204-4e69d19e16d2/kube-rbac-proxy/0.log"
Aug 04 22:26:52.386934 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:52.386908    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7bbbdbb76b-gx2vd_71351feb-8c6b-490c-b5bd-1d342838901c/console/0.log"
Aug 04 22:26:52.587152 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:52.587116    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-8598756487-mzsl4_e798691e-9513-451f-9b09-1cc6380e9626/console/0.log"
Aug 04 22:26:52.787377 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:52.787310    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-77c974ffcf-78rnm_fe4d127d-9108-4f27-b7ed-0af0cb582a83/download-server/0.log"
Aug 04 22:26:53.186649 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:26:53.186625    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-l57vw_c8c35a7c-9cad-4e67-aa5d-eee422ea3178/serve-healthcheck-canary/0.log"
Aug 04 22:27:07.371245 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:07.371203    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/14077369-fe10-4854-8785-0bfc9addb7c4-metrics-certs\") pod \"network-metrics-daemon-5h46r\" (UID: \"14077369-fe10-4854-8785-0bfc9addb7c4\") " pod="openshift-multus/network-metrics-daemon-5h46r"
Aug 04 22:27:07.373453 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:07.373434    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/14077369-fe10-4854-8785-0bfc9addb7c4-metrics-certs\") pod \"network-metrics-daemon-5h46r\" (UID: \"14077369-fe10-4854-8785-0bfc9addb7c4\") " pod="openshift-multus/network-metrics-daemon-5h46r"
Aug 04 22:27:07.395983 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:07.395956    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-5596r\""
Aug 04 22:27:07.404777 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:07.404760    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5h46r"
Aug 04 22:27:07.568920 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:07.568891    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-5h46r"]
Aug 04 22:27:07.572052 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:27:07.572022    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14077369_fe10_4854_8785_0bfc9addb7c4.slice/crio-53097df042c1a51a3f133d826c4db63d1d0f0822532f988e300d397c5b377838 WatchSource:0}: Error finding container 53097df042c1a51a3f133d826c4db63d1d0f0822532f988e300d397c5b377838: Status 404 returned error can't find the container with id 53097df042c1a51a3f133d826c4db63d1d0f0822532f988e300d397c5b377838
Aug 04 22:27:07.774326 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:07.774243    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5h46r" event={"ID":"14077369-fe10-4854-8785-0bfc9addb7c4","Type":"ContainerStarted","Data":"53097df042c1a51a3f133d826c4db63d1d0f0822532f988e300d397c5b377838"}
Aug 04 22:27:09.783124 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:09.783047    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5h46r" event={"ID":"14077369-fe10-4854-8785-0bfc9addb7c4","Type":"ContainerStarted","Data":"1ca6b6364af88e016824872c38c1f62709063aa2373d8955d6fc1597c05fa378"}
Aug 04 22:27:09.783124 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:09.783097    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5h46r" event={"ID":"14077369-fe10-4854-8785-0bfc9addb7c4","Type":"ContainerStarted","Data":"c9bda3aa625756991df7f211906b80f18ce19428cc732ad16989e9e82efeff24"}
Aug 04 22:27:09.798798 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:09.798752    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-5h46r" podStartSLOduration=375.202154277 podStartE2EDuration="6m16.798737147s" totalImagesPullingTime="1.59658287s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 22:20:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 22:27:09.797610175 +0000 UTC m=+376.790427903" watchObservedRunningTime="2026-08-04 22:27:09.798737147 +0000 UTC m=+376.791554874"
Aug 04 22:27:10.754210 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:10.754171    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-8598756487-mzsl4" podUID="e798691e-9513-451f-9b09-1cc6380e9626" containerName="console" containerID="cri-o://a691af9bd1be9461a931691bf963fa8cdc07fe64f045254cfe3c2b8724250709" gracePeriod=15
Aug 04 22:27:11.034146 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:11.034104    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8598756487-mzsl4"
Aug 04 22:27:11.102375 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:11.102348    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e798691e-9513-451f-9b09-1cc6380e9626-console-serving-cert\") pod \"e798691e-9513-451f-9b09-1cc6380e9626\" (UID: \"e798691e-9513-451f-9b09-1cc6380e9626\") "
Aug 04 22:27:11.102525 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:11.102392    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e798691e-9513-451f-9b09-1cc6380e9626-console-config\") pod \"e798691e-9513-451f-9b09-1cc6380e9626\" (UID: \"e798691e-9513-451f-9b09-1cc6380e9626\") "
Aug 04 22:27:11.102525 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:11.102413    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e798691e-9513-451f-9b09-1cc6380e9626-oauth-serving-cert\") pod \"e798691e-9513-451f-9b09-1cc6380e9626\" (UID: \"e798691e-9513-451f-9b09-1cc6380e9626\") "
Aug 04 22:27:11.102525 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:11.102438    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e798691e-9513-451f-9b09-1cc6380e9626-console-oauth-config\") pod \"e798691e-9513-451f-9b09-1cc6380e9626\" (UID: \"e798691e-9513-451f-9b09-1cc6380e9626\") "
Aug 04 22:27:11.102525 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:11.102470    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e798691e-9513-451f-9b09-1cc6380e9626-service-ca\") pod \"e798691e-9513-451f-9b09-1cc6380e9626\" (UID: \"e798691e-9513-451f-9b09-1cc6380e9626\") "
Aug 04 22:27:11.102525 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:11.102494    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r2jf9\" (UniqueName: \"kubernetes.io/projected/e798691e-9513-451f-9b09-1cc6380e9626-kube-api-access-r2jf9\") pod \"e798691e-9513-451f-9b09-1cc6380e9626\" (UID: \"e798691e-9513-451f-9b09-1cc6380e9626\") "
Aug 04 22:27:11.102832 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:11.102803    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e798691e-9513-451f-9b09-1cc6380e9626-console-config" (OuterVolumeSpecName: "console-config") pod "e798691e-9513-451f-9b09-1cc6380e9626" (UID: "e798691e-9513-451f-9b09-1cc6380e9626"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 22:27:11.102893 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:11.102822    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e798691e-9513-451f-9b09-1cc6380e9626-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "e798691e-9513-451f-9b09-1cc6380e9626" (UID: "e798691e-9513-451f-9b09-1cc6380e9626"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 22:27:11.102893 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:11.102850    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e798691e-9513-451f-9b09-1cc6380e9626-service-ca" (OuterVolumeSpecName: "service-ca") pod "e798691e-9513-451f-9b09-1cc6380e9626" (UID: "e798691e-9513-451f-9b09-1cc6380e9626"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 22:27:11.104676 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:11.104642    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e798691e-9513-451f-9b09-1cc6380e9626-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "e798691e-9513-451f-9b09-1cc6380e9626" (UID: "e798691e-9513-451f-9b09-1cc6380e9626"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 22:27:11.104768 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:11.104707    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e798691e-9513-451f-9b09-1cc6380e9626-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "e798691e-9513-451f-9b09-1cc6380e9626" (UID: "e798691e-9513-451f-9b09-1cc6380e9626"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 22:27:11.104768 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:11.104746    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e798691e-9513-451f-9b09-1cc6380e9626-kube-api-access-r2jf9" (OuterVolumeSpecName: "kube-api-access-r2jf9") pod "e798691e-9513-451f-9b09-1cc6380e9626" (UID: "e798691e-9513-451f-9b09-1cc6380e9626"). InnerVolumeSpecName "kube-api-access-r2jf9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 22:27:11.203314 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:11.203278    2580 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e798691e-9513-451f-9b09-1cc6380e9626-console-config\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
Aug 04 22:27:11.203314 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:11.203308    2580 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e798691e-9513-451f-9b09-1cc6380e9626-oauth-serving-cert\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
Aug 04 22:27:11.203314 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:11.203322    2580 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e798691e-9513-451f-9b09-1cc6380e9626-console-oauth-config\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
Aug 04 22:27:11.203515 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:11.203334    2580 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e798691e-9513-451f-9b09-1cc6380e9626-service-ca\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
Aug 04 22:27:11.203515 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:11.203346    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r2jf9\" (UniqueName: \"kubernetes.io/projected/e798691e-9513-451f-9b09-1cc6380e9626-kube-api-access-r2jf9\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
Aug 04 22:27:11.203515 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:11.203358    2580 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e798691e-9513-451f-9b09-1cc6380e9626-console-serving-cert\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
Aug 04 22:27:11.792972 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:11.792887    2580 generic.go:356] "Generic (PLEG): container finished" podID="e798691e-9513-451f-9b09-1cc6380e9626" containerID="a691af9bd1be9461a931691bf963fa8cdc07fe64f045254cfe3c2b8724250709" exitCode=0
Aug 04 22:27:11.792972 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:11.792934    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8598756487-mzsl4"
Aug 04 22:27:11.793187 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:11.792972    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8598756487-mzsl4" event={"ID":"e798691e-9513-451f-9b09-1cc6380e9626","Type":"ContainerDied","Data":"a691af9bd1be9461a931691bf963fa8cdc07fe64f045254cfe3c2b8724250709"}
Aug 04 22:27:11.793187 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:11.793024    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8598756487-mzsl4" event={"ID":"e798691e-9513-451f-9b09-1cc6380e9626","Type":"ContainerDied","Data":"1660363caa0a048fd1f340ef01d9c4774ebf9f1d699cac168a00b2dfb3a465c1"}
Aug 04 22:27:11.793187 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:11.793045    2580 scope.go:117] "RemoveContainer" containerID="a691af9bd1be9461a931691bf963fa8cdc07fe64f045254cfe3c2b8724250709"
Aug 04 22:27:11.800912 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:11.800894    2580 scope.go:117] "RemoveContainer" containerID="a691af9bd1be9461a931691bf963fa8cdc07fe64f045254cfe3c2b8724250709"
Aug 04 22:27:11.801293 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:27:11.801276    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a691af9bd1be9461a931691bf963fa8cdc07fe64f045254cfe3c2b8724250709\": container with ID starting with a691af9bd1be9461a931691bf963fa8cdc07fe64f045254cfe3c2b8724250709 not found: ID does not exist" containerID="a691af9bd1be9461a931691bf963fa8cdc07fe64f045254cfe3c2b8724250709"
Aug 04 22:27:11.801363 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:11.801299    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a691af9bd1be9461a931691bf963fa8cdc07fe64f045254cfe3c2b8724250709"} err="failed to get container status \"a691af9bd1be9461a931691bf963fa8cdc07fe64f045254cfe3c2b8724250709\": rpc error: code = NotFound desc = could not find container \"a691af9bd1be9461a931691bf963fa8cdc07fe64f045254cfe3c2b8724250709\": container with ID starting with a691af9bd1be9461a931691bf963fa8cdc07fe64f045254cfe3c2b8724250709 not found: ID does not exist"
Aug 04 22:27:11.808117 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:11.808097    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8598756487-mzsl4"]
Aug 04 22:27:11.811983 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:11.811963    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-8598756487-mzsl4"]
Aug 04 22:27:13.497295 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:13.497263    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e798691e-9513-451f-9b09-1cc6380e9626" path="/var/lib/kubelet/pods/e798691e-9513-451f-9b09-1cc6380e9626/volumes"
Aug 04 22:27:23.378069 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:23.378036    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Aug 04 22:27:23.378507 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:23.378403    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="581da9eb-d79f-40a2-af76-6758135a8b9c" containerName="prom-label-proxy" containerID="cri-o://eed7a835572f78b5f64a7cbed4cb34b29ac24d0cbe92d60f134281821a094916" gracePeriod=120
Aug 04 22:27:23.378507 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:23.378394    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="581da9eb-d79f-40a2-af76-6758135a8b9c" containerName="kube-rbac-proxy-web" containerID="cri-o://89546ca4b10842a73302b8c28363ac18f7256a87ac612f8668156716043bc6dc" gracePeriod=120
Aug 04 22:27:23.378507 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:23.378417    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="581da9eb-d79f-40a2-af76-6758135a8b9c" containerName="config-reloader" containerID="cri-o://11b8d4e1df550e53a7ddb5be1aef209b146423eee5ed417add70f77efc3571ca" gracePeriod=120
Aug 04 22:27:23.378507 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:23.378419    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="581da9eb-d79f-40a2-af76-6758135a8b9c" containerName="kube-rbac-proxy" containerID="cri-o://d48cd5bdcd85ede9097ab14a671dde3a77934082a6a50ce5266ee4c3de7610b8" gracePeriod=120
Aug 04 22:27:23.378507 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:23.378380    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="581da9eb-d79f-40a2-af76-6758135a8b9c" containerName="kube-rbac-proxy-metric" containerID="cri-o://d8528a1c0072e0b2f6ed08643bb51382d9bdc3f9ea89b8fcec1fd621114292c3" gracePeriod=120
Aug 04 22:27:23.378767 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:23.378373    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="581da9eb-d79f-40a2-af76-6758135a8b9c" containerName="alertmanager" containerID="cri-o://c953f45b3317bc5a7324899e03af2877575418190c800d158d026695b9cd2f20" gracePeriod=120
Aug 04 22:27:23.841412 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:23.841380    2580 generic.go:356] "Generic (PLEG): container finished" podID="581da9eb-d79f-40a2-af76-6758135a8b9c" containerID="eed7a835572f78b5f64a7cbed4cb34b29ac24d0cbe92d60f134281821a094916" exitCode=0
Aug 04 22:27:23.841412 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:23.841404    2580 generic.go:356] "Generic (PLEG): container finished" podID="581da9eb-d79f-40a2-af76-6758135a8b9c" containerID="d48cd5bdcd85ede9097ab14a671dde3a77934082a6a50ce5266ee4c3de7610b8" exitCode=0
Aug 04 22:27:23.841412 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:23.841411    2580 generic.go:356] "Generic (PLEG): container finished" podID="581da9eb-d79f-40a2-af76-6758135a8b9c" containerID="11b8d4e1df550e53a7ddb5be1aef209b146423eee5ed417add70f77efc3571ca" exitCode=0
Aug 04 22:27:23.841412 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:23.841417    2580 generic.go:356] "Generic (PLEG): container finished" podID="581da9eb-d79f-40a2-af76-6758135a8b9c" containerID="c953f45b3317bc5a7324899e03af2877575418190c800d158d026695b9cd2f20" exitCode=0
Aug 04 22:27:23.841728 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:23.841457    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"581da9eb-d79f-40a2-af76-6758135a8b9c","Type":"ContainerDied","Data":"eed7a835572f78b5f64a7cbed4cb34b29ac24d0cbe92d60f134281821a094916"}
Aug 04 22:27:23.841728 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:23.841542    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"581da9eb-d79f-40a2-af76-6758135a8b9c","Type":"ContainerDied","Data":"d48cd5bdcd85ede9097ab14a671dde3a77934082a6a50ce5266ee4c3de7610b8"}
Aug 04 22:27:23.841728 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:23.841581    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"581da9eb-d79f-40a2-af76-6758135a8b9c","Type":"ContainerDied","Data":"11b8d4e1df550e53a7ddb5be1aef209b146423eee5ed417add70f77efc3571ca"}
Aug 04 22:27:23.841728 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:23.841621    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"581da9eb-d79f-40a2-af76-6758135a8b9c","Type":"ContainerDied","Data":"c953f45b3317bc5a7324899e03af2877575418190c800d158d026695b9cd2f20"}
Aug 04 22:27:24.618611 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:24.618588    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Aug 04 22:27:24.711703 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:24.711614    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/581da9eb-d79f-40a2-af76-6758135a8b9c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"581da9eb-d79f-40a2-af76-6758135a8b9c\" (UID: \"581da9eb-d79f-40a2-af76-6758135a8b9c\") "
Aug 04 22:27:24.711703 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:24.711664    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/581da9eb-d79f-40a2-af76-6758135a8b9c-secret-alertmanager-main-tls\") pod \"581da9eb-d79f-40a2-af76-6758135a8b9c\" (UID: \"581da9eb-d79f-40a2-af76-6758135a8b9c\") "
Aug 04 22:27:24.711703 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:24.711699    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/581da9eb-d79f-40a2-af76-6758135a8b9c-config-out\") pod \"581da9eb-d79f-40a2-af76-6758135a8b9c\" (UID: \"581da9eb-d79f-40a2-af76-6758135a8b9c\") "
Aug 04 22:27:24.711975 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:24.711729    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/581da9eb-d79f-40a2-af76-6758135a8b9c-alertmanager-main-db\") pod \"581da9eb-d79f-40a2-af76-6758135a8b9c\" (UID: \"581da9eb-d79f-40a2-af76-6758135a8b9c\") "
Aug 04 22:27:24.711975 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:24.711865    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/581da9eb-d79f-40a2-af76-6758135a8b9c-config-volume\") pod \"581da9eb-d79f-40a2-af76-6758135a8b9c\" (UID: \"581da9eb-d79f-40a2-af76-6758135a8b9c\") "
Aug 04 22:27:24.711975 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:24.711918    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/581da9eb-d79f-40a2-af76-6758135a8b9c-alertmanager-trusted-ca-bundle\") pod \"581da9eb-d79f-40a2-af76-6758135a8b9c\" (UID: \"581da9eb-d79f-40a2-af76-6758135a8b9c\") "
Aug 04 22:27:24.711975 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:24.711944    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/581da9eb-d79f-40a2-af76-6758135a8b9c-metrics-client-ca\") pod \"581da9eb-d79f-40a2-af76-6758135a8b9c\" (UID: \"581da9eb-d79f-40a2-af76-6758135a8b9c\") "
Aug 04 22:27:24.711975 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:24.711968    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/581da9eb-d79f-40a2-af76-6758135a8b9c-tls-assets\") pod \"581da9eb-d79f-40a2-af76-6758135a8b9c\" (UID: \"581da9eb-d79f-40a2-af76-6758135a8b9c\") "
Aug 04 22:27:24.712263 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:24.712009    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/581da9eb-d79f-40a2-af76-6758135a8b9c-secret-alertmanager-kube-rbac-proxy-web\") pod \"581da9eb-d79f-40a2-af76-6758135a8b9c\" (UID: \"581da9eb-d79f-40a2-af76-6758135a8b9c\") "
Aug 04 22:27:24.712263 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:24.712055    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/581da9eb-d79f-40a2-af76-6758135a8b9c-cluster-tls-config\") pod \"581da9eb-d79f-40a2-af76-6758135a8b9c\" (UID: \"581da9eb-d79f-40a2-af76-6758135a8b9c\") "
Aug 04 22:27:24.712263 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:24.712074    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/581da9eb-d79f-40a2-af76-6758135a8b9c-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "581da9eb-d79f-40a2-af76-6758135a8b9c" (UID: "581da9eb-d79f-40a2-af76-6758135a8b9c"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 22:27:24.712263 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:24.712088    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xgdhk\" (UniqueName: \"kubernetes.io/projected/581da9eb-d79f-40a2-af76-6758135a8b9c-kube-api-access-xgdhk\") pod \"581da9eb-d79f-40a2-af76-6758135a8b9c\" (UID: \"581da9eb-d79f-40a2-af76-6758135a8b9c\") "
Aug 04 22:27:24.712263 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:24.712121    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/581da9eb-d79f-40a2-af76-6758135a8b9c-web-config\") pod \"581da9eb-d79f-40a2-af76-6758135a8b9c\" (UID: \"581da9eb-d79f-40a2-af76-6758135a8b9c\") "
Aug 04 22:27:24.712263 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:24.712168    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/581da9eb-d79f-40a2-af76-6758135a8b9c-secret-alertmanager-kube-rbac-proxy\") pod \"581da9eb-d79f-40a2-af76-6758135a8b9c\" (UID: \"581da9eb-d79f-40a2-af76-6758135a8b9c\") "
Aug 04 22:27:24.712557 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:24.712348    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/581da9eb-d79f-40a2-af76-6758135a8b9c-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "581da9eb-d79f-40a2-af76-6758135a8b9c" (UID: "581da9eb-d79f-40a2-af76-6758135a8b9c"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 22:27:24.712557 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:24.712457    2580 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/581da9eb-d79f-40a2-af76-6758135a8b9c-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
Aug 04 22:27:24.712557 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:24.712481    2580 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/581da9eb-d79f-40a2-af76-6758135a8b9c-alertmanager-main-db\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
Aug 04 22:27:24.712958 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:24.712874    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/581da9eb-d79f-40a2-af76-6758135a8b9c-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "581da9eb-d79f-40a2-af76-6758135a8b9c" (UID: "581da9eb-d79f-40a2-af76-6758135a8b9c"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 22:27:24.714480 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:24.714443    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/581da9eb-d79f-40a2-af76-6758135a8b9c-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "581da9eb-d79f-40a2-af76-6758135a8b9c" (UID: "581da9eb-d79f-40a2-af76-6758135a8b9c"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 22:27:24.714582 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:24.714492    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/581da9eb-d79f-40a2-af76-6758135a8b9c-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "581da9eb-d79f-40a2-af76-6758135a8b9c" (UID: "581da9eb-d79f-40a2-af76-6758135a8b9c"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 22:27:24.714659 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:24.714638    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/581da9eb-d79f-40a2-af76-6758135a8b9c-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "581da9eb-d79f-40a2-af76-6758135a8b9c" (UID: "581da9eb-d79f-40a2-af76-6758135a8b9c"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 22:27:24.714721 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:24.714673    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/581da9eb-d79f-40a2-af76-6758135a8b9c-config-out" (OuterVolumeSpecName: "config-out") pod "581da9eb-d79f-40a2-af76-6758135a8b9c" (UID: "581da9eb-d79f-40a2-af76-6758135a8b9c"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 22:27:24.714721 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:24.714701    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/581da9eb-d79f-40a2-af76-6758135a8b9c-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "581da9eb-d79f-40a2-af76-6758135a8b9c" (UID: "581da9eb-d79f-40a2-af76-6758135a8b9c"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 22:27:24.715063 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:24.715039    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/581da9eb-d79f-40a2-af76-6758135a8b9c-config-volume" (OuterVolumeSpecName: "config-volume") pod "581da9eb-d79f-40a2-af76-6758135a8b9c" (UID: "581da9eb-d79f-40a2-af76-6758135a8b9c"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 22:27:24.715770 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:24.715745    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/581da9eb-d79f-40a2-af76-6758135a8b9c-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "581da9eb-d79f-40a2-af76-6758135a8b9c" (UID: "581da9eb-d79f-40a2-af76-6758135a8b9c"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 22:27:24.716504 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:24.716484    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/581da9eb-d79f-40a2-af76-6758135a8b9c-kube-api-access-xgdhk" (OuterVolumeSpecName: "kube-api-access-xgdhk") pod "581da9eb-d79f-40a2-af76-6758135a8b9c" (UID: "581da9eb-d79f-40a2-af76-6758135a8b9c"). InnerVolumeSpecName "kube-api-access-xgdhk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 22:27:24.719506 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:24.719385    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/581da9eb-d79f-40a2-af76-6758135a8b9c-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "581da9eb-d79f-40a2-af76-6758135a8b9c" (UID: "581da9eb-d79f-40a2-af76-6758135a8b9c"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 22:27:24.725972 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:24.725947    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/581da9eb-d79f-40a2-af76-6758135a8b9c-web-config" (OuterVolumeSpecName: "web-config") pod "581da9eb-d79f-40a2-af76-6758135a8b9c" (UID: "581da9eb-d79f-40a2-af76-6758135a8b9c"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 22:27:24.813527 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:24.813486    2580 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/581da9eb-d79f-40a2-af76-6758135a8b9c-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
Aug 04 22:27:24.813527 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:24.813534    2580 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/581da9eb-d79f-40a2-af76-6758135a8b9c-secret-alertmanager-main-tls\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
Aug 04 22:27:24.813695 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:24.813545    2580 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/581da9eb-d79f-40a2-af76-6758135a8b9c-config-out\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
Aug 04 22:27:24.813695 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:24.813554    2580 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/581da9eb-d79f-40a2-af76-6758135a8b9c-config-volume\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
Aug 04 22:27:24.813695 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:24.813561    2580 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/581da9eb-d79f-40a2-af76-6758135a8b9c-metrics-client-ca\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
Aug 04 22:27:24.813695 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:24.813569    2580 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/581da9eb-d79f-40a2-af76-6758135a8b9c-tls-assets\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
Aug 04 22:27:24.813695 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:24.813578    2580 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/581da9eb-d79f-40a2-af76-6758135a8b9c-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
Aug 04 22:27:24.813695 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:24.813586    2580 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/581da9eb-d79f-40a2-af76-6758135a8b9c-cluster-tls-config\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
Aug 04 22:27:24.813695 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:24.813594    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xgdhk\" (UniqueName: \"kubernetes.io/projected/581da9eb-d79f-40a2-af76-6758135a8b9c-kube-api-access-xgdhk\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
Aug 04 22:27:24.813695 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:24.813601    2580 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/581da9eb-d79f-40a2-af76-6758135a8b9c-web-config\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
Aug 04 22:27:24.813695 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:24.813610    2580 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/581da9eb-d79f-40a2-af76-6758135a8b9c-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
Aug 04 22:27:24.849112 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:24.849082    2580 generic.go:356] "Generic (PLEG): container finished" podID="581da9eb-d79f-40a2-af76-6758135a8b9c" containerID="d8528a1c0072e0b2f6ed08643bb51382d9bdc3f9ea89b8fcec1fd621114292c3" exitCode=0
Aug 04 22:27:24.849112 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:24.849107    2580 generic.go:356] "Generic (PLEG): container finished" podID="581da9eb-d79f-40a2-af76-6758135a8b9c" containerID="89546ca4b10842a73302b8c28363ac18f7256a87ac612f8668156716043bc6dc" exitCode=0
Aug 04 22:27:24.849278 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:24.849161    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"581da9eb-d79f-40a2-af76-6758135a8b9c","Type":"ContainerDied","Data":"d8528a1c0072e0b2f6ed08643bb51382d9bdc3f9ea89b8fcec1fd621114292c3"}
Aug 04 22:27:24.849278 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:24.849226    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"581da9eb-d79f-40a2-af76-6758135a8b9c","Type":"ContainerDied","Data":"89546ca4b10842a73302b8c28363ac18f7256a87ac612f8668156716043bc6dc"}
Aug 04 22:27:24.849278 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:24.849168    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Aug 04 22:27:24.849278 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:24.849265    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"581da9eb-d79f-40a2-af76-6758135a8b9c","Type":"ContainerDied","Data":"9553f5da60c5e13e28990285c27739776fd9fe162d370a34e2e94574a2862c93"}
Aug 04 22:27:24.849407 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:24.849311    2580 scope.go:117] "RemoveContainer" containerID="eed7a835572f78b5f64a7cbed4cb34b29ac24d0cbe92d60f134281821a094916"
Aug 04 22:27:24.857067 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:24.857046    2580 scope.go:117] "RemoveContainer" containerID="d8528a1c0072e0b2f6ed08643bb51382d9bdc3f9ea89b8fcec1fd621114292c3"
Aug 04 22:27:24.870729 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:24.870621    2580 scope.go:117] "RemoveContainer" containerID="d48cd5bdcd85ede9097ab14a671dde3a77934082a6a50ce5266ee4c3de7610b8"
Aug 04 22:27:24.874220 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:24.874195    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Aug 04 22:27:24.878316 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:24.878294    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Aug 04 22:27:24.879422 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:24.879399    2580 scope.go:117] "RemoveContainer" containerID="89546ca4b10842a73302b8c28363ac18f7256a87ac612f8668156716043bc6dc"
Aug 04 22:27:24.885982 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:24.885960    2580 scope.go:117] "RemoveContainer" containerID="11b8d4e1df550e53a7ddb5be1aef209b146423eee5ed417add70f77efc3571ca"
Aug 04 22:27:24.892782 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:24.892765    2580 scope.go:117] "RemoveContainer" containerID="c953f45b3317bc5a7324899e03af2877575418190c800d158d026695b9cd2f20"
Aug 04 22:27:24.899498 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:24.899480    2580 scope.go:117] "RemoveContainer" containerID="4b3759fc06b41b22308796b759003e481d27f1f0ffc170846c253c0b63521123"
Aug 04 22:27:24.904963 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:24.904942    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Aug 04 22:27:24.905280 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:24.905267    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e798691e-9513-451f-9b09-1cc6380e9626" containerName="console"
Aug 04 22:27:24.905326 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:24.905282    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="e798691e-9513-451f-9b09-1cc6380e9626" containerName="console"
Aug 04 22:27:24.905326 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:24.905293    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="581da9eb-d79f-40a2-af76-6758135a8b9c" containerName="kube-rbac-proxy"
Aug 04 22:27:24.905326 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:24.905301    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="581da9eb-d79f-40a2-af76-6758135a8b9c" containerName="kube-rbac-proxy"
Aug 04 22:27:24.905326 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:24.905316    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="581da9eb-d79f-40a2-af76-6758135a8b9c" containerName="kube-rbac-proxy-web"
Aug 04 22:27:24.905326 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:24.905321    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="581da9eb-d79f-40a2-af76-6758135a8b9c" containerName="kube-rbac-proxy-web"
Aug 04 22:27:24.905479 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:24.905328    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="581da9eb-d79f-40a2-af76-6758135a8b9c" containerName="alertmanager"
Aug 04 22:27:24.905479 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:24.905333    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="581da9eb-d79f-40a2-af76-6758135a8b9c" containerName="alertmanager"
Aug 04 22:27:24.905479 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:24.905339    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="069b448c-edde-423c-b08d-4cac577c09e5" containerName="registry"
Aug 04 22:27:24.905479 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:24.905345    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="069b448c-edde-423c-b08d-4cac577c09e5" containerName="registry"
Aug 04 22:27:24.905479 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:24.905360    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="581da9eb-d79f-40a2-af76-6758135a8b9c" containerName="init-config-reloader"
Aug 04 22:27:24.905479 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:24.905368    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="581da9eb-d79f-40a2-af76-6758135a8b9c" containerName="init-config-reloader"
Aug 04 22:27:24.905479 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:24.905376    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="581da9eb-d79f-40a2-af76-6758135a8b9c" containerName="kube-rbac-proxy-metric"
Aug 04 22:27:24.905479 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:24.905382    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="581da9eb-d79f-40a2-af76-6758135a8b9c" containerName="kube-rbac-proxy-metric"
Aug 04 22:27:24.905479 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:24.905390    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="581da9eb-d79f-40a2-af76-6758135a8b9c" containerName="prom-label-proxy"
Aug 04 22:27:24.905479 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:24.905395    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="581da9eb-d79f-40a2-af76-6758135a8b9c" containerName="prom-label-proxy"
Aug 04 22:27:24.905479 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:24.905403    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="581da9eb-d79f-40a2-af76-6758135a8b9c" containerName="config-reloader"
Aug 04 22:27:24.905479 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:24.905408    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="581da9eb-d79f-40a2-af76-6758135a8b9c" containerName="config-reloader"
Aug 04 22:27:24.905479 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:24.905456    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="581da9eb-d79f-40a2-af76-6758135a8b9c" containerName="alertmanager"
Aug 04 22:27:24.905479 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:24.905465    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="069b448c-edde-423c-b08d-4cac577c09e5" containerName="registry"
Aug 04 22:27:24.905479 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:24.905471    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="581da9eb-d79f-40a2-af76-6758135a8b9c" containerName="config-reloader"
Aug 04 22:27:24.905479 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:24.905476    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="581da9eb-d79f-40a2-af76-6758135a8b9c" containerName="prom-label-proxy"
Aug 04 22:27:24.905479 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:24.905482    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="e798691e-9513-451f-9b09-1cc6380e9626" containerName="console"
Aug 04 22:27:24.905993 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:24.905488    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="581da9eb-d79f-40a2-af76-6758135a8b9c" containerName="kube-rbac-proxy-web"
Aug 04 22:27:24.905993 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:24.905493    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="581da9eb-d79f-40a2-af76-6758135a8b9c" containerName="kube-rbac-proxy"
Aug 04 22:27:24.905993 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:24.905499    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="581da9eb-d79f-40a2-af76-6758135a8b9c" containerName="kube-rbac-proxy-metric"
Aug 04 22:27:24.906813 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:24.906798    2580 scope.go:117] "RemoveContainer" containerID="eed7a835572f78b5f64a7cbed4cb34b29ac24d0cbe92d60f134281821a094916"
Aug 04 22:27:24.907073 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:27:24.907055    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eed7a835572f78b5f64a7cbed4cb34b29ac24d0cbe92d60f134281821a094916\": container with ID starting with eed7a835572f78b5f64a7cbed4cb34b29ac24d0cbe92d60f134281821a094916 not found: ID does not exist" containerID="eed7a835572f78b5f64a7cbed4cb34b29ac24d0cbe92d60f134281821a094916"
Aug 04 22:27:24.907120 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:24.907081    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eed7a835572f78b5f64a7cbed4cb34b29ac24d0cbe92d60f134281821a094916"} err="failed to get container status \"eed7a835572f78b5f64a7cbed4cb34b29ac24d0cbe92d60f134281821a094916\": rpc error: code = NotFound desc = could not find container \"eed7a835572f78b5f64a7cbed4cb34b29ac24d0cbe92d60f134281821a094916\": container with ID starting with eed7a835572f78b5f64a7cbed4cb34b29ac24d0cbe92d60f134281821a094916 not found: ID does not exist"
Aug 04 22:27:24.907120 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:24.907097    2580 scope.go:117] "RemoveContainer" containerID="d8528a1c0072e0b2f6ed08643bb51382d9bdc3f9ea89b8fcec1fd621114292c3"
Aug 04 22:27:24.907418 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:27:24.907399    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d8528a1c0072e0b2f6ed08643bb51382d9bdc3f9ea89b8fcec1fd621114292c3\": container with ID starting with d8528a1c0072e0b2f6ed08643bb51382d9bdc3f9ea89b8fcec1fd621114292c3 not found: ID does not exist" containerID="d8528a1c0072e0b2f6ed08643bb51382d9bdc3f9ea89b8fcec1fd621114292c3"
Aug 04 22:27:24.907466 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:24.907425    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d8528a1c0072e0b2f6ed08643bb51382d9bdc3f9ea89b8fcec1fd621114292c3"} err="failed to get container status \"d8528a1c0072e0b2f6ed08643bb51382d9bdc3f9ea89b8fcec1fd621114292c3\": rpc error: code = NotFound desc = could not find container \"d8528a1c0072e0b2f6ed08643bb51382d9bdc3f9ea89b8fcec1fd621114292c3\": container with ID starting with d8528a1c0072e0b2f6ed08643bb51382d9bdc3f9ea89b8fcec1fd621114292c3 not found: ID does not exist"
Aug 04 22:27:24.907466 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:24.907442    2580 scope.go:117] "RemoveContainer" containerID="d48cd5bdcd85ede9097ab14a671dde3a77934082a6a50ce5266ee4c3de7610b8"
Aug 04 22:27:24.907732 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:27:24.907713    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d48cd5bdcd85ede9097ab14a671dde3a77934082a6a50ce5266ee4c3de7610b8\": container with ID starting with d48cd5bdcd85ede9097ab14a671dde3a77934082a6a50ce5266ee4c3de7610b8 not found: ID does not exist" containerID="d48cd5bdcd85ede9097ab14a671dde3a77934082a6a50ce5266ee4c3de7610b8"
Aug 04 22:27:24.907790 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:24.907741    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d48cd5bdcd85ede9097ab14a671dde3a77934082a6a50ce5266ee4c3de7610b8"} err="failed to get container status \"d48cd5bdcd85ede9097ab14a671dde3a77934082a6a50ce5266ee4c3de7610b8\": rpc error: code = NotFound desc = could not find container \"d48cd5bdcd85ede9097ab14a671dde3a77934082a6a50ce5266ee4c3de7610b8\": container with ID starting with d48cd5bdcd85ede9097ab14a671dde3a77934082a6a50ce5266ee4c3de7610b8 not found: ID does not exist"
Aug 04 22:27:24.907790 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:24.907764    2580 scope.go:117] "RemoveContainer" containerID="89546ca4b10842a73302b8c28363ac18f7256a87ac612f8668156716043bc6dc"
Aug 04 22:27:24.908014 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:27:24.907998    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"89546ca4b10842a73302b8c28363ac18f7256a87ac612f8668156716043bc6dc\": container with ID starting with 89546ca4b10842a73302b8c28363ac18f7256a87ac612f8668156716043bc6dc not found: ID does not exist" containerID="89546ca4b10842a73302b8c28363ac18f7256a87ac612f8668156716043bc6dc"
Aug 04 22:27:24.908052 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:24.908020    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"89546ca4b10842a73302b8c28363ac18f7256a87ac612f8668156716043bc6dc"} err="failed to get container status \"89546ca4b10842a73302b8c28363ac18f7256a87ac612f8668156716043bc6dc\": rpc error: code = NotFound desc = could not find container \"89546ca4b10842a73302b8c28363ac18f7256a87ac612f8668156716043bc6dc\": container with ID starting with 89546ca4b10842a73302b8c28363ac18f7256a87ac612f8668156716043bc6dc not found: ID does not exist"
Aug 04 22:27:24.908052 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:24.908036    2580 scope.go:117] "RemoveContainer" containerID="11b8d4e1df550e53a7ddb5be1aef209b146423eee5ed417add70f77efc3571ca"
Aug 04 22:27:24.908271 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:27:24.908252    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"11b8d4e1df550e53a7ddb5be1aef209b146423eee5ed417add70f77efc3571ca\": container with ID starting with 11b8d4e1df550e53a7ddb5be1aef209b146423eee5ed417add70f77efc3571ca not found: ID does not exist" containerID="11b8d4e1df550e53a7ddb5be1aef209b146423eee5ed417add70f77efc3571ca"
Aug 04 22:27:24.908331 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:24.908278    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"11b8d4e1df550e53a7ddb5be1aef209b146423eee5ed417add70f77efc3571ca"} err="failed to get container status \"11b8d4e1df550e53a7ddb5be1aef209b146423eee5ed417add70f77efc3571ca\": rpc error: code = NotFound desc = could not find container \"11b8d4e1df550e53a7ddb5be1aef209b146423eee5ed417add70f77efc3571ca\": container with ID starting with 11b8d4e1df550e53a7ddb5be1aef209b146423eee5ed417add70f77efc3571ca not found: ID does not exist"
Aug 04 22:27:24.908331 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:24.908300    2580 scope.go:117] "RemoveContainer" containerID="c953f45b3317bc5a7324899e03af2877575418190c800d158d026695b9cd2f20"
Aug 04 22:27:24.908531 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:27:24.908510    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c953f45b3317bc5a7324899e03af2877575418190c800d158d026695b9cd2f20\": container with ID starting with c953f45b3317bc5a7324899e03af2877575418190c800d158d026695b9cd2f20 not found: ID does not exist" containerID="c953f45b3317bc5a7324899e03af2877575418190c800d158d026695b9cd2f20"
Aug 04 22:27:24.908567 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:24.908536    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c953f45b3317bc5a7324899e03af2877575418190c800d158d026695b9cd2f20"} err="failed to get container status \"c953f45b3317bc5a7324899e03af2877575418190c800d158d026695b9cd2f20\": rpc error: code = NotFound desc = could not find container \"c953f45b3317bc5a7324899e03af2877575418190c800d158d026695b9cd2f20\": container with ID starting with c953f45b3317bc5a7324899e03af2877575418190c800d158d026695b9cd2f20 not found: ID does not exist"
Aug 04 22:27:24.908567 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:24.908550    2580 scope.go:117] "RemoveContainer" containerID="4b3759fc06b41b22308796b759003e481d27f1f0ffc170846c253c0b63521123"
Aug 04 22:27:24.908759 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:27:24.908744    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4b3759fc06b41b22308796b759003e481d27f1f0ffc170846c253c0b63521123\": container with ID starting with 4b3759fc06b41b22308796b759003e481d27f1f0ffc170846c253c0b63521123 not found: ID does not exist" containerID="4b3759fc06b41b22308796b759003e481d27f1f0ffc170846c253c0b63521123"
Aug 04 22:27:24.908799 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:24.908763    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b3759fc06b41b22308796b759003e481d27f1f0ffc170846c253c0b63521123"} err="failed to get container status \"4b3759fc06b41b22308796b759003e481d27f1f0ffc170846c253c0b63521123\": rpc error: code = NotFound desc = could not find container \"4b3759fc06b41b22308796b759003e481d27f1f0ffc170846c253c0b63521123\": container with ID starting with 4b3759fc06b41b22308796b759003e481d27f1f0ffc170846c253c0b63521123 not found: ID does not exist"
Aug 04 22:27:24.908799 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:24.908776    2580 scope.go:117] "RemoveContainer" containerID="eed7a835572f78b5f64a7cbed4cb34b29ac24d0cbe92d60f134281821a094916"
Aug 04 22:27:24.908983 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:24.908966    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eed7a835572f78b5f64a7cbed4cb34b29ac24d0cbe92d60f134281821a094916"} err="failed to get container status \"eed7a835572f78b5f64a7cbed4cb34b29ac24d0cbe92d60f134281821a094916\": rpc error: code = NotFound desc = could not find container \"eed7a835572f78b5f64a7cbed4cb34b29ac24d0cbe92d60f134281821a094916\": container with ID starting with eed7a835572f78b5f64a7cbed4cb34b29ac24d0cbe92d60f134281821a094916 not found: ID does not exist"
Aug 04 22:27:24.909051 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:24.908985    2580 scope.go:117] "RemoveContainer" containerID="d8528a1c0072e0b2f6ed08643bb51382d9bdc3f9ea89b8fcec1fd621114292c3"
Aug 04 22:27:24.909213 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:24.909197    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d8528a1c0072e0b2f6ed08643bb51382d9bdc3f9ea89b8fcec1fd621114292c3"} err="failed to get container status \"d8528a1c0072e0b2f6ed08643bb51382d9bdc3f9ea89b8fcec1fd621114292c3\": rpc error: code = NotFound desc = could not find container \"d8528a1c0072e0b2f6ed08643bb51382d9bdc3f9ea89b8fcec1fd621114292c3\": container with ID starting with d8528a1c0072e0b2f6ed08643bb51382d9bdc3f9ea89b8fcec1fd621114292c3 not found: ID does not exist"
Aug 04 22:27:24.909259 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:24.909213    2580 scope.go:117] "RemoveContainer" containerID="d48cd5bdcd85ede9097ab14a671dde3a77934082a6a50ce5266ee4c3de7610b8"
Aug 04 22:27:24.909394 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:24.909378    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d48cd5bdcd85ede9097ab14a671dde3a77934082a6a50ce5266ee4c3de7610b8"} err="failed to get container status \"d48cd5bdcd85ede9097ab14a671dde3a77934082a6a50ce5266ee4c3de7610b8\": rpc error: code = NotFound desc = could not find container \"d48cd5bdcd85ede9097ab14a671dde3a77934082a6a50ce5266ee4c3de7610b8\": container with ID starting with d48cd5bdcd85ede9097ab14a671dde3a77934082a6a50ce5266ee4c3de7610b8 not found: ID does not exist"
Aug 04 22:27:24.909394 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:24.909392    2580 scope.go:117] "RemoveContainer" containerID="89546ca4b10842a73302b8c28363ac18f7256a87ac612f8668156716043bc6dc"
Aug 04 22:27:24.909624 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:24.909607    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"89546ca4b10842a73302b8c28363ac18f7256a87ac612f8668156716043bc6dc"} err="failed to get container status \"89546ca4b10842a73302b8c28363ac18f7256a87ac612f8668156716043bc6dc\": rpc error: code = NotFound desc = could not find container \"89546ca4b10842a73302b8c28363ac18f7256a87ac612f8668156716043bc6dc\": container with ID starting with 89546ca4b10842a73302b8c28363ac18f7256a87ac612f8668156716043bc6dc not found: ID does not exist"
Aug 04 22:27:24.909624 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:24.909624    2580 scope.go:117] "RemoveContainer" containerID="11b8d4e1df550e53a7ddb5be1aef209b146423eee5ed417add70f77efc3571ca"
Aug 04 22:27:24.909743 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:24.909727    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Aug 04 22:27:24.909826 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:24.909811    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"11b8d4e1df550e53a7ddb5be1aef209b146423eee5ed417add70f77efc3571ca"} err="failed to get container status \"11b8d4e1df550e53a7ddb5be1aef209b146423eee5ed417add70f77efc3571ca\": rpc error: code = NotFound desc = could not find container \"11b8d4e1df550e53a7ddb5be1aef209b146423eee5ed417add70f77efc3571ca\": container with ID starting with 11b8d4e1df550e53a7ddb5be1aef209b146423eee5ed417add70f77efc3571ca not found: ID does not exist"
Aug 04 22:27:24.909867 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:24.909835    2580 scope.go:117] "RemoveContainer" containerID="c953f45b3317bc5a7324899e03af2877575418190c800d158d026695b9cd2f20"
Aug 04 22:27:24.910038 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:24.910017    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c953f45b3317bc5a7324899e03af2877575418190c800d158d026695b9cd2f20"} err="failed to get container status \"c953f45b3317bc5a7324899e03af2877575418190c800d158d026695b9cd2f20\": rpc error: code = NotFound desc = could not find container \"c953f45b3317bc5a7324899e03af2877575418190c800d158d026695b9cd2f20\": container with ID starting with c953f45b3317bc5a7324899e03af2877575418190c800d158d026695b9cd2f20 not found: ID does not exist"
Aug 04 22:27:24.910105 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:24.910051    2580 scope.go:117] "RemoveContainer" containerID="4b3759fc06b41b22308796b759003e481d27f1f0ffc170846c253c0b63521123"
Aug 04 22:27:24.910418 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:24.910389    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b3759fc06b41b22308796b759003e481d27f1f0ffc170846c253c0b63521123"} err="failed to get container status \"4b3759fc06b41b22308796b759003e481d27f1f0ffc170846c253c0b63521123\": rpc error: code = NotFound desc = could not find container \"4b3759fc06b41b22308796b759003e481d27f1f0ffc170846c253c0b63521123\": container with ID starting with 4b3759fc06b41b22308796b759003e481d27f1f0ffc170846c253c0b63521123 not found: ID does not exist"
Aug 04 22:27:24.912893 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:24.911862    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Aug 04 22:27:24.912893 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:24.912435    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Aug 04 22:27:24.912893 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:24.912719    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Aug 04 22:27:24.913451 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:24.912992    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Aug 04 22:27:24.913451 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:24.913008    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Aug 04 22:27:24.913451 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:24.913165    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Aug 04 22:27:24.913451 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:24.913214    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-fbk4w\""
Aug 04 22:27:24.913703 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:24.913665    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Aug 04 22:27:24.913904 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:24.913877    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Aug 04 22:27:24.916823 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:24.916802    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Aug 04 22:27:24.921793 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:24.921771    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Aug 04 22:27:25.014946 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:25.014867    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/38bcb81e-e4a1-4ea4-99ec-91c4504efe29-config-out\") pod \"alertmanager-main-0\" (UID: \"38bcb81e-e4a1-4ea4-99ec-91c4504efe29\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 22:27:25.014946 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:25.014913    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/38bcb81e-e4a1-4ea4-99ec-91c4504efe29-config-volume\") pod \"alertmanager-main-0\" (UID: \"38bcb81e-e4a1-4ea4-99ec-91c4504efe29\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 22:27:25.014946 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:25.014936    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38bcb81e-e4a1-4ea4-99ec-91c4504efe29-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"38bcb81e-e4a1-4ea4-99ec-91c4504efe29\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 22:27:25.015196 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:25.015000    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/38bcb81e-e4a1-4ea4-99ec-91c4504efe29-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"38bcb81e-e4a1-4ea4-99ec-91c4504efe29\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 22:27:25.015196 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:25.015029    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/38bcb81e-e4a1-4ea4-99ec-91c4504efe29-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"38bcb81e-e4a1-4ea4-99ec-91c4504efe29\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 22:27:25.015196 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:25.015045    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/38bcb81e-e4a1-4ea4-99ec-91c4504efe29-web-config\") pod \"alertmanager-main-0\" (UID: \"38bcb81e-e4a1-4ea4-99ec-91c4504efe29\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 22:27:25.015196 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:25.015069    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/38bcb81e-e4a1-4ea4-99ec-91c4504efe29-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"38bcb81e-e4a1-4ea4-99ec-91c4504efe29\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 22:27:25.015196 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:25.015086    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/38bcb81e-e4a1-4ea4-99ec-91c4504efe29-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"38bcb81e-e4a1-4ea4-99ec-91c4504efe29\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 22:27:25.015196 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:25.015185    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/38bcb81e-e4a1-4ea4-99ec-91c4504efe29-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"38bcb81e-e4a1-4ea4-99ec-91c4504efe29\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 22:27:25.015408 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:25.015214    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5g6bm\" (UniqueName: \"kubernetes.io/projected/38bcb81e-e4a1-4ea4-99ec-91c4504efe29-kube-api-access-5g6bm\") pod \"alertmanager-main-0\" (UID: \"38bcb81e-e4a1-4ea4-99ec-91c4504efe29\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 22:27:25.015408 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:25.015232    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/38bcb81e-e4a1-4ea4-99ec-91c4504efe29-tls-assets\") pod \"alertmanager-main-0\" (UID: \"38bcb81e-e4a1-4ea4-99ec-91c4504efe29\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 22:27:25.015408 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:25.015274    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/38bcb81e-e4a1-4ea4-99ec-91c4504efe29-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"38bcb81e-e4a1-4ea4-99ec-91c4504efe29\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 22:27:25.015408 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:25.015291    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/38bcb81e-e4a1-4ea4-99ec-91c4504efe29-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"38bcb81e-e4a1-4ea4-99ec-91c4504efe29\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 22:27:25.115714 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:25.115688    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/38bcb81e-e4a1-4ea4-99ec-91c4504efe29-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"38bcb81e-e4a1-4ea4-99ec-91c4504efe29\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 22:27:25.115714 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:25.115716    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5g6bm\" (UniqueName: \"kubernetes.io/projected/38bcb81e-e4a1-4ea4-99ec-91c4504efe29-kube-api-access-5g6bm\") pod \"alertmanager-main-0\" (UID: \"38bcb81e-e4a1-4ea4-99ec-91c4504efe29\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 22:27:25.115867 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:25.115732    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/38bcb81e-e4a1-4ea4-99ec-91c4504efe29-tls-assets\") pod \"alertmanager-main-0\" (UID: \"38bcb81e-e4a1-4ea4-99ec-91c4504efe29\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 22:27:25.115867 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:25.115752    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/38bcb81e-e4a1-4ea4-99ec-91c4504efe29-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"38bcb81e-e4a1-4ea4-99ec-91c4504efe29\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 22:27:25.115867 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:25.115776    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/38bcb81e-e4a1-4ea4-99ec-91c4504efe29-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"38bcb81e-e4a1-4ea4-99ec-91c4504efe29\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 22:27:25.116008 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:25.115976    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/38bcb81e-e4a1-4ea4-99ec-91c4504efe29-config-out\") pod \"alertmanager-main-0\" (UID: \"38bcb81e-e4a1-4ea4-99ec-91c4504efe29\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 22:27:25.116054 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:25.116043    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/38bcb81e-e4a1-4ea4-99ec-91c4504efe29-config-volume\") pod \"alertmanager-main-0\" (UID: \"38bcb81e-e4a1-4ea4-99ec-91c4504efe29\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 22:27:25.116107 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:25.116080    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38bcb81e-e4a1-4ea4-99ec-91c4504efe29-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"38bcb81e-e4a1-4ea4-99ec-91c4504efe29\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 22:27:25.116190 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:25.116116    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/38bcb81e-e4a1-4ea4-99ec-91c4504efe29-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"38bcb81e-e4a1-4ea4-99ec-91c4504efe29\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 22:27:25.116190 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:25.116176    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/38bcb81e-e4a1-4ea4-99ec-91c4504efe29-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"38bcb81e-e4a1-4ea4-99ec-91c4504efe29\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 22:27:25.116303 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:25.116202    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/38bcb81e-e4a1-4ea4-99ec-91c4504efe29-web-config\") pod \"alertmanager-main-0\" (UID: \"38bcb81e-e4a1-4ea4-99ec-91c4504efe29\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 22:27:25.116303 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:25.116245    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/38bcb81e-e4a1-4ea4-99ec-91c4504efe29-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"38bcb81e-e4a1-4ea4-99ec-91c4504efe29\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 22:27:25.116303 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:25.116271    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/38bcb81e-e4a1-4ea4-99ec-91c4504efe29-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"38bcb81e-e4a1-4ea4-99ec-91c4504efe29\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 22:27:25.116624 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:25.116601    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/38bcb81e-e4a1-4ea4-99ec-91c4504efe29-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"38bcb81e-e4a1-4ea4-99ec-91c4504efe29\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 22:27:25.117605 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:25.117557    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/38bcb81e-e4a1-4ea4-99ec-91c4504efe29-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"38bcb81e-e4a1-4ea4-99ec-91c4504efe29\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 22:27:25.117822 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:25.117796    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38bcb81e-e4a1-4ea4-99ec-91c4504efe29-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"38bcb81e-e4a1-4ea4-99ec-91c4504efe29\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 22:27:25.119035 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:25.118864    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/38bcb81e-e4a1-4ea4-99ec-91c4504efe29-tls-assets\") pod \"alertmanager-main-0\" (UID: \"38bcb81e-e4a1-4ea4-99ec-91c4504efe29\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 22:27:25.119035 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:25.118873    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/38bcb81e-e4a1-4ea4-99ec-91c4504efe29-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"38bcb81e-e4a1-4ea4-99ec-91c4504efe29\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 22:27:25.119035 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:25.118982    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/38bcb81e-e4a1-4ea4-99ec-91c4504efe29-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"38bcb81e-e4a1-4ea4-99ec-91c4504efe29\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 22:27:25.119322 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:25.119305    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/38bcb81e-e4a1-4ea4-99ec-91c4504efe29-web-config\") pod \"alertmanager-main-0\" (UID: \"38bcb81e-e4a1-4ea4-99ec-91c4504efe29\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 22:27:25.119384 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:25.119356    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/38bcb81e-e4a1-4ea4-99ec-91c4504efe29-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"38bcb81e-e4a1-4ea4-99ec-91c4504efe29\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 22:27:25.119443 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:25.119384    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/38bcb81e-e4a1-4ea4-99ec-91c4504efe29-config-volume\") pod \"alertmanager-main-0\" (UID: \"38bcb81e-e4a1-4ea4-99ec-91c4504efe29\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 22:27:25.119662 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:25.119645    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/38bcb81e-e4a1-4ea4-99ec-91c4504efe29-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"38bcb81e-e4a1-4ea4-99ec-91c4504efe29\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 22:27:25.119902 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:25.119884    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/38bcb81e-e4a1-4ea4-99ec-91c4504efe29-config-out\") pod \"alertmanager-main-0\" (UID: \"38bcb81e-e4a1-4ea4-99ec-91c4504efe29\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 22:27:25.120433 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:25.120412    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/38bcb81e-e4a1-4ea4-99ec-91c4504efe29-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"38bcb81e-e4a1-4ea4-99ec-91c4504efe29\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 22:27:25.123080 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:25.123062    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5g6bm\" (UniqueName: \"kubernetes.io/projected/38bcb81e-e4a1-4ea4-99ec-91c4504efe29-kube-api-access-5g6bm\") pod \"alertmanager-main-0\" (UID: \"38bcb81e-e4a1-4ea4-99ec-91c4504efe29\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 22:27:25.220340 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:25.220315    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Aug 04 22:27:25.351374 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:25.351349    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Aug 04 22:27:25.353221 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:27:25.353187    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38bcb81e_e4a1_4ea4_99ec_91c4504efe29.slice/crio-0a78ca02f52c8e5129cd6b48beb0779c7e4c22a5f73f0edc7ebe91293b8800e0 WatchSource:0}: Error finding container 0a78ca02f52c8e5129cd6b48beb0779c7e4c22a5f73f0edc7ebe91293b8800e0: Status 404 returned error can't find the container with id 0a78ca02f52c8e5129cd6b48beb0779c7e4c22a5f73f0edc7ebe91293b8800e0
Aug 04 22:27:25.497495 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:25.497461    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="581da9eb-d79f-40a2-af76-6758135a8b9c" path="/var/lib/kubelet/pods/581da9eb-d79f-40a2-af76-6758135a8b9c/volumes"
Aug 04 22:27:25.854770 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:25.854738    2580 generic.go:356] "Generic (PLEG): container finished" podID="38bcb81e-e4a1-4ea4-99ec-91c4504efe29" containerID="d32fc373bb0e9620c4b3ff89661a2b89cc3512c02154a6287f1606982de393f7" exitCode=0
Aug 04 22:27:25.855217 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:25.854815    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"38bcb81e-e4a1-4ea4-99ec-91c4504efe29","Type":"ContainerDied","Data":"d32fc373bb0e9620c4b3ff89661a2b89cc3512c02154a6287f1606982de393f7"}
Aug 04 22:27:25.855217 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:25.854878    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"38bcb81e-e4a1-4ea4-99ec-91c4504efe29","Type":"ContainerStarted","Data":"0a78ca02f52c8e5129cd6b48beb0779c7e4c22a5f73f0edc7ebe91293b8800e0"}
Aug 04 22:27:26.863241 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:26.863206    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"38bcb81e-e4a1-4ea4-99ec-91c4504efe29","Type":"ContainerStarted","Data":"abf1aaafb34aa9c5a84e12349dc7e17d30d0787d33148e3acd1a575eca5f5c2a"}
Aug 04 22:27:26.863608 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:26.863300    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"38bcb81e-e4a1-4ea4-99ec-91c4504efe29","Type":"ContainerStarted","Data":"fbdb02a0c966898eaaacde8db31723d1f9089b590ded8e9f49d1fb02b37c86fa"}
Aug 04 22:27:26.863608 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:26.863326    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"38bcb81e-e4a1-4ea4-99ec-91c4504efe29","Type":"ContainerStarted","Data":"c5d00187bf85f08cbd953564ae27fdc21e6318b310bcbd89bc844af683aa8a0c"}
Aug 04 22:27:26.863608 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:26.863360    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"38bcb81e-e4a1-4ea4-99ec-91c4504efe29","Type":"ContainerStarted","Data":"2e9bcc23464ae7fe5f7855daff4c35895acdccc3940bc1ff314a08a843b49a9f"}
Aug 04 22:27:26.863608 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:26.863387    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"38bcb81e-e4a1-4ea4-99ec-91c4504efe29","Type":"ContainerStarted","Data":"b9b2427ed146e08d9633934da294f8636cb96de5f4cea0f31c94a53be36aaa3e"}
Aug 04 22:27:26.863608 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:26.863437    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"38bcb81e-e4a1-4ea4-99ec-91c4504efe29","Type":"ContainerStarted","Data":"008888d69f010e720756ce5cd067cd295edf3dd0686b5f5af34401d620d86135"}
Aug 04 22:27:26.888077 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:26.888022    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.869430596 podStartE2EDuration="2.888006009s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.575413ms" isStatefulPod=false podCreationTimestamp="2026-08-04 22:27:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 22:27:26.886431288 +0000 UTC m=+393.879249017" watchObservedRunningTime="2026-08-04 22:27:26.888006009 +0000 UTC m=+393.880823736"
Aug 04 22:27:31.996524 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:31.996439    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-84bf8c5959-bwnmv"]
Aug 04 22:27:31.999012 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:31.998990    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84bf8c5959-bwnmv"
Aug 04 22:27:32.012043 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:32.012019    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-84bf8c5959-bwnmv"]
Aug 04 22:27:32.072480 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:32.072450    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3dbf9394-ec01-4782-89fc-f424bc7cabe7-console-oauth-config\") pod \"console-84bf8c5959-bwnmv\" (UID: \"3dbf9394-ec01-4782-89fc-f424bc7cabe7\") " pod="openshift-console/console-84bf8c5959-bwnmv"
Aug 04 22:27:32.072618 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:32.072491    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3dbf9394-ec01-4782-89fc-f424bc7cabe7-trusted-ca-bundle\") pod \"console-84bf8c5959-bwnmv\" (UID: \"3dbf9394-ec01-4782-89fc-f424bc7cabe7\") " pod="openshift-console/console-84bf8c5959-bwnmv"
Aug 04 22:27:32.072618 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:32.072568    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2d2q8\" (UniqueName: \"kubernetes.io/projected/3dbf9394-ec01-4782-89fc-f424bc7cabe7-kube-api-access-2d2q8\") pod \"console-84bf8c5959-bwnmv\" (UID: \"3dbf9394-ec01-4782-89fc-f424bc7cabe7\") " pod="openshift-console/console-84bf8c5959-bwnmv"
Aug 04 22:27:32.072618 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:32.072588    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3dbf9394-ec01-4782-89fc-f424bc7cabe7-oauth-serving-cert\") pod \"console-84bf8c5959-bwnmv\" (UID: \"3dbf9394-ec01-4782-89fc-f424bc7cabe7\") " pod="openshift-console/console-84bf8c5959-bwnmv"
Aug 04 22:27:32.072618 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:32.072608    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3dbf9394-ec01-4782-89fc-f424bc7cabe7-console-config\") pod \"console-84bf8c5959-bwnmv\" (UID: \"3dbf9394-ec01-4782-89fc-f424bc7cabe7\") " pod="openshift-console/console-84bf8c5959-bwnmv"
Aug 04 22:27:32.072738 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:32.072692    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3dbf9394-ec01-4782-89fc-f424bc7cabe7-console-serving-cert\") pod \"console-84bf8c5959-bwnmv\" (UID: \"3dbf9394-ec01-4782-89fc-f424bc7cabe7\") " pod="openshift-console/console-84bf8c5959-bwnmv"
Aug 04 22:27:32.072738 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:32.072724    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3dbf9394-ec01-4782-89fc-f424bc7cabe7-service-ca\") pod \"console-84bf8c5959-bwnmv\" (UID: \"3dbf9394-ec01-4782-89fc-f424bc7cabe7\") " pod="openshift-console/console-84bf8c5959-bwnmv"
Aug 04 22:27:32.173595 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:32.173558    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2d2q8\" (UniqueName: \"kubernetes.io/projected/3dbf9394-ec01-4782-89fc-f424bc7cabe7-kube-api-access-2d2q8\") pod \"console-84bf8c5959-bwnmv\" (UID: \"3dbf9394-ec01-4782-89fc-f424bc7cabe7\") " pod="openshift-console/console-84bf8c5959-bwnmv"
Aug 04 22:27:32.173738 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:32.173599    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3dbf9394-ec01-4782-89fc-f424bc7cabe7-oauth-serving-cert\") pod \"console-84bf8c5959-bwnmv\" (UID: \"3dbf9394-ec01-4782-89fc-f424bc7cabe7\") " pod="openshift-console/console-84bf8c5959-bwnmv"
Aug 04 22:27:32.173738 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:32.173711    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3dbf9394-ec01-4782-89fc-f424bc7cabe7-console-config\") pod \"console-84bf8c5959-bwnmv\" (UID: \"3dbf9394-ec01-4782-89fc-f424bc7cabe7\") " pod="openshift-console/console-84bf8c5959-bwnmv"
Aug 04 22:27:32.173883 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:32.173743    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3dbf9394-ec01-4782-89fc-f424bc7cabe7-console-serving-cert\") pod \"console-84bf8c5959-bwnmv\" (UID: \"3dbf9394-ec01-4782-89fc-f424bc7cabe7\") " pod="openshift-console/console-84bf8c5959-bwnmv"
Aug 04 22:27:32.173883 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:32.173760    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3dbf9394-ec01-4782-89fc-f424bc7cabe7-service-ca\") pod \"console-84bf8c5959-bwnmv\" (UID: \"3dbf9394-ec01-4782-89fc-f424bc7cabe7\") " pod="openshift-console/console-84bf8c5959-bwnmv"
Aug 04 22:27:32.173883 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:32.173785    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3dbf9394-ec01-4782-89fc-f424bc7cabe7-console-oauth-config\") pod \"console-84bf8c5959-bwnmv\" (UID: \"3dbf9394-ec01-4782-89fc-f424bc7cabe7\") " pod="openshift-console/console-84bf8c5959-bwnmv"
Aug 04 22:27:32.173883 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:32.173837    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3dbf9394-ec01-4782-89fc-f424bc7cabe7-trusted-ca-bundle\") pod \"console-84bf8c5959-bwnmv\" (UID: \"3dbf9394-ec01-4782-89fc-f424bc7cabe7\") " pod="openshift-console/console-84bf8c5959-bwnmv"
Aug 04 22:27:32.174420 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:32.174398    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3dbf9394-ec01-4782-89fc-f424bc7cabe7-console-config\") pod \"console-84bf8c5959-bwnmv\" (UID: \"3dbf9394-ec01-4782-89fc-f424bc7cabe7\") " pod="openshift-console/console-84bf8c5959-bwnmv"
Aug 04 22:27:32.174526 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:32.174418    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3dbf9394-ec01-4782-89fc-f424bc7cabe7-oauth-serving-cert\") pod \"console-84bf8c5959-bwnmv\" (UID: \"3dbf9394-ec01-4782-89fc-f424bc7cabe7\") " pod="openshift-console/console-84bf8c5959-bwnmv"
Aug 04 22:27:32.174600 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:32.174577    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3dbf9394-ec01-4782-89fc-f424bc7cabe7-service-ca\") pod \"console-84bf8c5959-bwnmv\" (UID: \"3dbf9394-ec01-4782-89fc-f424bc7cabe7\") " pod="openshift-console/console-84bf8c5959-bwnmv"
Aug 04 22:27:32.174681 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:32.174667    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3dbf9394-ec01-4782-89fc-f424bc7cabe7-trusted-ca-bundle\") pod \"console-84bf8c5959-bwnmv\" (UID: \"3dbf9394-ec01-4782-89fc-f424bc7cabe7\") " pod="openshift-console/console-84bf8c5959-bwnmv"
Aug 04 22:27:32.176214 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:32.176188    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3dbf9394-ec01-4782-89fc-f424bc7cabe7-console-serving-cert\") pod \"console-84bf8c5959-bwnmv\" (UID: \"3dbf9394-ec01-4782-89fc-f424bc7cabe7\") " pod="openshift-console/console-84bf8c5959-bwnmv"
Aug 04 22:27:32.176300 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:32.176253    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3dbf9394-ec01-4782-89fc-f424bc7cabe7-console-oauth-config\") pod \"console-84bf8c5959-bwnmv\" (UID: \"3dbf9394-ec01-4782-89fc-f424bc7cabe7\") " pod="openshift-console/console-84bf8c5959-bwnmv"
Aug 04 22:27:32.180757 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:32.180732    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2d2q8\" (UniqueName: \"kubernetes.io/projected/3dbf9394-ec01-4782-89fc-f424bc7cabe7-kube-api-access-2d2q8\") pod \"console-84bf8c5959-bwnmv\" (UID: \"3dbf9394-ec01-4782-89fc-f424bc7cabe7\") " pod="openshift-console/console-84bf8c5959-bwnmv"
Aug 04 22:27:32.308316 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:32.308279    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84bf8c5959-bwnmv"
Aug 04 22:27:32.434285 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:32.434260    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-84bf8c5959-bwnmv"]
Aug 04 22:27:32.436750 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:27:32.436727    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3dbf9394_ec01_4782_89fc_f424bc7cabe7.slice/crio-228b6c07c7b94e590c2ecf25bb0e34068edce63bed2b92c3a844e3c2f9ac3846 WatchSource:0}: Error finding container 228b6c07c7b94e590c2ecf25bb0e34068edce63bed2b92c3a844e3c2f9ac3846: Status 404 returned error can't find the container with id 228b6c07c7b94e590c2ecf25bb0e34068edce63bed2b92c3a844e3c2f9ac3846
Aug 04 22:27:32.889215 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:32.889173    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84bf8c5959-bwnmv" event={"ID":"3dbf9394-ec01-4782-89fc-f424bc7cabe7","Type":"ContainerStarted","Data":"96f34373f37c5df581205cfcab8297fc6e4d45c465f649fa7e822ce2e6a04ca2"}
Aug 04 22:27:32.889395 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:32.889223    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84bf8c5959-bwnmv" event={"ID":"3dbf9394-ec01-4782-89fc-f424bc7cabe7","Type":"ContainerStarted","Data":"228b6c07c7b94e590c2ecf25bb0e34068edce63bed2b92c3a844e3c2f9ac3846"}
Aug 04 22:27:32.906429 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:32.906386    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-84bf8c5959-bwnmv" podStartSLOduration=1.906371603 podStartE2EDuration="1.906371603s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 22:27:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 22:27:32.904792062 +0000 UTC m=+399.897609790" watchObservedRunningTime="2026-08-04 22:27:32.906371603 +0000 UTC m=+399.899189330"
Aug 04 22:27:37.356928 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:27:37.356880    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-f77f48c6d-ghcnq" podUID="771ddd03-8847-4587-bd07-96d0b0dccac5"
Aug 04 22:27:37.908867 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:37.908828    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-f77f48c6d-ghcnq"
Aug 04 22:27:39.938611 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:39.938579    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/771ddd03-8847-4587-bd07-96d0b0dccac5-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-ghcnq\" (UID: \"771ddd03-8847-4587-bd07-96d0b0dccac5\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-ghcnq"
Aug 04 22:27:39.940881 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:39.940856    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/771ddd03-8847-4587-bd07-96d0b0dccac5-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-ghcnq\" (UID: \"771ddd03-8847-4587-bd07-96d0b0dccac5\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-ghcnq"
Aug 04 22:27:40.012343 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:40.012320    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-fgls5\""
Aug 04 22:27:40.020184 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:40.020166    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-f77f48c6d-ghcnq"
Aug 04 22:27:40.140858 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:40.140825    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-f77f48c6d-ghcnq"]
Aug 04 22:27:40.144326 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:27:40.144296    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod771ddd03_8847_4587_bd07_96d0b0dccac5.slice/crio-3b22629ee6a23a8338088a9e19e4cecaf06a35f2c01eb9ae7aad337e84279314 WatchSource:0}: Error finding container 3b22629ee6a23a8338088a9e19e4cecaf06a35f2c01eb9ae7aad337e84279314: Status 404 returned error can't find the container with id 3b22629ee6a23a8338088a9e19e4cecaf06a35f2c01eb9ae7aad337e84279314
Aug 04 22:27:40.924858 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:40.924761    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-f77f48c6d-ghcnq" event={"ID":"771ddd03-8847-4587-bd07-96d0b0dccac5","Type":"ContainerStarted","Data":"3b22629ee6a23a8338088a9e19e4cecaf06a35f2c01eb9ae7aad337e84279314"}
Aug 04 22:27:41.931324 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:41.931289    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-f77f48c6d-ghcnq" event={"ID":"771ddd03-8847-4587-bd07-96d0b0dccac5","Type":"ContainerStarted","Data":"7895f51a21eb5127fbf8f8c28df165eaf0d3d007d63fb77cb9098414975b7295"}
Aug 04 22:27:41.946561 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:41.946492    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-f77f48c6d-ghcnq" podStartSLOduration=400.906718296 podStartE2EDuration="6m41.94648053s" totalImagesPullingTime="1.039762234s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 22:21:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 22:27:41.945910702 +0000 UTC m=+408.938728430" watchObservedRunningTime="2026-08-04 22:27:41.94648053 +0000 UTC m=+408.939298257"
Aug 04 22:27:42.308996 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:42.308966    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-84bf8c5959-bwnmv"
Aug 04 22:27:42.309167 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:42.309033    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-84bf8c5959-bwnmv"
Aug 04 22:27:42.313812 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:42.313781    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-84bf8c5959-bwnmv"
Aug 04 22:27:42.939487 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:42.939460    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-84bf8c5959-bwnmv"
Aug 04 22:27:42.983461 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:27:42.983431    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7bbbdbb76b-gx2vd"]
Aug 04 22:28:07.844760 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:07.844718    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nt5zm"]
Aug 04 22:28:07.848330 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:07.848308    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nt5zm"
Aug 04 22:28:07.850527 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:07.850499    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Aug 04 22:28:07.850527 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:07.850520    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-692hh\""
Aug 04 22:28:07.851337 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:07.851321    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Aug 04 22:28:07.856077 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:07.856056    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nt5zm"]
Aug 04 22:28:07.868465 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:07.868437    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rfmbr\" (UniqueName: \"kubernetes.io/projected/8c2036c5-806e-4444-bb2b-a3390dd6b340-kube-api-access-rfmbr\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nt5zm\" (UID: \"8c2036c5-806e-4444-bb2b-a3390dd6b340\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nt5zm"
Aug 04 22:28:07.868585 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:07.868494    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8c2036c5-806e-4444-bb2b-a3390dd6b340-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nt5zm\" (UID: \"8c2036c5-806e-4444-bb2b-a3390dd6b340\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nt5zm"
Aug 04 22:28:07.868585 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:07.868564    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8c2036c5-806e-4444-bb2b-a3390dd6b340-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nt5zm\" (UID: \"8c2036c5-806e-4444-bb2b-a3390dd6b340\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nt5zm"
Aug 04 22:28:07.969184 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:07.969152    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8c2036c5-806e-4444-bb2b-a3390dd6b340-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nt5zm\" (UID: \"8c2036c5-806e-4444-bb2b-a3390dd6b340\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nt5zm"
Aug 04 22:28:07.969341 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:07.969225    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8c2036c5-806e-4444-bb2b-a3390dd6b340-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nt5zm\" (UID: \"8c2036c5-806e-4444-bb2b-a3390dd6b340\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nt5zm"
Aug 04 22:28:07.969341 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:07.969282    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rfmbr\" (UniqueName: \"kubernetes.io/projected/8c2036c5-806e-4444-bb2b-a3390dd6b340-kube-api-access-rfmbr\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nt5zm\" (UID: \"8c2036c5-806e-4444-bb2b-a3390dd6b340\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nt5zm"
Aug 04 22:28:07.969599 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:07.969577    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8c2036c5-806e-4444-bb2b-a3390dd6b340-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nt5zm\" (UID: \"8c2036c5-806e-4444-bb2b-a3390dd6b340\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nt5zm"
Aug 04 22:28:07.969635 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:07.969590    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8c2036c5-806e-4444-bb2b-a3390dd6b340-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nt5zm\" (UID: \"8c2036c5-806e-4444-bb2b-a3390dd6b340\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nt5zm"
Aug 04 22:28:07.977993 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:07.977972    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rfmbr\" (UniqueName: \"kubernetes.io/projected/8c2036c5-806e-4444-bb2b-a3390dd6b340-kube-api-access-rfmbr\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nt5zm\" (UID: \"8c2036c5-806e-4444-bb2b-a3390dd6b340\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nt5zm"
Aug 04 22:28:08.002931 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:08.002898    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7bbbdbb76b-gx2vd" podUID="71351feb-8c6b-490c-b5bd-1d342838901c" containerName="console" containerID="cri-o://6e8cce377be888a15a409b58fe68ac1a2b80bb43982c078e7d27a8e0c03dceb2" gracePeriod=15
Aug 04 22:28:08.158290 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:08.158254    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nt5zm"
Aug 04 22:28:08.264833 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:08.264805    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bbbdbb76b-gx2vd"
Aug 04 22:28:08.273202 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:08.273180    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/71351feb-8c6b-490c-b5bd-1d342838901c-console-oauth-config\") pod \"71351feb-8c6b-490c-b5bd-1d342838901c\" (UID: \"71351feb-8c6b-490c-b5bd-1d342838901c\") "
Aug 04 22:28:08.273345 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:08.273236    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/71351feb-8c6b-490c-b5bd-1d342838901c-service-ca\") pod \"71351feb-8c6b-490c-b5bd-1d342838901c\" (UID: \"71351feb-8c6b-490c-b5bd-1d342838901c\") "
Aug 04 22:28:08.273345 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:08.273277    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/71351feb-8c6b-490c-b5bd-1d342838901c-console-serving-cert\") pod \"71351feb-8c6b-490c-b5bd-1d342838901c\" (UID: \"71351feb-8c6b-490c-b5bd-1d342838901c\") "
Aug 04 22:28:08.273345 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:08.273301    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/71351feb-8c6b-490c-b5bd-1d342838901c-console-config\") pod \"71351feb-8c6b-490c-b5bd-1d342838901c\" (UID: \"71351feb-8c6b-490c-b5bd-1d342838901c\") "
Aug 04 22:28:08.273345 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:08.273340    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/71351feb-8c6b-490c-b5bd-1d342838901c-oauth-serving-cert\") pod \"71351feb-8c6b-490c-b5bd-1d342838901c\" (UID: \"71351feb-8c6b-490c-b5bd-1d342838901c\") "
Aug 04 22:28:08.273655 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:08.273631    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/71351feb-8c6b-490c-b5bd-1d342838901c-trusted-ca-bundle\") pod \"71351feb-8c6b-490c-b5bd-1d342838901c\" (UID: \"71351feb-8c6b-490c-b5bd-1d342838901c\") "
Aug 04 22:28:08.273793 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:08.273702    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qtg9v\" (UniqueName: \"kubernetes.io/projected/71351feb-8c6b-490c-b5bd-1d342838901c-kube-api-access-qtg9v\") pod \"71351feb-8c6b-490c-b5bd-1d342838901c\" (UID: \"71351feb-8c6b-490c-b5bd-1d342838901c\") "
Aug 04 22:28:08.273793 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:08.273718    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/71351feb-8c6b-490c-b5bd-1d342838901c-service-ca" (OuterVolumeSpecName: "service-ca") pod "71351feb-8c6b-490c-b5bd-1d342838901c" (UID: "71351feb-8c6b-490c-b5bd-1d342838901c"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 22:28:08.273993 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:08.273747    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/71351feb-8c6b-490c-b5bd-1d342838901c-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "71351feb-8c6b-490c-b5bd-1d342838901c" (UID: "71351feb-8c6b-490c-b5bd-1d342838901c"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 22:28:08.273993 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:08.273754    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/71351feb-8c6b-490c-b5bd-1d342838901c-console-config" (OuterVolumeSpecName: "console-config") pod "71351feb-8c6b-490c-b5bd-1d342838901c" (UID: "71351feb-8c6b-490c-b5bd-1d342838901c"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 22:28:08.274146 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:08.274117    2580 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/71351feb-8c6b-490c-b5bd-1d342838901c-service-ca\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
Aug 04 22:28:08.274255 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:08.274149    2580 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/71351feb-8c6b-490c-b5bd-1d342838901c-console-config\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
Aug 04 22:28:08.274255 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:08.274159    2580 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/71351feb-8c6b-490c-b5bd-1d342838901c-oauth-serving-cert\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
Aug 04 22:28:08.274255 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:08.274185    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/71351feb-8c6b-490c-b5bd-1d342838901c-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "71351feb-8c6b-490c-b5bd-1d342838901c" (UID: "71351feb-8c6b-490c-b5bd-1d342838901c"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 22:28:08.276383 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:08.276323    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/71351feb-8c6b-490c-b5bd-1d342838901c-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "71351feb-8c6b-490c-b5bd-1d342838901c" (UID: "71351feb-8c6b-490c-b5bd-1d342838901c"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 22:28:08.276383 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:08.276326    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/71351feb-8c6b-490c-b5bd-1d342838901c-kube-api-access-qtg9v" (OuterVolumeSpecName: "kube-api-access-qtg9v") pod "71351feb-8c6b-490c-b5bd-1d342838901c" (UID: "71351feb-8c6b-490c-b5bd-1d342838901c"). InnerVolumeSpecName "kube-api-access-qtg9v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 22:28:08.276547 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:08.276379    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/71351feb-8c6b-490c-b5bd-1d342838901c-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "71351feb-8c6b-490c-b5bd-1d342838901c" (UID: "71351feb-8c6b-490c-b5bd-1d342838901c"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 22:28:08.307604 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:08.307582    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nt5zm"]
Aug 04 22:28:08.309654 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:28:08.309628    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c2036c5_806e_4444_bb2b_a3390dd6b340.slice/crio-c2cf23e090b36595ff72ed94db01e471ebf688ad00087445e2b62e49939e2e14 WatchSource:0}: Error finding container c2cf23e090b36595ff72ed94db01e471ebf688ad00087445e2b62e49939e2e14: Status 404 returned error can't find the container with id c2cf23e090b36595ff72ed94db01e471ebf688ad00087445e2b62e49939e2e14
Aug 04 22:28:08.374736 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:08.374653    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qtg9v\" (UniqueName: \"kubernetes.io/projected/71351feb-8c6b-490c-b5bd-1d342838901c-kube-api-access-qtg9v\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
Aug 04 22:28:08.374736 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:08.374681    2580 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/71351feb-8c6b-490c-b5bd-1d342838901c-console-oauth-config\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
Aug 04 22:28:08.374736 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:08.374690    2580 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/71351feb-8c6b-490c-b5bd-1d342838901c-console-serving-cert\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
Aug 04 22:28:08.374736 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:08.374698    2580 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/71351feb-8c6b-490c-b5bd-1d342838901c-trusted-ca-bundle\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
Aug 04 22:28:09.040612 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:09.040562    2580 generic.go:356] "Generic (PLEG): container finished" podID="71351feb-8c6b-490c-b5bd-1d342838901c" containerID="6e8cce377be888a15a409b58fe68ac1a2b80bb43982c078e7d27a8e0c03dceb2" exitCode=0
Aug 04 22:28:09.040612 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:09.040614    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bbbdbb76b-gx2vd"
Aug 04 22:28:09.041198 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:09.040653    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bbbdbb76b-gx2vd" event={"ID":"71351feb-8c6b-490c-b5bd-1d342838901c","Type":"ContainerDied","Data":"6e8cce377be888a15a409b58fe68ac1a2b80bb43982c078e7d27a8e0c03dceb2"}
Aug 04 22:28:09.041198 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:09.040711    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bbbdbb76b-gx2vd" event={"ID":"71351feb-8c6b-490c-b5bd-1d342838901c","Type":"ContainerDied","Data":"febaa8dfc9c155b272ca89580f9680eaaa3d5c298086d3eeab3d5ebcd535cdc3"}
Aug 04 22:28:09.041198 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:09.040742    2580 scope.go:117] "RemoveContainer" containerID="6e8cce377be888a15a409b58fe68ac1a2b80bb43982c078e7d27a8e0c03dceb2"
Aug 04 22:28:09.042282 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:09.042061    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nt5zm" event={"ID":"8c2036c5-806e-4444-bb2b-a3390dd6b340","Type":"ContainerStarted","Data":"c2cf23e090b36595ff72ed94db01e471ebf688ad00087445e2b62e49939e2e14"}
Aug 04 22:28:09.050742 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:09.050725    2580 scope.go:117] "RemoveContainer" containerID="6e8cce377be888a15a409b58fe68ac1a2b80bb43982c078e7d27a8e0c03dceb2"
Aug 04 22:28:09.051036 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:28:09.051011    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6e8cce377be888a15a409b58fe68ac1a2b80bb43982c078e7d27a8e0c03dceb2\": container with ID starting with 6e8cce377be888a15a409b58fe68ac1a2b80bb43982c078e7d27a8e0c03dceb2 not found: ID does not exist" containerID="6e8cce377be888a15a409b58fe68ac1a2b80bb43982c078e7d27a8e0c03dceb2"
Aug 04 22:28:09.051117 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:09.051046    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6e8cce377be888a15a409b58fe68ac1a2b80bb43982c078e7d27a8e0c03dceb2"} err="failed to get container status \"6e8cce377be888a15a409b58fe68ac1a2b80bb43982c078e7d27a8e0c03dceb2\": rpc error: code = NotFound desc = could not find container \"6e8cce377be888a15a409b58fe68ac1a2b80bb43982c078e7d27a8e0c03dceb2\": container with ID starting with 6e8cce377be888a15a409b58fe68ac1a2b80bb43982c078e7d27a8e0c03dceb2 not found: ID does not exist"
Aug 04 22:28:09.062802 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:09.062773    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7bbbdbb76b-gx2vd"]
Aug 04 22:28:09.066210 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:09.066184    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7bbbdbb76b-gx2vd"]
Aug 04 22:28:09.499557 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:09.499519    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="71351feb-8c6b-490c-b5bd-1d342838901c" path="/var/lib/kubelet/pods/71351feb-8c6b-490c-b5bd-1d342838901c/volumes"
Aug 04 22:28:15.071250 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:15.071209    2580 generic.go:356] "Generic (PLEG): container finished" podID="8c2036c5-806e-4444-bb2b-a3390dd6b340" containerID="6de66f12791da83c4e254fcb153f0f72c53b5cd284816f7265b14740895b6b21" exitCode=0
Aug 04 22:28:15.071627 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:15.071261    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nt5zm" event={"ID":"8c2036c5-806e-4444-bb2b-a3390dd6b340","Type":"ContainerDied","Data":"6de66f12791da83c4e254fcb153f0f72c53b5cd284816f7265b14740895b6b21"}
Aug 04 22:28:18.086400 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:18.086363    2580 generic.go:356] "Generic (PLEG): container finished" podID="8c2036c5-806e-4444-bb2b-a3390dd6b340" containerID="eca60a1bcda4ee8a08e82b25616ecc8a7a9355a69e34f1d4bcba233a7742c2e1" exitCode=0
Aug 04 22:28:18.086872 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:18.086407    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nt5zm" event={"ID":"8c2036c5-806e-4444-bb2b-a3390dd6b340","Type":"ContainerDied","Data":"eca60a1bcda4ee8a08e82b25616ecc8a7a9355a69e34f1d4bcba233a7742c2e1"}
Aug 04 22:28:24.117312 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:24.117273    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nt5zm" event={"ID":"8c2036c5-806e-4444-bb2b-a3390dd6b340","Type":"ContainerStarted","Data":"ae354a8447cf814281845dee0bd8d933140fd00ae59d538f8a1dc6ecf4cc5a69"}
Aug 04 22:28:24.133470 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:24.133415    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nt5zm" podStartSLOduration=3.36819364 podStartE2EDuration="17.133401271s" totalImagesPullingTime="13.765207631s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 22:28:07 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 22:28:24.132400646 +0000 UTC m=+451.125218397" watchObservedRunningTime="2026-08-04 22:28:24.133401271 +0000 UTC m=+451.126218998"
Aug 04 22:28:25.123301 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:25.123270    2580 generic.go:356] "Generic (PLEG): container finished" podID="8c2036c5-806e-4444-bb2b-a3390dd6b340" containerID="ae354a8447cf814281845dee0bd8d933140fd00ae59d538f8a1dc6ecf4cc5a69" exitCode=0
Aug 04 22:28:25.123745 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:25.123356    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nt5zm" event={"ID":"8c2036c5-806e-4444-bb2b-a3390dd6b340","Type":"ContainerDied","Data":"ae354a8447cf814281845dee0bd8d933140fd00ae59d538f8a1dc6ecf4cc5a69"}
Aug 04 22:28:26.256684 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:26.256659    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nt5zm"
Aug 04 22:28:26.334291 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:26.334255    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rfmbr\" (UniqueName: \"kubernetes.io/projected/8c2036c5-806e-4444-bb2b-a3390dd6b340-kube-api-access-rfmbr\") pod \"8c2036c5-806e-4444-bb2b-a3390dd6b340\" (UID: \"8c2036c5-806e-4444-bb2b-a3390dd6b340\") "
Aug 04 22:28:26.334460 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:26.334353    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8c2036c5-806e-4444-bb2b-a3390dd6b340-bundle\") pod \"8c2036c5-806e-4444-bb2b-a3390dd6b340\" (UID: \"8c2036c5-806e-4444-bb2b-a3390dd6b340\") "
Aug 04 22:28:26.334460 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:26.334372    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8c2036c5-806e-4444-bb2b-a3390dd6b340-util\") pod \"8c2036c5-806e-4444-bb2b-a3390dd6b340\" (UID: \"8c2036c5-806e-4444-bb2b-a3390dd6b340\") "
Aug 04 22:28:26.335012 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:26.334986    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c2036c5-806e-4444-bb2b-a3390dd6b340-bundle" (OuterVolumeSpecName: "bundle") pod "8c2036c5-806e-4444-bb2b-a3390dd6b340" (UID: "8c2036c5-806e-4444-bb2b-a3390dd6b340"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 22:28:26.336460 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:26.336438    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c2036c5-806e-4444-bb2b-a3390dd6b340-kube-api-access-rfmbr" (OuterVolumeSpecName: "kube-api-access-rfmbr") pod "8c2036c5-806e-4444-bb2b-a3390dd6b340" (UID: "8c2036c5-806e-4444-bb2b-a3390dd6b340"). InnerVolumeSpecName "kube-api-access-rfmbr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 22:28:26.339091 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:26.339065    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c2036c5-806e-4444-bb2b-a3390dd6b340-util" (OuterVolumeSpecName: "util") pod "8c2036c5-806e-4444-bb2b-a3390dd6b340" (UID: "8c2036c5-806e-4444-bb2b-a3390dd6b340"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 22:28:26.435321 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:26.435231    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rfmbr\" (UniqueName: \"kubernetes.io/projected/8c2036c5-806e-4444-bb2b-a3390dd6b340-kube-api-access-rfmbr\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
Aug 04 22:28:26.435321 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:26.435263    2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8c2036c5-806e-4444-bb2b-a3390dd6b340-bundle\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
Aug 04 22:28:26.435321 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:26.435273    2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8c2036c5-806e-4444-bb2b-a3390dd6b340-util\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
Aug 04 22:28:27.138274 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:27.138236    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nt5zm" event={"ID":"8c2036c5-806e-4444-bb2b-a3390dd6b340","Type":"ContainerDied","Data":"c2cf23e090b36595ff72ed94db01e471ebf688ad00087445e2b62e49939e2e14"}
Aug 04 22:28:27.138274 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:27.138277    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540nt5zm"
Aug 04 22:28:27.138476 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:27.138286    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c2cf23e090b36595ff72ed94db01e471ebf688ad00087445e2b62e49939e2e14"
Aug 04 22:28:30.736978 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:30.736947    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-64l95"]
Aug 04 22:28:30.737369 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:30.737330    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c2036c5-806e-4444-bb2b-a3390dd6b340" containerName="util"
Aug 04 22:28:30.737369 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:30.737347    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c2036c5-806e-4444-bb2b-a3390dd6b340" containerName="util"
Aug 04 22:28:30.737369 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:30.737365    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71351feb-8c6b-490c-b5bd-1d342838901c" containerName="console"
Aug 04 22:28:30.737369 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:30.737371    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="71351feb-8c6b-490c-b5bd-1d342838901c" containerName="console"
Aug 04 22:28:30.737506 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:30.737391    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c2036c5-806e-4444-bb2b-a3390dd6b340" containerName="pull"
Aug 04 22:28:30.737506 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:30.737396    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c2036c5-806e-4444-bb2b-a3390dd6b340" containerName="pull"
Aug 04 22:28:30.737506 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:30.737403    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c2036c5-806e-4444-bb2b-a3390dd6b340" containerName="extract"
Aug 04 22:28:30.737506 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:30.737408    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c2036c5-806e-4444-bb2b-a3390dd6b340" containerName="extract"
Aug 04 22:28:30.737506 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:30.737460    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="8c2036c5-806e-4444-bb2b-a3390dd6b340" containerName="extract"
Aug 04 22:28:30.737506 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:30.737470    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="71351feb-8c6b-490c-b5bd-1d342838901c" containerName="console"
Aug 04 22:28:30.779245 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:30.779208    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-64l95"]
Aug 04 22:28:30.779404 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:30.779311    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-64l95"
Aug 04 22:28:30.782589 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:30.782564    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-lzl6x\""
Aug 04 22:28:30.782702 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:30.782620    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Aug 04 22:28:30.782702 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:30.782573    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Aug 04 22:28:30.872040 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:30.872005    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-drjcj\" (UniqueName: \"kubernetes.io/projected/d7f4fe83-6c22-4a90-b2fc-337f3d1d9ae6-kube-api-access-drjcj\") pod \"cert-manager-operator-controller-manager-55c444bf86-64l95\" (UID: \"d7f4fe83-6c22-4a90-b2fc-337f3d1d9ae6\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-64l95"
Aug 04 22:28:30.872218 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:30.872050    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d7f4fe83-6c22-4a90-b2fc-337f3d1d9ae6-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-64l95\" (UID: \"d7f4fe83-6c22-4a90-b2fc-337f3d1d9ae6\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-64l95"
Aug 04 22:28:30.972540 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:30.972507    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-drjcj\" (UniqueName: \"kubernetes.io/projected/d7f4fe83-6c22-4a90-b2fc-337f3d1d9ae6-kube-api-access-drjcj\") pod \"cert-manager-operator-controller-manager-55c444bf86-64l95\" (UID: \"d7f4fe83-6c22-4a90-b2fc-337f3d1d9ae6\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-64l95"
Aug 04 22:28:30.972679 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:30.972556    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d7f4fe83-6c22-4a90-b2fc-337f3d1d9ae6-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-64l95\" (UID: \"d7f4fe83-6c22-4a90-b2fc-337f3d1d9ae6\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-64l95"
Aug 04 22:28:30.972974 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:30.972957    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d7f4fe83-6c22-4a90-b2fc-337f3d1d9ae6-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-64l95\" (UID: \"d7f4fe83-6c22-4a90-b2fc-337f3d1d9ae6\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-64l95"
Aug 04 22:28:30.980731 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:30.980713    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-drjcj\" (UniqueName: \"kubernetes.io/projected/d7f4fe83-6c22-4a90-b2fc-337f3d1d9ae6-kube-api-access-drjcj\") pod \"cert-manager-operator-controller-manager-55c444bf86-64l95\" (UID: \"d7f4fe83-6c22-4a90-b2fc-337f3d1d9ae6\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-64l95"
Aug 04 22:28:31.088687 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:31.088659    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-64l95"
Aug 04 22:28:31.247471 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:31.247441    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-64l95"]
Aug 04 22:28:31.250403 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:28:31.250372    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7f4fe83_6c22_4a90_b2fc_337f3d1d9ae6.slice/crio-b979ccf8d16283e97bae9c1bb38d13d8c34554708c2fcdc77dfc76386bd04746 WatchSource:0}: Error finding container b979ccf8d16283e97bae9c1bb38d13d8c34554708c2fcdc77dfc76386bd04746: Status 404 returned error can't find the container with id b979ccf8d16283e97bae9c1bb38d13d8c34554708c2fcdc77dfc76386bd04746
Aug 04 22:28:32.160079 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:32.160042    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-64l95" event={"ID":"d7f4fe83-6c22-4a90-b2fc-337f3d1d9ae6","Type":"ContainerStarted","Data":"b979ccf8d16283e97bae9c1bb38d13d8c34554708c2fcdc77dfc76386bd04746"}
Aug 04 22:28:35.109930 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:35.109895    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-fwqcg"]
Aug 04 22:28:35.134024 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:35.133989    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-fwqcg"]
Aug 04 22:28:35.134184 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:35.134097    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-fwqcg"
Aug 04 22:28:35.136453 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:35.136427    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Aug 04 22:28:35.137188 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:35.137169    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Aug 04 22:28:35.137262 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:35.137169    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-btffs\""
Aug 04 22:28:35.176113 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:35.176084    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-64l95" event={"ID":"d7f4fe83-6c22-4a90-b2fc-337f3d1d9ae6","Type":"ContainerStarted","Data":"ff1713e9b6cacd8c91a77791a870da93d2dcaab2901d27a9931ca1a844d0101b"}
Aug 04 22:28:35.193327 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:35.193282    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-64l95" podStartSLOduration=2.269933984 podStartE2EDuration="5.193267335s" totalImagesPullingTime="2.923333351s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 22:28:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 22:28:35.192362213 +0000 UTC m=+462.185179941" watchObservedRunningTime="2026-08-04 22:28:35.193267335 +0000 UTC m=+462.186085063"
Aug 04 22:28:35.209231 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:35.209197    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zz42x\" (UniqueName: \"kubernetes.io/projected/0e2a4957-489a-4032-b8e4-a35d8359521b-kube-api-access-zz42x\") pod \"cert-manager-webhook-6486ffd997-fwqcg\" (UID: \"0e2a4957-489a-4032-b8e4-a35d8359521b\") " pod="cert-manager/cert-manager-webhook-6486ffd997-fwqcg"
Aug 04 22:28:35.209368 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:35.209302    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0e2a4957-489a-4032-b8e4-a35d8359521b-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-fwqcg\" (UID: \"0e2a4957-489a-4032-b8e4-a35d8359521b\") " pod="cert-manager/cert-manager-webhook-6486ffd997-fwqcg"
Aug 04 22:28:35.310425 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:35.310383    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0e2a4957-489a-4032-b8e4-a35d8359521b-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-fwqcg\" (UID: \"0e2a4957-489a-4032-b8e4-a35d8359521b\") " pod="cert-manager/cert-manager-webhook-6486ffd997-fwqcg"
Aug 04 22:28:35.310597 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:35.310478    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zz42x\" (UniqueName: \"kubernetes.io/projected/0e2a4957-489a-4032-b8e4-a35d8359521b-kube-api-access-zz42x\") pod \"cert-manager-webhook-6486ffd997-fwqcg\" (UID: \"0e2a4957-489a-4032-b8e4-a35d8359521b\") " pod="cert-manager/cert-manager-webhook-6486ffd997-fwqcg"
Aug 04 22:28:35.320479 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:35.320452    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zz42x\" (UniqueName: \"kubernetes.io/projected/0e2a4957-489a-4032-b8e4-a35d8359521b-kube-api-access-zz42x\") pod \"cert-manager-webhook-6486ffd997-fwqcg\" (UID: \"0e2a4957-489a-4032-b8e4-a35d8359521b\") " pod="cert-manager/cert-manager-webhook-6486ffd997-fwqcg"
Aug 04 22:28:35.320584 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:35.320490    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0e2a4957-489a-4032-b8e4-a35d8359521b-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-fwqcg\" (UID: \"0e2a4957-489a-4032-b8e4-a35d8359521b\") " pod="cert-manager/cert-manager-webhook-6486ffd997-fwqcg"
Aug 04 22:28:35.455477 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:35.455388    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-fwqcg"
Aug 04 22:28:35.618990 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:35.618962    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-fwqcg"]
Aug 04 22:28:35.625368 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:28:35.623832    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0e2a4957_489a_4032_b8e4_a35d8359521b.slice/crio-e431f856bb75d56d268f0e7ce052cff17bcb979ced0714f0e32e7470e85371cb WatchSource:0}: Error finding container e431f856bb75d56d268f0e7ce052cff17bcb979ced0714f0e32e7470e85371cb: Status 404 returned error can't find the container with id e431f856bb75d56d268f0e7ce052cff17bcb979ced0714f0e32e7470e85371cb
Aug 04 22:28:35.747020 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:35.746941    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp6zxn"]
Aug 04 22:28:35.776569 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:35.776530    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp6zxn"]
Aug 04 22:28:35.776718 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:35.776647    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp6zxn"
Aug 04 22:28:35.779796 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:35.779775    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-692hh\""
Aug 04 22:28:35.779959 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:35.779944    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Aug 04 22:28:35.780174 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:35.780160    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Aug 04 22:28:35.915262 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:35.915231    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/122c925a-8193-4d9c-bc28-9f6f826c8753-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp6zxn\" (UID: \"122c925a-8193-4d9c-bc28-9f6f826c8753\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp6zxn"
Aug 04 22:28:35.915437 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:35.915285    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/122c925a-8193-4d9c-bc28-9f6f826c8753-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp6zxn\" (UID: \"122c925a-8193-4d9c-bc28-9f6f826c8753\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp6zxn"
Aug 04 22:28:35.915437 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:35.915353    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dzzdv\" (UniqueName: \"kubernetes.io/projected/122c925a-8193-4d9c-bc28-9f6f826c8753-kube-api-access-dzzdv\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp6zxn\" (UID: \"122c925a-8193-4d9c-bc28-9f6f826c8753\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp6zxn"
Aug 04 22:28:36.016383 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:36.016309    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/122c925a-8193-4d9c-bc28-9f6f826c8753-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp6zxn\" (UID: \"122c925a-8193-4d9c-bc28-9f6f826c8753\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp6zxn"
Aug 04 22:28:36.016383 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:36.016359    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dzzdv\" (UniqueName: \"kubernetes.io/projected/122c925a-8193-4d9c-bc28-9f6f826c8753-kube-api-access-dzzdv\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp6zxn\" (UID: \"122c925a-8193-4d9c-bc28-9f6f826c8753\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp6zxn"
Aug 04 22:28:36.016587 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:36.016405    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/122c925a-8193-4d9c-bc28-9f6f826c8753-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp6zxn\" (UID: \"122c925a-8193-4d9c-bc28-9f6f826c8753\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp6zxn"
Aug 04 22:28:36.016779 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:36.016758    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/122c925a-8193-4d9c-bc28-9f6f826c8753-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp6zxn\" (UID: \"122c925a-8193-4d9c-bc28-9f6f826c8753\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp6zxn"
Aug 04 22:28:36.016871 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:36.016768    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/122c925a-8193-4d9c-bc28-9f6f826c8753-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp6zxn\" (UID: \"122c925a-8193-4d9c-bc28-9f6f826c8753\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp6zxn"
Aug 04 22:28:36.026577 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:36.026553    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dzzdv\" (UniqueName: \"kubernetes.io/projected/122c925a-8193-4d9c-bc28-9f6f826c8753-kube-api-access-dzzdv\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp6zxn\" (UID: \"122c925a-8193-4d9c-bc28-9f6f826c8753\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp6zxn"
Aug 04 22:28:36.086218 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:36.086183    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp6zxn"
Aug 04 22:28:36.182303 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:36.182266    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-fwqcg" event={"ID":"0e2a4957-489a-4032-b8e4-a35d8359521b","Type":"ContainerStarted","Data":"e431f856bb75d56d268f0e7ce052cff17bcb979ced0714f0e32e7470e85371cb"}
Aug 04 22:28:36.231352 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:36.231325    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp6zxn"]
Aug 04 22:28:36.232867 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:28:36.232840    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod122c925a_8193_4d9c_bc28_9f6f826c8753.slice/crio-97392988a4033ccb8df4faee729720575f5b84d5ca835e31725a17e748f1881c WatchSource:0}: Error finding container 97392988a4033ccb8df4faee729720575f5b84d5ca835e31725a17e748f1881c: Status 404 returned error can't find the container with id 97392988a4033ccb8df4faee729720575f5b84d5ca835e31725a17e748f1881c
Aug 04 22:28:37.190927 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:37.190895    2580 generic.go:356] "Generic (PLEG): container finished" podID="122c925a-8193-4d9c-bc28-9f6f826c8753" containerID="310fa788532d2f0c3d5a4c71d0071526520401fd1026814ce5a5c04fa67ee8bd" exitCode=0
Aug 04 22:28:37.191336 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:37.190937    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp6zxn" event={"ID":"122c925a-8193-4d9c-bc28-9f6f826c8753","Type":"ContainerDied","Data":"310fa788532d2f0c3d5a4c71d0071526520401fd1026814ce5a5c04fa67ee8bd"}
Aug 04 22:28:37.191336 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:37.190973    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp6zxn" event={"ID":"122c925a-8193-4d9c-bc28-9f6f826c8753","Type":"ContainerStarted","Data":"97392988a4033ccb8df4faee729720575f5b84d5ca835e31725a17e748f1881c"}
Aug 04 22:28:37.523627 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:37.523555    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-g4bpx"]
Aug 04 22:28:37.543330 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:37.543302    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-g4bpx"]
Aug 04 22:28:37.543479 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:37.543416    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-g4bpx"
Aug 04 22:28:37.545506 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:37.545486    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-47b6x\""
Aug 04 22:28:37.630397 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:37.630358    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5ed6f61b-3f57-4d35-b1a3-a8f65edd6004-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-g4bpx\" (UID: \"5ed6f61b-3f57-4d35-b1a3-a8f65edd6004\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-g4bpx"
Aug 04 22:28:37.630558 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:37.630419    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qtq75\" (UniqueName: \"kubernetes.io/projected/5ed6f61b-3f57-4d35-b1a3-a8f65edd6004-kube-api-access-qtq75\") pod \"cert-manager-cainjector-559cdd8c87-g4bpx\" (UID: \"5ed6f61b-3f57-4d35-b1a3-a8f65edd6004\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-g4bpx"
Aug 04 22:28:37.730987 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:37.730949    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qtq75\" (UniqueName: \"kubernetes.io/projected/5ed6f61b-3f57-4d35-b1a3-a8f65edd6004-kube-api-access-qtq75\") pod \"cert-manager-cainjector-559cdd8c87-g4bpx\" (UID: \"5ed6f61b-3f57-4d35-b1a3-a8f65edd6004\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-g4bpx"
Aug 04 22:28:37.731208 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:37.731034    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5ed6f61b-3f57-4d35-b1a3-a8f65edd6004-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-g4bpx\" (UID: \"5ed6f61b-3f57-4d35-b1a3-a8f65edd6004\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-g4bpx"
Aug 04 22:28:37.738235 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:37.738204    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5ed6f61b-3f57-4d35-b1a3-a8f65edd6004-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-g4bpx\" (UID: \"5ed6f61b-3f57-4d35-b1a3-a8f65edd6004\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-g4bpx"
Aug 04 22:28:37.738357 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:37.738345    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qtq75\" (UniqueName: \"kubernetes.io/projected/5ed6f61b-3f57-4d35-b1a3-a8f65edd6004-kube-api-access-qtq75\") pod \"cert-manager-cainjector-559cdd8c87-g4bpx\" (UID: \"5ed6f61b-3f57-4d35-b1a3-a8f65edd6004\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-g4bpx"
Aug 04 22:28:37.852734 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:37.852697    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-g4bpx"
Aug 04 22:28:37.975207 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:37.975178    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-g4bpx"]
Aug 04 22:28:37.979070 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:28:37.979039    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5ed6f61b_3f57_4d35_b1a3_a8f65edd6004.slice/crio-91fa1192f1b3f8ee201406a1c779858ee838bd32493427a470a7b25ef2a79b9e WatchSource:0}: Error finding container 91fa1192f1b3f8ee201406a1c779858ee838bd32493427a470a7b25ef2a79b9e: Status 404 returned error can't find the container with id 91fa1192f1b3f8ee201406a1c779858ee838bd32493427a470a7b25ef2a79b9e
Aug 04 22:28:38.196762 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:38.196684    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-g4bpx" event={"ID":"5ed6f61b-3f57-4d35-b1a3-a8f65edd6004","Type":"ContainerStarted","Data":"91fa1192f1b3f8ee201406a1c779858ee838bd32493427a470a7b25ef2a79b9e"}
Aug 04 22:28:40.217755 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:40.217703    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp6zxn" event={"ID":"122c925a-8193-4d9c-bc28-9f6f826c8753","Type":"ContainerStarted","Data":"bf65138596f0fd36b258d89cb6412beb72d42b31e2f6ab69a965eaf1028a25cf"}
Aug 04 22:28:41.226375 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:41.226338    2580 generic.go:356] "Generic (PLEG): container finished" podID="122c925a-8193-4d9c-bc28-9f6f826c8753" containerID="bf65138596f0fd36b258d89cb6412beb72d42b31e2f6ab69a965eaf1028a25cf" exitCode=0
Aug 04 22:28:41.226828 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:41.226394    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp6zxn" event={"ID":"122c925a-8193-4d9c-bc28-9f6f826c8753","Type":"ContainerDied","Data":"bf65138596f0fd36b258d89cb6412beb72d42b31e2f6ab69a965eaf1028a25cf"}
Aug 04 22:28:41.228507 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:41.228479    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-g4bpx" event={"ID":"5ed6f61b-3f57-4d35-b1a3-a8f65edd6004","Type":"ContainerStarted","Data":"4616e71de84097df235f0c2d8f9efd9e1f4a089dde8725c30bbbfd5eff4dbe2c"}
Aug 04 22:28:41.257758 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:41.257715    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-g4bpx" podStartSLOduration=1.537700627 podStartE2EDuration="4.257701201s" totalImagesPullingTime="2.720000574s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 22:28:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 22:28:41.256149347 +0000 UTC m=+468.248967066" watchObservedRunningTime="2026-08-04 22:28:41.257701201 +0000 UTC m=+468.250518928"
Aug 04 22:28:42.235068 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:42.235036    2580 generic.go:356] "Generic (PLEG): container finished" podID="122c925a-8193-4d9c-bc28-9f6f826c8753" containerID="363ca6b482cac851d116d9bcc337eb905253ed0b229190a480495a25d58bb6cc" exitCode=0
Aug 04 22:28:42.235496 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:42.235126    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp6zxn" event={"ID":"122c925a-8193-4d9c-bc28-9f6f826c8753","Type":"ContainerDied","Data":"363ca6b482cac851d116d9bcc337eb905253ed0b229190a480495a25d58bb6cc"}
Aug 04 22:28:43.366913 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:43.366891    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp6zxn"
Aug 04 22:28:43.481842 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:43.481798    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/122c925a-8193-4d9c-bc28-9f6f826c8753-util\") pod \"122c925a-8193-4d9c-bc28-9f6f826c8753\" (UID: \"122c925a-8193-4d9c-bc28-9f6f826c8753\") "
Aug 04 22:28:43.482086 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:43.481896    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/122c925a-8193-4d9c-bc28-9f6f826c8753-bundle\") pod \"122c925a-8193-4d9c-bc28-9f6f826c8753\" (UID: \"122c925a-8193-4d9c-bc28-9f6f826c8753\") "
Aug 04 22:28:43.482086 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:43.481930    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dzzdv\" (UniqueName: \"kubernetes.io/projected/122c925a-8193-4d9c-bc28-9f6f826c8753-kube-api-access-dzzdv\") pod \"122c925a-8193-4d9c-bc28-9f6f826c8753\" (UID: \"122c925a-8193-4d9c-bc28-9f6f826c8753\") "
Aug 04 22:28:43.482306 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:43.482283    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/122c925a-8193-4d9c-bc28-9f6f826c8753-bundle" (OuterVolumeSpecName: "bundle") pod "122c925a-8193-4d9c-bc28-9f6f826c8753" (UID: "122c925a-8193-4d9c-bc28-9f6f826c8753"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 22:28:43.484104 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:43.484080    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/122c925a-8193-4d9c-bc28-9f6f826c8753-kube-api-access-dzzdv" (OuterVolumeSpecName: "kube-api-access-dzzdv") pod "122c925a-8193-4d9c-bc28-9f6f826c8753" (UID: "122c925a-8193-4d9c-bc28-9f6f826c8753"). InnerVolumeSpecName "kube-api-access-dzzdv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 22:28:43.486643 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:43.486623    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/122c925a-8193-4d9c-bc28-9f6f826c8753-util" (OuterVolumeSpecName: "util") pod "122c925a-8193-4d9c-bc28-9f6f826c8753" (UID: "122c925a-8193-4d9c-bc28-9f6f826c8753"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 22:28:43.583366 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:43.583334    2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/122c925a-8193-4d9c-bc28-9f6f826c8753-util\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
Aug 04 22:28:43.583366 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:43.583362    2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/122c925a-8193-4d9c-bc28-9f6f826c8753-bundle\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
Aug 04 22:28:43.583366 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:43.583372    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dzzdv\" (UniqueName: \"kubernetes.io/projected/122c925a-8193-4d9c-bc28-9f6f826c8753-kube-api-access-dzzdv\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
Aug 04 22:28:44.250893 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:44.250859    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp6zxn" event={"ID":"122c925a-8193-4d9c-bc28-9f6f826c8753","Type":"ContainerDied","Data":"97392988a4033ccb8df4faee729720575f5b84d5ca835e31725a17e748f1881c"}
Aug 04 22:28:44.251084 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:44.250929    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="97392988a4033ccb8df4faee729720575f5b84d5ca835e31725a17e748f1881c"
Aug 04 22:28:44.251084 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:44.250868    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp6zxn"
Aug 04 22:28:48.238049 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:48.238013    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-zx5rv"]
Aug 04 22:28:48.238426 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:48.238347    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="122c925a-8193-4d9c-bc28-9f6f826c8753" containerName="extract"
Aug 04 22:28:48.238426 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:48.238358    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="122c925a-8193-4d9c-bc28-9f6f826c8753" containerName="extract"
Aug 04 22:28:48.238426 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:48.238368    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="122c925a-8193-4d9c-bc28-9f6f826c8753" containerName="util"
Aug 04 22:28:48.238426 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:48.238373    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="122c925a-8193-4d9c-bc28-9f6f826c8753" containerName="util"
Aug 04 22:28:48.238426 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:48.238386    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="122c925a-8193-4d9c-bc28-9f6f826c8753" containerName="pull"
Aug 04 22:28:48.238426 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:48.238392    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="122c925a-8193-4d9c-bc28-9f6f826c8753" containerName="pull"
Aug 04 22:28:48.238619 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:48.238438    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="122c925a-8193-4d9c-bc28-9f6f826c8753" containerName="extract"
Aug 04 22:28:48.240446 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:48.240431    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-zx5rv"
Aug 04 22:28:48.242440 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:48.242416    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Aug 04 22:28:48.242585 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:48.242563    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Aug 04 22:28:48.243359 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:48.243340    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-qrnnn\""
Aug 04 22:28:48.249107 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:48.249082    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-zx5rv"]
Aug 04 22:28:48.421730 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:48.421684    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0b16e7ff-2257-4402-9b5e-6c77a9f1ef96-tmp\") pod \"openshift-lws-operator-fd8ccff4c-zx5rv\" (UID: \"0b16e7ff-2257-4402-9b5e-6c77a9f1ef96\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-zx5rv"
Aug 04 22:28:48.421730 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:48.421740    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-78vx4\" (UniqueName: \"kubernetes.io/projected/0b16e7ff-2257-4402-9b5e-6c77a9f1ef96-kube-api-access-78vx4\") pod \"openshift-lws-operator-fd8ccff4c-zx5rv\" (UID: \"0b16e7ff-2257-4402-9b5e-6c77a9f1ef96\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-zx5rv"
Aug 04 22:28:48.523075 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:48.522997    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0b16e7ff-2257-4402-9b5e-6c77a9f1ef96-tmp\") pod \"openshift-lws-operator-fd8ccff4c-zx5rv\" (UID: \"0b16e7ff-2257-4402-9b5e-6c77a9f1ef96\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-zx5rv"
Aug 04 22:28:48.523075 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:48.523037    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-78vx4\" (UniqueName: \"kubernetes.io/projected/0b16e7ff-2257-4402-9b5e-6c77a9f1ef96-kube-api-access-78vx4\") pod \"openshift-lws-operator-fd8ccff4c-zx5rv\" (UID: \"0b16e7ff-2257-4402-9b5e-6c77a9f1ef96\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-zx5rv"
Aug 04 22:28:48.523382 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:48.523363    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0b16e7ff-2257-4402-9b5e-6c77a9f1ef96-tmp\") pod \"openshift-lws-operator-fd8ccff4c-zx5rv\" (UID: \"0b16e7ff-2257-4402-9b5e-6c77a9f1ef96\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-zx5rv"
Aug 04 22:28:48.531473 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:48.531441    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-78vx4\" (UniqueName: \"kubernetes.io/projected/0b16e7ff-2257-4402-9b5e-6c77a9f1ef96-kube-api-access-78vx4\") pod \"openshift-lws-operator-fd8ccff4c-zx5rv\" (UID: \"0b16e7ff-2257-4402-9b5e-6c77a9f1ef96\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-zx5rv"
Aug 04 22:28:48.549242 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:48.549218    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-zx5rv"
Aug 04 22:28:48.674476 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:48.674451    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-zx5rv"]
Aug 04 22:28:48.676738 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:28:48.676710    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0b16e7ff_2257_4402_9b5e_6c77a9f1ef96.slice/crio-8ce29e1c654b836ee3b9b41f0d6c496372a3ca1e056eb6fe9cd5288d06b9aab7 WatchSource:0}: Error finding container 8ce29e1c654b836ee3b9b41f0d6c496372a3ca1e056eb6fe9cd5288d06b9aab7: Status 404 returned error can't find the container with id 8ce29e1c654b836ee3b9b41f0d6c496372a3ca1e056eb6fe9cd5288d06b9aab7
Aug 04 22:28:49.279553 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:49.279516    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-zx5rv" event={"ID":"0b16e7ff-2257-4402-9b5e-6c77a9f1ef96","Type":"ContainerStarted","Data":"8ce29e1c654b836ee3b9b41f0d6c496372a3ca1e056eb6fe9cd5288d06b9aab7"}
Aug 04 22:28:51.291920 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:51.291889    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-fwqcg" event={"ID":"0e2a4957-489a-4032-b8e4-a35d8359521b","Type":"ContainerStarted","Data":"9aa0f7ab70e572d33ddd8a911ea92208173302871d0aabe0b66e709857355f0f"}
Aug 04 22:28:51.292304 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:51.291953    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-fwqcg"
Aug 04 22:28:51.308231 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:51.308188    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-fwqcg" podStartSLOduration=1.474037236 podStartE2EDuration="16.308173397s" totalImagesPullingTime="14.834136161s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 22:28:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 22:28:51.307680102 +0000 UTC m=+478.300497829" watchObservedRunningTime="2026-08-04 22:28:51.308173397 +0000 UTC m=+478.300991124"
Aug 04 22:28:52.298298 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:52.298248    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-zx5rv" event={"ID":"0b16e7ff-2257-4402-9b5e-6c77a9f1ef96","Type":"ContainerStarted","Data":"7c73d1ad2eae9b340899a61bebf35d4679f069a3824720117aa179d30c944fc1"}
Aug 04 22:28:52.314426 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:52.314377    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-zx5rv" podStartSLOduration=1.716299512 podStartE2EDuration="4.314363813s" totalImagesPullingTime="2.598064301s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 22:28:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 22:28:52.312270003 +0000 UTC m=+479.305087726" watchObservedRunningTime="2026-08-04 22:28:52.314363813 +0000 UTC m=+479.307181540"
Aug 04 22:28:54.515592 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:54.515553    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aft7mqh"]
Aug 04 22:28:54.518853 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:54.518834    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aft7mqh"
Aug 04 22:28:54.520883 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:54.520861    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Aug 04 22:28:54.521610 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:54.521594    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Aug 04 22:28:54.521699 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:54.521593    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-692hh\""
Aug 04 22:28:54.526464 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:54.526436    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aft7mqh"]
Aug 04 22:28:54.576624 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:54.576590    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qvg86\" (UniqueName: \"kubernetes.io/projected/bcdea554-cb76-4a71-9720-f71ccaec7148-kube-api-access-qvg86\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aft7mqh\" (UID: \"bcdea554-cb76-4a71-9720-f71ccaec7148\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aft7mqh"
Aug 04 22:28:54.576796 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:54.576646    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bcdea554-cb76-4a71-9720-f71ccaec7148-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aft7mqh\" (UID: \"bcdea554-cb76-4a71-9720-f71ccaec7148\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aft7mqh"
Aug 04 22:28:54.576796 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:54.576703    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bcdea554-cb76-4a71-9720-f71ccaec7148-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aft7mqh\" (UID: \"bcdea554-cb76-4a71-9720-f71ccaec7148\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aft7mqh"
Aug 04 22:28:54.677396 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:54.677351    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bcdea554-cb76-4a71-9720-f71ccaec7148-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aft7mqh\" (UID: \"bcdea554-cb76-4a71-9720-f71ccaec7148\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aft7mqh"
Aug 04 22:28:54.677577 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:54.677406    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bcdea554-cb76-4a71-9720-f71ccaec7148-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aft7mqh\" (UID: \"bcdea554-cb76-4a71-9720-f71ccaec7148\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aft7mqh"
Aug 04 22:28:54.677577 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:54.677481    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qvg86\" (UniqueName: \"kubernetes.io/projected/bcdea554-cb76-4a71-9720-f71ccaec7148-kube-api-access-qvg86\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aft7mqh\" (UID: \"bcdea554-cb76-4a71-9720-f71ccaec7148\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aft7mqh"
Aug 04 22:28:54.677826 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:54.677806    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bcdea554-cb76-4a71-9720-f71ccaec7148-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aft7mqh\" (UID: \"bcdea554-cb76-4a71-9720-f71ccaec7148\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aft7mqh"
Aug 04 22:28:54.677862 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:54.677826    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bcdea554-cb76-4a71-9720-f71ccaec7148-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aft7mqh\" (UID: \"bcdea554-cb76-4a71-9720-f71ccaec7148\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aft7mqh"
Aug 04 22:28:54.685065 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:54.685036    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qvg86\" (UniqueName: \"kubernetes.io/projected/bcdea554-cb76-4a71-9720-f71ccaec7148-kube-api-access-qvg86\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aft7mqh\" (UID: \"bcdea554-cb76-4a71-9720-f71ccaec7148\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aft7mqh"
Aug 04 22:28:54.828501 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:54.828470    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aft7mqh"
Aug 04 22:28:54.959950 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:54.959916    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aft7mqh"]
Aug 04 22:28:54.963362 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:28:54.963334    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbcdea554_cb76_4a71_9720_f71ccaec7148.slice/crio-9d429ba536185450daf98288ba7618fa200403d1a85ea085eb07daacc62cc457 WatchSource:0}: Error finding container 9d429ba536185450daf98288ba7618fa200403d1a85ea085eb07daacc62cc457: Status 404 returned error can't find the container with id 9d429ba536185450daf98288ba7618fa200403d1a85ea085eb07daacc62cc457
Aug 04 22:28:55.313396 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:55.313358    2580 generic.go:356] "Generic (PLEG): container finished" podID="bcdea554-cb76-4a71-9720-f71ccaec7148" containerID="384d1aa4bca86d8d9459105caaa783afa19ed39e9cc2a72c2db4620c532fdf8c" exitCode=0
Aug 04 22:28:55.313548 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:55.313442    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aft7mqh" event={"ID":"bcdea554-cb76-4a71-9720-f71ccaec7148","Type":"ContainerDied","Data":"384d1aa4bca86d8d9459105caaa783afa19ed39e9cc2a72c2db4620c532fdf8c"}
Aug 04 22:28:55.313548 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:55.313492    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aft7mqh" event={"ID":"bcdea554-cb76-4a71-9720-f71ccaec7148","Type":"ContainerStarted","Data":"9d429ba536185450daf98288ba7618fa200403d1a85ea085eb07daacc62cc457"}
Aug 04 22:28:56.324492 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:56.324460    2580 generic.go:356] "Generic (PLEG): container finished" podID="bcdea554-cb76-4a71-9720-f71ccaec7148" containerID="97a21dce5a987cd25e4cbd834df50ef1944ee217e9c514bd04eb92bc33f58511" exitCode=0
Aug 04 22:28:56.324883 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:56.324526    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aft7mqh" event={"ID":"bcdea554-cb76-4a71-9720-f71ccaec7148","Type":"ContainerDied","Data":"97a21dce5a987cd25e4cbd834df50ef1944ee217e9c514bd04eb92bc33f58511"}
Aug 04 22:28:57.300273 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:57.300237    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-fwqcg"
Aug 04 22:28:57.332096 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:57.332060    2580 generic.go:356] "Generic (PLEG): container finished" podID="bcdea554-cb76-4a71-9720-f71ccaec7148" containerID="23f8a73b7561c1013440c6e556e47960db55f90c7faa11b15f69f3376a2d57b0" exitCode=0
Aug 04 22:28:57.332586 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:57.332151    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aft7mqh" event={"ID":"bcdea554-cb76-4a71-9720-f71ccaec7148","Type":"ContainerDied","Data":"23f8a73b7561c1013440c6e556e47960db55f90c7faa11b15f69f3376a2d57b0"}
Aug 04 22:28:58.463664 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:58.463642    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aft7mqh"
Aug 04 22:28:58.502591 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:58.502564    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bcdea554-cb76-4a71-9720-f71ccaec7148-bundle\") pod \"bcdea554-cb76-4a71-9720-f71ccaec7148\" (UID: \"bcdea554-cb76-4a71-9720-f71ccaec7148\") "
Aug 04 22:28:58.502755 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:58.502605    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bcdea554-cb76-4a71-9720-f71ccaec7148-util\") pod \"bcdea554-cb76-4a71-9720-f71ccaec7148\" (UID: \"bcdea554-cb76-4a71-9720-f71ccaec7148\") "
Aug 04 22:28:58.502755 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:58.502662    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qvg86\" (UniqueName: \"kubernetes.io/projected/bcdea554-cb76-4a71-9720-f71ccaec7148-kube-api-access-qvg86\") pod \"bcdea554-cb76-4a71-9720-f71ccaec7148\" (UID: \"bcdea554-cb76-4a71-9720-f71ccaec7148\") "
Aug 04 22:28:58.503335 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:58.503304    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bcdea554-cb76-4a71-9720-f71ccaec7148-bundle" (OuterVolumeSpecName: "bundle") pod "bcdea554-cb76-4a71-9720-f71ccaec7148" (UID: "bcdea554-cb76-4a71-9720-f71ccaec7148"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 22:28:58.504723 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:58.504699    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bcdea554-cb76-4a71-9720-f71ccaec7148-kube-api-access-qvg86" (OuterVolumeSpecName: "kube-api-access-qvg86") pod "bcdea554-cb76-4a71-9720-f71ccaec7148" (UID: "bcdea554-cb76-4a71-9720-f71ccaec7148"). InnerVolumeSpecName "kube-api-access-qvg86". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 22:28:58.508190 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:58.508156    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bcdea554-cb76-4a71-9720-f71ccaec7148-util" (OuterVolumeSpecName: "util") pod "bcdea554-cb76-4a71-9720-f71ccaec7148" (UID: "bcdea554-cb76-4a71-9720-f71ccaec7148"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 22:28:58.603117 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:58.603029    2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bcdea554-cb76-4a71-9720-f71ccaec7148-bundle\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
Aug 04 22:28:58.603117 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:58.603057    2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bcdea554-cb76-4a71-9720-f71ccaec7148-util\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
Aug 04 22:28:58.603117 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:58.603069    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qvg86\" (UniqueName: \"kubernetes.io/projected/bcdea554-cb76-4a71-9720-f71ccaec7148-kube-api-access-qvg86\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
Aug 04 22:28:59.343083 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:59.343055    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aft7mqh"
Aug 04 22:28:59.343292 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:59.343047    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aft7mqh" event={"ID":"bcdea554-cb76-4a71-9720-f71ccaec7148","Type":"ContainerDied","Data":"9d429ba536185450daf98288ba7618fa200403d1a85ea085eb07daacc62cc457"}
Aug 04 22:28:59.343292 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:28:59.343216    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9d429ba536185450daf98288ba7618fa200403d1a85ea085eb07daacc62cc457"
Aug 04 22:29:08.072986 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:08.072929    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7f6cdbbfdb-wm7cd"]
Aug 04 22:29:08.073381 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:08.073299    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bcdea554-cb76-4a71-9720-f71ccaec7148" containerName="extract"
Aug 04 22:29:08.073381 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:08.073311    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="bcdea554-cb76-4a71-9720-f71ccaec7148" containerName="extract"
Aug 04 22:29:08.073381 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:08.073325    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bcdea554-cb76-4a71-9720-f71ccaec7148" containerName="util"
Aug 04 22:29:08.073381 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:08.073331    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="bcdea554-cb76-4a71-9720-f71ccaec7148" containerName="util"
Aug 04 22:29:08.073381 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:08.073348    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bcdea554-cb76-4a71-9720-f71ccaec7148" containerName="pull"
Aug 04 22:29:08.073381 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:08.073353    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="bcdea554-cb76-4a71-9720-f71ccaec7148" containerName="pull"
Aug 04 22:29:08.073570 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:08.073409    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="bcdea554-cb76-4a71-9720-f71ccaec7148" containerName="extract"
Aug 04 22:29:08.078698 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:08.078676    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7f6cdbbfdb-wm7cd"
Aug 04 22:29:08.081142 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:08.081111    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Aug 04 22:29:08.081257 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:08.081227    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Aug 04 22:29:08.081323 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:08.081228    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Aug 04 22:29:08.081390 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:08.081349    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-mqf97\""
Aug 04 22:29:08.081876 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:08.081862    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Aug 04 22:29:08.098312 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:08.098284    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7f6cdbbfdb-wm7cd"]
Aug 04 22:29:08.165781 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:08.165747    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e73397c2-acd8-428e-9d88-5595f27e6eef-tmp\") pod \"opendatahub-operator-controller-manager-7f6cdbbfdb-wm7cd\" (UID: \"e73397c2-acd8-428e-9d88-5595f27e6eef\") " pod="opendatahub/opendatahub-operator-controller-manager-7f6cdbbfdb-wm7cd"
Aug 04 22:29:08.165944 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:08.165812    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e73397c2-acd8-428e-9d88-5595f27e6eef-webhook-cert\") pod \"opendatahub-operator-controller-manager-7f6cdbbfdb-wm7cd\" (UID: \"e73397c2-acd8-428e-9d88-5595f27e6eef\") " pod="opendatahub/opendatahub-operator-controller-manager-7f6cdbbfdb-wm7cd"
Aug 04 22:29:08.165944 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:08.165839    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e73397c2-acd8-428e-9d88-5595f27e6eef-manifests\") pod \"opendatahub-operator-controller-manager-7f6cdbbfdb-wm7cd\" (UID: \"e73397c2-acd8-428e-9d88-5595f27e6eef\") " pod="opendatahub/opendatahub-operator-controller-manager-7f6cdbbfdb-wm7cd"
Aug 04 22:29:08.165944 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:08.165858    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tzdrr\" (UniqueName: \"kubernetes.io/projected/e73397c2-acd8-428e-9d88-5595f27e6eef-kube-api-access-tzdrr\") pod \"opendatahub-operator-controller-manager-7f6cdbbfdb-wm7cd\" (UID: \"e73397c2-acd8-428e-9d88-5595f27e6eef\") " pod="opendatahub/opendatahub-operator-controller-manager-7f6cdbbfdb-wm7cd"
Aug 04 22:29:08.165944 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:08.165918    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e73397c2-acd8-428e-9d88-5595f27e6eef-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7f6cdbbfdb-wm7cd\" (UID: \"e73397c2-acd8-428e-9d88-5595f27e6eef\") " pod="opendatahub/opendatahub-operator-controller-manager-7f6cdbbfdb-wm7cd"
Aug 04 22:29:08.266958 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:08.266917    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e73397c2-acd8-428e-9d88-5595f27e6eef-manifests\") pod \"opendatahub-operator-controller-manager-7f6cdbbfdb-wm7cd\" (UID: \"e73397c2-acd8-428e-9d88-5595f27e6eef\") " pod="opendatahub/opendatahub-operator-controller-manager-7f6cdbbfdb-wm7cd"
Aug 04 22:29:08.266958 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:08.266962    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tzdrr\" (UniqueName: \"kubernetes.io/projected/e73397c2-acd8-428e-9d88-5595f27e6eef-kube-api-access-tzdrr\") pod \"opendatahub-operator-controller-manager-7f6cdbbfdb-wm7cd\" (UID: \"e73397c2-acd8-428e-9d88-5595f27e6eef\") " pod="opendatahub/opendatahub-operator-controller-manager-7f6cdbbfdb-wm7cd"
Aug 04 22:29:08.267200 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:08.266995    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e73397c2-acd8-428e-9d88-5595f27e6eef-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7f6cdbbfdb-wm7cd\" (UID: \"e73397c2-acd8-428e-9d88-5595f27e6eef\") " pod="opendatahub/opendatahub-operator-controller-manager-7f6cdbbfdb-wm7cd"
Aug 04 22:29:08.267200 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:08.267020    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e73397c2-acd8-428e-9d88-5595f27e6eef-tmp\") pod \"opendatahub-operator-controller-manager-7f6cdbbfdb-wm7cd\" (UID: \"e73397c2-acd8-428e-9d88-5595f27e6eef\") " pod="opendatahub/opendatahub-operator-controller-manager-7f6cdbbfdb-wm7cd"
Aug 04 22:29:08.267200 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:08.267070    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e73397c2-acd8-428e-9d88-5595f27e6eef-webhook-cert\") pod \"opendatahub-operator-controller-manager-7f6cdbbfdb-wm7cd\" (UID: \"e73397c2-acd8-428e-9d88-5595f27e6eef\") " pod="opendatahub/opendatahub-operator-controller-manager-7f6cdbbfdb-wm7cd"
Aug 04 22:29:08.267369 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:08.267348    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e73397c2-acd8-428e-9d88-5595f27e6eef-manifests\") pod \"opendatahub-operator-controller-manager-7f6cdbbfdb-wm7cd\" (UID: \"e73397c2-acd8-428e-9d88-5595f27e6eef\") " pod="opendatahub/opendatahub-operator-controller-manager-7f6cdbbfdb-wm7cd"
Aug 04 22:29:08.269565 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:08.269534    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e73397c2-acd8-428e-9d88-5595f27e6eef-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7f6cdbbfdb-wm7cd\" (UID: \"e73397c2-acd8-428e-9d88-5595f27e6eef\") " pod="opendatahub/opendatahub-operator-controller-manager-7f6cdbbfdb-wm7cd"
Aug 04 22:29:08.269565 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:08.269560    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e73397c2-acd8-428e-9d88-5595f27e6eef-tmp\") pod \"opendatahub-operator-controller-manager-7f6cdbbfdb-wm7cd\" (UID: \"e73397c2-acd8-428e-9d88-5595f27e6eef\") " pod="opendatahub/opendatahub-operator-controller-manager-7f6cdbbfdb-wm7cd"
Aug 04 22:29:08.269704 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:08.269589    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e73397c2-acd8-428e-9d88-5595f27e6eef-webhook-cert\") pod \"opendatahub-operator-controller-manager-7f6cdbbfdb-wm7cd\" (UID: \"e73397c2-acd8-428e-9d88-5595f27e6eef\") " pod="opendatahub/opendatahub-operator-controller-manager-7f6cdbbfdb-wm7cd"
Aug 04 22:29:08.280948 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:08.280928    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tzdrr\" (UniqueName: \"kubernetes.io/projected/e73397c2-acd8-428e-9d88-5595f27e6eef-kube-api-access-tzdrr\") pod \"opendatahub-operator-controller-manager-7f6cdbbfdb-wm7cd\" (UID: \"e73397c2-acd8-428e-9d88-5595f27e6eef\") " pod="opendatahub/opendatahub-operator-controller-manager-7f6cdbbfdb-wm7cd"
Aug 04 22:29:08.389299 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:08.389218    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7f6cdbbfdb-wm7cd"
Aug 04 22:29:08.524659 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:08.524633    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7f6cdbbfdb-wm7cd"]
Aug 04 22:29:08.526760 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:29:08.526733    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode73397c2_acd8_428e_9d88_5595f27e6eef.slice/crio-e538105cd761e1f29cad13b5683f355c232a1819267fb527f2905bf6aba516e7 WatchSource:0}: Error finding container e538105cd761e1f29cad13b5683f355c232a1819267fb527f2905bf6aba516e7: Status 404 returned error can't find the container with id e538105cd761e1f29cad13b5683f355c232a1819267fb527f2905bf6aba516e7
Aug 04 22:29:09.394188 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:09.394089    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7f6cdbbfdb-wm7cd" event={"ID":"e73397c2-acd8-428e-9d88-5595f27e6eef","Type":"ContainerStarted","Data":"e538105cd761e1f29cad13b5683f355c232a1819267fb527f2905bf6aba516e7"}
Aug 04 22:29:12.410804 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:12.410765    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7f6cdbbfdb-wm7cd" event={"ID":"e73397c2-acd8-428e-9d88-5595f27e6eef","Type":"ContainerStarted","Data":"3d4ed2f4630ec453e33954f294c5714b8b7ab88e89b6583ce9cb43bcd016e8c2"}
Aug 04 22:29:13.422797 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:13.422763    2580 generic.go:356] "Generic (PLEG): container finished" podID="e73397c2-acd8-428e-9d88-5595f27e6eef" containerID="3d4ed2f4630ec453e33954f294c5714b8b7ab88e89b6583ce9cb43bcd016e8c2" exitCode=0
Aug 04 22:29:13.423200 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:13.422850    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7f6cdbbfdb-wm7cd" event={"ID":"e73397c2-acd8-428e-9d88-5595f27e6eef","Type":"ContainerDied","Data":"3d4ed2f4630ec453e33954f294c5714b8b7ab88e89b6583ce9cb43bcd016e8c2"}
Aug 04 22:29:14.429958 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:14.429888    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7f6cdbbfdb-wm7cd" event={"ID":"e73397c2-acd8-428e-9d88-5595f27e6eef","Type":"ContainerStarted","Data":"400ee5d7540d9cdf36e7ec400019f2c9bf3c082e27fef11a1035b063e5bbb68d"}
Aug 04 22:29:14.430391 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:14.430001    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7f6cdbbfdb-wm7cd"
Aug 04 22:29:14.449702 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:14.449654    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7f6cdbbfdb-wm7cd" podStartSLOduration=2.126915173 podStartE2EDuration="6.449639532s" totalImagesPullingTime="3.306339307s" totalInitContainerRuntime="1.016385052s" isStatefulPod=false podCreationTimestamp="2026-08-04 22:29:08 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 22:29:14.447636093 +0000 UTC m=+501.440453819" watchObservedRunningTime="2026-08-04 22:29:14.449639532 +0000 UTC m=+501.442457260"
Aug 04 22:29:25.437232 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:25.437199    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7f6cdbbfdb-wm7cd"
Aug 04 22:29:27.943746 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:27.943706    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-4vg4j"]
Aug 04 22:29:27.951918 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:27.951897    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-4vg4j"
Aug 04 22:29:27.954606 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:27.954571    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Aug 04 22:29:27.955120 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:27.955104    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-82lsl\""
Aug 04 22:29:27.960671 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:27.960649    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-4vg4j"]
Aug 04 22:29:28.027563 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:28.027531    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fbj6s\" (UniqueName: \"kubernetes.io/projected/52bb1513-6f34-4963-9427-5ec0949004be-kube-api-access-fbj6s\") pod \"odh-model-controller-7998c67dc4-4vg4j\" (UID: \"52bb1513-6f34-4963-9427-5ec0949004be\") " pod="opendatahub/odh-model-controller-7998c67dc4-4vg4j"
Aug 04 22:29:28.027793 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:28.027571    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/52bb1513-6f34-4963-9427-5ec0949004be-cert\") pod \"odh-model-controller-7998c67dc4-4vg4j\" (UID: \"52bb1513-6f34-4963-9427-5ec0949004be\") " pod="opendatahub/odh-model-controller-7998c67dc4-4vg4j"
Aug 04 22:29:28.128491 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:28.128457    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fbj6s\" (UniqueName: \"kubernetes.io/projected/52bb1513-6f34-4963-9427-5ec0949004be-kube-api-access-fbj6s\") pod \"odh-model-controller-7998c67dc4-4vg4j\" (UID: \"52bb1513-6f34-4963-9427-5ec0949004be\") " pod="opendatahub/odh-model-controller-7998c67dc4-4vg4j"
Aug 04 22:29:28.128491 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:28.128504    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/52bb1513-6f34-4963-9427-5ec0949004be-cert\") pod \"odh-model-controller-7998c67dc4-4vg4j\" (UID: \"52bb1513-6f34-4963-9427-5ec0949004be\") " pod="opendatahub/odh-model-controller-7998c67dc4-4vg4j"
Aug 04 22:29:28.128844 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:29:28.128642    2580 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Aug 04 22:29:28.128844 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:29:28.128723    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52bb1513-6f34-4963-9427-5ec0949004be-cert podName:52bb1513-6f34-4963-9427-5ec0949004be nodeName:}" failed. No retries permitted until 2026-08-04 22:29:28.628701232 +0000 UTC m=+515.621518951 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/52bb1513-6f34-4963-9427-5ec0949004be-cert") pod "odh-model-controller-7998c67dc4-4vg4j" (UID: "52bb1513-6f34-4963-9427-5ec0949004be") : secret "odh-model-controller-webhook-cert" not found
Aug 04 22:29:28.136469 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:28.136436    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fbj6s\" (UniqueName: \"kubernetes.io/projected/52bb1513-6f34-4963-9427-5ec0949004be-kube-api-access-fbj6s\") pod \"odh-model-controller-7998c67dc4-4vg4j\" (UID: \"52bb1513-6f34-4963-9427-5ec0949004be\") " pod="opendatahub/odh-model-controller-7998c67dc4-4vg4j"
Aug 04 22:29:28.560631 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:28.560600    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-lz56d"]
Aug 04 22:29:28.563992 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:28.563974    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-lz56d"
Aug 04 22:29:28.566060 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:28.566033    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Aug 04 22:29:28.574475 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:28.574456    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-lz56d"]
Aug 04 22:29:28.634031 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:28.634002    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mlvj6\" (UniqueName: \"kubernetes.io/projected/c1d1cba2-5e81-41b1-8acd-fd8e8c419afe-kube-api-access-mlvj6\") pod \"model-serving-api-54d89bd5fc-lz56d\" (UID: \"c1d1cba2-5e81-41b1-8acd-fd8e8c419afe\") " pod="opendatahub/model-serving-api-54d89bd5fc-lz56d"
Aug 04 22:29:28.634188 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:28.634038    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c1d1cba2-5e81-41b1-8acd-fd8e8c419afe-tls-certs\") pod \"model-serving-api-54d89bd5fc-lz56d\" (UID: \"c1d1cba2-5e81-41b1-8acd-fd8e8c419afe\") " pod="opendatahub/model-serving-api-54d89bd5fc-lz56d"
Aug 04 22:29:28.634188 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:28.634119    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/52bb1513-6f34-4963-9427-5ec0949004be-cert\") pod \"odh-model-controller-7998c67dc4-4vg4j\" (UID: \"52bb1513-6f34-4963-9427-5ec0949004be\") " pod="opendatahub/odh-model-controller-7998c67dc4-4vg4j"
Aug 04 22:29:28.636541 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:28.636518    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/52bb1513-6f34-4963-9427-5ec0949004be-cert\") pod \"odh-model-controller-7998c67dc4-4vg4j\" (UID: \"52bb1513-6f34-4963-9427-5ec0949004be\") " pod="opendatahub/odh-model-controller-7998c67dc4-4vg4j"
Aug 04 22:29:28.734651 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:28.734579    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mlvj6\" (UniqueName: \"kubernetes.io/projected/c1d1cba2-5e81-41b1-8acd-fd8e8c419afe-kube-api-access-mlvj6\") pod \"model-serving-api-54d89bd5fc-lz56d\" (UID: \"c1d1cba2-5e81-41b1-8acd-fd8e8c419afe\") " pod="opendatahub/model-serving-api-54d89bd5fc-lz56d"
Aug 04 22:29:28.734796 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:28.734671    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c1d1cba2-5e81-41b1-8acd-fd8e8c419afe-tls-certs\") pod \"model-serving-api-54d89bd5fc-lz56d\" (UID: \"c1d1cba2-5e81-41b1-8acd-fd8e8c419afe\") " pod="opendatahub/model-serving-api-54d89bd5fc-lz56d"
Aug 04 22:29:28.734836 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:29:28.734804    2580 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found
Aug 04 22:29:28.734877 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:29:28.734865    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1d1cba2-5e81-41b1-8acd-fd8e8c419afe-tls-certs podName:c1d1cba2-5e81-41b1-8acd-fd8e8c419afe nodeName:}" failed. No retries permitted until 2026-08-04 22:29:29.234845296 +0000 UTC m=+516.227663008 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/c1d1cba2-5e81-41b1-8acd-fd8e8c419afe-tls-certs") pod "model-serving-api-54d89bd5fc-lz56d" (UID: "c1d1cba2-5e81-41b1-8acd-fd8e8c419afe") : secret "model-serving-api-tls" not found
Aug 04 22:29:28.744722 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:28.744696    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mlvj6\" (UniqueName: \"kubernetes.io/projected/c1d1cba2-5e81-41b1-8acd-fd8e8c419afe-kube-api-access-mlvj6\") pod \"model-serving-api-54d89bd5fc-lz56d\" (UID: \"c1d1cba2-5e81-41b1-8acd-fd8e8c419afe\") " pod="opendatahub/model-serving-api-54d89bd5fc-lz56d"
Aug 04 22:29:28.862546 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:28.862448    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-4vg4j"
Aug 04 22:29:29.018044 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:29.016427    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-4vg4j"]
Aug 04 22:29:29.023825 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:29:29.023736    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52bb1513_6f34_4963_9427_5ec0949004be.slice/crio-0b686e196df2285d070bdabd3bc490203614e103d458f36d1d171d36cb4b98fa WatchSource:0}: Error finding container 0b686e196df2285d070bdabd3bc490203614e103d458f36d1d171d36cb4b98fa: Status 404 returned error can't find the container with id 0b686e196df2285d070bdabd3bc490203614e103d458f36d1d171d36cb4b98fa
Aug 04 22:29:29.240510 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:29.240420    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c1d1cba2-5e81-41b1-8acd-fd8e8c419afe-tls-certs\") pod \"model-serving-api-54d89bd5fc-lz56d\" (UID: \"c1d1cba2-5e81-41b1-8acd-fd8e8c419afe\") " pod="opendatahub/model-serving-api-54d89bd5fc-lz56d"
Aug 04 22:29:29.242778 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:29.242756    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c1d1cba2-5e81-41b1-8acd-fd8e8c419afe-tls-certs\") pod \"model-serving-api-54d89bd5fc-lz56d\" (UID: \"c1d1cba2-5e81-41b1-8acd-fd8e8c419afe\") " pod="opendatahub/model-serving-api-54d89bd5fc-lz56d"
Aug 04 22:29:29.475284 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:29.475250    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-lz56d"
Aug 04 22:29:29.500270 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:29.500199    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-4vg4j" event={"ID":"52bb1513-6f34-4963-9427-5ec0949004be","Type":"ContainerStarted","Data":"0b686e196df2285d070bdabd3bc490203614e103d458f36d1d171d36cb4b98fa"}
Aug 04 22:29:29.602516 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:29.602493    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-lz56d"]
Aug 04 22:29:29.604710 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:29:29.604686    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1d1cba2_5e81_41b1_8acd_fd8e8c419afe.slice/crio-2981f6572c653b79698ceb1b6ed5ffc5b522c35fd0bb54a114d3ac44b778c34a WatchSource:0}: Error finding container 2981f6572c653b79698ceb1b6ed5ffc5b522c35fd0bb54a114d3ac44b778c34a: Status 404 returned error can't find the container with id 2981f6572c653b79698ceb1b6ed5ffc5b522c35fd0bb54a114d3ac44b778c34a
Aug 04 22:29:30.508293 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:30.508238    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-lz56d" event={"ID":"c1d1cba2-5e81-41b1-8acd-fd8e8c419afe","Type":"ContainerStarted","Data":"2981f6572c653b79698ceb1b6ed5ffc5b522c35fd0bb54a114d3ac44b778c34a"}
Aug 04 22:29:33.046197 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:33.046173    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5c576658-q4m2v"]
Aug 04 22:29:33.050606 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:33.050584    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5c576658-q4m2v"
Aug 04 22:29:33.052943 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:33.052927    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Aug 04 22:29:33.053054 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:33.052971    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Aug 04 22:29:33.053054 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:33.052996    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Aug 04 22:29:33.053195 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:33.053061    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-nmvts\""
Aug 04 22:29:33.053253 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:33.053234    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Aug 04 22:29:33.058616 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:33.058581    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5c576658-q4m2v"]
Aug 04 22:29:33.178692 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:33.178661    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3aa7b540-e7e7-4dda-90ec-5461283845c0-tls-certs\") pod \"kube-auth-proxy-5c576658-q4m2v\" (UID: \"3aa7b540-e7e7-4dda-90ec-5461283845c0\") " pod="openshift-ingress/kube-auth-proxy-5c576658-q4m2v"
Aug 04 22:29:33.178869 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:33.178703    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-64m4s\" (UniqueName: \"kubernetes.io/projected/3aa7b540-e7e7-4dda-90ec-5461283845c0-kube-api-access-64m4s\") pod \"kube-auth-proxy-5c576658-q4m2v\" (UID: \"3aa7b540-e7e7-4dda-90ec-5461283845c0\") " pod="openshift-ingress/kube-auth-proxy-5c576658-q4m2v"
Aug 04 22:29:33.178869 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:33.178743    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3aa7b540-e7e7-4dda-90ec-5461283845c0-tmp\") pod \"kube-auth-proxy-5c576658-q4m2v\" (UID: \"3aa7b540-e7e7-4dda-90ec-5461283845c0\") " pod="openshift-ingress/kube-auth-proxy-5c576658-q4m2v"
Aug 04 22:29:33.280004 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:33.279911    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3aa7b540-e7e7-4dda-90ec-5461283845c0-tmp\") pod \"kube-auth-proxy-5c576658-q4m2v\" (UID: \"3aa7b540-e7e7-4dda-90ec-5461283845c0\") " pod="openshift-ingress/kube-auth-proxy-5c576658-q4m2v"
Aug 04 22:29:33.280207 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:33.280016    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3aa7b540-e7e7-4dda-90ec-5461283845c0-tls-certs\") pod \"kube-auth-proxy-5c576658-q4m2v\" (UID: \"3aa7b540-e7e7-4dda-90ec-5461283845c0\") " pod="openshift-ingress/kube-auth-proxy-5c576658-q4m2v"
Aug 04 22:29:33.280207 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:33.280046    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-64m4s\" (UniqueName: \"kubernetes.io/projected/3aa7b540-e7e7-4dda-90ec-5461283845c0-kube-api-access-64m4s\") pod \"kube-auth-proxy-5c576658-q4m2v\" (UID: \"3aa7b540-e7e7-4dda-90ec-5461283845c0\") " pod="openshift-ingress/kube-auth-proxy-5c576658-q4m2v"
Aug 04 22:29:33.280207 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:29:33.280175    2580 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found
Aug 04 22:29:33.280376 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:29:33.280237    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3aa7b540-e7e7-4dda-90ec-5461283845c0-tls-certs podName:3aa7b540-e7e7-4dda-90ec-5461283845c0 nodeName:}" failed. No retries permitted until 2026-08-04 22:29:33.780220857 +0000 UTC m=+520.773038562 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/3aa7b540-e7e7-4dda-90ec-5461283845c0-tls-certs") pod "kube-auth-proxy-5c576658-q4m2v" (UID: "3aa7b540-e7e7-4dda-90ec-5461283845c0") : secret "kube-auth-proxy-tls" not found
Aug 04 22:29:33.282321 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:33.282294    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3aa7b540-e7e7-4dda-90ec-5461283845c0-tmp\") pod \"kube-auth-proxy-5c576658-q4m2v\" (UID: \"3aa7b540-e7e7-4dda-90ec-5461283845c0\") " pod="openshift-ingress/kube-auth-proxy-5c576658-q4m2v"
Aug 04 22:29:33.287965 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:33.287940    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-64m4s\" (UniqueName: \"kubernetes.io/projected/3aa7b540-e7e7-4dda-90ec-5461283845c0-kube-api-access-64m4s\") pod \"kube-auth-proxy-5c576658-q4m2v\" (UID: \"3aa7b540-e7e7-4dda-90ec-5461283845c0\") " pod="openshift-ingress/kube-auth-proxy-5c576658-q4m2v"
Aug 04 22:29:33.523974 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:33.523940    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-lz56d" event={"ID":"c1d1cba2-5e81-41b1-8acd-fd8e8c419afe","Type":"ContainerStarted","Data":"bc6904e5cf9545137c5e2dfea260af339dddc0bf54f84d0e85c50cc68d366641"}
Aug 04 22:29:33.524190 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:33.524005    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-lz56d"
Aug 04 22:29:33.525581 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:33.525556    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-4vg4j" event={"ID":"52bb1513-6f34-4963-9427-5ec0949004be","Type":"ContainerStarted","Data":"f497616a5655a9d562c2051d3bc1a9d78389fea54f9e28ffe38c8c1623c53516"}
Aug 04 22:29:33.525688 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:33.525616    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-4vg4j"
Aug 04 22:29:33.544144 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:33.544028    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-lz56d" podStartSLOduration=2.13052192 podStartE2EDuration="5.544008625s" totalImagesPullingTime="3.413486705s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 22:29:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 22:29:33.540842234 +0000 UTC m=+520.533659975" watchObservedRunningTime="2026-08-04 22:29:33.544008625 +0000 UTC m=+520.536826354"
Aug 04 22:29:33.558895 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:33.558846    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-4vg4j" podStartSLOduration=2.608595861 podStartE2EDuration="6.558832463s" totalImagesPullingTime="3.950236602s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 22:29:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 22:29:33.556591815 +0000 UTC m=+520.549409543" watchObservedRunningTime="2026-08-04 22:29:33.558832463 +0000 UTC m=+520.551650189"
Aug 04 22:29:33.784803 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:33.784766    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3aa7b540-e7e7-4dda-90ec-5461283845c0-tls-certs\") pod \"kube-auth-proxy-5c576658-q4m2v\" (UID: \"3aa7b540-e7e7-4dda-90ec-5461283845c0\") " pod="openshift-ingress/kube-auth-proxy-5c576658-q4m2v"
Aug 04 22:29:33.787271 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:33.787242    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3aa7b540-e7e7-4dda-90ec-5461283845c0-tls-certs\") pod \"kube-auth-proxy-5c576658-q4m2v\" (UID: \"3aa7b540-e7e7-4dda-90ec-5461283845c0\") " pod="openshift-ingress/kube-auth-proxy-5c576658-q4m2v"
Aug 04 22:29:33.969593 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:33.969553    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5c576658-q4m2v"
Aug 04 22:29:34.129389 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:34.129357    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5c576658-q4m2v"]
Aug 04 22:29:34.131661 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:29:34.131631    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3aa7b540_e7e7_4dda_90ec_5461283845c0.slice/crio-346dfc4f8c5ce413365ad45e03d9e6541467dc4dcdf19cc02147d522e10525a2 WatchSource:0}: Error finding container 346dfc4f8c5ce413365ad45e03d9e6541467dc4dcdf19cc02147d522e10525a2: Status 404 returned error can't find the container with id 346dfc4f8c5ce413365ad45e03d9e6541467dc4dcdf19cc02147d522e10525a2
Aug 04 22:29:34.270379 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:34.270303    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2w4dp"]
Aug 04 22:29:34.274579 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:34.274564    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2w4dp"
Aug 04 22:29:34.276986 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:34.276967    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Aug 04 22:29:34.277230 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:34.277213    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-dwq9r\""
Aug 04 22:29:34.277343 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:34.277229    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Aug 04 22:29:34.277343 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:34.277238    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Aug 04 22:29:34.277343 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:34.277219    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Aug 04 22:29:34.285375 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:34.285348    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2w4dp"]
Aug 04 22:29:34.389385 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:34.389344    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/16afd1f2-ca14-48bf-82a5-c245a8d5105b-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-2w4dp\" (UID: \"16afd1f2-ca14-48bf-82a5-c245a8d5105b\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2w4dp"
Aug 04 22:29:34.389573 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:34.389396    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/16afd1f2-ca14-48bf-82a5-c245a8d5105b-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-2w4dp\" (UID: \"16afd1f2-ca14-48bf-82a5-c245a8d5105b\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2w4dp"
Aug 04 22:29:34.389573 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:34.389473    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pwkb8\" (UniqueName: \"kubernetes.io/projected/16afd1f2-ca14-48bf-82a5-c245a8d5105b-kube-api-access-pwkb8\") pod \"istiod-openshift-gateway-7b7995d5cd-2w4dp\" (UID: \"16afd1f2-ca14-48bf-82a5-c245a8d5105b\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2w4dp"
Aug 04 22:29:34.389573 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:34.389510    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/16afd1f2-ca14-48bf-82a5-c245a8d5105b-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-2w4dp\" (UID: \"16afd1f2-ca14-48bf-82a5-c245a8d5105b\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2w4dp"
Aug 04 22:29:34.389573 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:34.389534    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/16afd1f2-ca14-48bf-82a5-c245a8d5105b-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-2w4dp\" (UID: \"16afd1f2-ca14-48bf-82a5-c245a8d5105b\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2w4dp"
Aug 04 22:29:34.389573 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:34.389552    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/16afd1f2-ca14-48bf-82a5-c245a8d5105b-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-2w4dp\" (UID: \"16afd1f2-ca14-48bf-82a5-c245a8d5105b\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2w4dp"
Aug 04 22:29:34.389738 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:34.389655    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/16afd1f2-ca14-48bf-82a5-c245a8d5105b-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-2w4dp\" (UID: \"16afd1f2-ca14-48bf-82a5-c245a8d5105b\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2w4dp"
Aug 04 22:29:34.490455 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:34.490424    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/16afd1f2-ca14-48bf-82a5-c245a8d5105b-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-2w4dp\" (UID: \"16afd1f2-ca14-48bf-82a5-c245a8d5105b\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2w4dp"
Aug 04 22:29:34.490616 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:34.490475    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/16afd1f2-ca14-48bf-82a5-c245a8d5105b-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-2w4dp\" (UID: \"16afd1f2-ca14-48bf-82a5-c245a8d5105b\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2w4dp"
Aug 04 22:29:34.490666 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:34.490644    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pwkb8\" (UniqueName: \"kubernetes.io/projected/16afd1f2-ca14-48bf-82a5-c245a8d5105b-kube-api-access-pwkb8\") pod \"istiod-openshift-gateway-7b7995d5cd-2w4dp\" (UID: \"16afd1f2-ca14-48bf-82a5-c245a8d5105b\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2w4dp"
Aug 04 22:29:34.490770 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:34.490694    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/16afd1f2-ca14-48bf-82a5-c245a8d5105b-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-2w4dp\" (UID: \"16afd1f2-ca14-48bf-82a5-c245a8d5105b\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2w4dp"
Aug 04 22:29:34.490770 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:34.490730    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/16afd1f2-ca14-48bf-82a5-c245a8d5105b-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-2w4dp\" (UID: \"16afd1f2-ca14-48bf-82a5-c245a8d5105b\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2w4dp"
Aug 04 22:29:34.490770 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:34.490760    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/16afd1f2-ca14-48bf-82a5-c245a8d5105b-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-2w4dp\" (UID: \"16afd1f2-ca14-48bf-82a5-c245a8d5105b\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2w4dp"
Aug 04 22:29:34.490920 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:34.490835    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/16afd1f2-ca14-48bf-82a5-c245a8d5105b-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-2w4dp\" (UID: \"16afd1f2-ca14-48bf-82a5-c245a8d5105b\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2w4dp"
Aug 04 22:29:34.491411 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:34.491386    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/16afd1f2-ca14-48bf-82a5-c245a8d5105b-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-2w4dp\" (UID: \"16afd1f2-ca14-48bf-82a5-c245a8d5105b\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2w4dp"
Aug 04 22:29:34.493570 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:34.493537    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/16afd1f2-ca14-48bf-82a5-c245a8d5105b-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-2w4dp\" (UID: \"16afd1f2-ca14-48bf-82a5-c245a8d5105b\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2w4dp"
Aug 04 22:29:34.493743 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:34.493723    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/16afd1f2-ca14-48bf-82a5-c245a8d5105b-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-2w4dp\" (UID: \"16afd1f2-ca14-48bf-82a5-c245a8d5105b\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2w4dp"
Aug 04 22:29:34.493824 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:34.493734    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/16afd1f2-ca14-48bf-82a5-c245a8d5105b-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-2w4dp\" (UID: \"16afd1f2-ca14-48bf-82a5-c245a8d5105b\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2w4dp"
Aug 04 22:29:34.493880 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:34.493834    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/16afd1f2-ca14-48bf-82a5-c245a8d5105b-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-2w4dp\" (UID: \"16afd1f2-ca14-48bf-82a5-c245a8d5105b\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2w4dp"
Aug 04 22:29:34.500412 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:34.500388    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/16afd1f2-ca14-48bf-82a5-c245a8d5105b-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-2w4dp\" (UID: \"16afd1f2-ca14-48bf-82a5-c245a8d5105b\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2w4dp"
Aug 04 22:29:34.502641 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:34.502616    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pwkb8\" (UniqueName: \"kubernetes.io/projected/16afd1f2-ca14-48bf-82a5-c245a8d5105b-kube-api-access-pwkb8\") pod \"istiod-openshift-gateway-7b7995d5cd-2w4dp\" (UID: \"16afd1f2-ca14-48bf-82a5-c245a8d5105b\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2w4dp"
Aug 04 22:29:34.532312 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:34.532242    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5c576658-q4m2v" event={"ID":"3aa7b540-e7e7-4dda-90ec-5461283845c0","Type":"ContainerStarted","Data":"346dfc4f8c5ce413365ad45e03d9e6541467dc4dcdf19cc02147d522e10525a2"}
Aug 04 22:29:34.584965 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:34.584938    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2w4dp"
Aug 04 22:29:34.720881 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:34.720856    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2w4dp"]
Aug 04 22:29:34.722930 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:29:34.722904    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16afd1f2_ca14_48bf_82a5_c245a8d5105b.slice/crio-0c7fd5954f3d4cbf2a4800e7db1844a52d0fcfb5dbb842d5854d029f7d7dcef8 WatchSource:0}: Error finding container 0c7fd5954f3d4cbf2a4800e7db1844a52d0fcfb5dbb842d5854d029f7d7dcef8: Status 404 returned error can't find the container with id 0c7fd5954f3d4cbf2a4800e7db1844a52d0fcfb5dbb842d5854d029f7d7dcef8
Aug 04 22:29:35.537955 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:35.537917    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2w4dp" event={"ID":"16afd1f2-ca14-48bf-82a5-c245a8d5105b","Type":"ContainerStarted","Data":"0c7fd5954f3d4cbf2a4800e7db1844a52d0fcfb5dbb842d5854d029f7d7dcef8"}
Aug 04 22:29:37.553279 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:37.553240    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5c576658-q4m2v" event={"ID":"3aa7b540-e7e7-4dda-90ec-5461283845c0","Type":"ContainerStarted","Data":"cebbf2cb3ec8edf8fe128ab83225f2b78ded1cdab4c87b90c1834a6a367169c8"}
Aug 04 22:29:37.585580 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:37.585455    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5c576658-q4m2v" podStartSLOduration=1.6748751610000001 podStartE2EDuration="4.585431471s" totalImagesPullingTime="2.91055631s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 22:29:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 22:29:37.583056921 +0000 UTC m=+524.575874650" watchObservedRunningTime="2026-08-04 22:29:37.585431471 +0000 UTC m=+524.578249200"
Aug 04 22:29:37.716247 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:37.716210    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-fht77"]
Aug 04 22:29:37.723534 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:37.723509    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-fht77"
Aug 04 22:29:37.729561 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:37.729388    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Aug 04 22:29:37.729561 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:37.729422    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-2ls9q\""
Aug 04 22:29:37.731972 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:37.731949    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-bglnn"]
Aug 04 22:29:37.737311 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:37.736424    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-bglnn"
Aug 04 22:29:37.737311 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:37.737264    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-fht77"]
Aug 04 22:29:37.739006 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:37.738988    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-dqz5l\""
Aug 04 22:29:37.739258 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:37.739241    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Aug 04 22:29:37.750422 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:37.750095    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-bglnn"]
Aug 04 22:29:37.822785 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:37.822700    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mtpf7\" (UniqueName: \"kubernetes.io/projected/1750f21e-34b5-4693-8a9c-4c31e01241e5-kube-api-access-mtpf7\") pod \"llmisvc-controller-manager-777c6bd7d5-bglnn\" (UID: \"1750f21e-34b5-4693-8a9c-4c31e01241e5\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-bglnn"
Aug 04 22:29:37.822948 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:37.822813    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f0c28a16-8649-4ae0-b34a-1a5ab2ebd867-cert\") pod \"kserve-controller-manager-d6f4b65b8-fht77\" (UID: \"f0c28a16-8649-4ae0-b34a-1a5ab2ebd867\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-fht77"
Aug 04 22:29:37.822948 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:37.822874    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gtdg5\" (UniqueName: \"kubernetes.io/projected/f0c28a16-8649-4ae0-b34a-1a5ab2ebd867-kube-api-access-gtdg5\") pod \"kserve-controller-manager-d6f4b65b8-fht77\" (UID: \"f0c28a16-8649-4ae0-b34a-1a5ab2ebd867\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-fht77"
Aug 04 22:29:37.822948 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:37.822939    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1750f21e-34b5-4693-8a9c-4c31e01241e5-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-bglnn\" (UID: \"1750f21e-34b5-4693-8a9c-4c31e01241e5\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-bglnn"
Aug 04 22:29:37.924224 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:37.924190    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mtpf7\" (UniqueName: \"kubernetes.io/projected/1750f21e-34b5-4693-8a9c-4c31e01241e5-kube-api-access-mtpf7\") pod \"llmisvc-controller-manager-777c6bd7d5-bglnn\" (UID: \"1750f21e-34b5-4693-8a9c-4c31e01241e5\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-bglnn"
Aug 04 22:29:37.924410 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:37.924285    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f0c28a16-8649-4ae0-b34a-1a5ab2ebd867-cert\") pod \"kserve-controller-manager-d6f4b65b8-fht77\" (UID: \"f0c28a16-8649-4ae0-b34a-1a5ab2ebd867\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-fht77"
Aug 04 22:29:37.924410 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:37.924347    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gtdg5\" (UniqueName: \"kubernetes.io/projected/f0c28a16-8649-4ae0-b34a-1a5ab2ebd867-kube-api-access-gtdg5\") pod \"kserve-controller-manager-d6f4b65b8-fht77\" (UID: \"f0c28a16-8649-4ae0-b34a-1a5ab2ebd867\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-fht77"
Aug 04 22:29:37.924410 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:37.924394    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1750f21e-34b5-4693-8a9c-4c31e01241e5-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-bglnn\" (UID: \"1750f21e-34b5-4693-8a9c-4c31e01241e5\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-bglnn"
Aug 04 22:29:37.924585 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:29:37.924504    2580 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
Aug 04 22:29:37.924585 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:29:37.924565    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1750f21e-34b5-4693-8a9c-4c31e01241e5-cert podName:1750f21e-34b5-4693-8a9c-4c31e01241e5 nodeName:}" failed. No retries permitted until 2026-08-04 22:29:38.424545219 +0000 UTC m=+525.417362926 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/1750f21e-34b5-4693-8a9c-4c31e01241e5-cert") pod "llmisvc-controller-manager-777c6bd7d5-bglnn" (UID: "1750f21e-34b5-4693-8a9c-4c31e01241e5") : secret "llmisvc-webhook-server-cert" not found
Aug 04 22:29:37.927004 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:37.926983    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f0c28a16-8649-4ae0-b34a-1a5ab2ebd867-cert\") pod \"kserve-controller-manager-d6f4b65b8-fht77\" (UID: \"f0c28a16-8649-4ae0-b34a-1a5ab2ebd867\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-fht77"
Aug 04 22:29:37.933548 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:37.933525    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mtpf7\" (UniqueName: \"kubernetes.io/projected/1750f21e-34b5-4693-8a9c-4c31e01241e5-kube-api-access-mtpf7\") pod \"llmisvc-controller-manager-777c6bd7d5-bglnn\" (UID: \"1750f21e-34b5-4693-8a9c-4c31e01241e5\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-bglnn"
Aug 04 22:29:37.933896 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:37.933874    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gtdg5\" (UniqueName: \"kubernetes.io/projected/f0c28a16-8649-4ae0-b34a-1a5ab2ebd867-kube-api-access-gtdg5\") pod \"kserve-controller-manager-d6f4b65b8-fht77\" (UID: \"f0c28a16-8649-4ae0-b34a-1a5ab2ebd867\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-fht77"
Aug 04 22:29:38.042522 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:38.042491    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-fht77"
Aug 04 22:29:38.378201 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:38.378158    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 22:29:38.378311 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:38.378229    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 22:29:38.427835 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:38.427802    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1750f21e-34b5-4693-8a9c-4c31e01241e5-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-bglnn\" (UID: \"1750f21e-34b5-4693-8a9c-4c31e01241e5\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-bglnn"
Aug 04 22:29:38.430038 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:38.430018    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1750f21e-34b5-4693-8a9c-4c31e01241e5-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-bglnn\" (UID: \"1750f21e-34b5-4693-8a9c-4c31e01241e5\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-bglnn"
Aug 04 22:29:38.475162 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:38.475118    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-fht77"]
Aug 04 22:29:38.476187 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:29:38.476162    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0c28a16_8649_4ae0_b34a_1a5ab2ebd867.slice/crio-60dccb716c416d2c8e0f74b048f80569210b24f2f8385bb465a9723c19b99ff5 WatchSource:0}: Error finding container 60dccb716c416d2c8e0f74b048f80569210b24f2f8385bb465a9723c19b99ff5: Status 404 returned error can't find the container with id 60dccb716c416d2c8e0f74b048f80569210b24f2f8385bb465a9723c19b99ff5
Aug 04 22:29:38.559288 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:38.559253    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2w4dp" event={"ID":"16afd1f2-ca14-48bf-82a5-c245a8d5105b","Type":"ContainerStarted","Data":"cab90ca4046c4007e8a596932132d3167f88ff0bae253edae258b7b452170562"}
Aug 04 22:29:38.559715 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:38.559314    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2w4dp"
Aug 04 22:29:38.560667 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:38.560635    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-fht77" event={"ID":"f0c28a16-8649-4ae0-b34a-1a5ab2ebd867","Type":"ContainerStarted","Data":"60dccb716c416d2c8e0f74b048f80569210b24f2f8385bb465a9723c19b99ff5"}
Aug 04 22:29:38.592241 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:38.592149    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2w4dp" podStartSLOduration=0.939185176 podStartE2EDuration="4.592117534s" totalImagesPullingTime="3.652932358s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 22:29:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 22:29:38.588938937 +0000 UTC m=+525.581756676" watchObservedRunningTime="2026-08-04 22:29:38.592117534 +0000 UTC m=+525.584935261"
Aug 04 22:29:38.658054 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:38.658019    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-bglnn"
Aug 04 22:29:38.787005 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:38.786977    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-bglnn"]
Aug 04 22:29:38.788653 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:29:38.788628    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod1750f21e_34b5_4693_8a9c_4c31e01241e5.slice/crio-7cd1c9ee984d28bd7648127bf6453bae0a33ed3605b2b5b26c1ea45efa3f7bb1 WatchSource:0}: Error finding container 7cd1c9ee984d28bd7648127bf6453bae0a33ed3605b2b5b26c1ea45efa3f7bb1: Status 404 returned error can't find the container with id 7cd1c9ee984d28bd7648127bf6453bae0a33ed3605b2b5b26c1ea45efa3f7bb1
Aug 04 22:29:39.568724 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:39.568676    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-bglnn" event={"ID":"1750f21e-34b5-4693-8a9c-4c31e01241e5","Type":"ContainerStarted","Data":"7cd1c9ee984d28bd7648127bf6453bae0a33ed3605b2b5b26c1ea45efa3f7bb1"}
Aug 04 22:29:39.571364 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:39.571160    2580 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7b7995d5cd-2w4dp container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Aug 04 22:29:39.571364 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:39.571221    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2w4dp" podUID="16afd1f2-ca14-48bf-82a5-c245a8d5105b" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Aug 04 22:29:40.329930 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:40.329506    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fqw42"]
Aug 04 22:29:40.334981 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:40.334956    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fqw42"
Aug 04 22:29:40.339493 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:40.339351    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-27xvb\""
Aug 04 22:29:40.342512 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:40.342486    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fqw42"]
Aug 04 22:29:40.448310 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:40.448208    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b7dhs\" (UniqueName: \"kubernetes.io/projected/83102047-def5-4f94-a46c-a305d8f0d2b1-kube-api-access-b7dhs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fqw42\" (UID: \"83102047-def5-4f94-a46c-a305d8f0d2b1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fqw42"
Aug 04 22:29:40.448310 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:40.448270    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/83102047-def5-4f94-a46c-a305d8f0d2b1-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fqw42\" (UID: \"83102047-def5-4f94-a46c-a305d8f0d2b1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fqw42"
Aug 04 22:29:40.448310 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:40.448300    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/83102047-def5-4f94-a46c-a305d8f0d2b1-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fqw42\" (UID: \"83102047-def5-4f94-a46c-a305d8f0d2b1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fqw42"
Aug 04 22:29:40.448591 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:40.448344    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/83102047-def5-4f94-a46c-a305d8f0d2b1-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fqw42\" (UID: \"83102047-def5-4f94-a46c-a305d8f0d2b1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fqw42"
Aug 04 22:29:40.448591 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:40.448422    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/83102047-def5-4f94-a46c-a305d8f0d2b1-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fqw42\" (UID: \"83102047-def5-4f94-a46c-a305d8f0d2b1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fqw42"
Aug 04 22:29:40.448591 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:40.448446    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/83102047-def5-4f94-a46c-a305d8f0d2b1-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fqw42\" (UID: \"83102047-def5-4f94-a46c-a305d8f0d2b1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fqw42"
Aug 04 22:29:40.448591 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:40.448493    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/83102047-def5-4f94-a46c-a305d8f0d2b1-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fqw42\" (UID: \"83102047-def5-4f94-a46c-a305d8f0d2b1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fqw42"
Aug 04 22:29:40.448591 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:40.448554    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/83102047-def5-4f94-a46c-a305d8f0d2b1-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fqw42\" (UID: \"83102047-def5-4f94-a46c-a305d8f0d2b1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fqw42"
Aug 04 22:29:40.448842 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:40.448620    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/83102047-def5-4f94-a46c-a305d8f0d2b1-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fqw42\" (UID: \"83102047-def5-4f94-a46c-a305d8f0d2b1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fqw42"
Aug 04 22:29:40.550140 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:40.550097    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/83102047-def5-4f94-a46c-a305d8f0d2b1-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fqw42\" (UID: \"83102047-def5-4f94-a46c-a305d8f0d2b1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fqw42"
Aug 04 22:29:40.551254 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:40.550174    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/83102047-def5-4f94-a46c-a305d8f0d2b1-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fqw42\" (UID: \"83102047-def5-4f94-a46c-a305d8f0d2b1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fqw42"
Aug 04 22:29:40.551254 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:40.550223    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/83102047-def5-4f94-a46c-a305d8f0d2b1-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fqw42\" (UID: \"83102047-def5-4f94-a46c-a305d8f0d2b1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fqw42"
Aug 04 22:29:40.551254 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:40.550283    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b7dhs\" (UniqueName: \"kubernetes.io/projected/83102047-def5-4f94-a46c-a305d8f0d2b1-kube-api-access-b7dhs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fqw42\" (UID: \"83102047-def5-4f94-a46c-a305d8f0d2b1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fqw42"
Aug 04 22:29:40.551254 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:40.550327    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/83102047-def5-4f94-a46c-a305d8f0d2b1-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fqw42\" (UID: \"83102047-def5-4f94-a46c-a305d8f0d2b1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fqw42"
Aug 04 22:29:40.551254 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:40.550357    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/83102047-def5-4f94-a46c-a305d8f0d2b1-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fqw42\" (UID: \"83102047-def5-4f94-a46c-a305d8f0d2b1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fqw42"
Aug 04 22:29:40.551254 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:40.550405    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/83102047-def5-4f94-a46c-a305d8f0d2b1-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fqw42\" (UID: \"83102047-def5-4f94-a46c-a305d8f0d2b1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fqw42"
Aug 04 22:29:40.551254 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:40.550450    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/83102047-def5-4f94-a46c-a305d8f0d2b1-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fqw42\" (UID: \"83102047-def5-4f94-a46c-a305d8f0d2b1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fqw42"
Aug 04 22:29:40.551254 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:40.550482    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/83102047-def5-4f94-a46c-a305d8f0d2b1-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fqw42\" (UID: \"83102047-def5-4f94-a46c-a305d8f0d2b1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fqw42"
Aug 04 22:29:40.551254 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:40.551092    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/83102047-def5-4f94-a46c-a305d8f0d2b1-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fqw42\" (UID: \"83102047-def5-4f94-a46c-a305d8f0d2b1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fqw42"
Aug 04 22:29:40.551739 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:40.551616    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/83102047-def5-4f94-a46c-a305d8f0d2b1-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fqw42\" (UID: \"83102047-def5-4f94-a46c-a305d8f0d2b1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fqw42"
Aug 04 22:29:40.552060 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:40.552018    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/83102047-def5-4f94-a46c-a305d8f0d2b1-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fqw42\" (UID: \"83102047-def5-4f94-a46c-a305d8f0d2b1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fqw42"
Aug 04 22:29:40.552195 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:40.552125    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/83102047-def5-4f94-a46c-a305d8f0d2b1-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fqw42\" (UID: \"83102047-def5-4f94-a46c-a305d8f0d2b1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fqw42"
Aug 04 22:29:40.552262 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:40.552213    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/83102047-def5-4f94-a46c-a305d8f0d2b1-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fqw42\" (UID: \"83102047-def5-4f94-a46c-a305d8f0d2b1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fqw42"
Aug 04 22:29:40.554275 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:40.554235    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/83102047-def5-4f94-a46c-a305d8f0d2b1-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fqw42\" (UID: \"83102047-def5-4f94-a46c-a305d8f0d2b1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fqw42"
Aug 04 22:29:40.555123 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:40.555071    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/83102047-def5-4f94-a46c-a305d8f0d2b1-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fqw42\" (UID: \"83102047-def5-4f94-a46c-a305d8f0d2b1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fqw42"
Aug 04 22:29:40.567363 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:40.567311    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/83102047-def5-4f94-a46c-a305d8f0d2b1-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fqw42\" (UID: \"83102047-def5-4f94-a46c-a305d8f0d2b1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fqw42"
Aug 04 22:29:40.567484 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:40.567452    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b7dhs\" (UniqueName: \"kubernetes.io/projected/83102047-def5-4f94-a46c-a305d8f0d2b1-kube-api-access-b7dhs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fqw42\" (UID: \"83102047-def5-4f94-a46c-a305d8f0d2b1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fqw42"
Aug 04 22:29:40.653544 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:40.653456    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fqw42"
Aug 04 22:29:41.202499 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:41.202475    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fqw42"]
Aug 04 22:29:41.204358 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:29:41.204335    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83102047_def5_4f94_a46c_a305d8f0d2b1.slice/crio-f4fac009f73336532320ea36f90930478d7f3990eb8d1a5e99b259326d5d0e9d WatchSource:0}: Error finding container f4fac009f73336532320ea36f90930478d7f3990eb8d1a5e99b259326d5d0e9d: Status 404 returned error can't find the container with id f4fac009f73336532320ea36f90930478d7f3990eb8d1a5e99b259326d5d0e9d
Aug 04 22:29:41.589608 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:41.589574    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-fht77" event={"ID":"f0c28a16-8649-4ae0-b34a-1a5ab2ebd867","Type":"ContainerStarted","Data":"aa35c5ce5ff38847bbffb9fcaad57ed551682c0a1806fd16cc8dd4bbb34df31e"}
Aug 04 22:29:41.589826 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:41.589742    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-fht77"
Aug 04 22:29:41.590840 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:41.590812    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fqw42" event={"ID":"83102047-def5-4f94-a46c-a305d8f0d2b1","Type":"ContainerStarted","Data":"f4fac009f73336532320ea36f90930478d7f3990eb8d1a5e99b259326d5d0e9d"}
Aug 04 22:29:41.606606 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:41.606555    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-fht77" podStartSLOduration=1.968289354 podStartE2EDuration="4.606539023s" totalImagesPullingTime="2.638249669s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 22:29:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 22:29:41.605056597 +0000 UTC m=+528.597874326" watchObservedRunningTime="2026-08-04 22:29:41.606539023 +0000 UTC m=+528.599356749"
Aug 04 22:29:42.458053 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:42.457976    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2w4dp"]
Aug 04 22:29:42.458534 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:42.458262    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2w4dp" podUID="16afd1f2-ca14-48bf-82a5-c245a8d5105b" containerName="discovery" containerID="cri-o://cab90ca4046c4007e8a596932132d3167f88ff0bae253edae258b7b452170562" gracePeriod=30
Aug 04 22:29:42.459070 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:42.459050    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2w4dp"
Aug 04 22:29:42.599170 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:42.599035    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-bglnn" event={"ID":"1750f21e-34b5-4693-8a9c-4c31e01241e5","Type":"ContainerStarted","Data":"4ec2e975a85a86a6f793c08844c81d9c8cf64b0a2a71c54b76204c600787aed4"}
Aug 04 22:29:42.599170 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:42.599117    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-bglnn"
Aug 04 22:29:42.601304 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:42.601277    2580 generic.go:356] "Generic (PLEG): container finished" podID="16afd1f2-ca14-48bf-82a5-c245a8d5105b" containerID="cab90ca4046c4007e8a596932132d3167f88ff0bae253edae258b7b452170562" exitCode=0
Aug 04 22:29:42.601439 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:42.601334    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2w4dp" event={"ID":"16afd1f2-ca14-48bf-82a5-c245a8d5105b","Type":"ContainerDied","Data":"cab90ca4046c4007e8a596932132d3167f88ff0bae253edae258b7b452170562"}
Aug 04 22:29:42.617885 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:42.617822    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-bglnn" podStartSLOduration=2.224674822 podStartE2EDuration="5.61780196s" totalImagesPullingTime="3.393127138s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 22:29:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 22:29:42.614899133 +0000 UTC m=+529.607716859" watchObservedRunningTime="2026-08-04 22:29:42.61780196 +0000 UTC m=+529.610619687"
Aug 04 22:29:42.761957 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:42.761927    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2w4dp"
Aug 04 22:29:42.872940 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:42.872908    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pwkb8\" (UniqueName: \"kubernetes.io/projected/16afd1f2-ca14-48bf-82a5-c245a8d5105b-kube-api-access-pwkb8\") pod \"16afd1f2-ca14-48bf-82a5-c245a8d5105b\" (UID: \"16afd1f2-ca14-48bf-82a5-c245a8d5105b\") "
Aug 04 22:29:42.873153 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:42.872963    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/16afd1f2-ca14-48bf-82a5-c245a8d5105b-local-certs\") pod \"16afd1f2-ca14-48bf-82a5-c245a8d5105b\" (UID: \"16afd1f2-ca14-48bf-82a5-c245a8d5105b\") "
Aug 04 22:29:42.873153 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:42.873003    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/16afd1f2-ca14-48bf-82a5-c245a8d5105b-istio-token\") pod \"16afd1f2-ca14-48bf-82a5-c245a8d5105b\" (UID: \"16afd1f2-ca14-48bf-82a5-c245a8d5105b\") "
Aug 04 22:29:42.873153 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:42.873045    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/16afd1f2-ca14-48bf-82a5-c245a8d5105b-istio-csr-ca-configmap\") pod \"16afd1f2-ca14-48bf-82a5-c245a8d5105b\" (UID: \"16afd1f2-ca14-48bf-82a5-c245a8d5105b\") "
Aug 04 22:29:42.873153 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:42.873076    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/16afd1f2-ca14-48bf-82a5-c245a8d5105b-istio-kubeconfig\") pod \"16afd1f2-ca14-48bf-82a5-c245a8d5105b\" (UID: \"16afd1f2-ca14-48bf-82a5-c245a8d5105b\") "
Aug 04 22:29:42.873381 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:42.873170    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/16afd1f2-ca14-48bf-82a5-c245a8d5105b-cacerts\") pod \"16afd1f2-ca14-48bf-82a5-c245a8d5105b\" (UID: \"16afd1f2-ca14-48bf-82a5-c245a8d5105b\") "
Aug 04 22:29:42.873381 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:42.873199    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/16afd1f2-ca14-48bf-82a5-c245a8d5105b-istio-csr-dns-cert\") pod \"16afd1f2-ca14-48bf-82a5-c245a8d5105b\" (UID: \"16afd1f2-ca14-48bf-82a5-c245a8d5105b\") "
Aug 04 22:29:42.873486 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:42.873432    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/16afd1f2-ca14-48bf-82a5-c245a8d5105b-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "16afd1f2-ca14-48bf-82a5-c245a8d5105b" (UID: "16afd1f2-ca14-48bf-82a5-c245a8d5105b"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 22:29:42.873590 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:42.873545    2580 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/16afd1f2-ca14-48bf-82a5-c245a8d5105b-istio-csr-ca-configmap\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
Aug 04 22:29:42.875788 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:42.875745    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/16afd1f2-ca14-48bf-82a5-c245a8d5105b-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "16afd1f2-ca14-48bf-82a5-c245a8d5105b" (UID: "16afd1f2-ca14-48bf-82a5-c245a8d5105b"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 22:29:42.875788 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:42.875768    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/16afd1f2-ca14-48bf-82a5-c245a8d5105b-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "16afd1f2-ca14-48bf-82a5-c245a8d5105b" (UID: "16afd1f2-ca14-48bf-82a5-c245a8d5105b"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 22:29:42.875929 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:42.875827    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/16afd1f2-ca14-48bf-82a5-c245a8d5105b-local-certs" (OuterVolumeSpecName: "local-certs") pod "16afd1f2-ca14-48bf-82a5-c245a8d5105b" (UID: "16afd1f2-ca14-48bf-82a5-c245a8d5105b"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 22:29:42.876145 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:42.876106    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/16afd1f2-ca14-48bf-82a5-c245a8d5105b-istio-token" (OuterVolumeSpecName: "istio-token") pod "16afd1f2-ca14-48bf-82a5-c245a8d5105b" (UID: "16afd1f2-ca14-48bf-82a5-c245a8d5105b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 22:29:42.876419 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:42.876387    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/16afd1f2-ca14-48bf-82a5-c245a8d5105b-cacerts" (OuterVolumeSpecName: "cacerts") pod "16afd1f2-ca14-48bf-82a5-c245a8d5105b" (UID: "16afd1f2-ca14-48bf-82a5-c245a8d5105b"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 22:29:42.876560 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:42.876517    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/16afd1f2-ca14-48bf-82a5-c245a8d5105b-kube-api-access-pwkb8" (OuterVolumeSpecName: "kube-api-access-pwkb8") pod "16afd1f2-ca14-48bf-82a5-c245a8d5105b" (UID: "16afd1f2-ca14-48bf-82a5-c245a8d5105b"). InnerVolumeSpecName "kube-api-access-pwkb8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 22:29:42.974679 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:42.974600    2580 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/16afd1f2-ca14-48bf-82a5-c245a8d5105b-cacerts\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
Aug 04 22:29:42.974679 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:42.974640    2580 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/16afd1f2-ca14-48bf-82a5-c245a8d5105b-istio-csr-dns-cert\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
Aug 04 22:29:42.974679 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:42.974657    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pwkb8\" (UniqueName: \"kubernetes.io/projected/16afd1f2-ca14-48bf-82a5-c245a8d5105b-kube-api-access-pwkb8\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
Aug 04 22:29:42.974679 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:42.974672    2580 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/16afd1f2-ca14-48bf-82a5-c245a8d5105b-local-certs\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
Aug 04 22:29:42.974924 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:42.974685    2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/16afd1f2-ca14-48bf-82a5-c245a8d5105b-istio-token\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
Aug 04 22:29:42.974924 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:42.974697    2580 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/16afd1f2-ca14-48bf-82a5-c245a8d5105b-istio-kubeconfig\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
Aug 04 22:29:43.609270 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:43.609229    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2w4dp"
Aug 04 22:29:43.609270 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:43.609263    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2w4dp" event={"ID":"16afd1f2-ca14-48bf-82a5-c245a8d5105b","Type":"ContainerDied","Data":"0c7fd5954f3d4cbf2a4800e7db1844a52d0fcfb5dbb842d5854d029f7d7dcef8"}
Aug 04 22:29:43.609776 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:43.609318    2580 scope.go:117] "RemoveContainer" containerID="cab90ca4046c4007e8a596932132d3167f88ff0bae253edae258b7b452170562"
Aug 04 22:29:43.626799 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:43.626770    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2w4dp"]
Aug 04 22:29:43.630638 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:43.630614    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2w4dp"]
Aug 04 22:29:44.436522 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:44.436483    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 22:29:44.436602 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:44.436587    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 22:29:44.436646 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:44.436627    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 22:29:44.534454 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:44.534421    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-4vg4j"
Aug 04 22:29:44.538322 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:44.538292    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-lz56d"
Aug 04 22:29:44.618519 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:44.618487    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fqw42" event={"ID":"83102047-def5-4f94-a46c-a305d8f0d2b1","Type":"ContainerStarted","Data":"94d64f2d3e08f43f7552fc70e42875b52bcbf669841410b1e896e58f62af7fe2"}
Aug 04 22:29:44.637625 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:44.637564    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fqw42" podStartSLOduration=1.407856619 podStartE2EDuration="4.637541389s" totalImagesPullingTime="3.22968477s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 22:29:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 22:29:44.635091527 +0000 UTC m=+531.627909253" watchObservedRunningTime="2026-08-04 22:29:44.637541389 +0000 UTC m=+531.630359117"
Aug 04 22:29:44.654527 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:44.654456    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fqw42"
Aug 04 22:29:45.499222 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:45.499121    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="16afd1f2-ca14-48bf-82a5-c245a8d5105b" path="/var/lib/kubelet/pods/16afd1f2-ca14-48bf-82a5-c245a8d5105b/volumes"
Aug 04 22:29:45.659288 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:45.659257    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fqw42"
Aug 04 22:29:46.629073 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:46.629040    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fqw42"
Aug 04 22:29:46.630008 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:29:46.629989    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fqw42"
Aug 04 22:30:12.607039 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:12.607007    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-fht77"
Aug 04 22:30:13.611718 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:13.611687    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-bglnn"
Aug 04 22:30:31.855845 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:31.855764    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb7r844"]
Aug 04 22:30:31.856274 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:31.856121    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="16afd1f2-ca14-48bf-82a5-c245a8d5105b" containerName="discovery"
Aug 04 22:30:31.856274 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:31.856145    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="16afd1f2-ca14-48bf-82a5-c245a8d5105b" containerName="discovery"
Aug 04 22:30:31.856274 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:31.856219    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="16afd1f2-ca14-48bf-82a5-c245a8d5105b" containerName="discovery"
Aug 04 22:30:31.858452 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:31.858434    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb7r844"
Aug 04 22:30:31.860848 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:31.860831    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-692hh\""
Aug 04 22:30:31.861106 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:31.861086    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Aug 04 22:30:31.861646 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:31.861628    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Aug 04 22:30:31.869244 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:31.869219    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb7r844"]
Aug 04 22:30:31.948414 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:31.948381    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0twjj4"]
Aug 04 22:30:31.951125 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:31.951109    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0twjj4"
Aug 04 22:30:31.959764 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:31.959741    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0twjj4"]
Aug 04 22:30:32.022664 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:32.022635    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/26fac3f9-875e-44ef-b3a5-21d52e82ecad-bundle\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb7r844\" (UID: \"26fac3f9-875e-44ef-b3a5-21d52e82ecad\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb7r844"
Aug 04 22:30:32.022820 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:32.022709    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hldkl\" (UniqueName: \"kubernetes.io/projected/26fac3f9-875e-44ef-b3a5-21d52e82ecad-kube-api-access-hldkl\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb7r844\" (UID: \"26fac3f9-875e-44ef-b3a5-21d52e82ecad\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb7r844"
Aug 04 22:30:32.022820 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:32.022748    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/26fac3f9-875e-44ef-b3a5-21d52e82ecad-util\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb7r844\" (UID: \"26fac3f9-875e-44ef-b3a5-21d52e82ecad\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb7r844"
Aug 04 22:30:32.045374 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:32.045340    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053scqz6"]
Aug 04 22:30:32.048022 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:32.048007    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053scqz6"
Aug 04 22:30:32.057596 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:32.057575    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053scqz6"]
Aug 04 22:30:32.124050 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:32.123956    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ml57v\" (UniqueName: \"kubernetes.io/projected/965f928c-4865-4664-b81e-8b5811d34f8f-kube-api-access-ml57v\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053scqz6\" (UID: \"965f928c-4865-4664-b81e-8b5811d34f8f\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053scqz6"
Aug 04 22:30:32.124050 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:32.124010    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hldkl\" (UniqueName: \"kubernetes.io/projected/26fac3f9-875e-44ef-b3a5-21d52e82ecad-kube-api-access-hldkl\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb7r844\" (UID: \"26fac3f9-875e-44ef-b3a5-21d52e82ecad\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb7r844"
Aug 04 22:30:32.124323 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:32.124070    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8aadb63b-95fb-4b96-b6ef-5e76a9e0b8cb-bundle\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0twjj4\" (UID: \"8aadb63b-95fb-4b96-b6ef-5e76a9e0b8cb\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0twjj4"
Aug 04 22:30:32.124323 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:32.124101    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/26fac3f9-875e-44ef-b3a5-21d52e82ecad-util\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb7r844\" (UID: \"26fac3f9-875e-44ef-b3a5-21d52e82ecad\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb7r844"
Aug 04 22:30:32.124323 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:32.124122    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/965f928c-4865-4664-b81e-8b5811d34f8f-util\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053scqz6\" (UID: \"965f928c-4865-4664-b81e-8b5811d34f8f\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053scqz6"
Aug 04 22:30:32.124323 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:32.124179    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9xcbp\" (UniqueName: \"kubernetes.io/projected/8aadb63b-95fb-4b96-b6ef-5e76a9e0b8cb-kube-api-access-9xcbp\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0twjj4\" (UID: \"8aadb63b-95fb-4b96-b6ef-5e76a9e0b8cb\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0twjj4"
Aug 04 22:30:32.124323 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:32.124200    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/965f928c-4865-4664-b81e-8b5811d34f8f-bundle\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053scqz6\" (UID: \"965f928c-4865-4664-b81e-8b5811d34f8f\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053scqz6"
Aug 04 22:30:32.124323 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:32.124234    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/26fac3f9-875e-44ef-b3a5-21d52e82ecad-bundle\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb7r844\" (UID: \"26fac3f9-875e-44ef-b3a5-21d52e82ecad\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb7r844"
Aug 04 22:30:32.124323 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:32.124308    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8aadb63b-95fb-4b96-b6ef-5e76a9e0b8cb-util\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0twjj4\" (UID: \"8aadb63b-95fb-4b96-b6ef-5e76a9e0b8cb\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0twjj4"
Aug 04 22:30:32.124628 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:32.124454    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/26fac3f9-875e-44ef-b3a5-21d52e82ecad-util\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb7r844\" (UID: \"26fac3f9-875e-44ef-b3a5-21d52e82ecad\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb7r844"
Aug 04 22:30:32.124628 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:32.124527    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/26fac3f9-875e-44ef-b3a5-21d52e82ecad-bundle\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb7r844\" (UID: \"26fac3f9-875e-44ef-b3a5-21d52e82ecad\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb7r844"
Aug 04 22:30:32.136405 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:32.136377    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hldkl\" (UniqueName: \"kubernetes.io/projected/26fac3f9-875e-44ef-b3a5-21d52e82ecad-kube-api-access-hldkl\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb7r844\" (UID: \"26fac3f9-875e-44ef-b3a5-21d52e82ecad\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb7r844"
Aug 04 22:30:32.144923 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:32.144899    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cg9ql6"]
Aug 04 22:30:32.147617 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:32.147602    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cg9ql6"
Aug 04 22:30:32.157167 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:32.157141    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cg9ql6"]
Aug 04 22:30:32.168151 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:32.168119    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb7r844"
Aug 04 22:30:32.225766 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:32.225728    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8aadb63b-95fb-4b96-b6ef-5e76a9e0b8cb-bundle\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0twjj4\" (UID: \"8aadb63b-95fb-4b96-b6ef-5e76a9e0b8cb\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0twjj4"
Aug 04 22:30:32.225931 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:32.225788    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/948d6560-2c2a-4c11-8bfc-55585a8cf317-bundle\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cg9ql6\" (UID: \"948d6560-2c2a-4c11-8bfc-55585a8cf317\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cg9ql6"
Aug 04 22:30:32.225931 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:32.225829    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/965f928c-4865-4664-b81e-8b5811d34f8f-util\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053scqz6\" (UID: \"965f928c-4865-4664-b81e-8b5811d34f8f\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053scqz6"
Aug 04 22:30:32.225931 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:32.225871    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9xcbp\" (UniqueName: \"kubernetes.io/projected/8aadb63b-95fb-4b96-b6ef-5e76a9e0b8cb-kube-api-access-9xcbp\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0twjj4\" (UID: \"8aadb63b-95fb-4b96-b6ef-5e76a9e0b8cb\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0twjj4"
Aug 04 22:30:32.225931 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:32.225895    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/965f928c-4865-4664-b81e-8b5811d34f8f-bundle\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053scqz6\" (UID: \"965f928c-4865-4664-b81e-8b5811d34f8f\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053scqz6"
Aug 04 22:30:32.226391 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:32.225946    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/948d6560-2c2a-4c11-8bfc-55585a8cf317-util\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cg9ql6\" (UID: \"948d6560-2c2a-4c11-8bfc-55585a8cf317\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cg9ql6"
Aug 04 22:30:32.226391 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:32.225981    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8aadb63b-95fb-4b96-b6ef-5e76a9e0b8cb-util\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0twjj4\" (UID: \"8aadb63b-95fb-4b96-b6ef-5e76a9e0b8cb\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0twjj4"
Aug 04 22:30:32.226391 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:32.226007    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kpxx2\" (UniqueName: \"kubernetes.io/projected/948d6560-2c2a-4c11-8bfc-55585a8cf317-kube-api-access-kpxx2\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cg9ql6\" (UID: \"948d6560-2c2a-4c11-8bfc-55585a8cf317\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cg9ql6"
Aug 04 22:30:32.226391 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:32.226088    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ml57v\" (UniqueName: \"kubernetes.io/projected/965f928c-4865-4664-b81e-8b5811d34f8f-kube-api-access-ml57v\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053scqz6\" (UID: \"965f928c-4865-4664-b81e-8b5811d34f8f\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053scqz6"
Aug 04 22:30:32.226894 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:32.226869    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8aadb63b-95fb-4b96-b6ef-5e76a9e0b8cb-bundle\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0twjj4\" (UID: \"8aadb63b-95fb-4b96-b6ef-5e76a9e0b8cb\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0twjj4"
Aug 04 22:30:32.227457 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:32.227195    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/965f928c-4865-4664-b81e-8b5811d34f8f-util\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053scqz6\" (UID: \"965f928c-4865-4664-b81e-8b5811d34f8f\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053scqz6"
Aug 04 22:30:32.227457 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:32.227351    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8aadb63b-95fb-4b96-b6ef-5e76a9e0b8cb-util\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0twjj4\" (UID: \"8aadb63b-95fb-4b96-b6ef-5e76a9e0b8cb\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0twjj4"
Aug 04 22:30:32.227457 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:32.227397    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/965f928c-4865-4664-b81e-8b5811d34f8f-bundle\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053scqz6\" (UID: \"965f928c-4865-4664-b81e-8b5811d34f8f\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053scqz6"
Aug 04 22:30:32.234830 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:32.234778    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ml57v\" (UniqueName: \"kubernetes.io/projected/965f928c-4865-4664-b81e-8b5811d34f8f-kube-api-access-ml57v\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053scqz6\" (UID: \"965f928c-4865-4664-b81e-8b5811d34f8f\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053scqz6"
Aug 04 22:30:32.234953 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:32.234932    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9xcbp\" (UniqueName: \"kubernetes.io/projected/8aadb63b-95fb-4b96-b6ef-5e76a9e0b8cb-kube-api-access-9xcbp\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0twjj4\" (UID: \"8aadb63b-95fb-4b96-b6ef-5e76a9e0b8cb\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0twjj4"
Aug 04 22:30:32.260526 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:32.260465    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0twjj4"
Aug 04 22:30:32.305287 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:32.305261    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb7r844"]
Aug 04 22:30:32.307338 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:30:32.307309    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26fac3f9_875e_44ef_b3a5_21d52e82ecad.slice/crio-5e122e9caee851ba9482078259515d85b0dbe13b528a60577f1f530da2e2de6f WatchSource:0}: Error finding container 5e122e9caee851ba9482078259515d85b0dbe13b528a60577f1f530da2e2de6f: Status 404 returned error can't find the container with id 5e122e9caee851ba9482078259515d85b0dbe13b528a60577f1f530da2e2de6f
Aug 04 22:30:32.326964 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:32.326913    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/948d6560-2c2a-4c11-8bfc-55585a8cf317-bundle\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cg9ql6\" (UID: \"948d6560-2c2a-4c11-8bfc-55585a8cf317\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cg9ql6"
Aug 04 22:30:32.327110 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:32.326995    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/948d6560-2c2a-4c11-8bfc-55585a8cf317-util\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cg9ql6\" (UID: \"948d6560-2c2a-4c11-8bfc-55585a8cf317\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cg9ql6"
Aug 04 22:30:32.327110 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:32.327029    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kpxx2\" (UniqueName: \"kubernetes.io/projected/948d6560-2c2a-4c11-8bfc-55585a8cf317-kube-api-access-kpxx2\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cg9ql6\" (UID: \"948d6560-2c2a-4c11-8bfc-55585a8cf317\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cg9ql6"
Aug 04 22:30:32.327630 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:32.327606    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/948d6560-2c2a-4c11-8bfc-55585a8cf317-bundle\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cg9ql6\" (UID: \"948d6560-2c2a-4c11-8bfc-55585a8cf317\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cg9ql6"
Aug 04 22:30:32.327737 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:32.327632    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/948d6560-2c2a-4c11-8bfc-55585a8cf317-util\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cg9ql6\" (UID: \"948d6560-2c2a-4c11-8bfc-55585a8cf317\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cg9ql6"
Aug 04 22:30:32.334740 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:32.334719    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kpxx2\" (UniqueName: \"kubernetes.io/projected/948d6560-2c2a-4c11-8bfc-55585a8cf317-kube-api-access-kpxx2\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cg9ql6\" (UID: \"948d6560-2c2a-4c11-8bfc-55585a8cf317\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cg9ql6"
Aug 04 22:30:32.357635 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:32.357609    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053scqz6"
Aug 04 22:30:32.405157 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:32.405110    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0twjj4"]
Aug 04 22:30:32.407329 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:30:32.407299    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8aadb63b_95fb_4b96_b6ef_5e76a9e0b8cb.slice/crio-c584474d84a6f32a0292509f77e3717b6e4bf52c307143be5b0859bd99c71208 WatchSource:0}: Error finding container c584474d84a6f32a0292509f77e3717b6e4bf52c307143be5b0859bd99c71208: Status 404 returned error can't find the container with id c584474d84a6f32a0292509f77e3717b6e4bf52c307143be5b0859bd99c71208
Aug 04 22:30:32.457183 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:32.457158    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cg9ql6"
Aug 04 22:30:32.501556 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:32.501238    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053scqz6"]
Aug 04 22:30:32.503290 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:30:32.503267    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod965f928c_4865_4664_b81e_8b5811d34f8f.slice/crio-d80380cd422d3bb5528b750615d4d6a40415b09772151ea1863c7e427451bafe WatchSource:0}: Error finding container d80380cd422d3bb5528b750615d4d6a40415b09772151ea1863c7e427451bafe: Status 404 returned error can't find the container with id d80380cd422d3bb5528b750615d4d6a40415b09772151ea1863c7e427451bafe
Aug 04 22:30:32.616619 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:32.616589    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cg9ql6"]
Aug 04 22:30:32.663076 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:30:32.663002    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod948d6560_2c2a_4c11_8bfc_55585a8cf317.slice/crio-9956d0f7b464047cf67008a4ae625f6ee1a5a7854a7b7b7681d76d8e598755b0 WatchSource:0}: Error finding container 9956d0f7b464047cf67008a4ae625f6ee1a5a7854a7b7b7681d76d8e598755b0: Status 404 returned error can't find the container with id 9956d0f7b464047cf67008a4ae625f6ee1a5a7854a7b7b7681d76d8e598755b0
Aug 04 22:30:32.860889 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:32.860857    2580 generic.go:356] "Generic (PLEG): container finished" podID="948d6560-2c2a-4c11-8bfc-55585a8cf317" containerID="b292a8cd8644a9cb32164ad7f900b73590e92095d978eb9989f6d08cc2e4a2b6" exitCode=0
Aug 04 22:30:32.861345 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:32.860945    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cg9ql6" event={"ID":"948d6560-2c2a-4c11-8bfc-55585a8cf317","Type":"ContainerDied","Data":"b292a8cd8644a9cb32164ad7f900b73590e92095d978eb9989f6d08cc2e4a2b6"}
Aug 04 22:30:32.861345 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:32.861004    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cg9ql6" event={"ID":"948d6560-2c2a-4c11-8bfc-55585a8cf317","Type":"ContainerStarted","Data":"9956d0f7b464047cf67008a4ae625f6ee1a5a7854a7b7b7681d76d8e598755b0"}
Aug 04 22:30:32.862532 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:32.862514    2580 generic.go:356] "Generic (PLEG): container finished" podID="8aadb63b-95fb-4b96-b6ef-5e76a9e0b8cb" containerID="39ea73f1f37b9f10ba73e58d8350a3d2c818af5e9d8254f15157518e05d3eb26" exitCode=0
Aug 04 22:30:32.862626 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:32.862582    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0twjj4" event={"ID":"8aadb63b-95fb-4b96-b6ef-5e76a9e0b8cb","Type":"ContainerDied","Data":"39ea73f1f37b9f10ba73e58d8350a3d2c818af5e9d8254f15157518e05d3eb26"}
Aug 04 22:30:32.862678 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:32.862653    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0twjj4" event={"ID":"8aadb63b-95fb-4b96-b6ef-5e76a9e0b8cb","Type":"ContainerStarted","Data":"c584474d84a6f32a0292509f77e3717b6e4bf52c307143be5b0859bd99c71208"}
Aug 04 22:30:32.870376 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:32.870331    2580 generic.go:356] "Generic (PLEG): container finished" podID="26fac3f9-875e-44ef-b3a5-21d52e82ecad" containerID="cfb7eb70f3a134387ec57c18c487c9c854a05964d8cc60205d968de37a631572" exitCode=0
Aug 04 22:30:32.870447 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:32.870395    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb7r844" event={"ID":"26fac3f9-875e-44ef-b3a5-21d52e82ecad","Type":"ContainerDied","Data":"cfb7eb70f3a134387ec57c18c487c9c854a05964d8cc60205d968de37a631572"}
Aug 04 22:30:32.870530 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:32.870472    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb7r844" event={"ID":"26fac3f9-875e-44ef-b3a5-21d52e82ecad","Type":"ContainerStarted","Data":"5e122e9caee851ba9482078259515d85b0dbe13b528a60577f1f530da2e2de6f"}
Aug 04 22:30:32.872061 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:32.872039    2580 generic.go:356] "Generic (PLEG): container finished" podID="965f928c-4865-4664-b81e-8b5811d34f8f" containerID="48a0077030d9b92aed9b8d78c3d728a08534db3283f30380e7e1c0b859dd35a9" exitCode=0
Aug 04 22:30:32.872195 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:32.872065    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053scqz6" event={"ID":"965f928c-4865-4664-b81e-8b5811d34f8f","Type":"ContainerDied","Data":"48a0077030d9b92aed9b8d78c3d728a08534db3283f30380e7e1c0b859dd35a9"}
Aug 04 22:30:32.872195 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:32.872105    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053scqz6" event={"ID":"965f928c-4865-4664-b81e-8b5811d34f8f","Type":"ContainerStarted","Data":"d80380cd422d3bb5528b750615d4d6a40415b09772151ea1863c7e427451bafe"}
Aug 04 22:30:34.884032 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:34.883996    2580 generic.go:356] "Generic (PLEG): container finished" podID="948d6560-2c2a-4c11-8bfc-55585a8cf317" containerID="04265df2c49f162548e60837b93dfbc24b804607fa8a59d152a5bc0405acabbd" exitCode=0
Aug 04 22:30:34.884520 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:34.884072    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cg9ql6" event={"ID":"948d6560-2c2a-4c11-8bfc-55585a8cf317","Type":"ContainerDied","Data":"04265df2c49f162548e60837b93dfbc24b804607fa8a59d152a5bc0405acabbd"}
Aug 04 22:30:34.886026 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:34.886006    2580 generic.go:356] "Generic (PLEG): container finished" podID="8aadb63b-95fb-4b96-b6ef-5e76a9e0b8cb" containerID="6542f9d59e3ac08461db055be5d18f5419cd2be0de77c1f1d74cd3a1664623a8" exitCode=0
Aug 04 22:30:34.886150 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:34.886033    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0twjj4" event={"ID":"8aadb63b-95fb-4b96-b6ef-5e76a9e0b8cb","Type":"ContainerDied","Data":"6542f9d59e3ac08461db055be5d18f5419cd2be0de77c1f1d74cd3a1664623a8"}
Aug 04 22:30:34.888122 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:34.888102    2580 generic.go:356] "Generic (PLEG): container finished" podID="26fac3f9-875e-44ef-b3a5-21d52e82ecad" containerID="181aa2e98075a9f1d9e16d86007d45b4b2835be9611644926f13e8437ee96f8c" exitCode=0
Aug 04 22:30:34.888244 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:34.888210    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb7r844" event={"ID":"26fac3f9-875e-44ef-b3a5-21d52e82ecad","Type":"ContainerDied","Data":"181aa2e98075a9f1d9e16d86007d45b4b2835be9611644926f13e8437ee96f8c"}
Aug 04 22:30:34.890168 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:34.890123    2580 generic.go:356] "Generic (PLEG): container finished" podID="965f928c-4865-4664-b81e-8b5811d34f8f" containerID="619e10798338a7c71c50f234e669cdc05cc7c59a9599733fdb6251013c4ab698" exitCode=0
Aug 04 22:30:34.890249 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:34.890182    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053scqz6" event={"ID":"965f928c-4865-4664-b81e-8b5811d34f8f","Type":"ContainerDied","Data":"619e10798338a7c71c50f234e669cdc05cc7c59a9599733fdb6251013c4ab698"}
Aug 04 22:30:35.898063 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:35.898026    2580 generic.go:356] "Generic (PLEG): container finished" podID="26fac3f9-875e-44ef-b3a5-21d52e82ecad" containerID="de7bf2ff7e8a28168c2e6067b88ccbfa231aab4dc449e9a61b7e8a6351a3cf80" exitCode=0
Aug 04 22:30:35.898494 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:35.898110    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb7r844" event={"ID":"26fac3f9-875e-44ef-b3a5-21d52e82ecad","Type":"ContainerDied","Data":"de7bf2ff7e8a28168c2e6067b88ccbfa231aab4dc449e9a61b7e8a6351a3cf80"}
Aug 04 22:30:35.899994 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:35.899971    2580 generic.go:356] "Generic (PLEG): container finished" podID="965f928c-4865-4664-b81e-8b5811d34f8f" containerID="c0ff93cbd95ce470c075457bba950d3bf4f39c88cff5e2bb3f41fffc42751b07" exitCode=0
Aug 04 22:30:35.900107 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:35.900047    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053scqz6" event={"ID":"965f928c-4865-4664-b81e-8b5811d34f8f","Type":"ContainerDied","Data":"c0ff93cbd95ce470c075457bba950d3bf4f39c88cff5e2bb3f41fffc42751b07"}
Aug 04 22:30:35.901963 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:35.901941    2580 generic.go:356] "Generic (PLEG): container finished" podID="948d6560-2c2a-4c11-8bfc-55585a8cf317" containerID="58a4f733efe7326a06cb7f932b456e1b6e3d5eee5442e9dff7491540e2b52964" exitCode=0
Aug 04 22:30:35.902064 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:35.902022    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cg9ql6" event={"ID":"948d6560-2c2a-4c11-8bfc-55585a8cf317","Type":"ContainerDied","Data":"58a4f733efe7326a06cb7f932b456e1b6e3d5eee5442e9dff7491540e2b52964"}
Aug 04 22:30:35.903738 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:35.903717    2580 generic.go:356] "Generic (PLEG): container finished" podID="8aadb63b-95fb-4b96-b6ef-5e76a9e0b8cb" containerID="80a3896e39fb4c73781bbec2e4e8a78f557fc0343c242d4e461a58fa67a0f26f" exitCode=0
Aug 04 22:30:35.903807 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:35.903754    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0twjj4" event={"ID":"8aadb63b-95fb-4b96-b6ef-5e76a9e0b8cb","Type":"ContainerDied","Data":"80a3896e39fb4c73781bbec2e4e8a78f557fc0343c242d4e461a58fa67a0f26f"}
Aug 04 22:30:37.082970 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:37.082918    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cg9ql6"
Aug 04 22:30:37.129119 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:37.129093    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053scqz6"
Aug 04 22:30:37.132444 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:37.132425    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0twjj4"
Aug 04 22:30:37.135725 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:37.135708    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb7r844"
Aug 04 22:30:37.172518 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:37.172455    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/948d6560-2c2a-4c11-8bfc-55585a8cf317-util\") pod \"948d6560-2c2a-4c11-8bfc-55585a8cf317\" (UID: \"948d6560-2c2a-4c11-8bfc-55585a8cf317\") "
Aug 04 22:30:37.172518 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:37.172508    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/948d6560-2c2a-4c11-8bfc-55585a8cf317-bundle\") pod \"948d6560-2c2a-4c11-8bfc-55585a8cf317\" (UID: \"948d6560-2c2a-4c11-8bfc-55585a8cf317\") "
Aug 04 22:30:37.172685 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:37.172534    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kpxx2\" (UniqueName: \"kubernetes.io/projected/948d6560-2c2a-4c11-8bfc-55585a8cf317-kube-api-access-kpxx2\") pod \"948d6560-2c2a-4c11-8bfc-55585a8cf317\" (UID: \"948d6560-2c2a-4c11-8bfc-55585a8cf317\") "
Aug 04 22:30:37.173082 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:37.173052    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/948d6560-2c2a-4c11-8bfc-55585a8cf317-bundle" (OuterVolumeSpecName: "bundle") pod "948d6560-2c2a-4c11-8bfc-55585a8cf317" (UID: "948d6560-2c2a-4c11-8bfc-55585a8cf317"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 22:30:37.174641 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:37.174614    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/948d6560-2c2a-4c11-8bfc-55585a8cf317-kube-api-access-kpxx2" (OuterVolumeSpecName: "kube-api-access-kpxx2") pod "948d6560-2c2a-4c11-8bfc-55585a8cf317" (UID: "948d6560-2c2a-4c11-8bfc-55585a8cf317"). InnerVolumeSpecName "kube-api-access-kpxx2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 22:30:37.177518 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:37.177497    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/948d6560-2c2a-4c11-8bfc-55585a8cf317-util" (OuterVolumeSpecName: "util") pod "948d6560-2c2a-4c11-8bfc-55585a8cf317" (UID: "948d6560-2c2a-4c11-8bfc-55585a8cf317"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 22:30:37.273729 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:37.273689    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/26fac3f9-875e-44ef-b3a5-21d52e82ecad-util\") pod \"26fac3f9-875e-44ef-b3a5-21d52e82ecad\" (UID: \"26fac3f9-875e-44ef-b3a5-21d52e82ecad\") "
Aug 04 22:30:37.273932 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:37.273747    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ml57v\" (UniqueName: \"kubernetes.io/projected/965f928c-4865-4664-b81e-8b5811d34f8f-kube-api-access-ml57v\") pod \"965f928c-4865-4664-b81e-8b5811d34f8f\" (UID: \"965f928c-4865-4664-b81e-8b5811d34f8f\") "
Aug 04 22:30:37.273932 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:37.273771    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8aadb63b-95fb-4b96-b6ef-5e76a9e0b8cb-bundle\") pod \"8aadb63b-95fb-4b96-b6ef-5e76a9e0b8cb\" (UID: \"8aadb63b-95fb-4b96-b6ef-5e76a9e0b8cb\") "
Aug 04 22:30:37.273932 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:37.273836    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/965f928c-4865-4664-b81e-8b5811d34f8f-util\") pod \"965f928c-4865-4664-b81e-8b5811d34f8f\" (UID: \"965f928c-4865-4664-b81e-8b5811d34f8f\") "
Aug 04 22:30:37.273932 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:37.273862    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hldkl\" (UniqueName: \"kubernetes.io/projected/26fac3f9-875e-44ef-b3a5-21d52e82ecad-kube-api-access-hldkl\") pod \"26fac3f9-875e-44ef-b3a5-21d52e82ecad\" (UID: \"26fac3f9-875e-44ef-b3a5-21d52e82ecad\") "
Aug 04 22:30:37.273932 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:37.273883    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/965f928c-4865-4664-b81e-8b5811d34f8f-bundle\") pod \"965f928c-4865-4664-b81e-8b5811d34f8f\" (UID: \"965f928c-4865-4664-b81e-8b5811d34f8f\") "
Aug 04 22:30:37.273932 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:37.273923    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/26fac3f9-875e-44ef-b3a5-21d52e82ecad-bundle\") pod \"26fac3f9-875e-44ef-b3a5-21d52e82ecad\" (UID: \"26fac3f9-875e-44ef-b3a5-21d52e82ecad\") "
Aug 04 22:30:37.274299 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:37.273947    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9xcbp\" (UniqueName: \"kubernetes.io/projected/8aadb63b-95fb-4b96-b6ef-5e76a9e0b8cb-kube-api-access-9xcbp\") pod \"8aadb63b-95fb-4b96-b6ef-5e76a9e0b8cb\" (UID: \"8aadb63b-95fb-4b96-b6ef-5e76a9e0b8cb\") "
Aug 04 22:30:37.274299 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:37.273970    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8aadb63b-95fb-4b96-b6ef-5e76a9e0b8cb-util\") pod \"8aadb63b-95fb-4b96-b6ef-5e76a9e0b8cb\" (UID: \"8aadb63b-95fb-4b96-b6ef-5e76a9e0b8cb\") "
Aug 04 22:30:37.274299 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:37.274287    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kpxx2\" (UniqueName: \"kubernetes.io/projected/948d6560-2c2a-4c11-8bfc-55585a8cf317-kube-api-access-kpxx2\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
Aug 04 22:30:37.274593 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:37.274313    2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/948d6560-2c2a-4c11-8bfc-55585a8cf317-util\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
Aug 04 22:30:37.274593 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:37.274333    2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/948d6560-2c2a-4c11-8bfc-55585a8cf317-bundle\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
Aug 04 22:30:37.274593 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:37.274390    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8aadb63b-95fb-4b96-b6ef-5e76a9e0b8cb-bundle" (OuterVolumeSpecName: "bundle") pod "8aadb63b-95fb-4b96-b6ef-5e76a9e0b8cb" (UID: "8aadb63b-95fb-4b96-b6ef-5e76a9e0b8cb"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 22:30:37.274764 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:37.274679    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26fac3f9-875e-44ef-b3a5-21d52e82ecad-bundle" (OuterVolumeSpecName: "bundle") pod "26fac3f9-875e-44ef-b3a5-21d52e82ecad" (UID: "26fac3f9-875e-44ef-b3a5-21d52e82ecad"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 22:30:37.274918 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:37.274889    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/965f928c-4865-4664-b81e-8b5811d34f8f-bundle" (OuterVolumeSpecName: "bundle") pod "965f928c-4865-4664-b81e-8b5811d34f8f" (UID: "965f928c-4865-4664-b81e-8b5811d34f8f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 22:30:37.276611 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:37.276586    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/26fac3f9-875e-44ef-b3a5-21d52e82ecad-kube-api-access-hldkl" (OuterVolumeSpecName: "kube-api-access-hldkl") pod "26fac3f9-875e-44ef-b3a5-21d52e82ecad" (UID: "26fac3f9-875e-44ef-b3a5-21d52e82ecad"). InnerVolumeSpecName "kube-api-access-hldkl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 22:30:37.276611 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:37.276601    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8aadb63b-95fb-4b96-b6ef-5e76a9e0b8cb-kube-api-access-9xcbp" (OuterVolumeSpecName: "kube-api-access-9xcbp") pod "8aadb63b-95fb-4b96-b6ef-5e76a9e0b8cb" (UID: "8aadb63b-95fb-4b96-b6ef-5e76a9e0b8cb"). InnerVolumeSpecName "kube-api-access-9xcbp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 22:30:37.276819 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:37.276802    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/965f928c-4865-4664-b81e-8b5811d34f8f-kube-api-access-ml57v" (OuterVolumeSpecName: "kube-api-access-ml57v") pod "965f928c-4865-4664-b81e-8b5811d34f8f" (UID: "965f928c-4865-4664-b81e-8b5811d34f8f"). InnerVolumeSpecName "kube-api-access-ml57v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 22:30:37.280346 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:37.280327    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8aadb63b-95fb-4b96-b6ef-5e76a9e0b8cb-util" (OuterVolumeSpecName: "util") pod "8aadb63b-95fb-4b96-b6ef-5e76a9e0b8cb" (UID: "8aadb63b-95fb-4b96-b6ef-5e76a9e0b8cb"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 22:30:37.280399 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:37.280341    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/965f928c-4865-4664-b81e-8b5811d34f8f-util" (OuterVolumeSpecName: "util") pod "965f928c-4865-4664-b81e-8b5811d34f8f" (UID: "965f928c-4865-4664-b81e-8b5811d34f8f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 22:30:37.280709 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:37.280690    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26fac3f9-875e-44ef-b3a5-21d52e82ecad-util" (OuterVolumeSpecName: "util") pod "26fac3f9-875e-44ef-b3a5-21d52e82ecad" (UID: "26fac3f9-875e-44ef-b3a5-21d52e82ecad"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 22:30:37.375642 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:37.375607    2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/965f928c-4865-4664-b81e-8b5811d34f8f-util\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
Aug 04 22:30:37.375642 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:37.375634    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hldkl\" (UniqueName: \"kubernetes.io/projected/26fac3f9-875e-44ef-b3a5-21d52e82ecad-kube-api-access-hldkl\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
Aug 04 22:30:37.375642 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:37.375645    2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/965f928c-4865-4664-b81e-8b5811d34f8f-bundle\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
Aug 04 22:30:37.375642 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:37.375653    2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/26fac3f9-875e-44ef-b3a5-21d52e82ecad-bundle\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
Aug 04 22:30:37.375883 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:37.375661    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9xcbp\" (UniqueName: \"kubernetes.io/projected/8aadb63b-95fb-4b96-b6ef-5e76a9e0b8cb-kube-api-access-9xcbp\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
Aug 04 22:30:37.375883 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:37.375670    2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8aadb63b-95fb-4b96-b6ef-5e76a9e0b8cb-util\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
Aug 04 22:30:37.375883 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:37.375677    2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/26fac3f9-875e-44ef-b3a5-21d52e82ecad-util\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
Aug 04 22:30:37.375883 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:37.375686    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ml57v\" (UniqueName: \"kubernetes.io/projected/965f928c-4865-4664-b81e-8b5811d34f8f-kube-api-access-ml57v\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
Aug 04 22:30:37.375883 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:37.375695    2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8aadb63b-95fb-4b96-b6ef-5e76a9e0b8cb-bundle\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
Aug 04 22:30:37.916329 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:37.916298    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0twjj4"
Aug 04 22:30:37.916517 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:37.916329    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0twjj4" event={"ID":"8aadb63b-95fb-4b96-b6ef-5e76a9e0b8cb","Type":"ContainerDied","Data":"c584474d84a6f32a0292509f77e3717b6e4bf52c307143be5b0859bd99c71208"}
Aug 04 22:30:37.916517 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:37.916378    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c584474d84a6f32a0292509f77e3717b6e4bf52c307143be5b0859bd99c71208"
Aug 04 22:30:37.918497 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:37.918469    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb7r844" event={"ID":"26fac3f9-875e-44ef-b3a5-21d52e82ecad","Type":"ContainerDied","Data":"5e122e9caee851ba9482078259515d85b0dbe13b528a60577f1f530da2e2de6f"}
Aug 04 22:30:37.918596 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:37.918518    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5e122e9caee851ba9482078259515d85b0dbe13b528a60577f1f530da2e2de6f"
Aug 04 22:30:37.918596 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:37.918519    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb7r844"
Aug 04 22:30:37.920905 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:37.920879    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053scqz6" event={"ID":"965f928c-4865-4664-b81e-8b5811d34f8f","Type":"ContainerDied","Data":"d80380cd422d3bb5528b750615d4d6a40415b09772151ea1863c7e427451bafe"}
Aug 04 22:30:37.921008 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:37.920919    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d80380cd422d3bb5528b750615d4d6a40415b09772151ea1863c7e427451bafe"
Aug 04 22:30:37.921008 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:37.920974    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053scqz6"
Aug 04 22:30:37.923210 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:37.923185    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cg9ql6" event={"ID":"948d6560-2c2a-4c11-8bfc-55585a8cf317","Type":"ContainerDied","Data":"9956d0f7b464047cf67008a4ae625f6ee1a5a7854a7b7b7681d76d8e598755b0"}
Aug 04 22:30:37.923292 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:37.923227    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9956d0f7b464047cf67008a4ae625f6ee1a5a7854a7b7b7681d76d8e598755b0"
Aug 04 22:30:37.923292 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:37.923191    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cg9ql6"
Aug 04 22:30:43.209254 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:43.209216    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-j7k2n"]
Aug 04 22:30:43.209636 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:43.209622    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8aadb63b-95fb-4b96-b6ef-5e76a9e0b8cb" containerName="util"
Aug 04 22:30:43.209636 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:43.209635    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="8aadb63b-95fb-4b96-b6ef-5e76a9e0b8cb" containerName="util"
Aug 04 22:30:43.209717 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:43.209644    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="965f928c-4865-4664-b81e-8b5811d34f8f" containerName="util"
Aug 04 22:30:43.209717 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:43.209650    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="965f928c-4865-4664-b81e-8b5811d34f8f" containerName="util"
Aug 04 22:30:43.209717 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:43.209656    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="965f928c-4865-4664-b81e-8b5811d34f8f" containerName="pull"
Aug 04 22:30:43.209717 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:43.209662    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="965f928c-4865-4664-b81e-8b5811d34f8f" containerName="pull"
Aug 04 22:30:43.209717 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:43.209673    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="965f928c-4865-4664-b81e-8b5811d34f8f" containerName="extract"
Aug 04 22:30:43.209717 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:43.209678    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="965f928c-4865-4664-b81e-8b5811d34f8f" containerName="extract"
Aug 04 22:30:43.209717 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:43.209686    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8aadb63b-95fb-4b96-b6ef-5e76a9e0b8cb" containerName="extract"
Aug 04 22:30:43.209717 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:43.209691    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="8aadb63b-95fb-4b96-b6ef-5e76a9e0b8cb" containerName="extract"
Aug 04 22:30:43.209717 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:43.209703    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26fac3f9-875e-44ef-b3a5-21d52e82ecad" containerName="extract"
Aug 04 22:30:43.209717 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:43.209708    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="26fac3f9-875e-44ef-b3a5-21d52e82ecad" containerName="extract"
Aug 04 22:30:43.209717 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:43.209716    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="948d6560-2c2a-4c11-8bfc-55585a8cf317" containerName="util"
Aug 04 22:30:43.209717 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:43.209721    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="948d6560-2c2a-4c11-8bfc-55585a8cf317" containerName="util"
Aug 04 22:30:43.210057 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:43.209727    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26fac3f9-875e-44ef-b3a5-21d52e82ecad" containerName="pull"
Aug 04 22:30:43.210057 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:43.209732    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="26fac3f9-875e-44ef-b3a5-21d52e82ecad" containerName="pull"
Aug 04 22:30:43.210057 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:43.209737    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8aadb63b-95fb-4b96-b6ef-5e76a9e0b8cb" containerName="pull"
Aug 04 22:30:43.210057 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:43.209742    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="8aadb63b-95fb-4b96-b6ef-5e76a9e0b8cb" containerName="pull"
Aug 04 22:30:43.210057 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:43.209747    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="948d6560-2c2a-4c11-8bfc-55585a8cf317" containerName="extract"
Aug 04 22:30:43.210057 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:43.209752    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="948d6560-2c2a-4c11-8bfc-55585a8cf317" containerName="extract"
Aug 04 22:30:43.210057 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:43.209761    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="948d6560-2c2a-4c11-8bfc-55585a8cf317" containerName="pull"
Aug 04 22:30:43.210057 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:43.209766    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="948d6560-2c2a-4c11-8bfc-55585a8cf317" containerName="pull"
Aug 04 22:30:43.210057 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:43.209772    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26fac3f9-875e-44ef-b3a5-21d52e82ecad" containerName="util"
Aug 04 22:30:43.210057 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:43.209777    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="26fac3f9-875e-44ef-b3a5-21d52e82ecad" containerName="util"
Aug 04 22:30:43.210057 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:43.209831    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="948d6560-2c2a-4c11-8bfc-55585a8cf317" containerName="extract"
Aug 04 22:30:43.210057 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:43.209838    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="8aadb63b-95fb-4b96-b6ef-5e76a9e0b8cb" containerName="extract"
Aug 04 22:30:43.210057 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:43.209847    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="965f928c-4865-4664-b81e-8b5811d34f8f" containerName="extract"
Aug 04 22:30:43.210057 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:43.209853    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="26fac3f9-875e-44ef-b3a5-21d52e82ecad" containerName="extract"
Aug 04 22:30:43.213825 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:43.213808    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-j7k2n"
Aug 04 22:30:43.216690 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:43.216294    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Aug 04 22:30:43.216690 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:43.216454    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-r4cmj\""
Aug 04 22:30:43.216690 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:43.216300    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Aug 04 22:30:43.225227 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:43.225178    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-j7k2n"]
Aug 04 22:30:43.225389 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:43.225294    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-plxxn\" (UniqueName: \"kubernetes.io/projected/87a66d2b-fa82-44fd-911c-0eaf992cab31-kube-api-access-plxxn\") pod \"limitador-operator-controller-manager-6c549b6d85-j7k2n\" (UID: \"87a66d2b-fa82-44fd-911c-0eaf992cab31\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-j7k2n"
Aug 04 22:30:43.325901 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:43.325856    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-plxxn\" (UniqueName: \"kubernetes.io/projected/87a66d2b-fa82-44fd-911c-0eaf992cab31-kube-api-access-plxxn\") pod \"limitador-operator-controller-manager-6c549b6d85-j7k2n\" (UID: \"87a66d2b-fa82-44fd-911c-0eaf992cab31\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-j7k2n"
Aug 04 22:30:43.349870 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:43.349829    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-plxxn\" (UniqueName: \"kubernetes.io/projected/87a66d2b-fa82-44fd-911c-0eaf992cab31-kube-api-access-plxxn\") pod \"limitador-operator-controller-manager-6c549b6d85-j7k2n\" (UID: \"87a66d2b-fa82-44fd-911c-0eaf992cab31\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-j7k2n"
Aug 04 22:30:43.530610 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:43.530525    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-j7k2n"
Aug 04 22:30:43.672611 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:43.672585    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-j7k2n"]
Aug 04 22:30:43.674216 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:30:43.674176    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87a66d2b_fa82_44fd_911c_0eaf992cab31.slice/crio-b6b9da2da12483e294fd7ea0c2d4c42e28e6641a32afc515abd489d1d34792cc WatchSource:0}: Error finding container b6b9da2da12483e294fd7ea0c2d4c42e28e6641a32afc515abd489d1d34792cc: Status 404 returned error can't find the container with id b6b9da2da12483e294fd7ea0c2d4c42e28e6641a32afc515abd489d1d34792cc
Aug 04 22:30:43.956629 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:43.956596    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-j7k2n" event={"ID":"87a66d2b-fa82-44fd-911c-0eaf992cab31","Type":"ContainerStarted","Data":"b6b9da2da12483e294fd7ea0c2d4c42e28e6641a32afc515abd489d1d34792cc"}
Aug 04 22:30:47.366764 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:47.366728    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-ng2z4"]
Aug 04 22:30:47.370367 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:47.370350    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-ng2z4"
Aug 04 22:30:47.372682 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:47.372662    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-6wzcf\""
Aug 04 22:30:47.382802 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:47.382783    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-ng2z4"]
Aug 04 22:30:47.460261 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:47.460225    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2hzlk\" (UniqueName: \"kubernetes.io/projected/3724f0d4-fab6-4739-bae8-83b03e6ab9f0-kube-api-access-2hzlk\") pod \"kuadrant-operator-controller-manager-58fc56757c-ng2z4\" (UID: \"3724f0d4-fab6-4739-bae8-83b03e6ab9f0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-ng2z4"
Aug 04 22:30:47.460474 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:47.460299    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3724f0d4-fab6-4739-bae8-83b03e6ab9f0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-ng2z4\" (UID: \"3724f0d4-fab6-4739-bae8-83b03e6ab9f0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-ng2z4"
Aug 04 22:30:47.561689 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:47.561654    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3724f0d4-fab6-4739-bae8-83b03e6ab9f0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-ng2z4\" (UID: \"3724f0d4-fab6-4739-bae8-83b03e6ab9f0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-ng2z4"
Aug 04 22:30:47.561866 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:47.561706    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2hzlk\" (UniqueName: \"kubernetes.io/projected/3724f0d4-fab6-4739-bae8-83b03e6ab9f0-kube-api-access-2hzlk\") pod \"kuadrant-operator-controller-manager-58fc56757c-ng2z4\" (UID: \"3724f0d4-fab6-4739-bae8-83b03e6ab9f0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-ng2z4"
Aug 04 22:30:47.562069 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:47.562045    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3724f0d4-fab6-4739-bae8-83b03e6ab9f0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-ng2z4\" (UID: \"3724f0d4-fab6-4739-bae8-83b03e6ab9f0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-ng2z4"
Aug 04 22:30:47.571247 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:47.571221    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2hzlk\" (UniqueName: \"kubernetes.io/projected/3724f0d4-fab6-4739-bae8-83b03e6ab9f0-kube-api-access-2hzlk\") pod \"kuadrant-operator-controller-manager-58fc56757c-ng2z4\" (UID: \"3724f0d4-fab6-4739-bae8-83b03e6ab9f0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-ng2z4"
Aug 04 22:30:47.680717 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:47.680634    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-ng2z4"
Aug 04 22:30:47.824572 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:47.824544    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-ng2z4"]
Aug 04 22:30:47.827292 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:30:47.827268    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3724f0d4_fab6_4739_bae8_83b03e6ab9f0.slice/crio-00c10add45e2c86773cda565046d8dc75d1f340ef00110391fe8b416da355fbb WatchSource:0}: Error finding container 00c10add45e2c86773cda565046d8dc75d1f340ef00110391fe8b416da355fbb: Status 404 returned error can't find the container with id 00c10add45e2c86773cda565046d8dc75d1f340ef00110391fe8b416da355fbb
Aug 04 22:30:47.995391 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:47.995289    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-j7k2n" event={"ID":"87a66d2b-fa82-44fd-911c-0eaf992cab31","Type":"ContainerStarted","Data":"d64c2d6f198fcea6f4ff6754af31cb8a12e1968b00a63731438c3f8e6c605e42"}
Aug 04 22:30:47.995554 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:47.995462    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-j7k2n"
Aug 04 22:30:47.996956 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:47.996925    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-ng2z4" event={"ID":"3724f0d4-fab6-4739-bae8-83b03e6ab9f0","Type":"ContainerStarted","Data":"00c10add45e2c86773cda565046d8dc75d1f340ef00110391fe8b416da355fbb"}
Aug 04 22:30:48.026223 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:48.026172    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-j7k2n" podStartSLOduration=1.723644966 podStartE2EDuration="5.026157931s" totalImagesPullingTime="3.302512965s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 22:30:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 22:30:48.024256529 +0000 UTC m=+595.017074253" watchObservedRunningTime="2026-08-04 22:30:48.026157931 +0000 UTC m=+595.018975656"
Aug 04 22:30:50.057591 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:50.057558    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-68d88948d8-6n9nb"]
Aug 04 22:30:50.061465 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:50.061439    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-68d88948d8-6n9nb"
Aug 04 22:30:50.064485 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:50.064466    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-pj6pr\""
Aug 04 22:30:50.080971 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:50.080930    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-68d88948d8-6n9nb"]
Aug 04 22:30:50.081393 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:50.081362    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w2z4k\" (UniqueName: \"kubernetes.io/projected/0dfb1d09-a93f-4f1c-bb34-e5e11dbcbc58-kube-api-access-w2z4k\") pod \"authorino-operator-68d88948d8-6n9nb\" (UID: \"0dfb1d09-a93f-4f1c-bb34-e5e11dbcbc58\") " pod="kuadrant-system/authorino-operator-68d88948d8-6n9nb"
Aug 04 22:30:50.182624 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:50.182592    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w2z4k\" (UniqueName: \"kubernetes.io/projected/0dfb1d09-a93f-4f1c-bb34-e5e11dbcbc58-kube-api-access-w2z4k\") pod \"authorino-operator-68d88948d8-6n9nb\" (UID: \"0dfb1d09-a93f-4f1c-bb34-e5e11dbcbc58\") " pod="kuadrant-system/authorino-operator-68d88948d8-6n9nb"
Aug 04 22:30:50.191296 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:50.191266    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w2z4k\" (UniqueName: \"kubernetes.io/projected/0dfb1d09-a93f-4f1c-bb34-e5e11dbcbc58-kube-api-access-w2z4k\") pod \"authorino-operator-68d88948d8-6n9nb\" (UID: \"0dfb1d09-a93f-4f1c-bb34-e5e11dbcbc58\") " pod="kuadrant-system/authorino-operator-68d88948d8-6n9nb"
Aug 04 22:30:50.372882 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:50.372794    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-68d88948d8-6n9nb"
Aug 04 22:30:50.527643 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:50.527610    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-68d88948d8-6n9nb"]
Aug 04 22:30:50.530204 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:30:50.530175    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0dfb1d09_a93f_4f1c_bb34_e5e11dbcbc58.slice/crio-a4b787fd6df9d5d269f1c31f205c5b89150b41276dc456462f2c97f06eadd34b WatchSource:0}: Error finding container a4b787fd6df9d5d269f1c31f205c5b89150b41276dc456462f2c97f06eadd34b: Status 404 returned error can't find the container with id a4b787fd6df9d5d269f1c31f205c5b89150b41276dc456462f2c97f06eadd34b
Aug 04 22:30:51.014722 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:51.014689    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-68d88948d8-6n9nb" event={"ID":"0dfb1d09-a93f-4f1c-bb34-e5e11dbcbc58","Type":"ContainerStarted","Data":"a4b787fd6df9d5d269f1c31f205c5b89150b41276dc456462f2c97f06eadd34b"}
Aug 04 22:30:52.412715 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:52.412670    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-5985564776-lbpvl"]
Aug 04 22:30:52.416571 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:52.416547    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-5985564776-lbpvl"
Aug 04 22:30:52.419240 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:52.419215    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Aug 04 22:30:52.419360 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:52.419215    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-2c458\""
Aug 04 22:30:52.427251 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:52.427226    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-5985564776-lbpvl"]
Aug 04 22:30:52.500677 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:52.500643    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dpz6w\" (UniqueName: \"kubernetes.io/projected/133a8ae5-9a8b-4eae-ac7e-04e6b1e534da-kube-api-access-dpz6w\") pod \"dns-operator-controller-manager-5985564776-lbpvl\" (UID: \"133a8ae5-9a8b-4eae-ac7e-04e6b1e534da\") " pod="kuadrant-system/dns-operator-controller-manager-5985564776-lbpvl"
Aug 04 22:30:52.601938 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:52.601902    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dpz6w\" (UniqueName: \"kubernetes.io/projected/133a8ae5-9a8b-4eae-ac7e-04e6b1e534da-kube-api-access-dpz6w\") pod \"dns-operator-controller-manager-5985564776-lbpvl\" (UID: \"133a8ae5-9a8b-4eae-ac7e-04e6b1e534da\") " pod="kuadrant-system/dns-operator-controller-manager-5985564776-lbpvl"
Aug 04 22:30:52.610490 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:52.610460    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dpz6w\" (UniqueName: \"kubernetes.io/projected/133a8ae5-9a8b-4eae-ac7e-04e6b1e534da-kube-api-access-dpz6w\") pod \"dns-operator-controller-manager-5985564776-lbpvl\" (UID: \"133a8ae5-9a8b-4eae-ac7e-04e6b1e534da\") " pod="kuadrant-system/dns-operator-controller-manager-5985564776-lbpvl"
Aug 04 22:30:52.731657 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:52.731565    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-5985564776-lbpvl"
Aug 04 22:30:53.903843 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:53.903817    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-5985564776-lbpvl"]
Aug 04 22:30:53.905924 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:30:53.905896    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod133a8ae5_9a8b_4eae_ac7e_04e6b1e534da.slice/crio-6418cdee087b11cbc2be8062e033d5570bcb44519cf0b5b762fef92664c49694 WatchSource:0}: Error finding container 6418cdee087b11cbc2be8062e033d5570bcb44519cf0b5b762fef92664c49694: Status 404 returned error can't find the container with id 6418cdee087b11cbc2be8062e033d5570bcb44519cf0b5b762fef92664c49694
Aug 04 22:30:54.036058 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:54.035949    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-68d88948d8-6n9nb" event={"ID":"0dfb1d09-a93f-4f1c-bb34-e5e11dbcbc58","Type":"ContainerStarted","Data":"161bb751d13860beb6533f17d9be7b73eeabd776f3ccefc63a2c0d57d1b1a3ff"}
Aug 04 22:30:54.036280 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:54.036150    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-68d88948d8-6n9nb"
Aug 04 22:30:54.037571 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:54.037547    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-5985564776-lbpvl" event={"ID":"133a8ae5-9a8b-4eae-ac7e-04e6b1e534da","Type":"ContainerStarted","Data":"6418cdee087b11cbc2be8062e033d5570bcb44519cf0b5b762fef92664c49694"}
Aug 04 22:30:54.039758 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:54.039735    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-ng2z4" event={"ID":"3724f0d4-fab6-4739-bae8-83b03e6ab9f0","Type":"ContainerStarted","Data":"14491ccb9baf28742f70ed7ded4f8b2382d7f6d16790a077a00648e425f38839"}
Aug 04 22:30:54.039895 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:54.039875    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-ng2z4"
Aug 04 22:30:54.055046 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:54.054994    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-68d88948d8-6n9nb" podStartSLOduration=0.839472165 podStartE2EDuration="4.054976898s" totalImagesPullingTime="3.215504733s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 22:30:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 22:30:54.051948763 +0000 UTC m=+601.044766492" watchObservedRunningTime="2026-08-04 22:30:54.054976898 +0000 UTC m=+601.047794624"
Aug 04 22:30:54.068608 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:54.068560    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-ng2z4" podStartSLOduration=1.130114608 podStartE2EDuration="7.068548541s" totalImagesPullingTime="5.938433933s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 22:30:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 22:30:54.06772427 +0000 UTC m=+601.060541997" watchObservedRunningTime="2026-08-04 22:30:54.068548541 +0000 UTC m=+601.061366265"
Aug 04 22:30:55.610657 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:55.610626    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Aug 04 22:30:56.058507 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:56.058474    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-5985564776-lbpvl" event={"ID":"133a8ae5-9a8b-4eae-ac7e-04e6b1e534da","Type":"ContainerStarted","Data":"90de120679fa46246a3eba4c9ffe404eb8bba92c44c53fb59e4f60eac4cfd3f2"}
Aug 04 22:30:56.058717 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:56.058558    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-5985564776-lbpvl"
Aug 04 22:30:56.080289 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:56.080240    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-5985564776-lbpvl" podStartSLOduration=2.380257229 podStartE2EDuration="4.080225s" totalImagesPullingTime="1.699967771s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 22:30:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 22:30:56.077777791 +0000 UTC m=+603.070595520" watchObservedRunningTime="2026-08-04 22:30:56.080225 +0000 UTC m=+603.073042726"
Aug 04 22:30:56.487379 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:56.487293    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-598f86468b-zpglm"]
Aug 04 22:30:56.491063 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:56.491043    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-zpglm"
Aug 04 22:30:56.493351 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:56.493329    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Aug 04 22:30:56.493351 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:56.493339    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Aug 04 22:30:56.493351 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:56.493335    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-tr5x7\""
Aug 04 22:30:56.498241 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:56.498217    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-598f86468b-zpglm"]
Aug 04 22:30:56.539284 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:56.539255    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/19df4bc2-e186-4f41-8897-73231eb2c3b3-nginx-conf\") pod \"kuadrant-console-plugin-598f86468b-zpglm\" (UID: \"19df4bc2-e186-4f41-8897-73231eb2c3b3\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-zpglm"
Aug 04 22:30:56.539426 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:56.539287    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/19df4bc2-e186-4f41-8897-73231eb2c3b3-plugin-serving-cert\") pod \"kuadrant-console-plugin-598f86468b-zpglm\" (UID: \"19df4bc2-e186-4f41-8897-73231eb2c3b3\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-zpglm"
Aug 04 22:30:56.539426 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:56.539394    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ldz2d\" (UniqueName: \"kubernetes.io/projected/19df4bc2-e186-4f41-8897-73231eb2c3b3-kube-api-access-ldz2d\") pod \"kuadrant-console-plugin-598f86468b-zpglm\" (UID: \"19df4bc2-e186-4f41-8897-73231eb2c3b3\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-zpglm"
Aug 04 22:30:56.639982 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:56.639952    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/19df4bc2-e186-4f41-8897-73231eb2c3b3-nginx-conf\") pod \"kuadrant-console-plugin-598f86468b-zpglm\" (UID: \"19df4bc2-e186-4f41-8897-73231eb2c3b3\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-zpglm"
Aug 04 22:30:56.640457 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:56.639995    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/19df4bc2-e186-4f41-8897-73231eb2c3b3-plugin-serving-cert\") pod \"kuadrant-console-plugin-598f86468b-zpglm\" (UID: \"19df4bc2-e186-4f41-8897-73231eb2c3b3\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-zpglm"
Aug 04 22:30:56.640457 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:56.640084    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ldz2d\" (UniqueName: \"kubernetes.io/projected/19df4bc2-e186-4f41-8897-73231eb2c3b3-kube-api-access-ldz2d\") pod \"kuadrant-console-plugin-598f86468b-zpglm\" (UID: \"19df4bc2-e186-4f41-8897-73231eb2c3b3\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-zpglm"
Aug 04 22:30:56.640570 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:56.640547    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/19df4bc2-e186-4f41-8897-73231eb2c3b3-nginx-conf\") pod \"kuadrant-console-plugin-598f86468b-zpglm\" (UID: \"19df4bc2-e186-4f41-8897-73231eb2c3b3\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-zpglm"
Aug 04 22:30:56.642460 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:56.642430    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/19df4bc2-e186-4f41-8897-73231eb2c3b3-plugin-serving-cert\") pod \"kuadrant-console-plugin-598f86468b-zpglm\" (UID: \"19df4bc2-e186-4f41-8897-73231eb2c3b3\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-zpglm"
Aug 04 22:30:56.660972 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:56.660945    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ldz2d\" (UniqueName: \"kubernetes.io/projected/19df4bc2-e186-4f41-8897-73231eb2c3b3-kube-api-access-ldz2d\") pod \"kuadrant-console-plugin-598f86468b-zpglm\" (UID: \"19df4bc2-e186-4f41-8897-73231eb2c3b3\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-zpglm"
Aug 04 22:30:56.802500 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:56.802469    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-zpglm"
Aug 04 22:30:56.937535 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:56.937508    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-598f86468b-zpglm"]
Aug 04 22:30:56.938742 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:30:56.938718    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod19df4bc2_e186_4f41_8897_73231eb2c3b3.slice/crio-a194868e607d58f36c031fd33ca698efe59088d5352e0b9f4faba42e54771d16 WatchSource:0}: Error finding container a194868e607d58f36c031fd33ca698efe59088d5352e0b9f4faba42e54771d16: Status 404 returned error can't find the container with id a194868e607d58f36c031fd33ca698efe59088d5352e0b9f4faba42e54771d16
Aug 04 22:30:56.940549 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:56.940532    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 04 22:30:57.065627 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:57.065548    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-zpglm" event={"ID":"19df4bc2-e186-4f41-8897-73231eb2c3b3","Type":"ContainerStarted","Data":"a194868e607d58f36c031fd33ca698efe59088d5352e0b9f4faba42e54771d16"}
Aug 04 22:30:59.004790 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:30:59.004761    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-j7k2n"
Aug 04 22:31:02.099926 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:31:02.099828    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-zpglm" event={"ID":"19df4bc2-e186-4f41-8897-73231eb2c3b3","Type":"ContainerStarted","Data":"5b86b3605c0de5cbe59fa7e841237563580abb88d0e149e050c99c921a3a1b39"}
Aug 04 22:31:02.115522 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:31:02.115473    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-zpglm" podStartSLOduration=1.2566580840000001 podStartE2EDuration="6.115458813s" totalImagesPullingTime="4.858800729s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 22:30:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 22:31:02.114399763 +0000 UTC m=+609.107217487" watchObservedRunningTime="2026-08-04 22:31:02.115458813 +0000 UTC m=+609.108276590"
Aug 04 22:31:05.050781 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:31:05.050751    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-ng2z4"
Aug 04 22:31:05.051266 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:31:05.050833    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-68d88948d8-6n9nb"
Aug 04 22:31:06.919376 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:31:06.919339    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-ng2z4"]
Aug 04 22:31:06.919791 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:31:06.919536    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-ng2z4" podUID="3724f0d4-fab6-4739-bae8-83b03e6ab9f0" containerName="manager" containerID="cri-o://14491ccb9baf28742f70ed7ded4f8b2382d7f6d16790a077a00648e425f38839" gracePeriod=2
Aug 04 22:31:06.929904 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:31:06.929876    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-ng2z4"]
Aug 04 22:31:06.932693 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:31:06.932651    2580 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"3724f0d4-fab6-4739-bae8-83b03e6ab9f0\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-58fc56757c-ng2z4\": pods \"kuadrant-operator-controller-manager-58fc56757c-ng2z4\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-ng2z4"
Aug 04 22:31:06.944612 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:31:06.944588    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-j7k2n"]
Aug 04 22:31:06.944807 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:31:06.944782    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-j7k2n" podUID="87a66d2b-fa82-44fd-911c-0eaf992cab31" containerName="manager" containerID="cri-o://d64c2d6f198fcea6f4ff6754af31cb8a12e1968b00a63731438c3f8e6c605e42" gracePeriod=2
Aug 04 22:31:06.953346 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:31:06.953318    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-j7k2n"]
Aug 04 22:31:06.953765 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:31:06.953734    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-ng2z4\" is forbidden: User \"system:node:ip-10-0-137-117.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-117.ec2.internal' and this object" podUID="3724f0d4-fab6-4739-bae8-83b03e6ab9f0" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-ng2z4"
Aug 04 22:31:06.969501 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:31:06.969472    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-54ktv"]
Aug 04 22:31:06.969883 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:31:06.969864    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87a66d2b-fa82-44fd-911c-0eaf992cab31" containerName="manager"
Aug 04 22:31:06.969883 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:31:06.969878    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="87a66d2b-fa82-44fd-911c-0eaf992cab31" containerName="manager"
Aug 04 22:31:06.969883 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:31:06.969888    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3724f0d4-fab6-4739-bae8-83b03e6ab9f0" containerName="manager"
Aug 04 22:31:06.970119 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:31:06.969894    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="3724f0d4-fab6-4739-bae8-83b03e6ab9f0" containerName="manager"
Aug 04 22:31:06.970119 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:31:06.969948    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="3724f0d4-fab6-4739-bae8-83b03e6ab9f0" containerName="manager"
Aug 04 22:31:06.970119 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:31:06.969959    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="87a66d2b-fa82-44fd-911c-0eaf992cab31" containerName="manager"
Aug 04 22:31:06.973174 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:31:06.973154    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-54ktv"
Aug 04 22:31:06.975692 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:31:06.975657    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-j7k2n\" is forbidden: User \"system:node:ip-10-0-137-117.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-117.ec2.internal' and this object" podUID="87a66d2b-fa82-44fd-911c-0eaf992cab31" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-j7k2n"
Aug 04 22:31:06.976396 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:31:06.976375    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-z7vgr"]
Aug 04 22:31:06.978099 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:31:06.978056    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-ng2z4\" is forbidden: User \"system:node:ip-10-0-137-117.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-117.ec2.internal' and this object" podUID="3724f0d4-fab6-4739-bae8-83b03e6ab9f0" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-ng2z4"
Aug 04 22:31:06.980283 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:31:06.980264    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-z7vgr"
Aug 04 22:31:06.985840 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:31:06.985785    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-54ktv"]
Aug 04 22:31:07.006072 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:31:07.005228    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-z7vgr"]
Aug 04 22:31:07.011439 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:31:07.011401    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-j7k2n\" is forbidden: User \"system:node:ip-10-0-137-117.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-117.ec2.internal' and this object" podUID="87a66d2b-fa82-44fd-911c-0eaf992cab31" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-j7k2n"
Aug 04 22:31:07.013356 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:31:07.013318    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-ng2z4\" is forbidden: User \"system:node:ip-10-0-137-117.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-117.ec2.internal' and this object" podUID="3724f0d4-fab6-4739-bae8-83b03e6ab9f0" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-ng2z4"
Aug 04 22:31:07.041864 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:31:07.041830    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x2ldc\" (UniqueName: \"kubernetes.io/projected/e66cc0f6-1ffe-4bbe-830b-d82bb52ffdae-kube-api-access-x2ldc\") pod \"limitador-operator-controller-manager-6c549b6d85-z7vgr\" (UID: \"e66cc0f6-1ffe-4bbe-830b-d82bb52ffdae\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-z7vgr"
Aug 04 22:31:07.042006 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:31:07.041955    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ade161b9-e305-4482-84a6-85affed5f88e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-54ktv\" (UID: \"ade161b9-e305-4482-84a6-85affed5f88e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-54ktv"
Aug 04 22:31:07.042205 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:31:07.042187    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8w6bn\" (UniqueName: \"kubernetes.io/projected/ade161b9-e305-4482-84a6-85affed5f88e-kube-api-access-8w6bn\") pod \"kuadrant-operator-controller-manager-58fc56757c-54ktv\" (UID: \"ade161b9-e305-4482-84a6-85affed5f88e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-54ktv"
Aug 04 22:31:07.068077 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:31:07.068049    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-5985564776-lbpvl"
Aug 04 22:31:07.091502 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:31:07.091457    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-j7k2n\" is forbidden: User \"system:node:ip-10-0-137-117.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-117.ec2.internal' and this object" podUID="87a66d2b-fa82-44fd-911c-0eaf992cab31" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-j7k2n"
Aug 04 22:31:07.093008 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:31:07.092979    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-ng2z4\" is forbidden: User \"system:node:ip-10-0-137-117.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-117.ec2.internal' and this object" podUID="3724f0d4-fab6-4739-bae8-83b03e6ab9f0" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-ng2z4"
Aug 04 22:31:07.134057 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:31:07.134022    2580 generic.go:356] "Generic (PLEG): container finished" podID="87a66d2b-fa82-44fd-911c-0eaf992cab31" containerID="d64c2d6f198fcea6f4ff6754af31cb8a12e1968b00a63731438c3f8e6c605e42" exitCode=0
Aug 04 22:31:07.136543 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:31:07.136514    2580 generic.go:356] "Generic (PLEG): container finished" podID="3724f0d4-fab6-4739-bae8-83b03e6ab9f0" containerID="14491ccb9baf28742f70ed7ded4f8b2382d7f6d16790a077a00648e425f38839" exitCode=0
Aug 04 22:31:07.143016 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:31:07.142986    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ade161b9-e305-4482-84a6-85affed5f88e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-54ktv\" (UID: \"ade161b9-e305-4482-84a6-85affed5f88e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-54ktv"
Aug 04 22:31:07.143168 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:31:07.143044    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8w6bn\" (UniqueName: \"kubernetes.io/projected/ade161b9-e305-4482-84a6-85affed5f88e-kube-api-access-8w6bn\") pod \"kuadrant-operator-controller-manager-58fc56757c-54ktv\" (UID: \"ade161b9-e305-4482-84a6-85affed5f88e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-54ktv"
Aug 04 22:31:07.143168 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:31:07.143078    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x2ldc\" (UniqueName: \"kubernetes.io/projected/e66cc0f6-1ffe-4bbe-830b-d82bb52ffdae-kube-api-access-x2ldc\") pod \"limitador-operator-controller-manager-6c549b6d85-z7vgr\" (UID: \"e66cc0f6-1ffe-4bbe-830b-d82bb52ffdae\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-z7vgr"
Aug 04 22:31:07.143767 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:31:07.143738    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ade161b9-e305-4482-84a6-85affed5f88e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-54ktv\" (UID: \"ade161b9-e305-4482-84a6-85affed5f88e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-54ktv"
Aug 04 22:31:07.153590 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:31:07.153528    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8w6bn\" (UniqueName: \"kubernetes.io/projected/ade161b9-e305-4482-84a6-85affed5f88e-kube-api-access-8w6bn\") pod \"kuadrant-operator-controller-manager-58fc56757c-54ktv\" (UID: \"ade161b9-e305-4482-84a6-85affed5f88e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-54ktv"
Aug 04 22:31:07.154545 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:31:07.154509    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x2ldc\" (UniqueName: \"kubernetes.io/projected/e66cc0f6-1ffe-4bbe-830b-d82bb52ffdae-kube-api-access-x2ldc\") pod \"limitador-operator-controller-manager-6c549b6d85-z7vgr\" (UID: \"e66cc0f6-1ffe-4bbe-830b-d82bb52ffdae\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-z7vgr"
Aug 04 22:31:07.193686 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:31:07.193664    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-ng2z4"
Aug 04 22:31:07.195699 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:31:07.195683    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-j7k2n"
Aug 04 22:31:07.195810 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:31:07.195791    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-j7k2n\" is forbidden: User \"system:node:ip-10-0-137-117.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-117.ec2.internal' and this object" podUID="87a66d2b-fa82-44fd-911c-0eaf992cab31" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-j7k2n"
Aug 04 22:31:07.198593 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:31:07.198573    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-ng2z4\" is forbidden: User \"system:node:ip-10-0-137-117.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-117.ec2.internal' and this object" podUID="3724f0d4-fab6-4739-bae8-83b03e6ab9f0" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-ng2z4"
Aug 04 22:31:07.200693 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:31:07.200676    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-j7k2n\" is forbidden: User \"system:node:ip-10-0-137-117.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-117.ec2.internal' and this object" podUID="87a66d2b-fa82-44fd-911c-0eaf992cab31" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-j7k2n"
Aug 04 22:31:07.202770 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:31:07.202751    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-ng2z4\" is forbidden: User \"system:node:ip-10-0-137-117.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-117.ec2.internal' and this object" podUID="3724f0d4-fab6-4739-bae8-83b03e6ab9f0" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-ng2z4"
Aug 04 22:31:07.244001 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:31:07.243969    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-plxxn\" (UniqueName: \"kubernetes.io/projected/87a66d2b-fa82-44fd-911c-0eaf992cab31-kube-api-access-plxxn\") pod \"87a66d2b-fa82-44fd-911c-0eaf992cab31\" (UID: \"87a66d2b-fa82-44fd-911c-0eaf992cab31\") "
Aug 04 22:31:07.244186 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:31:07.244061    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2hzlk\" (UniqueName: \"kubernetes.io/projected/3724f0d4-fab6-4739-bae8-83b03e6ab9f0-kube-api-access-2hzlk\") pod \"3724f0d4-fab6-4739-bae8-83b03e6ab9f0\" (UID: \"3724f0d4-fab6-4739-bae8-83b03e6ab9f0\") "
Aug 04 22:31:07.244186 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:31:07.244103    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3724f0d4-fab6-4739-bae8-83b03e6ab9f0-extensions-socket-volume\") pod \"3724f0d4-fab6-4739-bae8-83b03e6ab9f0\" (UID: \"3724f0d4-fab6-4739-bae8-83b03e6ab9f0\") "
Aug 04 22:31:07.244716 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:31:07.244691    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3724f0d4-fab6-4739-bae8-83b03e6ab9f0-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "3724f0d4-fab6-4739-bae8-83b03e6ab9f0" (UID: "3724f0d4-fab6-4739-bae8-83b03e6ab9f0"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 22:31:07.246292 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:31:07.246266    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/87a66d2b-fa82-44fd-911c-0eaf992cab31-kube-api-access-plxxn" (OuterVolumeSpecName: "kube-api-access-plxxn") pod "87a66d2b-fa82-44fd-911c-0eaf992cab31" (UID: "87a66d2b-fa82-44fd-911c-0eaf992cab31"). InnerVolumeSpecName "kube-api-access-plxxn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 22:31:07.246375 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:31:07.246304    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3724f0d4-fab6-4739-bae8-83b03e6ab9f0-kube-api-access-2hzlk" (OuterVolumeSpecName: "kube-api-access-2hzlk") pod "3724f0d4-fab6-4739-bae8-83b03e6ab9f0" (UID: "3724f0d4-fab6-4739-bae8-83b03e6ab9f0"). InnerVolumeSpecName "kube-api-access-2hzlk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 22:31:07.344911 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:31:07.344874    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-plxxn\" (UniqueName: \"kubernetes.io/projected/87a66d2b-fa82-44fd-911c-0eaf992cab31-kube-api-access-plxxn\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
Aug 04 22:31:07.344911 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:31:07.344906    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2hzlk\" (UniqueName: \"kubernetes.io/projected/3724f0d4-fab6-4739-bae8-83b03e6ab9f0-kube-api-access-2hzlk\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
Aug 04 22:31:07.344911 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:31:07.344915    2580 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3724f0d4-fab6-4739-bae8-83b03e6ab9f0-extensions-socket-volume\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
Aug 04 22:31:07.347757 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:31:07.347731    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-54ktv"
Aug 04 22:31:07.353788 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:31:07.353769    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-z7vgr"
Aug 04 22:31:07.501552 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:31:07.501518    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3724f0d4-fab6-4739-bae8-83b03e6ab9f0" path="/var/lib/kubelet/pods/3724f0d4-fab6-4739-bae8-83b03e6ab9f0/volumes"
Aug 04 22:31:07.501986 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:31:07.501963    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="87a66d2b-fa82-44fd-911c-0eaf992cab31" path="/var/lib/kubelet/pods/87a66d2b-fa82-44fd-911c-0eaf992cab31/volumes"
Aug 04 22:31:07.502484 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:31:07.502467    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-54ktv"]
Aug 04 22:31:07.504761 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:31:07.504740    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podade161b9_e305_4482_84a6_85affed5f88e.slice/crio-dc9694828807b4f5b4c26d600e8339c67ed51db0626ff64860fb6eebeafd323e WatchSource:0}: Error finding container dc9694828807b4f5b4c26d600e8339c67ed51db0626ff64860fb6eebeafd323e: Status 404 returned error can't find the container with id dc9694828807b4f5b4c26d600e8339c67ed51db0626ff64860fb6eebeafd323e
Aug 04 22:31:07.521856 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:31:07.521831    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-z7vgr"]
Aug 04 22:31:07.523631 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:31:07.523536    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode66cc0f6_1ffe_4bbe_830b_d82bb52ffdae.slice/crio-961351efd4bacc938366f3cea77ce0636c26375b08fdd5e8363834290b5b44fe WatchSource:0}: Error finding container 961351efd4bacc938366f3cea77ce0636c26375b08fdd5e8363834290b5b44fe: Status 404 returned error can't find the container with id 961351efd4bacc938366f3cea77ce0636c26375b08fdd5e8363834290b5b44fe
Aug 04 22:31:07.836269 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:31:07.836230    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-zctkb"]
Aug 04 22:31:07.840646 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:31:07.840624    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-zctkb"
Aug 04 22:31:07.855642 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:31:07.855612    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-zctkb"]
Aug 04 22:31:07.950049 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:31:07.950021    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wwmqn\" (UniqueName: \"kubernetes.io/projected/3bedd616-15c0-4cd6-9a32-6915479f6c87-kube-api-access-wwmqn\") pod \"kuadrant-operator-controller-manager-68cf589589-zctkb\" (UID: \"3bedd616-15c0-4cd6-9a32-6915479f6c87\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-zctkb"
Aug 04 22:31:07.950463 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:31:07.950156    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3bedd616-15c0-4cd6-9a32-6915479f6c87-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-68cf589589-zctkb\" (UID: \"3bedd616-15c0-4cd6-9a32-6915479f6c87\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-zctkb"
Aug 04 22:31:08.051081 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:31:08.051046    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wwmqn\" (UniqueName: \"kubernetes.io/projected/3bedd616-15c0-4cd6-9a32-6915479f6c87-kube-api-access-wwmqn\") pod \"kuadrant-operator-controller-manager-68cf589589-zctkb\" (UID: \"3bedd616-15c0-4cd6-9a32-6915479f6c87\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-zctkb"
Aug 04 22:31:08.051269 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:31:08.051150    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3bedd616-15c0-4cd6-9a32-6915479f6c87-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-68cf589589-zctkb\" (UID: \"3bedd616-15c0-4cd6-9a32-6915479f6c87\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-zctkb"
Aug 04 22:31:08.051495 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:31:08.051478    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3bedd616-15c0-4cd6-9a32-6915479f6c87-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-68cf589589-zctkb\" (UID: \"3bedd616-15c0-4cd6-9a32-6915479f6c87\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-zctkb"
Aug 04 22:31:08.059491 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:31:08.059467    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wwmqn\" (UniqueName: \"kubernetes.io/projected/3bedd616-15c0-4cd6-9a32-6915479f6c87-kube-api-access-wwmqn\") pod \"kuadrant-operator-controller-manager-68cf589589-zctkb\" (UID: \"3bedd616-15c0-4cd6-9a32-6915479f6c87\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-zctkb"
Aug 04 22:31:08.144768 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:31:08.144689    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-z7vgr" event={"ID":"e66cc0f6-1ffe-4bbe-830b-d82bb52ffdae","Type":"ContainerStarted","Data":"3ca8555188259d3eb7240c7e975c1b0eef51a939f55ff73aa4bfab20c16e9025"}
Aug 04 22:31:08.144768 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:31:08.144741    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-z7vgr" event={"ID":"e66cc0f6-1ffe-4bbe-830b-d82bb52ffdae","Type":"ContainerStarted","Data":"961351efd4bacc938366f3cea77ce0636c26375b08fdd5e8363834290b5b44fe"}
Aug 04 22:31:08.144980 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:31:08.144804    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-z7vgr"
Aug 04 22:31:08.146468 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:31:08.146438    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-54ktv" event={"ID":"ade161b9-e305-4482-84a6-85affed5f88e","Type":"ContainerStarted","Data":"101cefa77e713faa09fb2a4db088b292f659146e34024ad94482dc4e43b8e722"}
Aug 04 22:31:08.146597 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:31:08.146490    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-54ktv"
Aug 04 22:31:08.146597 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:31:08.146511    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-54ktv" event={"ID":"ade161b9-e305-4482-84a6-85affed5f88e","Type":"ContainerStarted","Data":"dc9694828807b4f5b4c26d600e8339c67ed51db0626ff64860fb6eebeafd323e"}
Aug 04 22:31:08.147768 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:31:08.147747    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-j7k2n"
Aug 04 22:31:08.147869 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:31:08.147756    2580 scope.go:117] "RemoveContainer" containerID="d64c2d6f198fcea6f4ff6754af31cb8a12e1968b00a63731438c3f8e6c605e42"
Aug 04 22:31:08.149218 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:31:08.149205    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-ng2z4"
Aug 04 22:31:08.151626 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:31:08.151605    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-zctkb"
Aug 04 22:31:08.157487 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:31:08.157465    2580 scope.go:117] "RemoveContainer" containerID="14491ccb9baf28742f70ed7ded4f8b2382d7f6d16790a077a00648e425f38839"
Aug 04 22:31:08.165022 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:31:08.164969    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-z7vgr" podStartSLOduration=2.164950309 podStartE2EDuration="2.164950309s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 22:31:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 22:31:08.161814099 +0000 UTC m=+615.154631839" watchObservedRunningTime="2026-08-04 22:31:08.164950309 +0000 UTC m=+615.157768039"
Aug 04 22:31:08.189889 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:31:08.189836    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-54ktv" podStartSLOduration=2.189814944 podStartE2EDuration="2.189814944s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 22:31:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 22:31:08.189081463 +0000 UTC m=+615.181899202" watchObservedRunningTime="2026-08-04 22:31:08.189814944 +0000 UTC m=+615.182632674"
Aug 04 22:31:08.302822 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:31:08.302790    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-zctkb"]
Aug 04 22:31:08.303949 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:31:08.303919    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3bedd616_15c0_4cd6_9a32_6915479f6c87.slice/crio-e65e40f7730375dd991ab4e8d4602122e839471d0e7c185379f8cb669e4dd90e WatchSource:0}: Error finding container e65e40f7730375dd991ab4e8d4602122e839471d0e7c185379f8cb669e4dd90e: Status 404 returned error can't find the container with id e65e40f7730375dd991ab4e8d4602122e839471d0e7c185379f8cb669e4dd90e
Aug 04 22:31:09.158931 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:31:09.158882    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-zctkb" event={"ID":"3bedd616-15c0-4cd6-9a32-6915479f6c87","Type":"ContainerStarted","Data":"69391ff3832d3a30a2f5cbb925d4601313f52b8adb39518246d971a453139969"}
Aug 04 22:31:09.159434 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:31:09.158948    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-zctkb" event={"ID":"3bedd616-15c0-4cd6-9a32-6915479f6c87","Type":"ContainerStarted","Data":"e65e40f7730375dd991ab4e8d4602122e839471d0e7c185379f8cb669e4dd90e"}
Aug 04 22:31:09.186318 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:31:09.186270    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-zctkb" podStartSLOduration=2.1862539930000002 podStartE2EDuration="2.186253993s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 22:31:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 22:31:09.183722836 +0000 UTC m=+616.176540564" watchObservedRunningTime="2026-08-04 22:31:09.186253993 +0000 UTC m=+616.179071721"
Aug 04 22:31:10.164774 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:31:10.164736    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-zctkb"
Aug 04 22:31:19.161118 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:31:19.161032    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-z7vgr"
Aug 04 22:31:19.161530 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:31:19.161334    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-54ktv"
Aug 04 22:31:21.174224 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:31:21.174196    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-zctkb"
Aug 04 22:31:21.227252 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:31:21.227218    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-54ktv"]
Aug 04 22:31:21.227497 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:31:21.227462    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-54ktv" podUID="ade161b9-e305-4482-84a6-85affed5f88e" containerName="manager" containerID="cri-o://101cefa77e713faa09fb2a4db088b292f659146e34024ad94482dc4e43b8e722" gracePeriod=10
Aug 04 22:31:21.489407 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:31:21.489379    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-54ktv"
Aug 04 22:31:21.575220 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:31:21.575188    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ade161b9-e305-4482-84a6-85affed5f88e-extensions-socket-volume\") pod \"ade161b9-e305-4482-84a6-85affed5f88e\" (UID: \"ade161b9-e305-4482-84a6-85affed5f88e\") "
Aug 04 22:31:21.575398 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:31:21.575294    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8w6bn\" (UniqueName: \"kubernetes.io/projected/ade161b9-e305-4482-84a6-85affed5f88e-kube-api-access-8w6bn\") pod \"ade161b9-e305-4482-84a6-85affed5f88e\" (UID: \"ade161b9-e305-4482-84a6-85affed5f88e\") "
Aug 04 22:31:21.575563 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:31:21.575541    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ade161b9-e305-4482-84a6-85affed5f88e-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "ade161b9-e305-4482-84a6-85affed5f88e" (UID: "ade161b9-e305-4482-84a6-85affed5f88e"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 22:31:21.577349 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:31:21.577329    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ade161b9-e305-4482-84a6-85affed5f88e-kube-api-access-8w6bn" (OuterVolumeSpecName: "kube-api-access-8w6bn") pod "ade161b9-e305-4482-84a6-85affed5f88e" (UID: "ade161b9-e305-4482-84a6-85affed5f88e"). InnerVolumeSpecName "kube-api-access-8w6bn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 22:31:21.675899 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:31:21.675858    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8w6bn\" (UniqueName: \"kubernetes.io/projected/ade161b9-e305-4482-84a6-85affed5f88e-kube-api-access-8w6bn\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
Aug 04 22:31:21.675899 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:31:21.675894    2580 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ade161b9-e305-4482-84a6-85affed5f88e-extensions-socket-volume\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
Aug 04 22:31:22.246846 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:31:22.246806    2580 generic.go:356] "Generic (PLEG): container finished" podID="ade161b9-e305-4482-84a6-85affed5f88e" containerID="101cefa77e713faa09fb2a4db088b292f659146e34024ad94482dc4e43b8e722" exitCode=0
Aug 04 22:31:22.247357 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:31:22.246860    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-54ktv"
Aug 04 22:31:22.247357 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:31:22.246867    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-54ktv" event={"ID":"ade161b9-e305-4482-84a6-85affed5f88e","Type":"ContainerDied","Data":"101cefa77e713faa09fb2a4db088b292f659146e34024ad94482dc4e43b8e722"}
Aug 04 22:31:22.247357 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:31:22.246939    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-54ktv" event={"ID":"ade161b9-e305-4482-84a6-85affed5f88e","Type":"ContainerDied","Data":"dc9694828807b4f5b4c26d600e8339c67ed51db0626ff64860fb6eebeafd323e"}
Aug 04 22:31:22.247357 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:31:22.246962    2580 scope.go:117] "RemoveContainer" containerID="101cefa77e713faa09fb2a4db088b292f659146e34024ad94482dc4e43b8e722"
Aug 04 22:31:22.256657 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:31:22.256628    2580 scope.go:117] "RemoveContainer" containerID="101cefa77e713faa09fb2a4db088b292f659146e34024ad94482dc4e43b8e722"
Aug 04 22:31:22.256932 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:31:22.256912    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"101cefa77e713faa09fb2a4db088b292f659146e34024ad94482dc4e43b8e722\": container with ID starting with 101cefa77e713faa09fb2a4db088b292f659146e34024ad94482dc4e43b8e722 not found: ID does not exist" containerID="101cefa77e713faa09fb2a4db088b292f659146e34024ad94482dc4e43b8e722"
Aug 04 22:31:22.256981 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:31:22.256941    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"101cefa77e713faa09fb2a4db088b292f659146e34024ad94482dc4e43b8e722"} err="failed to get container status \"101cefa77e713faa09fb2a4db088b292f659146e34024ad94482dc4e43b8e722\": rpc error: code = NotFound desc = could not find container \"101cefa77e713faa09fb2a4db088b292f659146e34024ad94482dc4e43b8e722\": container with ID starting with 101cefa77e713faa09fb2a4db088b292f659146e34024ad94482dc4e43b8e722 not found: ID does not exist"
Aug 04 22:31:22.275124 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:31:22.275089    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-54ktv"]
Aug 04 22:31:22.282818 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:31:22.282788    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-54ktv"]
Aug 04 22:31:23.499442 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:31:23.499410    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ade161b9-e305-4482-84a6-85affed5f88e" path="/var/lib/kubelet/pods/ade161b9-e305-4482-84a6-85affed5f88e/volumes"
Aug 04 22:31:38.701575 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:31:38.701538    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-659754b74-vfjt2"]
Aug 04 22:31:38.702092 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:31:38.701999    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ade161b9-e305-4482-84a6-85affed5f88e" containerName="manager"
Aug 04 22:31:38.702092 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:31:38.702012    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="ade161b9-e305-4482-84a6-85affed5f88e" containerName="manager"
Aug 04 22:31:38.702192 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:31:38.702094    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="ade161b9-e305-4482-84a6-85affed5f88e" containerName="manager"
Aug 04 22:31:38.719323 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:31:38.719297    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-659754b74-vfjt2"]
Aug 04 22:31:38.719463 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:31:38.719387    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-659754b74-vfjt2"
Aug 04 22:31:38.839779 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:31:38.839748    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bb91d418-d336-4d6d-8398-f8bd800464c3-oauth-serving-cert\") pod \"console-659754b74-vfjt2\" (UID: \"bb91d418-d336-4d6d-8398-f8bd800464c3\") " pod="openshift-console/console-659754b74-vfjt2"
Aug 04 22:31:38.839964 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:31:38.839786    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bb91d418-d336-4d6d-8398-f8bd800464c3-service-ca\") pod \"console-659754b74-vfjt2\" (UID: \"bb91d418-d336-4d6d-8398-f8bd800464c3\") " pod="openshift-console/console-659754b74-vfjt2"
Aug 04 22:31:38.839964 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:31:38.839806    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w5zmx\" (UniqueName: \"kubernetes.io/projected/bb91d418-d336-4d6d-8398-f8bd800464c3-kube-api-access-w5zmx\") pod \"console-659754b74-vfjt2\" (UID: \"bb91d418-d336-4d6d-8398-f8bd800464c3\") " pod="openshift-console/console-659754b74-vfjt2"
Aug 04 22:31:38.839964 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:31:38.839824    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bb91d418-d336-4d6d-8398-f8bd800464c3-console-serving-cert\") pod \"console-659754b74-vfjt2\" (UID: \"bb91d418-d336-4d6d-8398-f8bd800464c3\") " pod="openshift-console/console-659754b74-vfjt2"
Aug 04 22:31:38.839964 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:31:38.839895    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bb91d418-d336-4d6d-8398-f8bd800464c3-console-config\") pod \"console-659754b74-vfjt2\" (UID: \"bb91d418-d336-4d6d-8398-f8bd800464c3\") " pod="openshift-console/console-659754b74-vfjt2"
Aug 04 22:31:38.839964 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:31:38.839916    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bb91d418-d336-4d6d-8398-f8bd800464c3-trusted-ca-bundle\") pod \"console-659754b74-vfjt2\" (UID: \"bb91d418-d336-4d6d-8398-f8bd800464c3\") " pod="openshift-console/console-659754b74-vfjt2"
Aug 04 22:31:38.839964 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:31:38.839942    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bb91d418-d336-4d6d-8398-f8bd800464c3-console-oauth-config\") pod \"console-659754b74-vfjt2\" (UID: \"bb91d418-d336-4d6d-8398-f8bd800464c3\") " pod="openshift-console/console-659754b74-vfjt2"
Aug 04 22:31:38.941262 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:31:38.941226    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bb91d418-d336-4d6d-8398-f8bd800464c3-console-config\") pod \"console-659754b74-vfjt2\" (UID: \"bb91d418-d336-4d6d-8398-f8bd800464c3\") " pod="openshift-console/console-659754b74-vfjt2"
Aug 04 22:31:38.941262 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:31:38.941266    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bb91d418-d336-4d6d-8398-f8bd800464c3-trusted-ca-bundle\") pod \"console-659754b74-vfjt2\" (UID: \"bb91d418-d336-4d6d-8398-f8bd800464c3\") " pod="openshift-console/console-659754b74-vfjt2"
Aug 04 22:31:38.941476 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:31:38.941286    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bb91d418-d336-4d6d-8398-f8bd800464c3-console-oauth-config\") pod \"console-659754b74-vfjt2\" (UID: \"bb91d418-d336-4d6d-8398-f8bd800464c3\") " pod="openshift-console/console-659754b74-vfjt2"
Aug 04 22:31:38.941476 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:31:38.941345    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bb91d418-d336-4d6d-8398-f8bd800464c3-oauth-serving-cert\") pod \"console-659754b74-vfjt2\" (UID: \"bb91d418-d336-4d6d-8398-f8bd800464c3\") " pod="openshift-console/console-659754b74-vfjt2"
Aug 04 22:31:38.941476 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:31:38.941367    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bb91d418-d336-4d6d-8398-f8bd800464c3-service-ca\") pod \"console-659754b74-vfjt2\" (UID: \"bb91d418-d336-4d6d-8398-f8bd800464c3\") " pod="openshift-console/console-659754b74-vfjt2"
Aug 04 22:31:38.941476 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:31:38.941390    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w5zmx\" (UniqueName: \"kubernetes.io/projected/bb91d418-d336-4d6d-8398-f8bd800464c3-kube-api-access-w5zmx\") pod \"console-659754b74-vfjt2\" (UID: \"bb91d418-d336-4d6d-8398-f8bd800464c3\") " pod="openshift-console/console-659754b74-vfjt2"
Aug 04 22:31:38.941476 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:31:38.941411    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bb91d418-d336-4d6d-8398-f8bd800464c3-console-serving-cert\") pod \"console-659754b74-vfjt2\" (UID: \"bb91d418-d336-4d6d-8398-f8bd800464c3\") " pod="openshift-console/console-659754b74-vfjt2"
Aug 04 22:31:38.942119 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:31:38.942086    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bb91d418-d336-4d6d-8398-f8bd800464c3-console-config\") pod \"console-659754b74-vfjt2\" (UID: \"bb91d418-d336-4d6d-8398-f8bd800464c3\") " pod="openshift-console/console-659754b74-vfjt2"
Aug 04 22:31:38.942263 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:31:38.942088    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bb91d418-d336-4d6d-8398-f8bd800464c3-oauth-serving-cert\") pod \"console-659754b74-vfjt2\" (UID: \"bb91d418-d336-4d6d-8398-f8bd800464c3\") " pod="openshift-console/console-659754b74-vfjt2"
Aug 04 22:31:38.942307 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:31:38.942258    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bb91d418-d336-4d6d-8398-f8bd800464c3-service-ca\") pod \"console-659754b74-vfjt2\" (UID: \"bb91d418-d336-4d6d-8398-f8bd800464c3\") " pod="openshift-console/console-659754b74-vfjt2"
Aug 04 22:31:38.942390 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:31:38.942372    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bb91d418-d336-4d6d-8398-f8bd800464c3-trusted-ca-bundle\") pod \"console-659754b74-vfjt2\" (UID: \"bb91d418-d336-4d6d-8398-f8bd800464c3\") " pod="openshift-console/console-659754b74-vfjt2"
Aug 04 22:31:38.943843 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:31:38.943820    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bb91d418-d336-4d6d-8398-f8bd800464c3-console-serving-cert\") pod \"console-659754b74-vfjt2\" (UID: \"bb91d418-d336-4d6d-8398-f8bd800464c3\") " pod="openshift-console/console-659754b74-vfjt2"
Aug 04 22:31:38.943936 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:31:38.943859    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bb91d418-d336-4d6d-8398-f8bd800464c3-console-oauth-config\") pod \"console-659754b74-vfjt2\" (UID: \"bb91d418-d336-4d6d-8398-f8bd800464c3\") " pod="openshift-console/console-659754b74-vfjt2"
Aug 04 22:31:38.949696 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:31:38.949669    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w5zmx\" (UniqueName: \"kubernetes.io/projected/bb91d418-d336-4d6d-8398-f8bd800464c3-kube-api-access-w5zmx\") pod \"console-659754b74-vfjt2\" (UID: \"bb91d418-d336-4d6d-8398-f8bd800464c3\") " pod="openshift-console/console-659754b74-vfjt2"
Aug 04 22:31:39.028335 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:31:39.028256    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-659754b74-vfjt2"
Aug 04 22:31:39.181430 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:31:39.181404    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-659754b74-vfjt2"]
Aug 04 22:31:39.182988 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:31:39.182957    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb91d418_d336_4d6d_8398_f8bd800464c3.slice/crio-48377854ab16517b183753957af4b391aa333472fa44b84425d5a21679e48516 WatchSource:0}: Error finding container 48377854ab16517b183753957af4b391aa333472fa44b84425d5a21679e48516: Status 404 returned error can't find the container with id 48377854ab16517b183753957af4b391aa333472fa44b84425d5a21679e48516
Aug 04 22:31:39.357313 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:31:39.357267    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-659754b74-vfjt2" event={"ID":"bb91d418-d336-4d6d-8398-f8bd800464c3","Type":"ContainerStarted","Data":"15b03bace514e918b15d8c42e8aeb91f4b2f7c22fc0183f1db5e17976a2b85b5"}
Aug 04 22:31:39.357516 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:31:39.357341    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-659754b74-vfjt2" event={"ID":"bb91d418-d336-4d6d-8398-f8bd800464c3","Type":"ContainerStarted","Data":"48377854ab16517b183753957af4b391aa333472fa44b84425d5a21679e48516"}
Aug 04 22:31:39.377631 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:31:39.377587    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-659754b74-vfjt2" podStartSLOduration=1.377573015 podStartE2EDuration="1.377573015s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 22:31:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 22:31:39.374997948 +0000 UTC m=+646.367815675" watchObservedRunningTime="2026-08-04 22:31:39.377573015 +0000 UTC m=+646.370390743"
Aug 04 22:31:47.255474 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:31:47.255440    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-595xm"]
Aug 04 22:31:47.259789 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:31:47.259766    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-85d9db4d5d-595xm"
Aug 04 22:31:47.261975 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:31:47.261958    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Aug 04 22:31:47.268918 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:31:47.268893    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-595xm"]
Aug 04 22:31:47.295760 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:31:47.295732    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-595xm"]
Aug 04 22:31:47.310598 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:31:47.310565    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h9nvv\" (UniqueName: \"kubernetes.io/projected/b4fbc784-f5b0-4745-b221-028a8f8b9e8a-kube-api-access-h9nvv\") pod \"limitador-limitador-85d9db4d5d-595xm\" (UID: \"b4fbc784-f5b0-4745-b221-028a8f8b9e8a\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-595xm"
Aug 04 22:31:47.310740 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:31:47.310614    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b4fbc784-f5b0-4745-b221-028a8f8b9e8a-config-file\") pod \"limitador-limitador-85d9db4d5d-595xm\" (UID: \"b4fbc784-f5b0-4745-b221-028a8f8b9e8a\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-595xm"
Aug 04 22:31:47.411516 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:31:47.411480    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h9nvv\" (UniqueName: \"kubernetes.io/projected/b4fbc784-f5b0-4745-b221-028a8f8b9e8a-kube-api-access-h9nvv\") pod \"limitador-limitador-85d9db4d5d-595xm\" (UID: \"b4fbc784-f5b0-4745-b221-028a8f8b9e8a\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-595xm"
Aug 04 22:31:47.411516 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:31:47.411516    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b4fbc784-f5b0-4745-b221-028a8f8b9e8a-config-file\") pod \"limitador-limitador-85d9db4d5d-595xm\" (UID: \"b4fbc784-f5b0-4745-b221-028a8f8b9e8a\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-595xm"
Aug 04 22:31:47.412124 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:31:47.412105    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b4fbc784-f5b0-4745-b221-028a8f8b9e8a-config-file\") pod \"limitador-limitador-85d9db4d5d-595xm\" (UID: \"b4fbc784-f5b0-4745-b221-028a8f8b9e8a\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-595xm"
Aug 04 22:31:47.420211 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:31:47.420182    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h9nvv\" (UniqueName: \"kubernetes.io/projected/b4fbc784-f5b0-4745-b221-028a8f8b9e8a-kube-api-access-h9nvv\") pod \"limitador-limitador-85d9db4d5d-595xm\" (UID: \"b4fbc784-f5b0-4745-b221-028a8f8b9e8a\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-595xm"
Aug 04 22:31:47.571592 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:31:47.571555    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-85d9db4d5d-595xm"
Aug 04 22:31:47.704185 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:31:47.704160    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-595xm"]
Aug 04 22:31:47.706145 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:31:47.706109    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4fbc784_f5b0_4745_b221_028a8f8b9e8a.slice/crio-f7c96b48ed91666fce63f6f6ee1bd6ae74163be9ac552149abdbe1319da1fb40 WatchSource:0}: Error finding container f7c96b48ed91666fce63f6f6ee1bd6ae74163be9ac552149abdbe1319da1fb40: Status 404 returned error can't find the container with id f7c96b48ed91666fce63f6f6ee1bd6ae74163be9ac552149abdbe1319da1fb40
Aug 04 22:31:48.409544 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:31:48.409512    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-85d9db4d5d-595xm" event={"ID":"b4fbc784-f5b0-4745-b221-028a8f8b9e8a","Type":"ContainerStarted","Data":"f7c96b48ed91666fce63f6f6ee1bd6ae74163be9ac552149abdbe1319da1fb40"}
Aug 04 22:31:49.028879 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:31:49.028843    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-659754b74-vfjt2"
Aug 04 22:31:49.029047 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:31:49.028910    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-659754b74-vfjt2"
Aug 04 22:31:49.033917 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:31:49.033895    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-659754b74-vfjt2"
Aug 04 22:31:49.417141 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:31:49.417104    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-85d9db4d5d-595xm" event={"ID":"b4fbc784-f5b0-4745-b221-028a8f8b9e8a","Type":"ContainerStarted","Data":"0942efc62e2f2010572b30ee730432a594d85d70d12c31d800ac84cd63eb1c68"}
Aug 04 22:31:49.417540 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:31:49.417178    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-85d9db4d5d-595xm"
Aug 04 22:31:49.421186 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:31:49.421165    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-659754b74-vfjt2"
Aug 04 22:31:49.433986 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:31:49.433943    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-85d9db4d5d-595xm" podStartSLOduration=1.072604167 podStartE2EDuration="2.433930644s" totalImagesPullingTime="1.361326477s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 22:31:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 22:31:49.433117848 +0000 UTC m=+656.425935579" watchObservedRunningTime="2026-08-04 22:31:49.433930644 +0000 UTC m=+656.426748371"
Aug 04 22:31:49.479043 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:31:49.479004    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-84bf8c5959-bwnmv"]
Aug 04 22:32:00.423998 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:32:00.423965    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-85d9db4d5d-595xm"
Aug 04 22:32:14.503917 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:32:14.503881    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-84bf8c5959-bwnmv" podUID="3dbf9394-ec01-4782-89fc-f424bc7cabe7" containerName="console" containerID="cri-o://96f34373f37c5df581205cfcab8297fc6e4d45c465f649fa7e822ce2e6a04ca2" gracePeriod=15
Aug 04 22:32:14.757986 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:32:14.757930    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84bf8c5959-bwnmv"
Aug 04 22:32:14.858452 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:32:14.858422    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3dbf9394-ec01-4782-89fc-f424bc7cabe7-service-ca\") pod \"3dbf9394-ec01-4782-89fc-f424bc7cabe7\" (UID: \"3dbf9394-ec01-4782-89fc-f424bc7cabe7\") "
Aug 04 22:32:14.858618 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:32:14.858458    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3dbf9394-ec01-4782-89fc-f424bc7cabe7-trusted-ca-bundle\") pod \"3dbf9394-ec01-4782-89fc-f424bc7cabe7\" (UID: \"3dbf9394-ec01-4782-89fc-f424bc7cabe7\") "
Aug 04 22:32:14.858618 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:32:14.858477    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2d2q8\" (UniqueName: \"kubernetes.io/projected/3dbf9394-ec01-4782-89fc-f424bc7cabe7-kube-api-access-2d2q8\") pod \"3dbf9394-ec01-4782-89fc-f424bc7cabe7\" (UID: \"3dbf9394-ec01-4782-89fc-f424bc7cabe7\") "
Aug 04 22:32:14.858618 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:32:14.858537    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3dbf9394-ec01-4782-89fc-f424bc7cabe7-oauth-serving-cert\") pod \"3dbf9394-ec01-4782-89fc-f424bc7cabe7\" (UID: \"3dbf9394-ec01-4782-89fc-f424bc7cabe7\") "
Aug 04 22:32:14.858618 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:32:14.858572    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3dbf9394-ec01-4782-89fc-f424bc7cabe7-console-oauth-config\") pod \"3dbf9394-ec01-4782-89fc-f424bc7cabe7\" (UID: \"3dbf9394-ec01-4782-89fc-f424bc7cabe7\") "
Aug 04 22:32:14.858618 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:32:14.858587    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3dbf9394-ec01-4782-89fc-f424bc7cabe7-console-config\") pod \"3dbf9394-ec01-4782-89fc-f424bc7cabe7\" (UID: \"3dbf9394-ec01-4782-89fc-f424bc7cabe7\") "
Aug 04 22:32:14.858901 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:32:14.858647    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3dbf9394-ec01-4782-89fc-f424bc7cabe7-console-serving-cert\") pod \"3dbf9394-ec01-4782-89fc-f424bc7cabe7\" (UID: \"3dbf9394-ec01-4782-89fc-f424bc7cabe7\") "
Aug 04 22:32:14.858965 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:32:14.858913    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3dbf9394-ec01-4782-89fc-f424bc7cabe7-service-ca" (OuterVolumeSpecName: "service-ca") pod "3dbf9394-ec01-4782-89fc-f424bc7cabe7" (UID: "3dbf9394-ec01-4782-89fc-f424bc7cabe7"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 22:32:14.859031 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:32:14.858956    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3dbf9394-ec01-4782-89fc-f424bc7cabe7-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "3dbf9394-ec01-4782-89fc-f424bc7cabe7" (UID: "3dbf9394-ec01-4782-89fc-f424bc7cabe7"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 22:32:14.859081 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:32:14.859034    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3dbf9394-ec01-4782-89fc-f424bc7cabe7-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "3dbf9394-ec01-4782-89fc-f424bc7cabe7" (UID: "3dbf9394-ec01-4782-89fc-f424bc7cabe7"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 22:32:14.859081 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:32:14.859039    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3dbf9394-ec01-4782-89fc-f424bc7cabe7-console-config" (OuterVolumeSpecName: "console-config") pod "3dbf9394-ec01-4782-89fc-f424bc7cabe7" (UID: "3dbf9394-ec01-4782-89fc-f424bc7cabe7"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 22:32:14.860788 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:32:14.860760    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3dbf9394-ec01-4782-89fc-f424bc7cabe7-kube-api-access-2d2q8" (OuterVolumeSpecName: "kube-api-access-2d2q8") pod "3dbf9394-ec01-4782-89fc-f424bc7cabe7" (UID: "3dbf9394-ec01-4782-89fc-f424bc7cabe7"). InnerVolumeSpecName "kube-api-access-2d2q8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 22:32:14.860885 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:32:14.860793    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3dbf9394-ec01-4782-89fc-f424bc7cabe7-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "3dbf9394-ec01-4782-89fc-f424bc7cabe7" (UID: "3dbf9394-ec01-4782-89fc-f424bc7cabe7"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 22:32:14.860885 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:32:14.860829    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3dbf9394-ec01-4782-89fc-f424bc7cabe7-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "3dbf9394-ec01-4782-89fc-f424bc7cabe7" (UID: "3dbf9394-ec01-4782-89fc-f424bc7cabe7"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 22:32:14.959380 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:32:14.959356    2580 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3dbf9394-ec01-4782-89fc-f424bc7cabe7-console-serving-cert\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
Aug 04 22:32:14.959380 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:32:14.959378    2580 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3dbf9394-ec01-4782-89fc-f424bc7cabe7-service-ca\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
Aug 04 22:32:14.959505 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:32:14.959388    2580 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3dbf9394-ec01-4782-89fc-f424bc7cabe7-trusted-ca-bundle\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
Aug 04 22:32:14.959505 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:32:14.959397    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2d2q8\" (UniqueName: \"kubernetes.io/projected/3dbf9394-ec01-4782-89fc-f424bc7cabe7-kube-api-access-2d2q8\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
Aug 04 22:32:14.959505 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:32:14.959407    2580 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3dbf9394-ec01-4782-89fc-f424bc7cabe7-oauth-serving-cert\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
Aug 04 22:32:14.959505 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:32:14.959415    2580 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3dbf9394-ec01-4782-89fc-f424bc7cabe7-console-oauth-config\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
Aug 04 22:32:14.959505 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:32:14.959423    2580 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3dbf9394-ec01-4782-89fc-f424bc7cabe7-console-config\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
Aug 04 22:32:15.571768 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:32:15.571734    2580 generic.go:356] "Generic (PLEG): container finished" podID="3dbf9394-ec01-4782-89fc-f424bc7cabe7" containerID="96f34373f37c5df581205cfcab8297fc6e4d45c465f649fa7e822ce2e6a04ca2" exitCode=0
Aug 04 22:32:15.572155 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:32:15.571788    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84bf8c5959-bwnmv"
Aug 04 22:32:15.572155 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:32:15.571818    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84bf8c5959-bwnmv" event={"ID":"3dbf9394-ec01-4782-89fc-f424bc7cabe7","Type":"ContainerDied","Data":"96f34373f37c5df581205cfcab8297fc6e4d45c465f649fa7e822ce2e6a04ca2"}
Aug 04 22:32:15.572155 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:32:15.571871    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84bf8c5959-bwnmv" event={"ID":"3dbf9394-ec01-4782-89fc-f424bc7cabe7","Type":"ContainerDied","Data":"228b6c07c7b94e590c2ecf25bb0e34068edce63bed2b92c3a844e3c2f9ac3846"}
Aug 04 22:32:15.572155 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:32:15.571896    2580 scope.go:117] "RemoveContainer" containerID="96f34373f37c5df581205cfcab8297fc6e4d45c465f649fa7e822ce2e6a04ca2"
Aug 04 22:32:15.581187 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:32:15.581166    2580 scope.go:117] "RemoveContainer" containerID="96f34373f37c5df581205cfcab8297fc6e4d45c465f649fa7e822ce2e6a04ca2"
Aug 04 22:32:15.581472 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:32:15.581445    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"96f34373f37c5df581205cfcab8297fc6e4d45c465f649fa7e822ce2e6a04ca2\": container with ID starting with 96f34373f37c5df581205cfcab8297fc6e4d45c465f649fa7e822ce2e6a04ca2 not found: ID does not exist" containerID="96f34373f37c5df581205cfcab8297fc6e4d45c465f649fa7e822ce2e6a04ca2"
Aug 04 22:32:15.581537 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:32:15.581475    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"96f34373f37c5df581205cfcab8297fc6e4d45c465f649fa7e822ce2e6a04ca2"} err="failed to get container status \"96f34373f37c5df581205cfcab8297fc6e4d45c465f649fa7e822ce2e6a04ca2\": rpc error: code = NotFound desc = could not find container \"96f34373f37c5df581205cfcab8297fc6e4d45c465f649fa7e822ce2e6a04ca2\": container with ID starting with 96f34373f37c5df581205cfcab8297fc6e4d45c465f649fa7e822ce2e6a04ca2 not found: ID does not exist"
Aug 04 22:32:15.596204 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:32:15.596165    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-84bf8c5959-bwnmv"]
Aug 04 22:32:15.604478 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:32:15.604458    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-84bf8c5959-bwnmv"]
Aug 04 22:32:17.499884 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:32:17.499850    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3dbf9394-ec01-4782-89fc-f424bc7cabe7" path="/var/lib/kubelet/pods/3dbf9394-ec01-4782-89fc-f424bc7cabe7/volumes"
Aug 04 22:33:00.317573 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:33:00.317524    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-595xm"]
Aug 04 22:33:22.431845 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:33:22.431803    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-595xm"]
Aug 04 22:33:43.797743 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:33:43.797710    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-595xm"]
Aug 04 22:33:59.989471 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:33:59.989417    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-595xm"]
Aug 04 22:34:32.790346 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:34:32.790312    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-595xm"]
Aug 04 22:34:44.789035 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:34:44.789001    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-595xm"]
Aug 04 22:34:53.798765 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:34:53.798724    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-595xm"]
Aug 04 22:36:08.499336 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:36:08.499302    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-595xm"]
Aug 04 22:36:17.206075 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:36:17.206034    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-595xm"]
Aug 04 22:36:28.706842 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:36:28.706812    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-595xm"]
Aug 04 22:37:27.805068 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:37:27.804981    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7ffd699c46-9m7dd"]
Aug 04 22:37:27.805544 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:37:27.805418    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3dbf9394-ec01-4782-89fc-f424bc7cabe7" containerName="console"
Aug 04 22:37:27.805544 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:37:27.805429    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="3dbf9394-ec01-4782-89fc-f424bc7cabe7" containerName="console"
Aug 04 22:37:27.805544 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:37:27.805503    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="3dbf9394-ec01-4782-89fc-f424bc7cabe7" containerName="console"
Aug 04 22:37:27.808500 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:37:27.808484    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7ffd699c46-9m7dd"
Aug 04 22:37:27.810647 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:37:27.810627    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Aug 04 22:37:27.811317 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:37:27.811300    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Aug 04 22:37:27.811366 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:37:27.811323    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-kwzp4\""
Aug 04 22:37:27.816428 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:37:27.816408    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7ffd699c46-9m7dd"]
Aug 04 22:37:27.910257 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:37:27.910216    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b78a75ce-e350-4eea-ab5f-dad45b6f0820-webhook-cert\") pod \"maas-controller-7ffd699c46-9m7dd\" (UID: \"b78a75ce-e350-4eea-ab5f-dad45b6f0820\") " pod="opendatahub/maas-controller-7ffd699c46-9m7dd"
Aug 04 22:37:27.910401 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:37:27.910280    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9798w\" (UniqueName: \"kubernetes.io/projected/b78a75ce-e350-4eea-ab5f-dad45b6f0820-kube-api-access-9798w\") pod \"maas-controller-7ffd699c46-9m7dd\" (UID: \"b78a75ce-e350-4eea-ab5f-dad45b6f0820\") " pod="opendatahub/maas-controller-7ffd699c46-9m7dd"
Aug 04 22:37:28.010737 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:37:28.010704    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9798w\" (UniqueName: \"kubernetes.io/projected/b78a75ce-e350-4eea-ab5f-dad45b6f0820-kube-api-access-9798w\") pod \"maas-controller-7ffd699c46-9m7dd\" (UID: \"b78a75ce-e350-4eea-ab5f-dad45b6f0820\") " pod="opendatahub/maas-controller-7ffd699c46-9m7dd"
Aug 04 22:37:28.010892 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:37:28.010777    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b78a75ce-e350-4eea-ab5f-dad45b6f0820-webhook-cert\") pod \"maas-controller-7ffd699c46-9m7dd\" (UID: \"b78a75ce-e350-4eea-ab5f-dad45b6f0820\") " pod="opendatahub/maas-controller-7ffd699c46-9m7dd"
Aug 04 22:37:28.013143 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:37:28.013103    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b78a75ce-e350-4eea-ab5f-dad45b6f0820-webhook-cert\") pod \"maas-controller-7ffd699c46-9m7dd\" (UID: \"b78a75ce-e350-4eea-ab5f-dad45b6f0820\") " pod="opendatahub/maas-controller-7ffd699c46-9m7dd"
Aug 04 22:37:28.018594 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:37:28.018569    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9798w\" (UniqueName: \"kubernetes.io/projected/b78a75ce-e350-4eea-ab5f-dad45b6f0820-kube-api-access-9798w\") pod \"maas-controller-7ffd699c46-9m7dd\" (UID: \"b78a75ce-e350-4eea-ab5f-dad45b6f0820\") " pod="opendatahub/maas-controller-7ffd699c46-9m7dd"
Aug 04 22:37:28.120977 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:37:28.120894    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7ffd699c46-9m7dd"
Aug 04 22:37:28.252605 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:37:28.252578    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7ffd699c46-9m7dd"]
Aug 04 22:37:28.254741 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:37:28.254712    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb78a75ce_e350_4eea_ab5f_dad45b6f0820.slice/crio-ca3b8a977508f7a9215c668ebd74dccb0ea07cdb64a187409dac7755ae977c3e WatchSource:0}: Error finding container ca3b8a977508f7a9215c668ebd74dccb0ea07cdb64a187409dac7755ae977c3e: Status 404 returned error can't find the container with id ca3b8a977508f7a9215c668ebd74dccb0ea07cdb64a187409dac7755ae977c3e
Aug 04 22:37:28.256141 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:37:28.256113    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 04 22:37:28.385861 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:37:28.385782    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7ffd699c46-9m7dd" event={"ID":"b78a75ce-e350-4eea-ab5f-dad45b6f0820","Type":"ContainerStarted","Data":"ca3b8a977508f7a9215c668ebd74dccb0ea07cdb64a187409dac7755ae977c3e"}
Aug 04 22:37:31.407934 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:37:31.407899    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7ffd699c46-9m7dd" event={"ID":"b78a75ce-e350-4eea-ab5f-dad45b6f0820","Type":"ContainerStarted","Data":"377c869be10cd4a9e0b1383ac1a90bf21ba4a2aae022c1a2d52b60daf30aa9f9"}
Aug 04 22:37:31.408398 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:37:31.407977    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7ffd699c46-9m7dd"
Aug 04 22:37:31.426245 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:37:31.426206    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7ffd699c46-9m7dd" podStartSLOduration=2.105906814 podStartE2EDuration="4.426192957s" totalImagesPullingTime="2.320286143s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 22:37:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 22:37:31.425467275 +0000 UTC m=+998.418285004" watchObservedRunningTime="2026-08-04 22:37:31.426192957 +0000 UTC m=+998.419010684"
Aug 04 22:37:42.416303 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:37:42.416273    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7ffd699c46-9m7dd"
Aug 04 22:37:47.091833 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:37:47.091795    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7ffd699c46-9m7dd"]
Aug 04 22:37:47.092290 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:37:47.092026    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-7ffd699c46-9m7dd" podUID="b78a75ce-e350-4eea-ab5f-dad45b6f0820" containerName="manager" containerID="cri-o://377c869be10cd4a9e0b1383ac1a90bf21ba4a2aae022c1a2d52b60daf30aa9f9" gracePeriod=30
Aug 04 22:37:47.349737 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:37:47.349670    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7ffd699c46-9m7dd"
Aug 04 22:37:47.476728 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:37:47.476702    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9798w\" (UniqueName: \"kubernetes.io/projected/b78a75ce-e350-4eea-ab5f-dad45b6f0820-kube-api-access-9798w\") pod \"b78a75ce-e350-4eea-ab5f-dad45b6f0820\" (UID: \"b78a75ce-e350-4eea-ab5f-dad45b6f0820\") "
Aug 04 22:37:47.476914 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:37:47.476745    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b78a75ce-e350-4eea-ab5f-dad45b6f0820-webhook-cert\") pod \"b78a75ce-e350-4eea-ab5f-dad45b6f0820\" (UID: \"b78a75ce-e350-4eea-ab5f-dad45b6f0820\") "
Aug 04 22:37:47.478954 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:37:47.478921    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b78a75ce-e350-4eea-ab5f-dad45b6f0820-kube-api-access-9798w" (OuterVolumeSpecName: "kube-api-access-9798w") pod "b78a75ce-e350-4eea-ab5f-dad45b6f0820" (UID: "b78a75ce-e350-4eea-ab5f-dad45b6f0820"). InnerVolumeSpecName "kube-api-access-9798w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 22:37:47.478954 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:37:47.478929    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b78a75ce-e350-4eea-ab5f-dad45b6f0820-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "b78a75ce-e350-4eea-ab5f-dad45b6f0820" (UID: "b78a75ce-e350-4eea-ab5f-dad45b6f0820"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 22:37:47.502434 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:37:47.502404    2580 generic.go:356] "Generic (PLEG): container finished" podID="b78a75ce-e350-4eea-ab5f-dad45b6f0820" containerID="377c869be10cd4a9e0b1383ac1a90bf21ba4a2aae022c1a2d52b60daf30aa9f9" exitCode=0
Aug 04 22:37:47.502595 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:37:47.502450    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7ffd699c46-9m7dd"
Aug 04 22:37:47.502595 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:37:47.502484    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7ffd699c46-9m7dd" event={"ID":"b78a75ce-e350-4eea-ab5f-dad45b6f0820","Type":"ContainerDied","Data":"377c869be10cd4a9e0b1383ac1a90bf21ba4a2aae022c1a2d52b60daf30aa9f9"}
Aug 04 22:37:47.502595 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:37:47.502535    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7ffd699c46-9m7dd" event={"ID":"b78a75ce-e350-4eea-ab5f-dad45b6f0820","Type":"ContainerDied","Data":"ca3b8a977508f7a9215c668ebd74dccb0ea07cdb64a187409dac7755ae977c3e"}
Aug 04 22:37:47.502595 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:37:47.502557    2580 scope.go:117] "RemoveContainer" containerID="377c869be10cd4a9e0b1383ac1a90bf21ba4a2aae022c1a2d52b60daf30aa9f9"
Aug 04 22:37:47.513071 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:37:47.513052    2580 scope.go:117] "RemoveContainer" containerID="377c869be10cd4a9e0b1383ac1a90bf21ba4a2aae022c1a2d52b60daf30aa9f9"
Aug 04 22:37:47.513397 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:37:47.513376    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"377c869be10cd4a9e0b1383ac1a90bf21ba4a2aae022c1a2d52b60daf30aa9f9\": container with ID starting with 377c869be10cd4a9e0b1383ac1a90bf21ba4a2aae022c1a2d52b60daf30aa9f9 not found: ID does not exist" containerID="377c869be10cd4a9e0b1383ac1a90bf21ba4a2aae022c1a2d52b60daf30aa9f9"
Aug 04 22:37:47.513439 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:37:47.513408    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"377c869be10cd4a9e0b1383ac1a90bf21ba4a2aae022c1a2d52b60daf30aa9f9"} err="failed to get container status \"377c869be10cd4a9e0b1383ac1a90bf21ba4a2aae022c1a2d52b60daf30aa9f9\": rpc error: code = NotFound desc = could not find container \"377c869be10cd4a9e0b1383ac1a90bf21ba4a2aae022c1a2d52b60daf30aa9f9\": container with ID starting with 377c869be10cd4a9e0b1383ac1a90bf21ba4a2aae022c1a2d52b60daf30aa9f9 not found: ID does not exist"
Aug 04 22:37:47.524318 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:37:47.524291    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7ffd699c46-9m7dd"]
Aug 04 22:37:47.529632 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:37:47.529606    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7ffd699c46-9m7dd"]
Aug 04 22:37:47.577822 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:37:47.577797    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9798w\" (UniqueName: \"kubernetes.io/projected/b78a75ce-e350-4eea-ab5f-dad45b6f0820-kube-api-access-9798w\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
Aug 04 22:37:47.577822 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:37:47.577820    2580 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b78a75ce-e350-4eea-ab5f-dad45b6f0820-webhook-cert\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
Aug 04 22:37:48.322543 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:37:48.322508    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7ffd699c46-9mfpm"]
Aug 04 22:37:48.323078 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:37:48.323023    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b78a75ce-e350-4eea-ab5f-dad45b6f0820" containerName="manager"
Aug 04 22:37:48.323078 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:37:48.323039    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="b78a75ce-e350-4eea-ab5f-dad45b6f0820" containerName="manager"
Aug 04 22:37:48.323190 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:37:48.323104    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="b78a75ce-e350-4eea-ab5f-dad45b6f0820" containerName="manager"
Aug 04 22:37:48.327478 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:37:48.327461    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7ffd699c46-9mfpm"
Aug 04 22:37:48.329829 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:37:48.329809    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Aug 04 22:37:48.330606 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:37:48.330588    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Aug 04 22:37:48.330690 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:37:48.330618    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-kwzp4\""
Aug 04 22:37:48.336293 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:37:48.336267    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7ffd699c46-9mfpm"]
Aug 04 22:37:48.385325 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:37:48.385280    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6nlbh\" (UniqueName: \"kubernetes.io/projected/47cdd932-71eb-4668-a5c5-af6b1a3c8d15-kube-api-access-6nlbh\") pod \"maas-controller-7ffd699c46-9mfpm\" (UID: \"47cdd932-71eb-4668-a5c5-af6b1a3c8d15\") " pod="opendatahub/maas-controller-7ffd699c46-9mfpm"
Aug 04 22:37:48.385513 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:37:48.385350    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/47cdd932-71eb-4668-a5c5-af6b1a3c8d15-webhook-cert\") pod \"maas-controller-7ffd699c46-9mfpm\" (UID: \"47cdd932-71eb-4668-a5c5-af6b1a3c8d15\") " pod="opendatahub/maas-controller-7ffd699c46-9mfpm"
Aug 04 22:37:48.485861 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:37:48.485827    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/47cdd932-71eb-4668-a5c5-af6b1a3c8d15-webhook-cert\") pod \"maas-controller-7ffd699c46-9mfpm\" (UID: \"47cdd932-71eb-4668-a5c5-af6b1a3c8d15\") " pod="opendatahub/maas-controller-7ffd699c46-9mfpm"
Aug 04 22:37:48.486068 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:37:48.485978    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6nlbh\" (UniqueName: \"kubernetes.io/projected/47cdd932-71eb-4668-a5c5-af6b1a3c8d15-kube-api-access-6nlbh\") pod \"maas-controller-7ffd699c46-9mfpm\" (UID: \"47cdd932-71eb-4668-a5c5-af6b1a3c8d15\") " pod="opendatahub/maas-controller-7ffd699c46-9mfpm"
Aug 04 22:37:48.488374 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:37:48.488349    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/47cdd932-71eb-4668-a5c5-af6b1a3c8d15-webhook-cert\") pod \"maas-controller-7ffd699c46-9mfpm\" (UID: \"47cdd932-71eb-4668-a5c5-af6b1a3c8d15\") " pod="opendatahub/maas-controller-7ffd699c46-9mfpm"
Aug 04 22:37:48.493656 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:37:48.493634    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6nlbh\" (UniqueName: \"kubernetes.io/projected/47cdd932-71eb-4668-a5c5-af6b1a3c8d15-kube-api-access-6nlbh\") pod \"maas-controller-7ffd699c46-9mfpm\" (UID: \"47cdd932-71eb-4668-a5c5-af6b1a3c8d15\") " pod="opendatahub/maas-controller-7ffd699c46-9mfpm"
Aug 04 22:37:48.639665 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:37:48.639586    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7ffd699c46-9mfpm"
Aug 04 22:37:48.788504 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:37:48.788476    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7ffd699c46-9mfpm"]
Aug 04 22:37:48.793714 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:37:48.791351    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47cdd932_71eb_4668_a5c5_af6b1a3c8d15.slice/crio-2298b1a17aedf2a2c3d4d5073855355db6be4398b3efe730651dc6de5550eda1 WatchSource:0}: Error finding container 2298b1a17aedf2a2c3d4d5073855355db6be4398b3efe730651dc6de5550eda1: Status 404 returned error can't find the container with id 2298b1a17aedf2a2c3d4d5073855355db6be4398b3efe730651dc6de5550eda1
Aug 04 22:37:49.500845 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:37:49.500800    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b78a75ce-e350-4eea-ab5f-dad45b6f0820" path="/var/lib/kubelet/pods/b78a75ce-e350-4eea-ab5f-dad45b6f0820/volumes"
Aug 04 22:37:49.516336 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:37:49.516292    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7ffd699c46-9mfpm" event={"ID":"47cdd932-71eb-4668-a5c5-af6b1a3c8d15","Type":"ContainerStarted","Data":"e7b8d9fa3a55f9112b31bd4fc6a19879bea6f4c1ef7690609702ab8c7e9f4b85"}
Aug 04 22:37:49.516490 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:37:49.516357    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7ffd699c46-9mfpm" event={"ID":"47cdd932-71eb-4668-a5c5-af6b1a3c8d15","Type":"ContainerStarted","Data":"2298b1a17aedf2a2c3d4d5073855355db6be4398b3efe730651dc6de5550eda1"}
Aug 04 22:37:49.516490 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:37:49.516386    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7ffd699c46-9mfpm"
Aug 04 22:37:49.537492 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:37:49.537445    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7ffd699c46-9mfpm" podStartSLOduration=1.009937128 podStartE2EDuration="1.53743094s" totalImagesPullingTime="527.493812ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 22:37:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 22:37:49.535173932 +0000 UTC m=+1016.527991672" watchObservedRunningTime="2026-08-04 22:37:49.53743094 +0000 UTC m=+1016.530248667"
Aug 04 22:38:00.524797 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:38:00.524764    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7ffd699c46-9mfpm"
Aug 04 22:38:10.398162 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:38:10.396904    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-595xm"]
Aug 04 22:38:18.994948 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:38:18.994913    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-595xm"]
Aug 04 22:39:15.105482 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:39:15.105444    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-595xm"]
Aug 04 22:39:22.104361 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:39:22.104306    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-595xm"]
Aug 04 22:39:37.402797 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:39:37.402759    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-595xm"]
Aug 04 22:39:43.491919 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:39:43.491886    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-595xm"]
Aug 04 22:39:52.896742 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:39:52.896704    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-595xm"]
Aug 04 22:40:00.203086 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:40:00.203050    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-595xm"]
Aug 04 22:40:13.599160 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:40:13.599109    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-595xm"]
Aug 04 22:40:18.690491 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:40:18.690408    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-595xm"]
Aug 04 22:40:23.891474 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:40:23.891434    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-595xm"]
Aug 04 22:40:45.927972 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:40:45.927936    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-595xm"]
Aug 04 22:40:56.428796 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:40:56.428752    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-595xm"]
Aug 04 22:41:20.988547 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:41:20.988510    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-595xm"]
Aug 04 22:41:31.636269 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:41:31.636234    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-595xm"]
Aug 04 22:41:37.407683 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:41:37.407644    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-595xm"]
Aug 04 22:41:44.942797 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:41:44.942761    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-595xm"]
Aug 04 22:41:52.537429 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:41:52.537393    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-595xm"]
Aug 04 22:41:57.618738 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:41:57.618699    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-595xm"]
Aug 04 22:42:03.337429 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:42:03.337392    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-595xm"]
Aug 04 22:42:11.930383 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:42:11.930346    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-595xm"]
Aug 04 22:42:20.303790 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:42:20.303758    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-595xm"]
Aug 04 22:42:31.908297 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:42:31.908251    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-595xm"]
Aug 04 22:42:38.303525 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:42:38.303490    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-595xm"]
Aug 04 22:42:43.793111 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:42:43.793076    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-595xm"]
Aug 04 22:42:48.702038 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:42:48.702003    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-595xm"]
Aug 04 22:42:55.801611 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:42:55.801576    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-595xm"]
Aug 04 22:43:01.307453 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:43:01.307419    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-595xm"]
Aug 04 22:43:06.198868 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:43:06.198827    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-595xm"]
Aug 04 22:43:16.788802 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:43:16.788720    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-595xm"]
Aug 04 22:44:12.019050 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:44:12.019017    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-zctkb"]
Aug 04 22:44:12.019588 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:44:12.019266    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-zctkb" podUID="3bedd616-15c0-4cd6-9a32-6915479f6c87" containerName="manager" containerID="cri-o://69391ff3832d3a30a2f5cbb925d4601313f52b8adb39518246d971a453139969" gracePeriod=10
Aug 04 22:44:12.275002 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:44:12.274944    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-zctkb"
Aug 04 22:44:12.400706 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:44:12.400661    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3bedd616-15c0-4cd6-9a32-6915479f6c87-extensions-socket-volume\") pod \"3bedd616-15c0-4cd6-9a32-6915479f6c87\" (UID: \"3bedd616-15c0-4cd6-9a32-6915479f6c87\") "
Aug 04 22:44:12.400891 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:44:12.400765    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wwmqn\" (UniqueName: \"kubernetes.io/projected/3bedd616-15c0-4cd6-9a32-6915479f6c87-kube-api-access-wwmqn\") pod \"3bedd616-15c0-4cd6-9a32-6915479f6c87\" (UID: \"3bedd616-15c0-4cd6-9a32-6915479f6c87\") "
Aug 04 22:44:12.401054 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:44:12.401031    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3bedd616-15c0-4cd6-9a32-6915479f6c87-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "3bedd616-15c0-4cd6-9a32-6915479f6c87" (UID: "3bedd616-15c0-4cd6-9a32-6915479f6c87"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 22:44:12.402935 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:44:12.402908    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3bedd616-15c0-4cd6-9a32-6915479f6c87-kube-api-access-wwmqn" (OuterVolumeSpecName: "kube-api-access-wwmqn") pod "3bedd616-15c0-4cd6-9a32-6915479f6c87" (UID: "3bedd616-15c0-4cd6-9a32-6915479f6c87"). InnerVolumeSpecName "kube-api-access-wwmqn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 22:44:12.502239 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:44:12.502205    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wwmqn\" (UniqueName: \"kubernetes.io/projected/3bedd616-15c0-4cd6-9a32-6915479f6c87-kube-api-access-wwmqn\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
Aug 04 22:44:12.502239 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:44:12.502232    2580 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3bedd616-15c0-4cd6-9a32-6915479f6c87-extensions-socket-volume\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
Aug 04 22:44:12.750529 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:44:12.750487    2580 generic.go:356] "Generic (PLEG): container finished" podID="3bedd616-15c0-4cd6-9a32-6915479f6c87" containerID="69391ff3832d3a30a2f5cbb925d4601313f52b8adb39518246d971a453139969" exitCode=0
Aug 04 22:44:12.750705 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:44:12.750552    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-zctkb"
Aug 04 22:44:12.750705 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:44:12.750552    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-zctkb" event={"ID":"3bedd616-15c0-4cd6-9a32-6915479f6c87","Type":"ContainerDied","Data":"69391ff3832d3a30a2f5cbb925d4601313f52b8adb39518246d971a453139969"}
Aug 04 22:44:12.750705 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:44:12.750648    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-zctkb" event={"ID":"3bedd616-15c0-4cd6-9a32-6915479f6c87","Type":"ContainerDied","Data":"e65e40f7730375dd991ab4e8d4602122e839471d0e7c185379f8cb669e4dd90e"}
Aug 04 22:44:12.750705 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:44:12.750680    2580 scope.go:117] "RemoveContainer" containerID="69391ff3832d3a30a2f5cbb925d4601313f52b8adb39518246d971a453139969"
Aug 04 22:44:12.761110 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:44:12.761089    2580 scope.go:117] "RemoveContainer" containerID="69391ff3832d3a30a2f5cbb925d4601313f52b8adb39518246d971a453139969"
Aug 04 22:44:12.761402 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:44:12.761381    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"69391ff3832d3a30a2f5cbb925d4601313f52b8adb39518246d971a453139969\": container with ID starting with 69391ff3832d3a30a2f5cbb925d4601313f52b8adb39518246d971a453139969 not found: ID does not exist" containerID="69391ff3832d3a30a2f5cbb925d4601313f52b8adb39518246d971a453139969"
Aug 04 22:44:12.761470 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:44:12.761413    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"69391ff3832d3a30a2f5cbb925d4601313f52b8adb39518246d971a453139969"} err="failed to get container status \"69391ff3832d3a30a2f5cbb925d4601313f52b8adb39518246d971a453139969\": rpc error: code = NotFound desc = could not find container \"69391ff3832d3a30a2f5cbb925d4601313f52b8adb39518246d971a453139969\": container with ID starting with 69391ff3832d3a30a2f5cbb925d4601313f52b8adb39518246d971a453139969 not found: ID does not exist"
Aug 04 22:44:12.771084 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:44:12.771058    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-zctkb"]
Aug 04 22:44:12.776908 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:44:12.776885    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-zctkb"]
Aug 04 22:44:13.501216 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:44:13.501182    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3bedd616-15c0-4cd6-9a32-6915479f6c87" path="/var/lib/kubelet/pods/3bedd616-15c0-4cd6-9a32-6915479f6c87/volumes"
Aug 04 22:45:00.153687 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:45:00.153656    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29764725-zqqw9"]
Aug 04 22:45:00.154120 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:45:00.154045    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3bedd616-15c0-4cd6-9a32-6915479f6c87" containerName="manager"
Aug 04 22:45:00.154120 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:45:00.154056    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="3bedd616-15c0-4cd6-9a32-6915479f6c87" containerName="manager"
Aug 04 22:45:00.154221 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:45:00.154157    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="3bedd616-15c0-4cd6-9a32-6915479f6c87" containerName="manager"
Aug 04 22:45:00.157485 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:45:00.157471    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29764725-zqqw9"
Aug 04 22:45:00.160466 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:45:00.160439    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-vvngh\""
Aug 04 22:45:00.165400 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:45:00.165076    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29764725-zqqw9"]
Aug 04 22:45:00.168424 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:45:00.168407    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29764725-zqqw9"
Aug 04 22:45:00.304987 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:45:00.304964    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29764725-zqqw9"]
Aug 04 22:45:00.306609 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:45:00.306579    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b2e0994_c8c4_439e_95ef_a1154620c1b1.slice/crio-abd3271154f4abada8313789b64a15fce728320c8295e077f857dd9505922c05 WatchSource:0}: Error finding container abd3271154f4abada8313789b64a15fce728320c8295e077f857dd9505922c05: Status 404 returned error can't find the container with id abd3271154f4abada8313789b64a15fce728320c8295e077f857dd9505922c05
Aug 04 22:45:00.308421 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:45:00.308405    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 04 22:45:01.022760 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:45:01.022728    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29764725-zqqw9" event={"ID":"0b2e0994-c8c4-439e-95ef-a1154620c1b1","Type":"ContainerStarted","Data":"abd3271154f4abada8313789b64a15fce728320c8295e077f857dd9505922c05"}
Aug 04 22:45:03.035830 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:45:03.035741    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29764725-zqqw9" event={"ID":"0b2e0994-c8c4-439e-95ef-a1154620c1b1","Type":"ContainerStarted","Data":"e2786afa30265cbd40cde5a75042343fe67eee29fbabaa7a5c96f93b3a730cb9"}
Aug 04 22:45:03.056735 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:45:03.052222    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29764725-zqqw9" podStartSLOduration=0.798284961 podStartE2EDuration="3.052200101s" totalImagesPullingTime="2.25391514s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 22:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 22:45:03.049264995 +0000 UTC m=+1450.042082712" watchObservedRunningTime="2026-08-04 22:45:03.052200101 +0000 UTC m=+1450.045017829"
Aug 04 22:45:04.042628 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:45:04.042590    2580 generic.go:356] "Generic (PLEG): container finished" podID="0b2e0994-c8c4-439e-95ef-a1154620c1b1" containerID="e2786afa30265cbd40cde5a75042343fe67eee29fbabaa7a5c96f93b3a730cb9" exitCode=0
Aug 04 22:45:04.043025 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:45:04.042674    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29764725-zqqw9" event={"ID":"0b2e0994-c8c4-439e-95ef-a1154620c1b1","Type":"ContainerDied","Data":"e2786afa30265cbd40cde5a75042343fe67eee29fbabaa7a5c96f93b3a730cb9"}
Aug 04 22:45:05.183091 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:45:05.183067    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29764725-zqqw9"
Aug 04 22:45:06.055145 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:45:06.055114    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29764725-zqqw9"
Aug 04 22:45:06.055145 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:45:06.055125    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29764725-zqqw9" event={"ID":"0b2e0994-c8c4-439e-95ef-a1154620c1b1","Type":"ContainerDied","Data":"abd3271154f4abada8313789b64a15fce728320c8295e077f857dd9505922c05"}
Aug 04 22:45:06.055346 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:45:06.055185    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="abd3271154f4abada8313789b64a15fce728320c8295e077f857dd9505922c05"
Aug 04 22:45:12.698290 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:45:12.698257    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-k7zmk"]
Aug 04 22:45:12.698684 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:45:12.698670    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b2e0994-c8c4-439e-95ef-a1154620c1b1" containerName="cleanup"
Aug 04 22:45:12.698684 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:45:12.698684    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b2e0994-c8c4-439e-95ef-a1154620c1b1" containerName="cleanup"
Aug 04 22:45:12.698765 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:45:12.698756    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="0b2e0994-c8c4-439e-95ef-a1154620c1b1" containerName="cleanup"
Aug 04 22:45:12.702083 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:45:12.702061    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-k7zmk"
Aug 04 22:45:12.704332 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:45:12.704313    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-6wzcf\""
Aug 04 22:45:12.714148 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:45:12.714110    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-k7zmk"]
Aug 04 22:45:12.813459 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:45:12.813425    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/23bb4b1b-9ef0-48d7-bff3-7dc5db6a2b66-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-68cf589589-k7zmk\" (UID: \"23bb4b1b-9ef0-48d7-bff3-7dc5db6a2b66\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-k7zmk"
Aug 04 22:45:12.813634 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:45:12.813555    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hpbd8\" (UniqueName: \"kubernetes.io/projected/23bb4b1b-9ef0-48d7-bff3-7dc5db6a2b66-kube-api-access-hpbd8\") pod \"kuadrant-operator-controller-manager-68cf589589-k7zmk\" (UID: \"23bb4b1b-9ef0-48d7-bff3-7dc5db6a2b66\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-k7zmk"
Aug 04 22:45:12.914201 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:45:12.914165    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/23bb4b1b-9ef0-48d7-bff3-7dc5db6a2b66-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-68cf589589-k7zmk\" (UID: \"23bb4b1b-9ef0-48d7-bff3-7dc5db6a2b66\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-k7zmk"
Aug 04 22:45:12.914334 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:45:12.914253    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hpbd8\" (UniqueName: \"kubernetes.io/projected/23bb4b1b-9ef0-48d7-bff3-7dc5db6a2b66-kube-api-access-hpbd8\") pod \"kuadrant-operator-controller-manager-68cf589589-k7zmk\" (UID: \"23bb4b1b-9ef0-48d7-bff3-7dc5db6a2b66\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-k7zmk"
Aug 04 22:45:12.914557 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:45:12.914525    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/23bb4b1b-9ef0-48d7-bff3-7dc5db6a2b66-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-68cf589589-k7zmk\" (UID: \"23bb4b1b-9ef0-48d7-bff3-7dc5db6a2b66\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-k7zmk"
Aug 04 22:45:12.923605 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:45:12.923574    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hpbd8\" (UniqueName: \"kubernetes.io/projected/23bb4b1b-9ef0-48d7-bff3-7dc5db6a2b66-kube-api-access-hpbd8\") pod \"kuadrant-operator-controller-manager-68cf589589-k7zmk\" (UID: \"23bb4b1b-9ef0-48d7-bff3-7dc5db6a2b66\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-k7zmk"
Aug 04 22:45:13.012582 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:45:13.012503    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-k7zmk"
Aug 04 22:45:13.162458 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:45:13.162433    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-k7zmk"]
Aug 04 22:45:13.165342 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:45:13.165317    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23bb4b1b_9ef0_48d7_bff3_7dc5db6a2b66.slice/crio-10bd17f992a574f1fdae5522609c58f809fbbfb7057f4a3f609c287d20cda21d WatchSource:0}: Error finding container 10bd17f992a574f1fdae5522609c58f809fbbfb7057f4a3f609c287d20cda21d: Status 404 returned error can't find the container with id 10bd17f992a574f1fdae5522609c58f809fbbfb7057f4a3f609c287d20cda21d
Aug 04 22:45:14.109193 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:45:14.109158    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-k7zmk" event={"ID":"23bb4b1b-9ef0-48d7-bff3-7dc5db6a2b66","Type":"ContainerStarted","Data":"fa21e1a5e44ba56969f7e9d00a26b1d176d5eab30379bdcc8d9a56019736eca7"}
Aug 04 22:45:14.109625 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:45:14.109210    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-k7zmk" event={"ID":"23bb4b1b-9ef0-48d7-bff3-7dc5db6a2b66","Type":"ContainerStarted","Data":"10bd17f992a574f1fdae5522609c58f809fbbfb7057f4a3f609c287d20cda21d"}
Aug 04 22:45:14.109625 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:45:14.109383    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-k7zmk"
Aug 04 22:45:14.130062 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:45:14.130021    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-k7zmk" podStartSLOduration=2.130007006 podStartE2EDuration="2.130007006s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 22:45:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 22:45:14.127939498 +0000 UTC m=+1461.120757224" watchObservedRunningTime="2026-08-04 22:45:14.130007006 +0000 UTC m=+1461.122824733"
Aug 04 22:45:25.117793 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:45:25.117762    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-k7zmk"
Aug 04 22:45:32.895972 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:45:32.895934    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-595xm"]
Aug 04 22:45:39.993585 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:45:39.993550    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-595xm"]
Aug 04 22:46:01.511308 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:46:01.511269    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-595xm"]
Aug 04 22:46:33.907704 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:46:33.907668    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-595xm"]
Aug 04 22:46:40.898802 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:46:40.898765    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-595xm"]
Aug 04 22:46:48.698762 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:46:48.698728    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-595xm"]
Aug 04 22:46:55.294658 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:46:55.294621    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-595xm"]
Aug 04 22:47:04.298705 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:47:04.298669    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-595xm"]
Aug 04 22:47:10.298006 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:47:10.297967    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-595xm"]
Aug 04 22:47:19.807209 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:47:19.807171    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-595xm"]
Aug 04 22:47:24.895973 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:47:24.895937    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-595xm"]
Aug 04 22:47:34.697822 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:47:34.697784    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-595xm"]
Aug 04 22:47:41.491545 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:47:41.491511    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-595xm"]
Aug 04 22:47:50.698106 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:47:50.698072    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-595xm"]
Aug 04 22:48:14.808790 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:48:14.808756    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-595xm"]
Aug 04 22:48:19.903791 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:48:19.903753    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-595xm"]
Aug 04 22:48:28.303580 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:48:28.303544    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-595xm"]
Aug 04 22:48:37.607845 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:48:37.607810    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-595xm"]
Aug 04 22:49:15.803365 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:49:15.803290    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-595xm"]
Aug 04 22:49:25.396368 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:49:25.396333    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-595xm"]
Aug 04 22:49:29.699812 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:49:29.699772    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-595xm"]
Aug 04 22:49:36.000690 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:49:36.000654    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-595xm"]
Aug 04 22:49:46.297588 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:49:46.297553    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-595xm"]
Aug 04 22:49:52.400161 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:49:52.400113    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-595xm"]
Aug 04 22:49:58.899905 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:49:58.899875    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-595xm"]
Aug 04 22:50:05.091862 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:50:05.091830    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-595xm"]
Aug 04 22:50:09.400602 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:50:09.400563    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-595xm"]
Aug 04 22:50:20.599631 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:50:20.599596    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-595xm"]
Aug 04 22:50:25.697899 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:50:25.697862    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-595xm"]
Aug 04 22:50:43.203409 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:50:43.203371    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-595xm"]
Aug 04 22:50:48.506970 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:50:48.506887    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-595xm"]
Aug 04 22:51:01.910275 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:51:01.910238    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-595xm"]
Aug 04 22:51:07.110143 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:51:07.110098    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-595xm"]
Aug 04 22:51:13.700760 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:51:13.700726    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-595xm"]
Aug 04 22:51:18.590611 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:51:18.590579    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-595xm"]
Aug 04 22:51:24.903522 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:51:24.903489    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-595xm"]
Aug 04 22:51:34.707314 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:51:34.707276    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-595xm"]
Aug 04 22:51:40.707106 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:51:40.707070    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-595xm"]
Aug 04 22:51:51.601232 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:51:51.601196    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-595xm"]
Aug 04 22:51:58.501174 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:51:58.501126    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-595xm"]
Aug 04 22:52:08.502830 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:52:08.502796    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-595xm"]
Aug 04 22:52:23.803856 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:52:23.803774    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-595xm"]
Aug 04 22:52:30.801879 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:52:30.801836    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-595xm"]
Aug 04 22:52:40.999038 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:52:40.999006    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-595xm"]
Aug 04 22:52:47.728106 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:52:47.728067    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-595xm"]
Aug 04 22:52:55.997925 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:52:55.997887    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-595xm"]
Aug 04 22:53:01.416093 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:53:01.416060    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-595xm"]
Aug 04 22:53:09.013009 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:53:09.012974    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-e4f3cae8-openshift-default-6566d57b6-lcz2q"]
Aug 04 22:53:09.016881 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:53:09.016865    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-e4f3cae8-openshift-default-6566d57b6-lcz2q"
Aug 04 22:53:09.019344 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:53:09.019326    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-e4f3cae8-openshift-default-dockercfg-4dqwt\""
Aug 04 22:53:09.037034 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:53:09.037010    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-e4f3cae8-openshift-default-6566d57b6-lcz2q"]
Aug 04 22:53:09.114234 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:53:09.114197    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-86clw\" (UniqueName: \"kubernetes.io/projected/268f14db-dd79-4e1c-a4eb-89849954a3f9-kube-api-access-86clw\") pod \"e2e-ait-e4f3cae8-openshift-default-6566d57b6-lcz2q\" (UID: \"268f14db-dd79-4e1c-a4eb-89849954a3f9\") " pod="openshift-ingress/e2e-ait-e4f3cae8-openshift-default-6566d57b6-lcz2q"
Aug 04 22:53:09.114234 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:53:09.114234    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/268f14db-dd79-4e1c-a4eb-89849954a3f9-workload-socket\") pod \"e2e-ait-e4f3cae8-openshift-default-6566d57b6-lcz2q\" (UID: \"268f14db-dd79-4e1c-a4eb-89849954a3f9\") " pod="openshift-ingress/e2e-ait-e4f3cae8-openshift-default-6566d57b6-lcz2q"
Aug 04 22:53:09.114501 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:53:09.114254    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/268f14db-dd79-4e1c-a4eb-89849954a3f9-istio-data\") pod \"e2e-ait-e4f3cae8-openshift-default-6566d57b6-lcz2q\" (UID: \"268f14db-dd79-4e1c-a4eb-89849954a3f9\") " pod="openshift-ingress/e2e-ait-e4f3cae8-openshift-default-6566d57b6-lcz2q"
Aug 04 22:53:09.114501 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:53:09.114370    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/268f14db-dd79-4e1c-a4eb-89849954a3f9-workload-certs\") pod \"e2e-ait-e4f3cae8-openshift-default-6566d57b6-lcz2q\" (UID: \"268f14db-dd79-4e1c-a4eb-89849954a3f9\") " pod="openshift-ingress/e2e-ait-e4f3cae8-openshift-default-6566d57b6-lcz2q"
Aug 04 22:53:09.114501 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:53:09.114449    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/268f14db-dd79-4e1c-a4eb-89849954a3f9-istio-token\") pod \"e2e-ait-e4f3cae8-openshift-default-6566d57b6-lcz2q\" (UID: \"268f14db-dd79-4e1c-a4eb-89849954a3f9\") " pod="openshift-ingress/e2e-ait-e4f3cae8-openshift-default-6566d57b6-lcz2q"
Aug 04 22:53:09.114501 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:53:09.114483    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/268f14db-dd79-4e1c-a4eb-89849954a3f9-credential-socket\") pod \"e2e-ait-e4f3cae8-openshift-default-6566d57b6-lcz2q\" (UID: \"268f14db-dd79-4e1c-a4eb-89849954a3f9\") " pod="openshift-ingress/e2e-ait-e4f3cae8-openshift-default-6566d57b6-lcz2q"
Aug 04 22:53:09.114661 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:53:09.114509    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/268f14db-dd79-4e1c-a4eb-89849954a3f9-istio-envoy\") pod \"e2e-ait-e4f3cae8-openshift-default-6566d57b6-lcz2q\" (UID: \"268f14db-dd79-4e1c-a4eb-89849954a3f9\") " pod="openshift-ingress/e2e-ait-e4f3cae8-openshift-default-6566d57b6-lcz2q"
Aug 04 22:53:09.114661 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:53:09.114533    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/268f14db-dd79-4e1c-a4eb-89849954a3f9-istio-podinfo\") pod \"e2e-ait-e4f3cae8-openshift-default-6566d57b6-lcz2q\" (UID: \"268f14db-dd79-4e1c-a4eb-89849954a3f9\") " pod="openshift-ingress/e2e-ait-e4f3cae8-openshift-default-6566d57b6-lcz2q"
Aug 04 22:53:09.114661 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:53:09.114561    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/268f14db-dd79-4e1c-a4eb-89849954a3f9-istiod-ca-cert\") pod \"e2e-ait-e4f3cae8-openshift-default-6566d57b6-lcz2q\" (UID: \"268f14db-dd79-4e1c-a4eb-89849954a3f9\") " pod="openshift-ingress/e2e-ait-e4f3cae8-openshift-default-6566d57b6-lcz2q"
Aug 04 22:53:09.215350 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:53:09.215313    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/268f14db-dd79-4e1c-a4eb-89849954a3f9-istio-token\") pod \"e2e-ait-e4f3cae8-openshift-default-6566d57b6-lcz2q\" (UID: \"268f14db-dd79-4e1c-a4eb-89849954a3f9\") " pod="openshift-ingress/e2e-ait-e4f3cae8-openshift-default-6566d57b6-lcz2q"
Aug 04 22:53:09.215525 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:53:09.215367    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/268f14db-dd79-4e1c-a4eb-89849954a3f9-credential-socket\") pod \"e2e-ait-e4f3cae8-openshift-default-6566d57b6-lcz2q\" (UID: \"268f14db-dd79-4e1c-a4eb-89849954a3f9\") " pod="openshift-ingress/e2e-ait-e4f3cae8-openshift-default-6566d57b6-lcz2q"
Aug 04 22:53:09.215525 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:53:09.215481    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/268f14db-dd79-4e1c-a4eb-89849954a3f9-istio-envoy\") pod \"e2e-ait-e4f3cae8-openshift-default-6566d57b6-lcz2q\" (UID: \"268f14db-dd79-4e1c-a4eb-89849954a3f9\") " pod="openshift-ingress/e2e-ait-e4f3cae8-openshift-default-6566d57b6-lcz2q"
Aug 04 22:53:09.215525 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:53:09.215516    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/268f14db-dd79-4e1c-a4eb-89849954a3f9-istio-podinfo\") pod \"e2e-ait-e4f3cae8-openshift-default-6566d57b6-lcz2q\" (UID: \"268f14db-dd79-4e1c-a4eb-89849954a3f9\") " pod="openshift-ingress/e2e-ait-e4f3cae8-openshift-default-6566d57b6-lcz2q"
Aug 04 22:53:09.215662 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:53:09.215540    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/268f14db-dd79-4e1c-a4eb-89849954a3f9-istiod-ca-cert\") pod \"e2e-ait-e4f3cae8-openshift-default-6566d57b6-lcz2q\" (UID: \"268f14db-dd79-4e1c-a4eb-89849954a3f9\") " pod="openshift-ingress/e2e-ait-e4f3cae8-openshift-default-6566d57b6-lcz2q"
Aug 04 22:53:09.215662 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:53:09.215641    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-86clw\" (UniqueName: \"kubernetes.io/projected/268f14db-dd79-4e1c-a4eb-89849954a3f9-kube-api-access-86clw\") pod \"e2e-ait-e4f3cae8-openshift-default-6566d57b6-lcz2q\" (UID: \"268f14db-dd79-4e1c-a4eb-89849954a3f9\") " pod="openshift-ingress/e2e-ait-e4f3cae8-openshift-default-6566d57b6-lcz2q"
Aug 04 22:53:09.215770 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:53:09.215667    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/268f14db-dd79-4e1c-a4eb-89849954a3f9-workload-socket\") pod \"e2e-ait-e4f3cae8-openshift-default-6566d57b6-lcz2q\" (UID: \"268f14db-dd79-4e1c-a4eb-89849954a3f9\") " pod="openshift-ingress/e2e-ait-e4f3cae8-openshift-default-6566d57b6-lcz2q"
Aug 04 22:53:09.215770 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:53:09.215692    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/268f14db-dd79-4e1c-a4eb-89849954a3f9-istio-data\") pod \"e2e-ait-e4f3cae8-openshift-default-6566d57b6-lcz2q\" (UID: \"268f14db-dd79-4e1c-a4eb-89849954a3f9\") " pod="openshift-ingress/e2e-ait-e4f3cae8-openshift-default-6566d57b6-lcz2q"
Aug 04 22:53:09.215770 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:53:09.215750    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/268f14db-dd79-4e1c-a4eb-89849954a3f9-workload-certs\") pod \"e2e-ait-e4f3cae8-openshift-default-6566d57b6-lcz2q\" (UID: \"268f14db-dd79-4e1c-a4eb-89849954a3f9\") " pod="openshift-ingress/e2e-ait-e4f3cae8-openshift-default-6566d57b6-lcz2q"
Aug 04 22:53:09.215770 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:53:09.215757    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/268f14db-dd79-4e1c-a4eb-89849954a3f9-credential-socket\") pod \"e2e-ait-e4f3cae8-openshift-default-6566d57b6-lcz2q\" (UID: \"268f14db-dd79-4e1c-a4eb-89849954a3f9\") " pod="openshift-ingress/e2e-ait-e4f3cae8-openshift-default-6566d57b6-lcz2q"
Aug 04 22:53:09.216102 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:53:09.216083    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/268f14db-dd79-4e1c-a4eb-89849954a3f9-istio-data\") pod \"e2e-ait-e4f3cae8-openshift-default-6566d57b6-lcz2q\" (UID: \"268f14db-dd79-4e1c-a4eb-89849954a3f9\") " pod="openshift-ingress/e2e-ait-e4f3cae8-openshift-default-6566d57b6-lcz2q"
Aug 04 22:53:09.216312 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:53:09.216287    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/268f14db-dd79-4e1c-a4eb-89849954a3f9-workload-certs\") pod \"e2e-ait-e4f3cae8-openshift-default-6566d57b6-lcz2q\" (UID: \"268f14db-dd79-4e1c-a4eb-89849954a3f9\") " pod="openshift-ingress/e2e-ait-e4f3cae8-openshift-default-6566d57b6-lcz2q"
Aug 04 22:53:09.216394 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:53:09.216319    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/268f14db-dd79-4e1c-a4eb-89849954a3f9-workload-socket\") pod \"e2e-ait-e4f3cae8-openshift-default-6566d57b6-lcz2q\" (UID: \"268f14db-dd79-4e1c-a4eb-89849954a3f9\") " pod="openshift-ingress/e2e-ait-e4f3cae8-openshift-default-6566d57b6-lcz2q"
Aug 04 22:53:09.216454 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:53:09.216404    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/268f14db-dd79-4e1c-a4eb-89849954a3f9-istiod-ca-cert\") pod \"e2e-ait-e4f3cae8-openshift-default-6566d57b6-lcz2q\" (UID: \"268f14db-dd79-4e1c-a4eb-89849954a3f9\") " pod="openshift-ingress/e2e-ait-e4f3cae8-openshift-default-6566d57b6-lcz2q"
Aug 04 22:53:09.217922 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:53:09.217895    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/268f14db-dd79-4e1c-a4eb-89849954a3f9-istio-envoy\") pod \"e2e-ait-e4f3cae8-openshift-default-6566d57b6-lcz2q\" (UID: \"268f14db-dd79-4e1c-a4eb-89849954a3f9\") " pod="openshift-ingress/e2e-ait-e4f3cae8-openshift-default-6566d57b6-lcz2q"
Aug 04 22:53:09.218272 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:53:09.218254    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/268f14db-dd79-4e1c-a4eb-89849954a3f9-istio-podinfo\") pod \"e2e-ait-e4f3cae8-openshift-default-6566d57b6-lcz2q\" (UID: \"268f14db-dd79-4e1c-a4eb-89849954a3f9\") " pod="openshift-ingress/e2e-ait-e4f3cae8-openshift-default-6566d57b6-lcz2q"
Aug 04 22:53:09.223379 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:53:09.223354    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/268f14db-dd79-4e1c-a4eb-89849954a3f9-istio-token\") pod \"e2e-ait-e4f3cae8-openshift-default-6566d57b6-lcz2q\" (UID: \"268f14db-dd79-4e1c-a4eb-89849954a3f9\") " pod="openshift-ingress/e2e-ait-e4f3cae8-openshift-default-6566d57b6-lcz2q"
Aug 04 22:53:09.223697 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:53:09.223675    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-86clw\" (UniqueName: \"kubernetes.io/projected/268f14db-dd79-4e1c-a4eb-89849954a3f9-kube-api-access-86clw\") pod \"e2e-ait-e4f3cae8-openshift-default-6566d57b6-lcz2q\" (UID: \"268f14db-dd79-4e1c-a4eb-89849954a3f9\") " pod="openshift-ingress/e2e-ait-e4f3cae8-openshift-default-6566d57b6-lcz2q"
Aug 04 22:53:09.329743 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:53:09.329706    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-e4f3cae8-openshift-default-6566d57b6-lcz2q"
Aug 04 22:53:09.478625 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:53:09.478596    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-e4f3cae8-openshift-default-6566d57b6-lcz2q"]
Aug 04 22:53:09.480996 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:53:09.480966    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod268f14db_dd79_4e1c_a4eb_89849954a3f9.slice/crio-ac8fb2b465dec82489123c389396edf39689cad2436d3f5fa585c72adf69c4cd WatchSource:0}: Error finding container ac8fb2b465dec82489123c389396edf39689cad2436d3f5fa585c72adf69c4cd: Status 404 returned error can't find the container with id ac8fb2b465dec82489123c389396edf39689cad2436d3f5fa585c72adf69c4cd
Aug 04 22:53:09.483194 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:53:09.483162    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 22:53:09.483293 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:53:09.483249    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 22:53:09.483359 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:53:09.483291    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 22:53:09.950858 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:53:09.950818    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e4f3cae8-openshift-default-6566d57b6-lcz2q" event={"ID":"268f14db-dd79-4e1c-a4eb-89849954a3f9","Type":"ContainerStarted","Data":"5e9a0fb7995933d591e6456df52c948767f76c644b4470d8289c73f86385ade1"}
Aug 04 22:53:09.951032 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:53:09.950905    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e4f3cae8-openshift-default-6566d57b6-lcz2q" event={"ID":"268f14db-dd79-4e1c-a4eb-89849954a3f9","Type":"ContainerStarted","Data":"ac8fb2b465dec82489123c389396edf39689cad2436d3f5fa585c72adf69c4cd"}
Aug 04 22:53:09.976151 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:53:09.976090    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-e4f3cae8-openshift-default-6566d57b6-lcz2q" podStartSLOduration=1.976075902 podStartE2EDuration="1.976075902s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 22:53:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 22:53:09.973400893 +0000 UTC m=+1936.966218620" watchObservedRunningTime="2026-08-04 22:53:09.976075902 +0000 UTC m=+1936.968893709"
Aug 04 22:53:10.330841 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:53:10.330804    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-e4f3cae8-openshift-default-6566d57b6-lcz2q"
Aug 04 22:53:10.335935 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:53:10.335912    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-e4f3cae8-openshift-default-6566d57b6-lcz2q"
Aug 04 22:53:10.957299 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:53:10.957260    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-e4f3cae8-openshift-default-6566d57b6-lcz2q"
Aug 04 22:53:10.958199 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:53:10.958180    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-e4f3cae8-openshift-default-6566d57b6-lcz2q"
Aug 04 22:53:15.907407 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:53:15.907370    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-595xm"]
Aug 04 22:53:25.958778 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:53:25.958745    2580 patch_prober.go:28] interesting pod/e2e-ait-e4f3cae8-openshift-default-6566d57b6-lcz2q container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Aug 04 22:53:25.959195 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:53:25.958798    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-e4f3cae8-openshift-default-6566d57b6-lcz2q" podUID="268f14db-dd79-4e1c-a4eb-89849954a3f9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Aug 04 22:53:26.053143 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:53:26.053095    2580 generic.go:356] "Generic (PLEG): container finished" podID="268f14db-dd79-4e1c-a4eb-89849954a3f9" containerID="5e9a0fb7995933d591e6456df52c948767f76c644b4470d8289c73f86385ade1" exitCode=0
Aug 04 22:53:26.053307 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:53:26.053170    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e4f3cae8-openshift-default-6566d57b6-lcz2q" event={"ID":"268f14db-dd79-4e1c-a4eb-89849954a3f9","Type":"ContainerDied","Data":"5e9a0fb7995933d591e6456df52c948767f76c644b4470d8289c73f86385ade1"}
Aug 04 22:53:26.053557 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:53:26.053544    2580 scope.go:117] "RemoveContainer" containerID="5e9a0fb7995933d591e6456df52c948767f76c644b4470d8289c73f86385ade1"
Aug 04 22:53:26.054542 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:53:26.054513    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 22:53:26.054640 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:53:26.054596    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 22:53:26.054703 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:53:26.054644    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 22:53:27.064338 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:53:27.064303    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e4f3cae8-openshift-default-6566d57b6-lcz2q" event={"ID":"268f14db-dd79-4e1c-a4eb-89849954a3f9","Type":"ContainerStarted","Data":"8cdd2a9c000f66fb3cb99dacb755de0f91543f8ae87a5ea099219b48a8d0210f"}
Aug 04 22:53:27.330260 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:53:27.330174    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-e4f3cae8-openshift-default-6566d57b6-lcz2q"
Aug 04 22:53:27.330413 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:53:27.330345    2580 patch_prober.go:28] interesting pod/e2e-ait-e4f3cae8-openshift-default-6566d57b6-lcz2q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Aug 04 22:53:27.330413 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:53:27.330389    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-e4f3cae8-openshift-default-6566d57b6-lcz2q" podUID="268f14db-dd79-4e1c-a4eb-89849954a3f9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Aug 04 22:53:28.331149 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:53:28.331097    2580 patch_prober.go:28] interesting pod/e2e-ait-e4f3cae8-openshift-default-6566d57b6-lcz2q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Aug 04 22:53:28.331536 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:53:28.331176    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-e4f3cae8-openshift-default-6566d57b6-lcz2q" podUID="268f14db-dd79-4e1c-a4eb-89849954a3f9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Aug 04 22:53:29.330457 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:53:29.330424    2580 patch_prober.go:28] interesting pod/e2e-ait-e4f3cae8-openshift-default-6566d57b6-lcz2q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Aug 04 22:53:29.330624 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:53:29.330479    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-e4f3cae8-openshift-default-6566d57b6-lcz2q" podUID="268f14db-dd79-4e1c-a4eb-89849954a3f9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Aug 04 22:53:30.330251 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:53:30.330214    2580 patch_prober.go:28] interesting pod/e2e-ait-e4f3cae8-openshift-default-6566d57b6-lcz2q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Aug 04 22:53:30.330631 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:53:30.330271    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-e4f3cae8-openshift-default-6566d57b6-lcz2q" podUID="268f14db-dd79-4e1c-a4eb-89849954a3f9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Aug 04 22:53:31.330610 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:53:31.330572    2580 patch_prober.go:28] interesting pod/e2e-ait-e4f3cae8-openshift-default-6566d57b6-lcz2q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Aug 04 22:53:31.331080 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:53:31.330637    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-e4f3cae8-openshift-default-6566d57b6-lcz2q" podUID="268f14db-dd79-4e1c-a4eb-89849954a3f9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Aug 04 22:53:32.334696 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:53:32.334668    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-e4f3cae8-openshift-default-6566d57b6-lcz2q"
Aug 04 22:53:32.335093 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:53:32.334988    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-e4f3cae8-openshift-default-6566d57b6-lcz2q"
Aug 04 22:53:32.335685 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:53:32.335669    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-e4f3cae8-openshift-default-6566d57b6-lcz2q"
Aug 04 22:53:36.913064 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:53:36.913027    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e4f3cae8-m797w"]
Aug 04 22:53:36.917372 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:53:36.917350    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e4f3cae8-m797w"
Aug 04 22:53:36.920254 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:53:36.920229    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-vvngh\""
Aug 04 22:53:36.920623 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:53:36.920607    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Aug 04 22:53:36.933819 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:53:36.933699    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e4f3cae8-m797w"]
Aug 04 22:53:37.073190 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:53:37.073158    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c4af63c3-eff5-441c-83a9-f1960e35c516-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-e4f3cae8-m797w\" (UID: \"c4af63c3-eff5-441c-83a9-f1960e35c516\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e4f3cae8-m797w"
Aug 04 22:53:37.173790 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:53:37.173699    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c4af63c3-eff5-441c-83a9-f1960e35c516-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-e4f3cae8-m797w\" (UID: \"c4af63c3-eff5-441c-83a9-f1960e35c516\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e4f3cae8-m797w"
Aug 04 22:53:37.174340 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:53:37.174322    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c4af63c3-eff5-441c-83a9-f1960e35c516-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-e4f3cae8-m797w\" (UID: \"c4af63c3-eff5-441c-83a9-f1960e35c516\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e4f3cae8-m797w"
Aug 04 22:53:37.235095 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:53:37.235063    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e4f3cae8-m797w"
Aug 04 22:53:37.374443 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:53:37.374414    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e4f3cae8-m797w"]
Aug 04 22:53:37.375977 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:53:37.375946    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4af63c3_eff5_441c_83a9_f1960e35c516.slice/crio-226c355d68825361d7b13bdd22edf0bbf60adc61e363c939caa537e7f21c3af1 WatchSource:0}: Error finding container 226c355d68825361d7b13bdd22edf0bbf60adc61e363c939caa537e7f21c3af1: Status 404 returned error can't find the container with id 226c355d68825361d7b13bdd22edf0bbf60adc61e363c939caa537e7f21c3af1
Aug 04 22:53:38.133487 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:53:38.133454    2580 generic.go:356] "Generic (PLEG): container finished" podID="c4af63c3-eff5-441c-83a9-f1960e35c516" containerID="91cc57aeebc5880c2f74bb5c3b9dca2700eda45f1f839308df57e52fb392f1ea" exitCode=0
Aug 04 22:53:38.133858 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:53:38.133552    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e4f3cae8-m797w" event={"ID":"c4af63c3-eff5-441c-83a9-f1960e35c516","Type":"ContainerDied","Data":"91cc57aeebc5880c2f74bb5c3b9dca2700eda45f1f839308df57e52fb392f1ea"}
Aug 04 22:53:38.133858 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:53:38.133605    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e4f3cae8-m797w" event={"ID":"c4af63c3-eff5-441c-83a9-f1960e35c516","Type":"ContainerStarted","Data":"226c355d68825361d7b13bdd22edf0bbf60adc61e363c939caa537e7f21c3af1"}
Aug 04 22:53:39.276119 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:53:39.276095    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e4f3cae8-m797w"
Aug 04 22:53:39.393745 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:53:39.393657    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c4af63c3-eff5-441c-83a9-f1960e35c516-maas-api-service-ca\") pod \"c4af63c3-eff5-441c-83a9-f1960e35c516\" (UID: \"c4af63c3-eff5-441c-83a9-f1960e35c516\") "
Aug 04 22:53:39.393987 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:53:39.393964    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c4af63c3-eff5-441c-83a9-f1960e35c516-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "c4af63c3-eff5-441c-83a9-f1960e35c516" (UID: "c4af63c3-eff5-441c-83a9-f1960e35c516"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 22:53:39.495022 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:53:39.495001    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c4af63c3-eff5-441c-83a9-f1960e35c516-maas-api-service-ca\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
Aug 04 22:53:40.146936 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:53:40.146909    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e4f3cae8-m797w"
Aug 04 22:53:40.147112 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:53:40.146948    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e4f3cae8-m797w" event={"ID":"c4af63c3-eff5-441c-83a9-f1960e35c516","Type":"ContainerDied","Data":"226c355d68825361d7b13bdd22edf0bbf60adc61e363c939caa537e7f21c3af1"}
Aug 04 22:53:40.147112 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:53:40.146998    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="226c355d68825361d7b13bdd22edf0bbf60adc61e363c939caa537e7f21c3af1"
Aug 04 22:53:43.204997 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:53:43.204955    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e4f3cae8-m797w"]
Aug 04 22:53:43.207442 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:53:43.207419    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e4f3cae8-m797w"]
Aug 04 22:53:43.329654 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:53:43.329619    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-e4f3cae8-openshift-default-6566d57b6-lcz2q"]
Aug 04 22:53:43.329885 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:53:43.329861    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-e4f3cae8-openshift-default-6566d57b6-lcz2q" podUID="268f14db-dd79-4e1c-a4eb-89849954a3f9" containerName="istio-proxy" containerID="cri-o://8cdd2a9c000f66fb3cb99dacb755de0f91543f8ae87a5ea099219b48a8d0210f" gracePeriod=30
Aug 04 22:53:43.500716 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:53:43.500637    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c4af63c3-eff5-441c-83a9-f1960e35c516" path="/var/lib/kubelet/pods/c4af63c3-eff5-441c-83a9-f1960e35c516/volumes"
Aug 04 22:53:45.917787 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:53:45.917709    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-595xm"]
Aug 04 22:53:47.338100 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:53:47.338050    2580 patch_prober.go:28] interesting pod/e2e-ait-e4f3cae8-openshift-default-6566d57b6-lcz2q container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Aug 04 22:53:47.338627 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:53:47.338170    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-e4f3cae8-openshift-default-6566d57b6-lcz2q" podUID="268f14db-dd79-4e1c-a4eb-89849954a3f9" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Aug 04 22:53:47.706698 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:53:47.706594    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-63f65db9-75d7cc8548-l9ktm"]
Aug 04 22:53:47.707095 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:53:47.707079    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4af63c3-eff5-441c-83a9-f1960e35c516" containerName="revoke-keys"
Aug 04 22:53:47.707201 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:53:47.707098    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4af63c3-eff5-441c-83a9-f1960e35c516" containerName="revoke-keys"
Aug 04 22:53:47.707255 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:53:47.707221    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="c4af63c3-eff5-441c-83a9-f1960e35c516" containerName="revoke-keys"
Aug 04 22:53:47.710708 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:53:47.710690    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-63f65db9-75d7cc8548-l9ktm"
Aug 04 22:53:47.720209 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:53:47.720188    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-migrate-63f65db9-dockercfg-s76zv\""
Aug 04 22:53:47.720376 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:53:47.720359    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-migrate-63f65db9\""
Aug 04 22:53:47.729224 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:53:47.729195    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-63f65db9-75d7cc8548-l9ktm"]
Aug 04 22:53:47.757457 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:53:47.757430    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bzf2p\" (UniqueName: \"kubernetes.io/projected/52c3f26b-6ea8-4815-8f5c-32ae24ff51ff-kube-api-access-bzf2p\") pod \"payload-pre-processing-e2e-migrate-63f65db9-75d7cc8548-l9ktm\" (UID: \"52c3f26b-6ea8-4815-8f5c-32ae24ff51ff\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-63f65db9-75d7cc8548-l9ktm"
Aug 04 22:53:47.757604 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:53:47.757479    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/52c3f26b-6ea8-4815-8f5c-32ae24ff51ff-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-63f65db9-75d7cc8548-l9ktm\" (UID: \"52c3f26b-6ea8-4815-8f5c-32ae24ff51ff\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-63f65db9-75d7cc8548-l9ktm"
Aug 04 22:53:47.858844 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:53:47.858807    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bzf2p\" (UniqueName: \"kubernetes.io/projected/52c3f26b-6ea8-4815-8f5c-32ae24ff51ff-kube-api-access-bzf2p\") pod \"payload-pre-processing-e2e-migrate-63f65db9-75d7cc8548-l9ktm\" (UID: \"52c3f26b-6ea8-4815-8f5c-32ae24ff51ff\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-63f65db9-75d7cc8548-l9ktm"
Aug 04 22:53:47.859029 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:53:47.858872    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/52c3f26b-6ea8-4815-8f5c-32ae24ff51ff-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-63f65db9-75d7cc8548-l9ktm\" (UID: \"52c3f26b-6ea8-4815-8f5c-32ae24ff51ff\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-63f65db9-75d7cc8548-l9ktm"
Aug 04 22:53:47.859652 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:53:47.859626    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/52c3f26b-6ea8-4815-8f5c-32ae24ff51ff-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-63f65db9-75d7cc8548-l9ktm\" (UID: \"52c3f26b-6ea8-4815-8f5c-32ae24ff51ff\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-63f65db9-75d7cc8548-l9ktm"
Aug 04 22:53:47.868397 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:53:47.868374    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bzf2p\" (UniqueName: \"kubernetes.io/projected/52c3f26b-6ea8-4815-8f5c-32ae24ff51ff-kube-api-access-bzf2p\") pod \"payload-pre-processing-e2e-migrate-63f65db9-75d7cc8548-l9ktm\" (UID: \"52c3f26b-6ea8-4815-8f5c-32ae24ff51ff\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-63f65db9-75d7cc8548-l9ktm"
Aug 04 22:53:48.021151 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:53:48.021040    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-63f65db9-75d7cc8548-l9ktm"
Aug 04 22:53:48.368360 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:53:48.368329    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-63f65db9-75d7cc8548-l9ktm"]
Aug 04 22:53:48.370456 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:53:48.370430    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52c3f26b_6ea8_4815_8f5c_32ae24ff51ff.slice/crio-19866afb57d64064a08f27b340c475a91254d9e3385814aad5c02273578b71cd WatchSource:0}: Error finding container 19866afb57d64064a08f27b340c475a91254d9e3385814aad5c02273578b71cd: Status 404 returned error can't find the container with id 19866afb57d64064a08f27b340c475a91254d9e3385814aad5c02273578b71cd
Aug 04 22:53:48.372758 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:53:48.372740    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 04 22:53:48.570933 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:53:48.570898    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-e4f3cae8-openshift-default-6566d57b6-lcz2q"
Aug 04 22:53:48.665713 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:53:48.665619    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/268f14db-dd79-4e1c-a4eb-89849954a3f9-istio-data\") pod \"268f14db-dd79-4e1c-a4eb-89849954a3f9\" (UID: \"268f14db-dd79-4e1c-a4eb-89849954a3f9\") "
Aug 04 22:53:48.665713 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:53:48.665658    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/268f14db-dd79-4e1c-a4eb-89849954a3f9-istiod-ca-cert\") pod \"268f14db-dd79-4e1c-a4eb-89849954a3f9\" (UID: \"268f14db-dd79-4e1c-a4eb-89849954a3f9\") "
Aug 04 22:53:48.665713 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:53:48.665687    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/268f14db-dd79-4e1c-a4eb-89849954a3f9-istio-envoy\") pod \"268f14db-dd79-4e1c-a4eb-89849954a3f9\" (UID: \"268f14db-dd79-4e1c-a4eb-89849954a3f9\") "
Aug 04 22:53:48.665984 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:53:48.665718    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/268f14db-dd79-4e1c-a4eb-89849954a3f9-credential-socket\") pod \"268f14db-dd79-4e1c-a4eb-89849954a3f9\" (UID: \"268f14db-dd79-4e1c-a4eb-89849954a3f9\") "
Aug 04 22:53:48.665984 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:53:48.665749    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/268f14db-dd79-4e1c-a4eb-89849954a3f9-workload-socket\") pod \"268f14db-dd79-4e1c-a4eb-89849954a3f9\" (UID: \"268f14db-dd79-4e1c-a4eb-89849954a3f9\") "
Aug 04 22:53:48.665984 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:53:48.665770    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/268f14db-dd79-4e1c-a4eb-89849954a3f9-istio-podinfo\") pod \"268f14db-dd79-4e1c-a4eb-89849954a3f9\" (UID: \"268f14db-dd79-4e1c-a4eb-89849954a3f9\") "
Aug 04 22:53:48.665984 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:53:48.665836    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/268f14db-dd79-4e1c-a4eb-89849954a3f9-workload-certs\") pod \"268f14db-dd79-4e1c-a4eb-89849954a3f9\" (UID: \"268f14db-dd79-4e1c-a4eb-89849954a3f9\") "
Aug 04 22:53:48.665984 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:53:48.665893    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/268f14db-dd79-4e1c-a4eb-89849954a3f9-istio-token\") pod \"268f14db-dd79-4e1c-a4eb-89849954a3f9\" (UID: \"268f14db-dd79-4e1c-a4eb-89849954a3f9\") "
Aug 04 22:53:48.665984 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:53:48.665898    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/268f14db-dd79-4e1c-a4eb-89849954a3f9-istio-data" (OuterVolumeSpecName: "istio-data") pod "268f14db-dd79-4e1c-a4eb-89849954a3f9" (UID: "268f14db-dd79-4e1c-a4eb-89849954a3f9"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 22:53:48.665984 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:53:48.665938    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-86clw\" (UniqueName: \"kubernetes.io/projected/268f14db-dd79-4e1c-a4eb-89849954a3f9-kube-api-access-86clw\") pod \"268f14db-dd79-4e1c-a4eb-89849954a3f9\" (UID: \"268f14db-dd79-4e1c-a4eb-89849954a3f9\") "
Aug 04 22:53:48.666357 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:53:48.666102    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/268f14db-dd79-4e1c-a4eb-89849954a3f9-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "268f14db-dd79-4e1c-a4eb-89849954a3f9" (UID: "268f14db-dd79-4e1c-a4eb-89849954a3f9"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 22:53:48.666357 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:53:48.666101    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/268f14db-dd79-4e1c-a4eb-89849954a3f9-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "268f14db-dd79-4e1c-a4eb-89849954a3f9" (UID: "268f14db-dd79-4e1c-a4eb-89849954a3f9"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 22:53:48.666357 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:53:48.666280    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/268f14db-dd79-4e1c-a4eb-89849954a3f9-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "268f14db-dd79-4e1c-a4eb-89849954a3f9" (UID: "268f14db-dd79-4e1c-a4eb-89849954a3f9"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 22:53:48.666357 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:53:48.666335    2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/268f14db-dd79-4e1c-a4eb-89849954a3f9-workload-certs\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
Aug 04 22:53:48.666357 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:53:48.666354    2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/268f14db-dd79-4e1c-a4eb-89849954a3f9-istio-data\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
Aug 04 22:53:48.666540 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:53:48.666368    2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/268f14db-dd79-4e1c-a4eb-89849954a3f9-istiod-ca-cert\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
Aug 04 22:53:48.666540 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:53:48.666412    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/268f14db-dd79-4e1c-a4eb-89849954a3f9-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "268f14db-dd79-4e1c-a4eb-89849954a3f9" (UID: "268f14db-dd79-4e1c-a4eb-89849954a3f9"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 22:53:48.668204 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:53:48.668181    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/268f14db-dd79-4e1c-a4eb-89849954a3f9-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "268f14db-dd79-4e1c-a4eb-89849954a3f9" (UID: "268f14db-dd79-4e1c-a4eb-89849954a3f9"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 22:53:48.668376 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:53:48.668340    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/268f14db-dd79-4e1c-a4eb-89849954a3f9-kube-api-access-86clw" (OuterVolumeSpecName: "kube-api-access-86clw") pod "268f14db-dd79-4e1c-a4eb-89849954a3f9" (UID: "268f14db-dd79-4e1c-a4eb-89849954a3f9"). InnerVolumeSpecName "kube-api-access-86clw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 22:53:48.668503 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:53:48.668480    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/268f14db-dd79-4e1c-a4eb-89849954a3f9-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "268f14db-dd79-4e1c-a4eb-89849954a3f9" (UID: "268f14db-dd79-4e1c-a4eb-89849954a3f9"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Aug 04 22:53:48.668567 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:53:48.668502    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/268f14db-dd79-4e1c-a4eb-89849954a3f9-istio-token" (OuterVolumeSpecName: "istio-token") pod "268f14db-dd79-4e1c-a4eb-89849954a3f9" (UID: "268f14db-dd79-4e1c-a4eb-89849954a3f9"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 22:53:48.767635 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:53:48.767593    2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/268f14db-dd79-4e1c-a4eb-89849954a3f9-istio-envoy\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
Aug 04 22:53:48.767635 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:53:48.767626    2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/268f14db-dd79-4e1c-a4eb-89849954a3f9-credential-socket\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
Aug 04 22:53:48.767635 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:53:48.767635    2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/268f14db-dd79-4e1c-a4eb-89849954a3f9-workload-socket\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
Aug 04 22:53:48.767635 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:53:48.767645    2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/268f14db-dd79-4e1c-a4eb-89849954a3f9-istio-podinfo\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
Aug 04 22:53:48.767914 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:53:48.767653    2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/268f14db-dd79-4e1c-a4eb-89849954a3f9-istio-token\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
Aug 04 22:53:48.767914 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:53:48.767662    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-86clw\" (UniqueName: \"kubernetes.io/projected/268f14db-dd79-4e1c-a4eb-89849954a3f9-kube-api-access-86clw\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
Aug 04 22:53:49.205795 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:53:49.205754    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-63f65db9-75d7cc8548-l9ktm" event={"ID":"52c3f26b-6ea8-4815-8f5c-32ae24ff51ff","Type":"ContainerStarted","Data":"19866afb57d64064a08f27b340c475a91254d9e3385814aad5c02273578b71cd"}
Aug 04 22:53:49.208190 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:53:49.208159    2580 generic.go:356] "Generic (PLEG): container finished" podID="268f14db-dd79-4e1c-a4eb-89849954a3f9" containerID="8cdd2a9c000f66fb3cb99dacb755de0f91543f8ae87a5ea099219b48a8d0210f" exitCode=0
Aug 04 22:53:49.208332 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:53:49.208210    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e4f3cae8-openshift-default-6566d57b6-lcz2q" event={"ID":"268f14db-dd79-4e1c-a4eb-89849954a3f9","Type":"ContainerDied","Data":"8cdd2a9c000f66fb3cb99dacb755de0f91543f8ae87a5ea099219b48a8d0210f"}
Aug 04 22:53:49.208332 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:53:49.208266    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e4f3cae8-openshift-default-6566d57b6-lcz2q" event={"ID":"268f14db-dd79-4e1c-a4eb-89849954a3f9","Type":"ContainerDied","Data":"ac8fb2b465dec82489123c389396edf39689cad2436d3f5fa585c72adf69c4cd"}
Aug 04 22:53:49.208332 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:53:49.208281    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-e4f3cae8-openshift-default-6566d57b6-lcz2q"
Aug 04 22:53:49.208332 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:53:49.208297    2580 scope.go:117] "RemoveContainer" containerID="8cdd2a9c000f66fb3cb99dacb755de0f91543f8ae87a5ea099219b48a8d0210f"
Aug 04 22:53:49.222210 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:53:49.222188    2580 scope.go:117] "RemoveContainer" containerID="5e9a0fb7995933d591e6456df52c948767f76c644b4470d8289c73f86385ade1"
Aug 04 22:53:49.233863 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:53:49.233834    2580 scope.go:117] "RemoveContainer" containerID="8cdd2a9c000f66fb3cb99dacb755de0f91543f8ae87a5ea099219b48a8d0210f"
Aug 04 22:53:49.234195 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:53:49.234172    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8cdd2a9c000f66fb3cb99dacb755de0f91543f8ae87a5ea099219b48a8d0210f\": container with ID starting with 8cdd2a9c000f66fb3cb99dacb755de0f91543f8ae87a5ea099219b48a8d0210f not found: ID does not exist" containerID="8cdd2a9c000f66fb3cb99dacb755de0f91543f8ae87a5ea099219b48a8d0210f"
Aug 04 22:53:49.234302 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:53:49.234205    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8cdd2a9c000f66fb3cb99dacb755de0f91543f8ae87a5ea099219b48a8d0210f"} err="failed to get container status \"8cdd2a9c000f66fb3cb99dacb755de0f91543f8ae87a5ea099219b48a8d0210f\": rpc error: code = NotFound desc = could not find container \"8cdd2a9c000f66fb3cb99dacb755de0f91543f8ae87a5ea099219b48a8d0210f\": container with ID starting with 8cdd2a9c000f66fb3cb99dacb755de0f91543f8ae87a5ea099219b48a8d0210f not found: ID does not exist"
Aug 04 22:53:49.234302 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:53:49.234229    2580 scope.go:117] "RemoveContainer" containerID="5e9a0fb7995933d591e6456df52c948767f76c644b4470d8289c73f86385ade1"
Aug 04 22:53:49.234599 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:53:49.234544    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5e9a0fb7995933d591e6456df52c948767f76c644b4470d8289c73f86385ade1\": container with ID starting with 5e9a0fb7995933d591e6456df52c948767f76c644b4470d8289c73f86385ade1 not found: ID does not exist" containerID="5e9a0fb7995933d591e6456df52c948767f76c644b4470d8289c73f86385ade1"
Aug 04 22:53:49.234599 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:53:49.234574    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5e9a0fb7995933d591e6456df52c948767f76c644b4470d8289c73f86385ade1"} err="failed to get container status \"5e9a0fb7995933d591e6456df52c948767f76c644b4470d8289c73f86385ade1\": rpc error: code = NotFound desc = could not find container \"5e9a0fb7995933d591e6456df52c948767f76c644b4470d8289c73f86385ade1\": container with ID starting with 5e9a0fb7995933d591e6456df52c948767f76c644b4470d8289c73f86385ade1 not found: ID does not exist"
Aug 04 22:53:49.236958 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:53:49.236771    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-e4f3cae8-openshift-default-6566d57b6-lcz2q"]
Aug 04 22:53:49.243933 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:53:49.243908    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-e4f3cae8-openshift-default-6566d57b6-lcz2q"]
Aug 04 22:53:49.501763 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:53:49.501686    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="268f14db-dd79-4e1c-a4eb-89849954a3f9" path="/var/lib/kubelet/pods/268f14db-dd79-4e1c-a4eb-89849954a3f9/volumes"
Aug 04 22:53:50.216886 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:53:50.216849    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-63f65db9-75d7cc8548-l9ktm" event={"ID":"52c3f26b-6ea8-4815-8f5c-32ae24ff51ff","Type":"ContainerStarted","Data":"15aa4f4fdbb681c5727b62a63c7fa54af602d7ca8ce66a9fc522c3c526d6aa38"}
Aug 04 22:53:50.217078 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:53:50.216985    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-63f65db9-75d7cc8548-l9ktm"
Aug 04 22:53:50.233713 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:53:50.233666    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-migrate-63f65db9-75d7cc8548-l9ktm" podStartSLOduration=1.6044574630000001 podStartE2EDuration="3.233652676s" totalImagesPullingTime="1.629195213s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 22:53:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 22:53:50.231771647 +0000 UTC m=+1977.224589375" watchObservedRunningTime="2026-08-04 22:53:50.233652676 +0000 UTC m=+1977.226470404"
Aug 04 22:53:53.905723 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:53:53.905619    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-595xm"]
Aug 04 22:54:01.225307 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:54:01.225262    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-63f65db9-75d7cc8548-l9ktm"
Aug 04 22:54:11.523577 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:54:11.523543    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-63f65db9-jslps"]
Aug 04 22:54:11.523973 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:54:11.523949    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="268f14db-dd79-4e1c-a4eb-89849954a3f9" containerName="istio-proxy"
Aug 04 22:54:11.523973 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:54:11.523960    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="268f14db-dd79-4e1c-a4eb-89849954a3f9" containerName="istio-proxy"
Aug 04 22:54:11.524046 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:54:11.523987    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="268f14db-dd79-4e1c-a4eb-89849954a3f9" containerName="istio-proxy"
Aug 04 22:54:11.524046 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:54:11.523998    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="268f14db-dd79-4e1c-a4eb-89849954a3f9" containerName="istio-proxy"
Aug 04 22:54:11.524114 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:54:11.524074    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="268f14db-dd79-4e1c-a4eb-89849954a3f9" containerName="istio-proxy"
Aug 04 22:54:11.524114 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:54:11.524082    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="268f14db-dd79-4e1c-a4eb-89849954a3f9" containerName="istio-proxy"
Aug 04 22:54:11.527436 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:54:11.527419    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-63f65db9-jslps"
Aug 04 22:54:11.530198 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:54:11.530173    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-vvngh\""
Aug 04 22:54:11.530427 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:54:11.530409    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Aug 04 22:54:11.547581 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:54:11.547554    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-63f65db9-jslps"]
Aug 04 22:54:11.658529 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:54:11.658490    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f943501a-6d23-483b-b8fe-8291c9a9a7a4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-63f65db9-jslps\" (UID: \"f943501a-6d23-483b-b8fe-8291c9a9a7a4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-63f65db9-jslps"
Aug 04 22:54:11.759035 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:54:11.758997    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f943501a-6d23-483b-b8fe-8291c9a9a7a4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-63f65db9-jslps\" (UID: \"f943501a-6d23-483b-b8fe-8291c9a9a7a4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-63f65db9-jslps"
Aug 04 22:54:11.759623 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:54:11.759603    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f943501a-6d23-483b-b8fe-8291c9a9a7a4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-63f65db9-jslps\" (UID: \"f943501a-6d23-483b-b8fe-8291c9a9a7a4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-63f65db9-jslps"
Aug 04 22:54:11.838101 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:54:11.838066    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-63f65db9-jslps"
Aug 04 22:54:12.178669 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:54:12.178640    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-63f65db9-jslps"]
Aug 04 22:54:12.181015 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:54:12.180987    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf943501a_6d23_483b_b8fe_8291c9a9a7a4.slice/crio-73c6cceea1a9ea4843646a123e6a8d102e79894fa22f68a2269dc58315735763 WatchSource:0}: Error finding container 73c6cceea1a9ea4843646a123e6a8d102e79894fa22f68a2269dc58315735763: Status 404 returned error can't find the container with id 73c6cceea1a9ea4843646a123e6a8d102e79894fa22f68a2269dc58315735763
Aug 04 22:54:12.359818 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:54:12.359788    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-63f65db9-jslps" event={"ID":"f943501a-6d23-483b-b8fe-8291c9a9a7a4","Type":"ContainerStarted","Data":"73c6cceea1a9ea4843646a123e6a8d102e79894fa22f68a2269dc58315735763"}
Aug 04 22:54:13.367158 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:54:13.367117    2580 generic.go:356] "Generic (PLEG): container finished" podID="f943501a-6d23-483b-b8fe-8291c9a9a7a4" containerID="a1ada9f7052d1cfb4a5cb057f5f4056587a0bcbda4ed07bec83204f03f6e816b" exitCode=0
Aug 04 22:54:13.367513 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:54:13.367161    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-63f65db9-jslps" event={"ID":"f943501a-6d23-483b-b8fe-8291c9a9a7a4","Type":"ContainerDied","Data":"a1ada9f7052d1cfb4a5cb057f5f4056587a0bcbda4ed07bec83204f03f6e816b"}
Aug 04 22:54:14.510643 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:54:14.510614    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-63f65db9-jslps"
Aug 04 22:54:14.583056 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:54:14.583031    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f943501a-6d23-483b-b8fe-8291c9a9a7a4-maas-api-service-ca\") pod \"f943501a-6d23-483b-b8fe-8291c9a9a7a4\" (UID: \"f943501a-6d23-483b-b8fe-8291c9a9a7a4\") "
Aug 04 22:54:14.583381 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:54:14.583359    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f943501a-6d23-483b-b8fe-8291c9a9a7a4-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "f943501a-6d23-483b-b8fe-8291c9a9a7a4" (UID: "f943501a-6d23-483b-b8fe-8291c9a9a7a4"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 22:54:14.684119 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:54:14.684057    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f943501a-6d23-483b-b8fe-8291c9a9a7a4-maas-api-service-ca\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
Aug 04 22:54:15.379500 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:54:15.379469    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-63f65db9-jslps"
Aug 04 22:54:15.379665 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:54:15.379503    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-63f65db9-jslps" event={"ID":"f943501a-6d23-483b-b8fe-8291c9a9a7a4","Type":"ContainerDied","Data":"73c6cceea1a9ea4843646a123e6a8d102e79894fa22f68a2269dc58315735763"}
Aug 04 22:54:15.379665 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:54:15.379544    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="73c6cceea1a9ea4843646a123e6a8d102e79894fa22f68a2269dc58315735763"
Aug 04 22:54:17.486919 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:54:17.486877    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-63f65db9-75d7cc8548-l9ktm"]
Aug 04 22:54:17.487315 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:54:17.487213    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-migrate-63f65db9-75d7cc8548-l9ktm" podUID="52c3f26b-6ea8-4815-8f5c-32ae24ff51ff" containerName="payload-pre-processing" containerID="cri-o://15aa4f4fdbb681c5727b62a63c7fa54af602d7ca8ce66a9fc522c3c526d6aa38" gracePeriod=30
Aug 04 22:54:17.630089 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:54:17.630059    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-63f65db9-jslps"]
Aug 04 22:54:17.634866 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:54:17.634777    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-63f65db9-jslps"]
Aug 04 22:54:17.757426 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:54:17.757398    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-63f65db9-75d7cc8548-l9ktm"
Aug 04 22:54:17.809330 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:54:17.809301    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/52c3f26b-6ea8-4815-8f5c-32ae24ff51ff-plugins-config-volume\") pod \"52c3f26b-6ea8-4815-8f5c-32ae24ff51ff\" (UID: \"52c3f26b-6ea8-4815-8f5c-32ae24ff51ff\") "
Aug 04 22:54:17.809485 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:54:17.809426    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bzf2p\" (UniqueName: \"kubernetes.io/projected/52c3f26b-6ea8-4815-8f5c-32ae24ff51ff-kube-api-access-bzf2p\") pod \"52c3f26b-6ea8-4815-8f5c-32ae24ff51ff\" (UID: \"52c3f26b-6ea8-4815-8f5c-32ae24ff51ff\") "
Aug 04 22:54:17.809715 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:54:17.809692    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/52c3f26b-6ea8-4815-8f5c-32ae24ff51ff-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "52c3f26b-6ea8-4815-8f5c-32ae24ff51ff" (UID: "52c3f26b-6ea8-4815-8f5c-32ae24ff51ff"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 22:54:17.811978 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:54:17.811945    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/52c3f26b-6ea8-4815-8f5c-32ae24ff51ff-kube-api-access-bzf2p" (OuterVolumeSpecName: "kube-api-access-bzf2p") pod "52c3f26b-6ea8-4815-8f5c-32ae24ff51ff" (UID: "52c3f26b-6ea8-4815-8f5c-32ae24ff51ff"). InnerVolumeSpecName "kube-api-access-bzf2p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 22:54:17.910924 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:54:17.910892    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bzf2p\" (UniqueName: \"kubernetes.io/projected/52c3f26b-6ea8-4815-8f5c-32ae24ff51ff-kube-api-access-bzf2p\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
Aug 04 22:54:17.910924 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:54:17.910918    2580 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/52c3f26b-6ea8-4815-8f5c-32ae24ff51ff-plugins-config-volume\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
Aug 04 22:54:18.398996 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:54:18.398962    2580 generic.go:356] "Generic (PLEG): container finished" podID="52c3f26b-6ea8-4815-8f5c-32ae24ff51ff" containerID="15aa4f4fdbb681c5727b62a63c7fa54af602d7ca8ce66a9fc522c3c526d6aa38" exitCode=0
Aug 04 22:54:18.399187 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:54:18.399004    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-63f65db9-75d7cc8548-l9ktm"
Aug 04 22:54:18.399187 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:54:18.399035    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-63f65db9-75d7cc8548-l9ktm" event={"ID":"52c3f26b-6ea8-4815-8f5c-32ae24ff51ff","Type":"ContainerDied","Data":"15aa4f4fdbb681c5727b62a63c7fa54af602d7ca8ce66a9fc522c3c526d6aa38"}
Aug 04 22:54:18.399187 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:54:18.399076    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-63f65db9-75d7cc8548-l9ktm" event={"ID":"52c3f26b-6ea8-4815-8f5c-32ae24ff51ff","Type":"ContainerDied","Data":"19866afb57d64064a08f27b340c475a91254d9e3385814aad5c02273578b71cd"}
Aug 04 22:54:18.399187 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:54:18.399097    2580 scope.go:117] "RemoveContainer" containerID="15aa4f4fdbb681c5727b62a63c7fa54af602d7ca8ce66a9fc522c3c526d6aa38"
Aug 04 22:54:18.409638 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:54:18.409617    2580 scope.go:117] "RemoveContainer" containerID="15aa4f4fdbb681c5727b62a63c7fa54af602d7ca8ce66a9fc522c3c526d6aa38"
Aug 04 22:54:18.409875 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:54:18.409856    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"15aa4f4fdbb681c5727b62a63c7fa54af602d7ca8ce66a9fc522c3c526d6aa38\": container with ID starting with 15aa4f4fdbb681c5727b62a63c7fa54af602d7ca8ce66a9fc522c3c526d6aa38 not found: ID does not exist" containerID="15aa4f4fdbb681c5727b62a63c7fa54af602d7ca8ce66a9fc522c3c526d6aa38"
Aug 04 22:54:18.409920 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:54:18.409883    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"15aa4f4fdbb681c5727b62a63c7fa54af602d7ca8ce66a9fc522c3c526d6aa38"} err="failed to get container status \"15aa4f4fdbb681c5727b62a63c7fa54af602d7ca8ce66a9fc522c3c526d6aa38\": rpc error: code = NotFound desc = could not find container \"15aa4f4fdbb681c5727b62a63c7fa54af602d7ca8ce66a9fc522c3c526d6aa38\": container with ID starting with 15aa4f4fdbb681c5727b62a63c7fa54af602d7ca8ce66a9fc522c3c526d6aa38 not found: ID does not exist"
Aug 04 22:54:18.422496 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:54:18.422474    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-63f65db9-75d7cc8548-l9ktm"]
Aug 04 22:54:18.424994 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:54:18.424975    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-63f65db9-75d7cc8548-l9ktm"]
Aug 04 22:54:18.511694 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:54:18.511663    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-9192747d-openshift-default-5f4dc99fd-8wwl4"]
Aug 04 22:54:18.512194 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:54:18.512176    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="52c3f26b-6ea8-4815-8f5c-32ae24ff51ff" containerName="payload-pre-processing"
Aug 04 22:54:18.512194 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:54:18.512193    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="52c3f26b-6ea8-4815-8f5c-32ae24ff51ff" containerName="payload-pre-processing"
Aug 04 22:54:18.512342 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:54:18.512222    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f943501a-6d23-483b-b8fe-8291c9a9a7a4" containerName="revoke-keys"
Aug 04 22:54:18.512342 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:54:18.512228    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="f943501a-6d23-483b-b8fe-8291c9a9a7a4" containerName="revoke-keys"
Aug 04 22:54:18.512342 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:54:18.512293    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="52c3f26b-6ea8-4815-8f5c-32ae24ff51ff" containerName="payload-pre-processing"
Aug 04 22:54:18.512342 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:54:18.512300    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="f943501a-6d23-483b-b8fe-8291c9a9a7a4" containerName="revoke-keys"
Aug 04 22:54:18.516958 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:54:18.516940    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-9192747d-openshift-default-5f4dc99fd-8wwl4"
Aug 04 22:54:18.519443 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:54:18.519425    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-9192747d-openshift-default-dockercfg-q7hb9\""
Aug 04 22:54:18.526787 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:54:18.526763    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-9192747d-openshift-default-5f4dc99fd-8wwl4"]
Aug 04 22:54:18.617505 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:54:18.617476    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2c0b10e5-7586-42ad-9b9a-eefa16536fb3-istio-podinfo\") pod \"e2e-ait-9192747d-openshift-default-5f4dc99fd-8wwl4\" (UID: \"2c0b10e5-7586-42ad-9b9a-eefa16536fb3\") " pod="openshift-ingress/e2e-ait-9192747d-openshift-default-5f4dc99fd-8wwl4"
Aug 04 22:54:18.617655 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:54:18.617514    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2c0b10e5-7586-42ad-9b9a-eefa16536fb3-istio-token\") pod \"e2e-ait-9192747d-openshift-default-5f4dc99fd-8wwl4\" (UID: \"2c0b10e5-7586-42ad-9b9a-eefa16536fb3\") " pod="openshift-ingress/e2e-ait-9192747d-openshift-default-5f4dc99fd-8wwl4"
Aug 04 22:54:18.617655 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:54:18.617574    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2c0b10e5-7586-42ad-9b9a-eefa16536fb3-istiod-ca-cert\") pod \"e2e-ait-9192747d-openshift-default-5f4dc99fd-8wwl4\" (UID: \"2c0b10e5-7586-42ad-9b9a-eefa16536fb3\") " pod="openshift-ingress/e2e-ait-9192747d-openshift-default-5f4dc99fd-8wwl4"
Aug 04 22:54:18.617655 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:54:18.617629    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c4226\" (UniqueName: \"kubernetes.io/projected/2c0b10e5-7586-42ad-9b9a-eefa16536fb3-kube-api-access-c4226\") pod \"e2e-ait-9192747d-openshift-default-5f4dc99fd-8wwl4\" (UID: \"2c0b10e5-7586-42ad-9b9a-eefa16536fb3\") " pod="openshift-ingress/e2e-ait-9192747d-openshift-default-5f4dc99fd-8wwl4"
Aug 04 22:54:18.617789 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:54:18.617668    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2c0b10e5-7586-42ad-9b9a-eefa16536fb3-workload-certs\") pod \"e2e-ait-9192747d-openshift-default-5f4dc99fd-8wwl4\" (UID: \"2c0b10e5-7586-42ad-9b9a-eefa16536fb3\") " pod="openshift-ingress/e2e-ait-9192747d-openshift-default-5f4dc99fd-8wwl4"
Aug 04 22:54:18.617789 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:54:18.617686    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c0b10e5-7586-42ad-9b9a-eefa16536fb3-credential-socket\") pod \"e2e-ait-9192747d-openshift-default-5f4dc99fd-8wwl4\" (UID: \"2c0b10e5-7586-42ad-9b9a-eefa16536fb3\") " pod="openshift-ingress/e2e-ait-9192747d-openshift-default-5f4dc99fd-8wwl4"
Aug 04 22:54:18.617789 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:54:18.617748    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c0b10e5-7586-42ad-9b9a-eefa16536fb3-workload-socket\") pod \"e2e-ait-9192747d-openshift-default-5f4dc99fd-8wwl4\" (UID: \"2c0b10e5-7586-42ad-9b9a-eefa16536fb3\") " pod="openshift-ingress/e2e-ait-9192747d-openshift-default-5f4dc99fd-8wwl4"
Aug 04 22:54:18.617886 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:54:18.617798    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2c0b10e5-7586-42ad-9b9a-eefa16536fb3-istio-envoy\") pod \"e2e-ait-9192747d-openshift-default-5f4dc99fd-8wwl4\" (UID: \"2c0b10e5-7586-42ad-9b9a-eefa16536fb3\") " pod="openshift-ingress/e2e-ait-9192747d-openshift-default-5f4dc99fd-8wwl4"
Aug 04 22:54:18.617886 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:54:18.617822    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2c0b10e5-7586-42ad-9b9a-eefa16536fb3-istio-data\") pod \"e2e-ait-9192747d-openshift-default-5f4dc99fd-8wwl4\" (UID: \"2c0b10e5-7586-42ad-9b9a-eefa16536fb3\") " pod="openshift-ingress/e2e-ait-9192747d-openshift-default-5f4dc99fd-8wwl4"
Aug 04 22:54:18.718586 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:54:18.718508    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c0b10e5-7586-42ad-9b9a-eefa16536fb3-workload-socket\") pod \"e2e-ait-9192747d-openshift-default-5f4dc99fd-8wwl4\" (UID: \"2c0b10e5-7586-42ad-9b9a-eefa16536fb3\") " pod="openshift-ingress/e2e-ait-9192747d-openshift-default-5f4dc99fd-8wwl4"
Aug 04 22:54:18.718586 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:54:18.718546    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2c0b10e5-7586-42ad-9b9a-eefa16536fb3-istio-envoy\") pod \"e2e-ait-9192747d-openshift-default-5f4dc99fd-8wwl4\" (UID: \"2c0b10e5-7586-42ad-9b9a-eefa16536fb3\") " pod="openshift-ingress/e2e-ait-9192747d-openshift-default-5f4dc99fd-8wwl4"
Aug 04 22:54:18.718586 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:54:18.718562    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2c0b10e5-7586-42ad-9b9a-eefa16536fb3-istio-data\") pod \"e2e-ait-9192747d-openshift-default-5f4dc99fd-8wwl4\" (UID: \"2c0b10e5-7586-42ad-9b9a-eefa16536fb3\") " pod="openshift-ingress/e2e-ait-9192747d-openshift-default-5f4dc99fd-8wwl4"
Aug 04 22:54:18.718586 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:54:18.718583    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2c0b10e5-7586-42ad-9b9a-eefa16536fb3-istio-podinfo\") pod \"e2e-ait-9192747d-openshift-default-5f4dc99fd-8wwl4\" (UID: \"2c0b10e5-7586-42ad-9b9a-eefa16536fb3\") " pod="openshift-ingress/e2e-ait-9192747d-openshift-default-5f4dc99fd-8wwl4"
Aug 04 22:54:18.718892 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:54:18.718609    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2c0b10e5-7586-42ad-9b9a-eefa16536fb3-istio-token\") pod \"e2e-ait-9192747d-openshift-default-5f4dc99fd-8wwl4\" (UID: \"2c0b10e5-7586-42ad-9b9a-eefa16536fb3\") " pod="openshift-ingress/e2e-ait-9192747d-openshift-default-5f4dc99fd-8wwl4"
Aug 04 22:54:18.718892 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:54:18.718659    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2c0b10e5-7586-42ad-9b9a-eefa16536fb3-istiod-ca-cert\") pod \"e2e-ait-9192747d-openshift-default-5f4dc99fd-8wwl4\" (UID: \"2c0b10e5-7586-42ad-9b9a-eefa16536fb3\") " pod="openshift-ingress/e2e-ait-9192747d-openshift-default-5f4dc99fd-8wwl4"
Aug 04 22:54:18.718892 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:54:18.718718    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c4226\" (UniqueName: \"kubernetes.io/projected/2c0b10e5-7586-42ad-9b9a-eefa16536fb3-kube-api-access-c4226\") pod \"e2e-ait-9192747d-openshift-default-5f4dc99fd-8wwl4\" (UID: \"2c0b10e5-7586-42ad-9b9a-eefa16536fb3\") " pod="openshift-ingress/e2e-ait-9192747d-openshift-default-5f4dc99fd-8wwl4"
Aug 04 22:54:18.718892 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:54:18.718746    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2c0b10e5-7586-42ad-9b9a-eefa16536fb3-workload-certs\") pod \"e2e-ait-9192747d-openshift-default-5f4dc99fd-8wwl4\" (UID: \"2c0b10e5-7586-42ad-9b9a-eefa16536fb3\") " pod="openshift-ingress/e2e-ait-9192747d-openshift-default-5f4dc99fd-8wwl4"
Aug 04 22:54:18.718892 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:54:18.718773    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c0b10e5-7586-42ad-9b9a-eefa16536fb3-credential-socket\") pod \"e2e-ait-9192747d-openshift-default-5f4dc99fd-8wwl4\" (UID: \"2c0b10e5-7586-42ad-9b9a-eefa16536fb3\") " pod="openshift-ingress/e2e-ait-9192747d-openshift-default-5f4dc99fd-8wwl4"
Aug 04 22:54:18.719160 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:54:18.719042    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2c0b10e5-7586-42ad-9b9a-eefa16536fb3-istio-data\") pod \"e2e-ait-9192747d-openshift-default-5f4dc99fd-8wwl4\" (UID: \"2c0b10e5-7586-42ad-9b9a-eefa16536fb3\") " pod="openshift-ingress/e2e-ait-9192747d-openshift-default-5f4dc99fd-8wwl4"
Aug 04 22:54:18.719160 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:54:18.719049    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c0b10e5-7586-42ad-9b9a-eefa16536fb3-workload-socket\") pod \"e2e-ait-9192747d-openshift-default-5f4dc99fd-8wwl4\" (UID: \"2c0b10e5-7586-42ad-9b9a-eefa16536fb3\") " pod="openshift-ingress/e2e-ait-9192747d-openshift-default-5f4dc99fd-8wwl4"
Aug 04 22:54:18.719160 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:54:18.719076    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2c0b10e5-7586-42ad-9b9a-eefa16536fb3-workload-certs\") pod \"e2e-ait-9192747d-openshift-default-5f4dc99fd-8wwl4\" (UID: \"2c0b10e5-7586-42ad-9b9a-eefa16536fb3\") " pod="openshift-ingress/e2e-ait-9192747d-openshift-default-5f4dc99fd-8wwl4"
Aug 04 22:54:18.719295 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:54:18.719244    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c0b10e5-7586-42ad-9b9a-eefa16536fb3-credential-socket\") pod \"e2e-ait-9192747d-openshift-default-5f4dc99fd-8wwl4\" (UID: \"2c0b10e5-7586-42ad-9b9a-eefa16536fb3\") " pod="openshift-ingress/e2e-ait-9192747d-openshift-default-5f4dc99fd-8wwl4"
Aug 04 22:54:18.719618 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:54:18.719599    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2c0b10e5-7586-42ad-9b9a-eefa16536fb3-istiod-ca-cert\") pod \"e2e-ait-9192747d-openshift-default-5f4dc99fd-8wwl4\" (UID: \"2c0b10e5-7586-42ad-9b9a-eefa16536fb3\") " pod="openshift-ingress/e2e-ait-9192747d-openshift-default-5f4dc99fd-8wwl4"
Aug 04 22:54:18.720786 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:54:18.720767    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2c0b10e5-7586-42ad-9b9a-eefa16536fb3-istio-envoy\") pod \"e2e-ait-9192747d-openshift-default-5f4dc99fd-8wwl4\" (UID: \"2c0b10e5-7586-42ad-9b9a-eefa16536fb3\") " pod="openshift-ingress/e2e-ait-9192747d-openshift-default-5f4dc99fd-8wwl4"
Aug 04 22:54:18.721035 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:54:18.721015    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2c0b10e5-7586-42ad-9b9a-eefa16536fb3-istio-podinfo\") pod \"e2e-ait-9192747d-openshift-default-5f4dc99fd-8wwl4\" (UID: \"2c0b10e5-7586-42ad-9b9a-eefa16536fb3\") " pod="openshift-ingress/e2e-ait-9192747d-openshift-default-5f4dc99fd-8wwl4"
Aug 04 22:54:18.726835 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:54:18.726809    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2c0b10e5-7586-42ad-9b9a-eefa16536fb3-istio-token\") pod \"e2e-ait-9192747d-openshift-default-5f4dc99fd-8wwl4\" (UID: \"2c0b10e5-7586-42ad-9b9a-eefa16536fb3\") " pod="openshift-ingress/e2e-ait-9192747d-openshift-default-5f4dc99fd-8wwl4"
Aug 04 22:54:18.726926 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:54:18.726890    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c4226\" (UniqueName: \"kubernetes.io/projected/2c0b10e5-7586-42ad-9b9a-eefa16536fb3-kube-api-access-c4226\") pod \"e2e-ait-9192747d-openshift-default-5f4dc99fd-8wwl4\" (UID: \"2c0b10e5-7586-42ad-9b9a-eefa16536fb3\") " pod="openshift-ingress/e2e-ait-9192747d-openshift-default-5f4dc99fd-8wwl4"
Aug 04 22:54:18.828370 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:54:18.828336    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-9192747d-openshift-default-5f4dc99fd-8wwl4"
Aug 04 22:54:18.971881 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:54:18.971849    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-9192747d-openshift-default-5f4dc99fd-8wwl4"]
Aug 04 22:54:18.972893 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:54:18.972872    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c0b10e5_7586_42ad_9b9a_eefa16536fb3.slice/crio-a9fe62b58e88cf90cd53777bd5606b6d26fa451f0db04591eaaf24ff9d484513 WatchSource:0}: Error finding container a9fe62b58e88cf90cd53777bd5606b6d26fa451f0db04591eaaf24ff9d484513: Status 404 returned error can't find the container with id a9fe62b58e88cf90cd53777bd5606b6d26fa451f0db04591eaaf24ff9d484513
Aug 04 22:54:18.975069 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:54:18.975035    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 22:54:18.975180 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:54:18.975100    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 22:54:18.975180 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:54:18.975144    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 22:54:19.408061 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:54:19.408027    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-9192747d-openshift-default-5f4dc99fd-8wwl4" event={"ID":"2c0b10e5-7586-42ad-9b9a-eefa16536fb3","Type":"ContainerStarted","Data":"1040e340e55312ed7b2f8181e892449014d67c9482d9102b1d2e22e1280fb9c6"}
Aug 04 22:54:19.408276 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:54:19.408087    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-9192747d-openshift-default-5f4dc99fd-8wwl4" event={"ID":"2c0b10e5-7586-42ad-9b9a-eefa16536fb3","Type":"ContainerStarted","Data":"a9fe62b58e88cf90cd53777bd5606b6d26fa451f0db04591eaaf24ff9d484513"}
Aug 04 22:54:19.429189 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:54:19.429144    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-9192747d-openshift-default-5f4dc99fd-8wwl4" podStartSLOduration=1.42911348 podStartE2EDuration="1.42911348s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 22:54:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 22:54:19.426189595 +0000 UTC m=+2006.419007323" watchObservedRunningTime="2026-08-04 22:54:19.42911348 +0000 UTC m=+2006.421931208"
Aug 04 22:54:19.499510 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:54:19.499473    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="52c3f26b-6ea8-4815-8f5c-32ae24ff51ff" path="/var/lib/kubelet/pods/52c3f26b-6ea8-4815-8f5c-32ae24ff51ff/volumes"
Aug 04 22:54:19.499881 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:54:19.499861    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f943501a-6d23-483b-b8fe-8291c9a9a7a4" path="/var/lib/kubelet/pods/f943501a-6d23-483b-b8fe-8291c9a9a7a4/volumes"
Aug 04 22:54:19.704981 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:54:19.704907    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-595xm"]
Aug 04 22:54:19.828725 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:54:19.828689    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-9192747d-openshift-default-5f4dc99fd-8wwl4"
Aug 04 22:54:20.834432 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:54:20.834405    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-9192747d-openshift-default-5f4dc99fd-8wwl4"
Aug 04 22:54:21.421406 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:54:21.421373    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-9192747d-openshift-default-5f4dc99fd-8wwl4"
Aug 04 22:54:21.422461 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:54:21.422443    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-9192747d-openshift-default-5f4dc99fd-8wwl4"
Aug 04 22:54:29.697160 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:54:29.697114    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-595xm"]
Aug 04 22:54:34.513281 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:54:34.513204    2580 generic.go:356] "Generic (PLEG): container finished" podID="2c0b10e5-7586-42ad-9b9a-eefa16536fb3" containerID="1040e340e55312ed7b2f8181e892449014d67c9482d9102b1d2e22e1280fb9c6" exitCode=0
Aug 04 22:54:34.513281 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:54:34.513262    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-9192747d-openshift-default-5f4dc99fd-8wwl4" event={"ID":"2c0b10e5-7586-42ad-9b9a-eefa16536fb3","Type":"ContainerDied","Data":"1040e340e55312ed7b2f8181e892449014d67c9482d9102b1d2e22e1280fb9c6"}
Aug 04 22:54:34.513681 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:54:34.513642    2580 scope.go:117] "RemoveContainer" containerID="1040e340e55312ed7b2f8181e892449014d67c9482d9102b1d2e22e1280fb9c6"
Aug 04 22:54:34.514606 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:54:34.514576    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 22:54:34.514669 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:54:34.514643    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 22:54:34.514708 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:54:34.514678    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 22:54:35.520575 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:54:35.520536    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-9192747d-openshift-default-5f4dc99fd-8wwl4" event={"ID":"2c0b10e5-7586-42ad-9b9a-eefa16536fb3","Type":"ContainerStarted","Data":"b1986f422be5def2e49bb8f93ba9c5d42c0511852154a85314c01403763c2d98"}
Aug 04 22:54:35.829089 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:54:35.829055    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-9192747d-openshift-default-5f4dc99fd-8wwl4"
Aug 04 22:54:35.829897 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:54:35.829868    2580 patch_prober.go:28] interesting pod/e2e-ait-9192747d-openshift-default-5f4dc99fd-8wwl4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Aug 04 22:54:35.830013 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:54:35.829917    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-9192747d-openshift-default-5f4dc99fd-8wwl4" podUID="2c0b10e5-7586-42ad-9b9a-eefa16536fb3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Aug 04 22:54:36.422116 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:54:36.422087    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-9192747d-openshift-default-5f4dc99fd-8wwl4"
Aug 04 22:54:36.828933 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:54:36.828901    2580 patch_prober.go:28] interesting pod/e2e-ait-9192747d-openshift-default-5f4dc99fd-8wwl4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Aug 04 22:54:36.829350 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:54:36.828965    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-9192747d-openshift-default-5f4dc99fd-8wwl4" podUID="2c0b10e5-7586-42ad-9b9a-eefa16536fb3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Aug 04 22:54:37.829617 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:54:37.829582    2580 patch_prober.go:28] interesting pod/e2e-ait-9192747d-openshift-default-5f4dc99fd-8wwl4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Aug 04 22:54:37.830019 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:54:37.829646    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-9192747d-openshift-default-5f4dc99fd-8wwl4" podUID="2c0b10e5-7586-42ad-9b9a-eefa16536fb3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Aug 04 22:54:38.828881 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:54:38.828846    2580 patch_prober.go:28] interesting pod/e2e-ait-9192747d-openshift-default-5f4dc99fd-8wwl4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Aug 04 22:54:38.829073 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:54:38.828908    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-9192747d-openshift-default-5f4dc99fd-8wwl4" podUID="2c0b10e5-7586-42ad-9b9a-eefa16536fb3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Aug 04 22:54:39.829330 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:54:39.829294    2580 patch_prober.go:28] interesting pod/e2e-ait-9192747d-openshift-default-5f4dc99fd-8wwl4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Aug 04 22:54:39.829724 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:54:39.829358    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-9192747d-openshift-default-5f4dc99fd-8wwl4" podUID="2c0b10e5-7586-42ad-9b9a-eefa16536fb3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Aug 04 22:54:40.833146 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:54:40.833108    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-9192747d-openshift-default-5f4dc99fd-8wwl4"
Aug 04 22:54:40.834054 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:54:40.834034    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-9192747d-openshift-default-5f4dc99fd-8wwl4"
Aug 04 22:54:51.654296 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:54:51.654259    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9192747d-ghfqz"]
Aug 04 22:54:51.657053 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:54:51.657036    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9192747d-ghfqz"
Aug 04 22:54:51.659659 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:54:51.659633    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Aug 04 22:54:51.659803 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:54:51.659709    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-vvngh\""
Aug 04 22:54:51.667027 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:54:51.666997    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9192747d-ghfqz"]
Aug 04 22:54:51.709903 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:54:51.709868    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/80f23b2c-e1e2-4403-a47b-5561b76e2e14-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-9192747d-ghfqz\" (UID: \"80f23b2c-e1e2-4403-a47b-5561b76e2e14\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9192747d-ghfqz"
Aug 04 22:54:51.810948 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:54:51.810914    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/80f23b2c-e1e2-4403-a47b-5561b76e2e14-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-9192747d-ghfqz\" (UID: \"80f23b2c-e1e2-4403-a47b-5561b76e2e14\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9192747d-ghfqz"
Aug 04 22:54:51.811588 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:54:51.811563    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/80f23b2c-e1e2-4403-a47b-5561b76e2e14-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-9192747d-ghfqz\" (UID: \"80f23b2c-e1e2-4403-a47b-5561b76e2e14\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9192747d-ghfqz"
Aug 04 22:54:51.969119 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:54:51.969037    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9192747d-ghfqz"
Aug 04 22:54:52.109098 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:54:52.109070    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9192747d-ghfqz"]
Aug 04 22:54:52.109965 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:54:52.109931    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80f23b2c_e1e2_4403_a47b_5561b76e2e14.slice/crio-0c46ba21704121d82617607542dcfc48601bced3aaaf8c5e9853c3963fa4cde6 WatchSource:0}: Error finding container 0c46ba21704121d82617607542dcfc48601bced3aaaf8c5e9853c3963fa4cde6: Status 404 returned error can't find the container with id 0c46ba21704121d82617607542dcfc48601bced3aaaf8c5e9853c3963fa4cde6
Aug 04 22:54:52.627846 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:54:52.627753    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9192747d-ghfqz" event={"ID":"80f23b2c-e1e2-4403-a47b-5561b76e2e14","Type":"ContainerStarted","Data":"b8c2cafca6158dfd36472589d0a025531670af917d23dd0461ed5e7ded0af0e9"}
Aug 04 22:54:52.627846 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:54:52.627806    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9192747d-ghfqz" event={"ID":"80f23b2c-e1e2-4403-a47b-5561b76e2e14","Type":"ContainerStarted","Data":"0c46ba21704121d82617607542dcfc48601bced3aaaf8c5e9853c3963fa4cde6"}
Aug 04 22:54:52.643417 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:54:52.643371    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9192747d-ghfqz" podStartSLOduration=1.643355887 podStartE2EDuration="1.643355887s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 22:54:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 22:54:52.641672806 +0000 UTC m=+2039.634490536" watchObservedRunningTime="2026-08-04 22:54:52.643355887 +0000 UTC m=+2039.636173659"
Aug 04 22:54:53.635293 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:54:53.635260    2580 generic.go:356] "Generic (PLEG): container finished" podID="80f23b2c-e1e2-4403-a47b-5561b76e2e14" containerID="b8c2cafca6158dfd36472589d0a025531670af917d23dd0461ed5e7ded0af0e9" exitCode=0
Aug 04 22:54:53.635656 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:54:53.635353    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9192747d-ghfqz" event={"ID":"80f23b2c-e1e2-4403-a47b-5561b76e2e14","Type":"ContainerDied","Data":"b8c2cafca6158dfd36472589d0a025531670af917d23dd0461ed5e7ded0af0e9"}
Aug 04 22:54:54.775520 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:54:54.775494    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9192747d-ghfqz"
Aug 04 22:54:54.837090 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:54:54.837060    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/80f23b2c-e1e2-4403-a47b-5561b76e2e14-maas-api-service-ca\") pod \"80f23b2c-e1e2-4403-a47b-5561b76e2e14\" (UID: \"80f23b2c-e1e2-4403-a47b-5561b76e2e14\") "
Aug 04 22:54:54.837466 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:54:54.837440    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/80f23b2c-e1e2-4403-a47b-5561b76e2e14-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "80f23b2c-e1e2-4403-a47b-5561b76e2e14" (UID: "80f23b2c-e1e2-4403-a47b-5561b76e2e14"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 22:54:54.937878 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:54:54.937818    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/80f23b2c-e1e2-4403-a47b-5561b76e2e14-maas-api-service-ca\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
Aug 04 22:54:55.647966 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:54:55.647932    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9192747d-ghfqz" event={"ID":"80f23b2c-e1e2-4403-a47b-5561b76e2e14","Type":"ContainerDied","Data":"0c46ba21704121d82617607542dcfc48601bced3aaaf8c5e9853c3963fa4cde6"}
Aug 04 22:54:55.647966 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:54:55.647960    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9192747d-ghfqz"
Aug 04 22:54:55.648177 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:54:55.647977    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0c46ba21704121d82617607542dcfc48601bced3aaaf8c5e9853c3963fa4cde6"
Aug 04 22:55:02.811403 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:55:02.811370    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9192747d-ghfqz"]
Aug 04 22:55:02.814335 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:55:02.814310    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9192747d-ghfqz"]
Aug 04 22:55:03.501366 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:55:03.501332    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="80f23b2c-e1e2-4403-a47b-5561b76e2e14" path="/var/lib/kubelet/pods/80f23b2c-e1e2-4403-a47b-5561b76e2e14/volumes"
Aug 04 22:55:04.015422 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:55:04.015387    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-9192747d-openshift-default-5f4dc99fd-8wwl4"]
Aug 04 22:55:04.015898 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:55:04.015633    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-9192747d-openshift-default-5f4dc99fd-8wwl4" podUID="2c0b10e5-7586-42ad-9b9a-eefa16536fb3" containerName="istio-proxy" containerID="cri-o://b1986f422be5def2e49bb8f93ba9c5d42c0511852154a85314c01403763c2d98" gracePeriod=30
Aug 04 22:55:05.700939 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:55:05.700905    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-595xm"]
Aug 04 22:55:08.502742 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:55:08.502710    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-8410bf38-785967944-jd74r"]
Aug 04 22:55:08.503247 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:55:08.503222    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80f23b2c-e1e2-4403-a47b-5561b76e2e14" containerName="revoke-keys"
Aug 04 22:55:08.503247 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:55:08.503240    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="80f23b2c-e1e2-4403-a47b-5561b76e2e14" containerName="revoke-keys"
Aug 04 22:55:08.503443 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:55:08.503330    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="80f23b2c-e1e2-4403-a47b-5561b76e2e14" containerName="revoke-keys"
Aug 04 22:55:08.505767 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:55:08.505751    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-8410bf38-785967944-jd74r"
Aug 04 22:55:08.508154 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:55:08.508109    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-derive-8410bf38\""
Aug 04 22:55:08.508287 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:55:08.508175    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-derive-8410bf38-dockercfg-6nnbt\""
Aug 04 22:55:08.517209 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:55:08.517176    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-8410bf38-785967944-jd74r"]
Aug 04 22:55:08.552399 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:55:08.552362    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zq8dx\" (UniqueName: \"kubernetes.io/projected/48dbb5b8-e1e9-49f5-a1c9-361554b85442-kube-api-access-zq8dx\") pod \"payload-pre-processing-e2e-derive-8410bf38-785967944-jd74r\" (UID: \"48dbb5b8-e1e9-49f5-a1c9-361554b85442\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-8410bf38-785967944-jd74r"
Aug 04 22:55:08.552584 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:55:08.552453    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/48dbb5b8-e1e9-49f5-a1c9-361554b85442-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-8410bf38-785967944-jd74r\" (UID: \"48dbb5b8-e1e9-49f5-a1c9-361554b85442\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-8410bf38-785967944-jd74r"
Aug 04 22:55:08.653936 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:55:08.653892    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/48dbb5b8-e1e9-49f5-a1c9-361554b85442-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-8410bf38-785967944-jd74r\" (UID: \"48dbb5b8-e1e9-49f5-a1c9-361554b85442\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-8410bf38-785967944-jd74r"
Aug 04 22:55:08.654122 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:55:08.653999    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zq8dx\" (UniqueName: \"kubernetes.io/projected/48dbb5b8-e1e9-49f5-a1c9-361554b85442-kube-api-access-zq8dx\") pod \"payload-pre-processing-e2e-derive-8410bf38-785967944-jd74r\" (UID: \"48dbb5b8-e1e9-49f5-a1c9-361554b85442\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-8410bf38-785967944-jd74r"
Aug 04 22:55:08.654624 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:55:08.654600    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/48dbb5b8-e1e9-49f5-a1c9-361554b85442-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-8410bf38-785967944-jd74r\" (UID: \"48dbb5b8-e1e9-49f5-a1c9-361554b85442\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-8410bf38-785967944-jd74r"
Aug 04 22:55:08.662343 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:55:08.662322    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zq8dx\" (UniqueName: \"kubernetes.io/projected/48dbb5b8-e1e9-49f5-a1c9-361554b85442-kube-api-access-zq8dx\") pod \"payload-pre-processing-e2e-derive-8410bf38-785967944-jd74r\" (UID: \"48dbb5b8-e1e9-49f5-a1c9-361554b85442\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-8410bf38-785967944-jd74r"
Aug 04 22:55:08.816935 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:55:08.816902    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-8410bf38-785967944-jd74r"
Aug 04 22:55:09.166431 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:55:09.166404    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-8410bf38-785967944-jd74r"]
Aug 04 22:55:09.167571 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:55:09.167546    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48dbb5b8_e1e9_49f5_a1c9_361554b85442.slice/crio-33b2a1f12c850a02fb7649bc48fab82cf09832ace8bb6e61a277c3b5f441851b WatchSource:0}: Error finding container 33b2a1f12c850a02fb7649bc48fab82cf09832ace8bb6e61a277c3b5f441851b: Status 404 returned error can't find the container with id 33b2a1f12c850a02fb7649bc48fab82cf09832ace8bb6e61a277c3b5f441851b
Aug 04 22:55:09.273326 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:55:09.273303    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-9192747d-openshift-default-5f4dc99fd-8wwl4"
Aug 04 22:55:09.359417 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:55:09.359389    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c4226\" (UniqueName: \"kubernetes.io/projected/2c0b10e5-7586-42ad-9b9a-eefa16536fb3-kube-api-access-c4226\") pod \"2c0b10e5-7586-42ad-9b9a-eefa16536fb3\" (UID: \"2c0b10e5-7586-42ad-9b9a-eefa16536fb3\") "
Aug 04 22:55:09.359594 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:55:09.359442    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c0b10e5-7586-42ad-9b9a-eefa16536fb3-workload-socket\") pod \"2c0b10e5-7586-42ad-9b9a-eefa16536fb3\" (UID: \"2c0b10e5-7586-42ad-9b9a-eefa16536fb3\") "
Aug 04 22:55:09.359594 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:55:09.359475    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2c0b10e5-7586-42ad-9b9a-eefa16536fb3-istio-podinfo\") pod \"2c0b10e5-7586-42ad-9b9a-eefa16536fb3\" (UID: \"2c0b10e5-7586-42ad-9b9a-eefa16536fb3\") "
Aug 04 22:55:09.359594 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:55:09.359498    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2c0b10e5-7586-42ad-9b9a-eefa16536fb3-istio-data\") pod \"2c0b10e5-7586-42ad-9b9a-eefa16536fb3\" (UID: \"2c0b10e5-7586-42ad-9b9a-eefa16536fb3\") "
Aug 04 22:55:09.359594 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:55:09.359527    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2c0b10e5-7586-42ad-9b9a-eefa16536fb3-workload-certs\") pod \"2c0b10e5-7586-42ad-9b9a-eefa16536fb3\" (UID: \"2c0b10e5-7586-42ad-9b9a-eefa16536fb3\") "
Aug 04 22:55:09.359594 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:55:09.359565    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2c0b10e5-7586-42ad-9b9a-eefa16536fb3-istiod-ca-cert\") pod \"2c0b10e5-7586-42ad-9b9a-eefa16536fb3\" (UID: \"2c0b10e5-7586-42ad-9b9a-eefa16536fb3\") "
Aug 04 22:55:09.359871 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:55:09.359614    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2c0b10e5-7586-42ad-9b9a-eefa16536fb3-istio-token\") pod \"2c0b10e5-7586-42ad-9b9a-eefa16536fb3\" (UID: \"2c0b10e5-7586-42ad-9b9a-eefa16536fb3\") "
Aug 04 22:55:09.359871 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:55:09.359662    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c0b10e5-7586-42ad-9b9a-eefa16536fb3-credential-socket\") pod \"2c0b10e5-7586-42ad-9b9a-eefa16536fb3\" (UID: \"2c0b10e5-7586-42ad-9b9a-eefa16536fb3\") "
Aug 04 22:55:09.359871 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:55:09.359685    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2c0b10e5-7586-42ad-9b9a-eefa16536fb3-istio-envoy\") pod \"2c0b10e5-7586-42ad-9b9a-eefa16536fb3\" (UID: \"2c0b10e5-7586-42ad-9b9a-eefa16536fb3\") "
Aug 04 22:55:09.359871 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:55:09.359827    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c0b10e5-7586-42ad-9b9a-eefa16536fb3-istio-data" (OuterVolumeSpecName: "istio-data") pod "2c0b10e5-7586-42ad-9b9a-eefa16536fb3" (UID: "2c0b10e5-7586-42ad-9b9a-eefa16536fb3"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 22:55:09.359871 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:55:09.359837    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c0b10e5-7586-42ad-9b9a-eefa16536fb3-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "2c0b10e5-7586-42ad-9b9a-eefa16536fb3" (UID: "2c0b10e5-7586-42ad-9b9a-eefa16536fb3"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 22:55:09.360167 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:55:09.360037    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c0b10e5-7586-42ad-9b9a-eefa16536fb3-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "2c0b10e5-7586-42ad-9b9a-eefa16536fb3" (UID: "2c0b10e5-7586-42ad-9b9a-eefa16536fb3"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 22:55:09.360167 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:55:09.360058    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2c0b10e5-7586-42ad-9b9a-eefa16536fb3-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "2c0b10e5-7586-42ad-9b9a-eefa16536fb3" (UID: "2c0b10e5-7586-42ad-9b9a-eefa16536fb3"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 22:55:09.360167 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:55:09.360089    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c0b10e5-7586-42ad-9b9a-eefa16536fb3-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "2c0b10e5-7586-42ad-9b9a-eefa16536fb3" (UID: "2c0b10e5-7586-42ad-9b9a-eefa16536fb3"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 22:55:09.360167 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:55:09.360151    2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2c0b10e5-7586-42ad-9b9a-eefa16536fb3-istio-data\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
Aug 04 22:55:09.360367 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:55:09.360171    2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2c0b10e5-7586-42ad-9b9a-eefa16536fb3-workload-certs\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
Aug 04 22:55:09.361770 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:55:09.361748    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2c0b10e5-7586-42ad-9b9a-eefa16536fb3-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "2c0b10e5-7586-42ad-9b9a-eefa16536fb3" (UID: "2c0b10e5-7586-42ad-9b9a-eefa16536fb3"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Aug 04 22:55:09.361916 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:55:09.361896    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c0b10e5-7586-42ad-9b9a-eefa16536fb3-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "2c0b10e5-7586-42ad-9b9a-eefa16536fb3" (UID: "2c0b10e5-7586-42ad-9b9a-eefa16536fb3"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 22:55:09.362082 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:55:09.362059    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2c0b10e5-7586-42ad-9b9a-eefa16536fb3-kube-api-access-c4226" (OuterVolumeSpecName: "kube-api-access-c4226") pod "2c0b10e5-7586-42ad-9b9a-eefa16536fb3" (UID: "2c0b10e5-7586-42ad-9b9a-eefa16536fb3"). InnerVolumeSpecName "kube-api-access-c4226". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 22:55:09.362219 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:55:09.362089    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2c0b10e5-7586-42ad-9b9a-eefa16536fb3-istio-token" (OuterVolumeSpecName: "istio-token") pod "2c0b10e5-7586-42ad-9b9a-eefa16536fb3" (UID: "2c0b10e5-7586-42ad-9b9a-eefa16536fb3"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 22:55:09.460732 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:55:09.460661    2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2c0b10e5-7586-42ad-9b9a-eefa16536fb3-istio-token\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
Aug 04 22:55:09.460732 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:55:09.460688    2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c0b10e5-7586-42ad-9b9a-eefa16536fb3-credential-socket\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
Aug 04 22:55:09.460732 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:55:09.460698    2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2c0b10e5-7586-42ad-9b9a-eefa16536fb3-istio-envoy\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
Aug 04 22:55:09.460732 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:55:09.460707    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c4226\" (UniqueName: \"kubernetes.io/projected/2c0b10e5-7586-42ad-9b9a-eefa16536fb3-kube-api-access-c4226\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
Aug 04 22:55:09.460732 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:55:09.460715    2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c0b10e5-7586-42ad-9b9a-eefa16536fb3-workload-socket\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
Aug 04 22:55:09.460732 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:55:09.460723    2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2c0b10e5-7586-42ad-9b9a-eefa16536fb3-istio-podinfo\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
Aug 04 22:55:09.460732 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:55:09.460731    2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2c0b10e5-7586-42ad-9b9a-eefa16536fb3-istiod-ca-cert\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
Aug 04 22:55:09.737705 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:55:09.737606    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-8410bf38-785967944-jd74r" event={"ID":"48dbb5b8-e1e9-49f5-a1c9-361554b85442","Type":"ContainerStarted","Data":"090e509c26d20c92901edb13423dd7b043e529ffa2a23d67983633b87d1da2ea"}
Aug 04 22:55:09.738115 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:55:09.737755    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-8410bf38-785967944-jd74r" event={"ID":"48dbb5b8-e1e9-49f5-a1c9-361554b85442","Type":"ContainerStarted","Data":"33b2a1f12c850a02fb7649bc48fab82cf09832ace8bb6e61a277c3b5f441851b"}
Aug 04 22:55:09.738115 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:55:09.737800    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-8410bf38-785967944-jd74r"
Aug 04 22:55:09.739528 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:55:09.739498    2580 generic.go:356] "Generic (PLEG): container finished" podID="2c0b10e5-7586-42ad-9b9a-eefa16536fb3" containerID="b1986f422be5def2e49bb8f93ba9c5d42c0511852154a85314c01403763c2d98" exitCode=0
Aug 04 22:55:09.739649 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:55:09.739549    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-9192747d-openshift-default-5f4dc99fd-8wwl4"
Aug 04 22:55:09.739649 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:55:09.739577    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-9192747d-openshift-default-5f4dc99fd-8wwl4" event={"ID":"2c0b10e5-7586-42ad-9b9a-eefa16536fb3","Type":"ContainerDied","Data":"b1986f422be5def2e49bb8f93ba9c5d42c0511852154a85314c01403763c2d98"}
Aug 04 22:55:09.739649 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:55:09.739628    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-9192747d-openshift-default-5f4dc99fd-8wwl4" event={"ID":"2c0b10e5-7586-42ad-9b9a-eefa16536fb3","Type":"ContainerDied","Data":"a9fe62b58e88cf90cd53777bd5606b6d26fa451f0db04591eaaf24ff9d484513"}
Aug 04 22:55:09.739649 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:55:09.739649    2580 scope.go:117] "RemoveContainer" containerID="b1986f422be5def2e49bb8f93ba9c5d42c0511852154a85314c01403763c2d98"
Aug 04 22:55:09.749665 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:55:09.749646    2580 scope.go:117] "RemoveContainer" containerID="1040e340e55312ed7b2f8181e892449014d67c9482d9102b1d2e22e1280fb9c6"
Aug 04 22:55:09.759704 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:55:09.759685    2580 scope.go:117] "RemoveContainer" containerID="b1986f422be5def2e49bb8f93ba9c5d42c0511852154a85314c01403763c2d98"
Aug 04 22:55:09.759989 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:55:09.759961    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b1986f422be5def2e49bb8f93ba9c5d42c0511852154a85314c01403763c2d98\": container with ID starting with b1986f422be5def2e49bb8f93ba9c5d42c0511852154a85314c01403763c2d98 not found: ID does not exist" containerID="b1986f422be5def2e49bb8f93ba9c5d42c0511852154a85314c01403763c2d98"
Aug 04 22:55:09.760094 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:55:09.759996    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b1986f422be5def2e49bb8f93ba9c5d42c0511852154a85314c01403763c2d98"} err="failed to get container status \"b1986f422be5def2e49bb8f93ba9c5d42c0511852154a85314c01403763c2d98\": rpc error: code = NotFound desc = could not find container \"b1986f422be5def2e49bb8f93ba9c5d42c0511852154a85314c01403763c2d98\": container with ID starting with b1986f422be5def2e49bb8f93ba9c5d42c0511852154a85314c01403763c2d98 not found: ID does not exist"
Aug 04 22:55:09.760094 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:55:09.760013    2580 scope.go:117] "RemoveContainer" containerID="1040e340e55312ed7b2f8181e892449014d67c9482d9102b1d2e22e1280fb9c6"
Aug 04 22:55:09.760356 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:55:09.760335    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1040e340e55312ed7b2f8181e892449014d67c9482d9102b1d2e22e1280fb9c6\": container with ID starting with 1040e340e55312ed7b2f8181e892449014d67c9482d9102b1d2e22e1280fb9c6 not found: ID does not exist" containerID="1040e340e55312ed7b2f8181e892449014d67c9482d9102b1d2e22e1280fb9c6"
Aug 04 22:55:09.760425 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:55:09.760364    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1040e340e55312ed7b2f8181e892449014d67c9482d9102b1d2e22e1280fb9c6"} err="failed to get container status \"1040e340e55312ed7b2f8181e892449014d67c9482d9102b1d2e22e1280fb9c6\": rpc error: code = NotFound desc = could not find container \"1040e340e55312ed7b2f8181e892449014d67c9482d9102b1d2e22e1280fb9c6\": container with ID starting with 1040e340e55312ed7b2f8181e892449014d67c9482d9102b1d2e22e1280fb9c6 not found: ID does not exist"
Aug 04 22:55:09.771271 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:55:09.771229    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-derive-8410bf38-785967944-jd74r" podStartSLOduration=1.771217673 podStartE2EDuration="1.771217673s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 22:55:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 22:55:09.757320102 +0000 UTC m=+2056.750137853" watchObservedRunningTime="2026-08-04 22:55:09.771217673 +0000 UTC m=+2056.764035400"
Aug 04 22:55:09.771609 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:55:09.771594    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-9192747d-openshift-default-5f4dc99fd-8wwl4"]
Aug 04 22:55:09.775015 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:55:09.774994    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-9192747d-openshift-default-5f4dc99fd-8wwl4"]
Aug 04 22:55:11.500110 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:55:11.500079    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2c0b10e5-7586-42ad-9b9a-eefa16536fb3" path="/var/lib/kubelet/pods/2c0b10e5-7586-42ad-9b9a-eefa16536fb3/volumes"
Aug 04 22:55:13.792363 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:55:13.792333    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-595xm"]
Aug 04 22:55:20.750265 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:55:20.750237    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-8410bf38-785967944-jd74r"
Aug 04 22:55:31.596954 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:55:31.596918    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-8410bf38-md64c"]
Aug 04 22:55:31.597381 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:55:31.597366    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2c0b10e5-7586-42ad-9b9a-eefa16536fb3" containerName="istio-proxy"
Aug 04 22:55:31.597438 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:55:31.597383    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="2c0b10e5-7586-42ad-9b9a-eefa16536fb3" containerName="istio-proxy"
Aug 04 22:55:31.597438 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:55:31.597393    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2c0b10e5-7586-42ad-9b9a-eefa16536fb3" containerName="istio-proxy"
Aug 04 22:55:31.597438 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:55:31.597398    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="2c0b10e5-7586-42ad-9b9a-eefa16536fb3" containerName="istio-proxy"
Aug 04 22:55:31.597539 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:55:31.597467    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="2c0b10e5-7586-42ad-9b9a-eefa16536fb3" containerName="istio-proxy"
Aug 04 22:55:31.597539 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:55:31.597475    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="2c0b10e5-7586-42ad-9b9a-eefa16536fb3" containerName="istio-proxy"
Aug 04 22:55:31.599764 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:55:31.599748    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-8410bf38-md64c"
Aug 04 22:55:31.601880 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:55:31.601857    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-vvngh\""
Aug 04 22:55:31.602087 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:55:31.602072    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Aug 04 22:55:31.607517 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:55:31.607447    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-8410bf38-md64c"]
Aug 04 22:55:31.758840 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:55:31.758805    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a16a58fd-325c-4ba1-8e0d-f60db1d74599-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-8410bf38-md64c\" (UID: \"a16a58fd-325c-4ba1-8e0d-f60db1d74599\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-8410bf38-md64c"
Aug 04 22:55:31.859457 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:55:31.859385    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a16a58fd-325c-4ba1-8e0d-f60db1d74599-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-8410bf38-md64c\" (UID: \"a16a58fd-325c-4ba1-8e0d-f60db1d74599\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-8410bf38-md64c"
Aug 04 22:55:31.859963 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:55:31.859945    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a16a58fd-325c-4ba1-8e0d-f60db1d74599-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-8410bf38-md64c\" (UID: \"a16a58fd-325c-4ba1-8e0d-f60db1d74599\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-8410bf38-md64c"
Aug 04 22:55:31.913235 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:55:31.913212    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-8410bf38-md64c"
Aug 04 22:55:32.048566 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:55:32.048534    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-8410bf38-md64c"]
Aug 04 22:55:32.050156 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:55:32.050109    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda16a58fd_325c_4ba1_8e0d_f60db1d74599.slice/crio-3345a47d4a6761ef3e55363dcf3be482bb210e3599c818389d645e88c68a337c WatchSource:0}: Error finding container 3345a47d4a6761ef3e55363dcf3be482bb210e3599c818389d645e88c68a337c: Status 404 returned error can't find the container with id 3345a47d4a6761ef3e55363dcf3be482bb210e3599c818389d645e88c68a337c
Aug 04 22:55:32.879117 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:55:32.879088    2580 generic.go:356] "Generic (PLEG): container finished" podID="a16a58fd-325c-4ba1-8e0d-f60db1d74599" containerID="1d80985ba192c0e8aedc7e306ab32fec2c8e655e1d98b94e34036a439ba9e4a7" exitCode=0
Aug 04 22:55:32.879457 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:55:32.879151    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-8410bf38-md64c" event={"ID":"a16a58fd-325c-4ba1-8e0d-f60db1d74599","Type":"ContainerDied","Data":"1d80985ba192c0e8aedc7e306ab32fec2c8e655e1d98b94e34036a439ba9e4a7"}
Aug 04 22:55:32.879457 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:55:32.879198    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-8410bf38-md64c" event={"ID":"a16a58fd-325c-4ba1-8e0d-f60db1d74599","Type":"ContainerStarted","Data":"3345a47d4a6761ef3e55363dcf3be482bb210e3599c818389d645e88c68a337c"}
Aug 04 22:55:34.022817 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:55:34.022789    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-8410bf38-md64c"
Aug 04 22:55:34.179913 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:55:34.179831    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a16a58fd-325c-4ba1-8e0d-f60db1d74599-maas-api-service-ca\") pod \"a16a58fd-325c-4ba1-8e0d-f60db1d74599\" (UID: \"a16a58fd-325c-4ba1-8e0d-f60db1d74599\") "
Aug 04 22:55:34.180204 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:55:34.180181    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a16a58fd-325c-4ba1-8e0d-f60db1d74599-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "a16a58fd-325c-4ba1-8e0d-f60db1d74599" (UID: "a16a58fd-325c-4ba1-8e0d-f60db1d74599"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 22:55:34.281269 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:55:34.281238    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a16a58fd-325c-4ba1-8e0d-f60db1d74599-maas-api-service-ca\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
Aug 04 22:55:34.891943 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:55:34.891916    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-8410bf38-md64c"
Aug 04 22:55:34.892111 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:55:34.891955    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-8410bf38-md64c" event={"ID":"a16a58fd-325c-4ba1-8e0d-f60db1d74599","Type":"ContainerDied","Data":"3345a47d4a6761ef3e55363dcf3be482bb210e3599c818389d645e88c68a337c"}
Aug 04 22:55:34.892111 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:55:34.892002    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3345a47d4a6761ef3e55363dcf3be482bb210e3599c818389d645e88c68a337c"
Aug 04 22:55:38.404910 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:55:38.404872    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-8410bf38-785967944-jd74r"]
Aug 04 22:55:38.405495 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:55:38.405156    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-derive-8410bf38-785967944-jd74r" podUID="48dbb5b8-e1e9-49f5-a1c9-361554b85442" containerName="payload-pre-processing" containerID="cri-o://090e509c26d20c92901edb13423dd7b043e529ffa2a23d67983633b87d1da2ea" gracePeriod=30
Aug 04 22:55:38.556719 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:55:38.556682    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-8410bf38-md64c"]
Aug 04 22:55:38.560077 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:55:38.560051    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-8410bf38-md64c"]
Aug 04 22:55:38.661967 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:55:38.661908    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-8410bf38-785967944-jd74r"
Aug 04 22:55:38.814457 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:55:38.814424    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/48dbb5b8-e1e9-49f5-a1c9-361554b85442-plugins-config-volume\") pod \"48dbb5b8-e1e9-49f5-a1c9-361554b85442\" (UID: \"48dbb5b8-e1e9-49f5-a1c9-361554b85442\") "
Aug 04 22:55:38.814618 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:55:38.814469    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zq8dx\" (UniqueName: \"kubernetes.io/projected/48dbb5b8-e1e9-49f5-a1c9-361554b85442-kube-api-access-zq8dx\") pod \"48dbb5b8-e1e9-49f5-a1c9-361554b85442\" (UID: \"48dbb5b8-e1e9-49f5-a1c9-361554b85442\") "
Aug 04 22:55:38.814901 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:55:38.814874    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/48dbb5b8-e1e9-49f5-a1c9-361554b85442-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "48dbb5b8-e1e9-49f5-a1c9-361554b85442" (UID: "48dbb5b8-e1e9-49f5-a1c9-361554b85442"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 22:55:38.816605 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:55:38.816580    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/48dbb5b8-e1e9-49f5-a1c9-361554b85442-kube-api-access-zq8dx" (OuterVolumeSpecName: "kube-api-access-zq8dx") pod "48dbb5b8-e1e9-49f5-a1c9-361554b85442" (UID: "48dbb5b8-e1e9-49f5-a1c9-361554b85442"). InnerVolumeSpecName "kube-api-access-zq8dx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 22:55:38.915859 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:55:38.915787    2580 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/48dbb5b8-e1e9-49f5-a1c9-361554b85442-plugins-config-volume\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
Aug 04 22:55:38.915859 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:55:38.915815    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zq8dx\" (UniqueName: \"kubernetes.io/projected/48dbb5b8-e1e9-49f5-a1c9-361554b85442-kube-api-access-zq8dx\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
Aug 04 22:55:38.917592 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:55:38.917563    2580 generic.go:356] "Generic (PLEG): container finished" podID="48dbb5b8-e1e9-49f5-a1c9-361554b85442" containerID="090e509c26d20c92901edb13423dd7b043e529ffa2a23d67983633b87d1da2ea" exitCode=0
Aug 04 22:55:38.917725 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:55:38.917615    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-8410bf38-785967944-jd74r"
Aug 04 22:55:38.917725 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:55:38.917652    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-8410bf38-785967944-jd74r" event={"ID":"48dbb5b8-e1e9-49f5-a1c9-361554b85442","Type":"ContainerDied","Data":"090e509c26d20c92901edb13423dd7b043e529ffa2a23d67983633b87d1da2ea"}
Aug 04 22:55:38.917725 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:55:38.917708    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-8410bf38-785967944-jd74r" event={"ID":"48dbb5b8-e1e9-49f5-a1c9-361554b85442","Type":"ContainerDied","Data":"33b2a1f12c850a02fb7649bc48fab82cf09832ace8bb6e61a277c3b5f441851b"}
Aug 04 22:55:38.917887 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:55:38.917733    2580 scope.go:117] "RemoveContainer" containerID="090e509c26d20c92901edb13423dd7b043e529ffa2a23d67983633b87d1da2ea"
Aug 04 22:55:38.927018 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:55:38.927003    2580 scope.go:117] "RemoveContainer" containerID="090e509c26d20c92901edb13423dd7b043e529ffa2a23d67983633b87d1da2ea"
Aug 04 22:55:38.927296 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:55:38.927274    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"090e509c26d20c92901edb13423dd7b043e529ffa2a23d67983633b87d1da2ea\": container with ID starting with 090e509c26d20c92901edb13423dd7b043e529ffa2a23d67983633b87d1da2ea not found: ID does not exist" containerID="090e509c26d20c92901edb13423dd7b043e529ffa2a23d67983633b87d1da2ea"
Aug 04 22:55:38.927355 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:55:38.927302    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"090e509c26d20c92901edb13423dd7b043e529ffa2a23d67983633b87d1da2ea"} err="failed to get container status \"090e509c26d20c92901edb13423dd7b043e529ffa2a23d67983633b87d1da2ea\": rpc error: code = NotFound desc = could not find container \"090e509c26d20c92901edb13423dd7b043e529ffa2a23d67983633b87d1da2ea\": container with ID starting with 090e509c26d20c92901edb13423dd7b043e529ffa2a23d67983633b87d1da2ea not found: ID does not exist"
Aug 04 22:55:38.939969 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:55:38.939937    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-8410bf38-785967944-jd74r"]
Aug 04 22:55:38.942815 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:55:38.942795    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-8410bf38-785967944-jd74r"]
Aug 04 22:55:39.499412 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:55:39.499379    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="48dbb5b8-e1e9-49f5-a1c9-361554b85442" path="/var/lib/kubelet/pods/48dbb5b8-e1e9-49f5-a1c9-361554b85442/volumes"
Aug 04 22:55:39.499778 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:55:39.499698    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a16a58fd-325c-4ba1-8e0d-f60db1d74599" path="/var/lib/kubelet/pods/a16a58fd-325c-4ba1-8e0d-f60db1d74599/volumes"
Aug 04 22:55:41.104761 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:55:41.104726    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-595xm"]
Aug 04 22:55:53.995908 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:55:53.995834    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-595xm"]
Aug 04 22:57:24.597009 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:57:24.596970    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-595xm"]
Aug 04 22:57:31.797841 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:57:31.797805    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-595xm"]
Aug 04 22:57:42.155598 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:57:42.155562    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-3c68233e-d4446d7c6-sq2jx"]
Aug 04 22:57:42.156202 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:57:42.156183    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48dbb5b8-e1e9-49f5-a1c9-361554b85442" containerName="payload-pre-processing"
Aug 04 22:57:42.156202 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:57:42.156203    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="48dbb5b8-e1e9-49f5-a1c9-361554b85442" containerName="payload-pre-processing"
Aug 04 22:57:42.156370 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:57:42.156246    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a16a58fd-325c-4ba1-8e0d-f60db1d74599" containerName="revoke-keys"
Aug 04 22:57:42.156370 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:57:42.156256    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="a16a58fd-325c-4ba1-8e0d-f60db1d74599" containerName="revoke-keys"
Aug 04 22:57:42.156370 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:57:42.156357    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="a16a58fd-325c-4ba1-8e0d-f60db1d74599" containerName="revoke-keys"
Aug 04 22:57:42.156575 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:57:42.156371    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="48dbb5b8-e1e9-49f5-a1c9-361554b85442" containerName="payload-pre-processing"
Aug 04 22:57:42.159623 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:57:42.159601    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-3c68233e-d4446d7c6-sq2jx"
Aug 04 22:57:42.162166 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:57:42.162126    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-3c68233e\""
Aug 04 22:57:42.162294 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:57:42.162220    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-3c68233e-dockercfg-86khd\""
Aug 04 22:57:42.167786 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:57:42.167764    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-3c68233e-d4446d7c6-sq2jx"]
Aug 04 22:57:42.204440 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:57:42.204398    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/233fa7b7-bbba-42ae-984c-6e9ab682142d-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-3c68233e-d4446d7c6-sq2jx\" (UID: \"233fa7b7-bbba-42ae-984c-6e9ab682142d\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-3c68233e-d4446d7c6-sq2jx"
Aug 04 22:57:42.204607 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:57:42.204473    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j2gp5\" (UniqueName: \"kubernetes.io/projected/233fa7b7-bbba-42ae-984c-6e9ab682142d-kube-api-access-j2gp5\") pod \"payload-pre-processing-e2e-mt-3c68233e-d4446d7c6-sq2jx\" (UID: \"233fa7b7-bbba-42ae-984c-6e9ab682142d\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-3c68233e-d4446d7c6-sq2jx"
Aug 04 22:57:42.305385 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:57:42.305352    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j2gp5\" (UniqueName: \"kubernetes.io/projected/233fa7b7-bbba-42ae-984c-6e9ab682142d-kube-api-access-j2gp5\") pod \"payload-pre-processing-e2e-mt-3c68233e-d4446d7c6-sq2jx\" (UID: \"233fa7b7-bbba-42ae-984c-6e9ab682142d\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-3c68233e-d4446d7c6-sq2jx"
Aug 04 22:57:42.305558 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:57:42.305422    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/233fa7b7-bbba-42ae-984c-6e9ab682142d-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-3c68233e-d4446d7c6-sq2jx\" (UID: \"233fa7b7-bbba-42ae-984c-6e9ab682142d\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-3c68233e-d4446d7c6-sq2jx"
Aug 04 22:57:42.306108 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:57:42.306088    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/233fa7b7-bbba-42ae-984c-6e9ab682142d-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-3c68233e-d4446d7c6-sq2jx\" (UID: \"233fa7b7-bbba-42ae-984c-6e9ab682142d\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-3c68233e-d4446d7c6-sq2jx"
Aug 04 22:57:42.312690 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:57:42.312662    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j2gp5\" (UniqueName: \"kubernetes.io/projected/233fa7b7-bbba-42ae-984c-6e9ab682142d-kube-api-access-j2gp5\") pod \"payload-pre-processing-e2e-mt-3c68233e-d4446d7c6-sq2jx\" (UID: \"233fa7b7-bbba-42ae-984c-6e9ab682142d\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-3c68233e-d4446d7c6-sq2jx"
Aug 04 22:57:42.471592 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:57:42.471509    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-3c68233e-d4446d7c6-sq2jx"
Aug 04 22:57:42.823345 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:57:42.823240    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-3c68233e-d4446d7c6-sq2jx"]
Aug 04 22:57:42.825804 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:57:42.825776    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod233fa7b7_bbba_42ae_984c_6e9ab682142d.slice/crio-60832142305d5ca851ebdc9675ca0b585a818f1bee3fbb27369b83c98f1b348c WatchSource:0}: Error finding container 60832142305d5ca851ebdc9675ca0b585a818f1bee3fbb27369b83c98f1b348c: Status 404 returned error can't find the container with id 60832142305d5ca851ebdc9675ca0b585a818f1bee3fbb27369b83c98f1b348c
Aug 04 22:57:43.667842 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:57:43.667798    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-3c68233e-d4446d7c6-sq2jx" event={"ID":"233fa7b7-bbba-42ae-984c-6e9ab682142d","Type":"ContainerStarted","Data":"39cb30eb4bbefd49f2a4aa6d35eaa9983d59dfbb22c4aa90d1aa3fa282eb27a6"}
Aug 04 22:57:43.668331 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:57:43.667861    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-3c68233e-d4446d7c6-sq2jx" event={"ID":"233fa7b7-bbba-42ae-984c-6e9ab682142d","Type":"ContainerStarted","Data":"60832142305d5ca851ebdc9675ca0b585a818f1bee3fbb27369b83c98f1b348c"}
Aug 04 22:57:43.668331 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:57:43.667885    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-3c68233e-d4446d7c6-sq2jx"
Aug 04 22:57:43.686282 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:57:43.686235    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-3c68233e-d4446d7c6-sq2jx" podStartSLOduration=1.686221677 podStartE2EDuration="1.686221677s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 22:57:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 22:57:43.685085626 +0000 UTC m=+2210.677903392" watchObservedRunningTime="2026-08-04 22:57:43.686221677 +0000 UTC m=+2210.679039430"
Aug 04 22:57:44.391222 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:57:44.391185    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-595xm"]
Aug 04 22:57:54.676088 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:57:54.676054    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-3c68233e-d4446d7c6-sq2jx"
Aug 04 22:58:13.081775 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:58:13.081743    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3c68233e-mfs2c"]
Aug 04 22:58:13.085596 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:58:13.085573    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3c68233e-mfs2c"
Aug 04 22:58:13.088095 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:58:13.088068    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-vvngh\""
Aug 04 22:58:13.088221 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:58:13.088081    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Aug 04 22:58:13.093425 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:58:13.093397    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3c68233e-mfs2c"]
Aug 04 22:58:13.183593 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:58:13.183555    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bb82c0da-8314-478c-a235-4d9fb6122a6f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-3c68233e-mfs2c\" (UID: \"bb82c0da-8314-478c-a235-4d9fb6122a6f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3c68233e-mfs2c"
Aug 04 22:58:13.284019 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:58:13.283993    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bb82c0da-8314-478c-a235-4d9fb6122a6f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-3c68233e-mfs2c\" (UID: \"bb82c0da-8314-478c-a235-4d9fb6122a6f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3c68233e-mfs2c"
Aug 04 22:58:13.284633 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:58:13.284614    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bb82c0da-8314-478c-a235-4d9fb6122a6f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-3c68233e-mfs2c\" (UID: \"bb82c0da-8314-478c-a235-4d9fb6122a6f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3c68233e-mfs2c"
Aug 04 22:58:13.397878 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:58:13.397816    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3c68233e-mfs2c"
Aug 04 22:58:13.536176 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:58:13.536148    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3c68233e-mfs2c"]
Aug 04 22:58:13.537164 ip-10-0-137-117 kubenswrapper[2580]: W0804 22:58:13.537109    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb82c0da_8314_478c_a235_4d9fb6122a6f.slice/crio-09484199edb3e5d8120987c89a0a39fd80d244dcb61ce42ab0ac0bbf5ae981ad WatchSource:0}: Error finding container 09484199edb3e5d8120987c89a0a39fd80d244dcb61ce42ab0ac0bbf5ae981ad: Status 404 returned error can't find the container with id 09484199edb3e5d8120987c89a0a39fd80d244dcb61ce42ab0ac0bbf5ae981ad
Aug 04 22:58:13.854234 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:58:13.854197    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3c68233e-mfs2c" event={"ID":"bb82c0da-8314-478c-a235-4d9fb6122a6f","Type":"ContainerStarted","Data":"09484199edb3e5d8120987c89a0a39fd80d244dcb61ce42ab0ac0bbf5ae981ad"}
Aug 04 22:58:13.874671 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:58:13.874629    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3c68233e-mfs2c" podStartSLOduration=0.87461271 podStartE2EDuration="874.61271ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 22:58:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 22:58:13.872792835 +0000 UTC m=+2240.865610565" watchObservedRunningTime="2026-08-04 22:58:13.87461271 +0000 UTC m=+2240.867430438"
Aug 04 22:58:14.863078 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:58:14.863042    2580 generic.go:356] "Generic (PLEG): container finished" podID="bb82c0da-8314-478c-a235-4d9fb6122a6f" containerID="cbf494bf7e227456507e2afda1f57bc25870a42b6f5ffe4344455b6e9fd67ede" exitCode=0
Aug 04 22:58:14.863486 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:58:14.863115    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3c68233e-mfs2c" event={"ID":"bb82c0da-8314-478c-a235-4d9fb6122a6f","Type":"ContainerDied","Data":"cbf494bf7e227456507e2afda1f57bc25870a42b6f5ffe4344455b6e9fd67ede"}
Aug 04 22:58:16.005893 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:58:16.005868    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3c68233e-mfs2c"
Aug 04 22:58:16.104665 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:58:16.104637    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bb82c0da-8314-478c-a235-4d9fb6122a6f-maas-api-service-ca\") pod \"bb82c0da-8314-478c-a235-4d9fb6122a6f\" (UID: \"bb82c0da-8314-478c-a235-4d9fb6122a6f\") "
Aug 04 22:58:16.104975 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:58:16.104954    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bb82c0da-8314-478c-a235-4d9fb6122a6f-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "bb82c0da-8314-478c-a235-4d9fb6122a6f" (UID: "bb82c0da-8314-478c-a235-4d9fb6122a6f"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 22:58:16.205939 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:58:16.205860    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bb82c0da-8314-478c-a235-4d9fb6122a6f-maas-api-service-ca\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
Aug 04 22:58:16.636371 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:58:16.636334    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-3c68233e-d4446d7c6-sq2jx"]
Aug 04 22:58:16.636834 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:58:16.636802    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-3c68233e-d4446d7c6-sq2jx" podUID="233fa7b7-bbba-42ae-984c-6e9ab682142d" containerName="payload-pre-processing" containerID="cri-o://39cb30eb4bbefd49f2a4aa6d35eaa9983d59dfbb22c4aa90d1aa3fa282eb27a6" gracePeriod=30
Aug 04 22:58:16.773289 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:58:16.773255    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3c68233e-mfs2c"]
Aug 04 22:58:16.776726 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:58:16.776705    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3c68233e-mfs2c"]
Aug 04 22:58:16.876749 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:58:16.876726    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="09484199edb3e5d8120987c89a0a39fd80d244dcb61ce42ab0ac0bbf5ae981ad"
Aug 04 22:58:16.876867 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:58:16.876728    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3c68233e-mfs2c"
Aug 04 22:58:16.878179 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:58:16.878124    2580 generic.go:356] "Generic (PLEG): container finished" podID="233fa7b7-bbba-42ae-984c-6e9ab682142d" containerID="39cb30eb4bbefd49f2a4aa6d35eaa9983d59dfbb22c4aa90d1aa3fa282eb27a6" exitCode=0
Aug 04 22:58:16.878271 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:58:16.878156    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-3c68233e-d4446d7c6-sq2jx" event={"ID":"233fa7b7-bbba-42ae-984c-6e9ab682142d","Type":"ContainerDied","Data":"39cb30eb4bbefd49f2a4aa6d35eaa9983d59dfbb22c4aa90d1aa3fa282eb27a6"}
Aug 04 22:58:16.878331 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:58:16.878282    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-3c68233e-d4446d7c6-sq2jx" event={"ID":"233fa7b7-bbba-42ae-984c-6e9ab682142d","Type":"ContainerDied","Data":"60832142305d5ca851ebdc9675ca0b585a818f1bee3fbb27369b83c98f1b348c"}
Aug 04 22:58:16.878331 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:58:16.878300    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="60832142305d5ca851ebdc9675ca0b585a818f1bee3fbb27369b83c98f1b348c"
Aug 04 22:58:16.888110 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:58:16.888059    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"maas-api-revoke-keys-e2e-mt-3c68233e-mfs2c\" is forbidden: User \"system:node:ip-10-0-137-117.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"odh-ai-gateway-infra\": no relationship found between node 'ip-10-0-137-117.ec2.internal' and this object" podUID="bb82c0da-8314-478c-a235-4d9fb6122a6f" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3c68233e-mfs2c"
Aug 04 22:58:16.888589 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:58:16.888573    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-3c68233e-d4446d7c6-sq2jx"
Aug 04 22:58:16.904848 ip-10-0-137-117 kubenswrapper[2580]: E0804 22:58:16.904818    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"maas-api-revoke-keys-e2e-mt-3c68233e-mfs2c\" is forbidden: User \"system:node:ip-10-0-137-117.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"odh-ai-gateway-infra\": no relationship found between node 'ip-10-0-137-117.ec2.internal' and this object" podUID="bb82c0da-8314-478c-a235-4d9fb6122a6f" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3c68233e-mfs2c"
Aug 04 22:58:16.911228 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:58:16.911208    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j2gp5\" (UniqueName: \"kubernetes.io/projected/233fa7b7-bbba-42ae-984c-6e9ab682142d-kube-api-access-j2gp5\") pod \"233fa7b7-bbba-42ae-984c-6e9ab682142d\" (UID: \"233fa7b7-bbba-42ae-984c-6e9ab682142d\") "
Aug 04 22:58:16.911327 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:58:16.911295    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/233fa7b7-bbba-42ae-984c-6e9ab682142d-plugins-config-volume\") pod \"233fa7b7-bbba-42ae-984c-6e9ab682142d\" (UID: \"233fa7b7-bbba-42ae-984c-6e9ab682142d\") "
Aug 04 22:58:16.911630 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:58:16.911609    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/233fa7b7-bbba-42ae-984c-6e9ab682142d-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "233fa7b7-bbba-42ae-984c-6e9ab682142d" (UID: "233fa7b7-bbba-42ae-984c-6e9ab682142d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 22:58:16.913189 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:58:16.913168    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/233fa7b7-bbba-42ae-984c-6e9ab682142d-kube-api-access-j2gp5" (OuterVolumeSpecName: "kube-api-access-j2gp5") pod "233fa7b7-bbba-42ae-984c-6e9ab682142d" (UID: "233fa7b7-bbba-42ae-984c-6e9ab682142d"). InnerVolumeSpecName "kube-api-access-j2gp5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 22:58:17.012417 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:58:17.012393    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j2gp5\" (UniqueName: \"kubernetes.io/projected/233fa7b7-bbba-42ae-984c-6e9ab682142d-kube-api-access-j2gp5\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
Aug 04 22:58:17.012417 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:58:17.012413    2580 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/233fa7b7-bbba-42ae-984c-6e9ab682142d-plugins-config-volume\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
Aug 04 22:58:17.502500 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:58:17.502459    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bb82c0da-8314-478c-a235-4d9fb6122a6f" path="/var/lib/kubelet/pods/bb82c0da-8314-478c-a235-4d9fb6122a6f/volumes"
Aug 04 22:58:17.885197 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:58:17.885165    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-3c68233e-d4446d7c6-sq2jx"
Aug 04 22:58:17.903731 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:58:17.903699    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-3c68233e-d4446d7c6-sq2jx"]
Aug 04 22:58:17.907378 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:58:17.907346    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-3c68233e-d4446d7c6-sq2jx"]
Aug 04 22:58:18.593310 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:58:18.593265    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-595xm"]
Aug 04 22:58:19.500726 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:58:19.500692    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="233fa7b7-bbba-42ae-984c-6e9ab682142d" path="/var/lib/kubelet/pods/233fa7b7-bbba-42ae-984c-6e9ab682142d/volumes"
Aug 04 22:58:56.896657 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:58:56.896618    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-595xm"]
Aug 04 22:59:04.052192 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:59:04.052154    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-k7zmk"]
Aug 04 22:59:04.052862 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:59:04.052385    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-k7zmk" podUID="23bb4b1b-9ef0-48d7-bff3-7dc5db6a2b66" containerName="manager" containerID="cri-o://fa21e1a5e44ba56969f7e9d00a26b1d176d5eab30379bdcc8d9a56019736eca7" gracePeriod=10
Aug 04 22:59:04.186157 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:59:04.186103    2580 generic.go:356] "Generic (PLEG): container finished" podID="23bb4b1b-9ef0-48d7-bff3-7dc5db6a2b66" containerID="fa21e1a5e44ba56969f7e9d00a26b1d176d5eab30379bdcc8d9a56019736eca7" exitCode=0
Aug 04 22:59:04.186439 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:59:04.186412    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-k7zmk" event={"ID":"23bb4b1b-9ef0-48d7-bff3-7dc5db6a2b66","Type":"ContainerDied","Data":"fa21e1a5e44ba56969f7e9d00a26b1d176d5eab30379bdcc8d9a56019736eca7"}
Aug 04 22:59:04.333438 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:59:04.333409    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-k7zmk"
Aug 04 22:59:04.491253 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:59:04.491222    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/23bb4b1b-9ef0-48d7-bff3-7dc5db6a2b66-extensions-socket-volume\") pod \"23bb4b1b-9ef0-48d7-bff3-7dc5db6a2b66\" (UID: \"23bb4b1b-9ef0-48d7-bff3-7dc5db6a2b66\") "
Aug 04 22:59:04.491435 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:59:04.491279    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hpbd8\" (UniqueName: \"kubernetes.io/projected/23bb4b1b-9ef0-48d7-bff3-7dc5db6a2b66-kube-api-access-hpbd8\") pod \"23bb4b1b-9ef0-48d7-bff3-7dc5db6a2b66\" (UID: \"23bb4b1b-9ef0-48d7-bff3-7dc5db6a2b66\") "
Aug 04 22:59:04.491604 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:59:04.491578    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/23bb4b1b-9ef0-48d7-bff3-7dc5db6a2b66-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "23bb4b1b-9ef0-48d7-bff3-7dc5db6a2b66" (UID: "23bb4b1b-9ef0-48d7-bff3-7dc5db6a2b66"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 22:59:04.493399 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:59:04.493373    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/23bb4b1b-9ef0-48d7-bff3-7dc5db6a2b66-kube-api-access-hpbd8" (OuterVolumeSpecName: "kube-api-access-hpbd8") pod "23bb4b1b-9ef0-48d7-bff3-7dc5db6a2b66" (UID: "23bb4b1b-9ef0-48d7-bff3-7dc5db6a2b66"). InnerVolumeSpecName "kube-api-access-hpbd8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 22:59:04.592321 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:59:04.592249    2580 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/23bb4b1b-9ef0-48d7-bff3-7dc5db6a2b66-extensions-socket-volume\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
Aug 04 22:59:04.592321 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:59:04.592274    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hpbd8\" (UniqueName: \"kubernetes.io/projected/23bb4b1b-9ef0-48d7-bff3-7dc5db6a2b66-kube-api-access-hpbd8\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
Aug 04 22:59:05.194139 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:59:05.194109    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-k7zmk"
Aug 04 22:59:05.194536 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:59:05.194152    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-k7zmk" event={"ID":"23bb4b1b-9ef0-48d7-bff3-7dc5db6a2b66","Type":"ContainerDied","Data":"10bd17f992a574f1fdae5522609c58f809fbbfb7057f4a3f609c287d20cda21d"}
Aug 04 22:59:05.194536 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:59:05.194219    2580 scope.go:117] "RemoveContainer" containerID="fa21e1a5e44ba56969f7e9d00a26b1d176d5eab30379bdcc8d9a56019736eca7"
Aug 04 22:59:05.237953 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:59:05.237925    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-k7zmk"]
Aug 04 22:59:05.248632 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:59:05.248610    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-k7zmk"]
Aug 04 22:59:05.500004 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:59:05.499928    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="23bb4b1b-9ef0-48d7-bff3-7dc5db6a2b66" path="/var/lib/kubelet/pods/23bb4b1b-9ef0-48d7-bff3-7dc5db6a2b66/volumes"
Aug 04 22:59:53.716760 ip-10-0-137-117 kubenswrapper[2580]: I0804 22:59:53.716728    2580 scope.go:117] "RemoveContainer" containerID="91cc57aeebc5880c2f74bb5c3b9dca2700eda45f1f839308df57e52fb392f1ea"
Aug 04 23:00:00.140267 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:00:00.140229    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29764740-2qrtg"]
Aug 04 23:00:00.140675 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:00:00.140625    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb82c0da-8314-478c-a235-4d9fb6122a6f" containerName="revoke-keys"
Aug 04 23:00:00.140675 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:00:00.140637    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb82c0da-8314-478c-a235-4d9fb6122a6f" containerName="revoke-keys"
Aug 04 23:00:00.140675 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:00:00.140656    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="23bb4b1b-9ef0-48d7-bff3-7dc5db6a2b66" containerName="manager"
Aug 04 23:00:00.140675 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:00:00.140662    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="23bb4b1b-9ef0-48d7-bff3-7dc5db6a2b66" containerName="manager"
Aug 04 23:00:00.140675 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:00:00.140677    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="233fa7b7-bbba-42ae-984c-6e9ab682142d" containerName="payload-pre-processing"
Aug 04 23:00:00.140870 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:00:00.140683    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="233fa7b7-bbba-42ae-984c-6e9ab682142d" containerName="payload-pre-processing"
Aug 04 23:00:00.140870 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:00:00.140740    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="233fa7b7-bbba-42ae-984c-6e9ab682142d" containerName="payload-pre-processing"
Aug 04 23:00:00.140870 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:00:00.140751    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="23bb4b1b-9ef0-48d7-bff3-7dc5db6a2b66" containerName="manager"
Aug 04 23:00:00.140870 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:00:00.140759    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="bb82c0da-8314-478c-a235-4d9fb6122a6f" containerName="revoke-keys"
Aug 04 23:00:00.143716 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:00:00.143699    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29764740-2qrtg"
Aug 04 23:00:00.145995 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:00:00.145972    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-vvngh\""
Aug 04 23:00:00.150245 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:00:00.150221    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29764740-2qrtg"]
Aug 04 23:00:00.156035 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:00:00.156016    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29764740-2qrtg"
Aug 04 23:00:00.290797 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:00:00.290766    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29764740-2qrtg"]
Aug 04 23:00:00.291251 ip-10-0-137-117 kubenswrapper[2580]: W0804 23:00:00.291227    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod694057cd_70d0_4977_9a71_11d11f0fae05.slice/crio-8ec8fc47c43cdddd98a3c18d139314786d0d3acc980de177354286d46c2c19d3 WatchSource:0}: Error finding container 8ec8fc47c43cdddd98a3c18d139314786d0d3acc980de177354286d46c2c19d3: Status 404 returned error can't find the container with id 8ec8fc47c43cdddd98a3c18d139314786d0d3acc980de177354286d46c2c19d3
Aug 04 23:00:00.528321 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:00:00.528247    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29764740-2qrtg" event={"ID":"694057cd-70d0-4977-9a71-11d11f0fae05","Type":"ContainerStarted","Data":"8ec8fc47c43cdddd98a3c18d139314786d0d3acc980de177354286d46c2c19d3"}
Aug 04 23:00:01.535303 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:00:01.535212    2580 generic.go:356] "Generic (PLEG): container finished" podID="694057cd-70d0-4977-9a71-11d11f0fae05" containerID="a29ab5fea1cea9afc2ea7c5810db608da969deb1e62b70bce29705bcd8b4d41a" exitCode=0
Aug 04 23:00:01.535303 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:00:01.535276    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29764740-2qrtg" event={"ID":"694057cd-70d0-4977-9a71-11d11f0fae05","Type":"ContainerDied","Data":"a29ab5fea1cea9afc2ea7c5810db608da969deb1e62b70bce29705bcd8b4d41a"}
Aug 04 23:00:02.679563 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:00:02.679536    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29764740-2qrtg"
Aug 04 23:00:03.549896 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:00:03.549868    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29764740-2qrtg"
Aug 04 23:00:03.550028 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:00:03.549895    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29764740-2qrtg" event={"ID":"694057cd-70d0-4977-9a71-11d11f0fae05","Type":"ContainerDied","Data":"8ec8fc47c43cdddd98a3c18d139314786d0d3acc980de177354286d46c2c19d3"}
Aug 04 23:00:03.550028 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:00:03.549938    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8ec8fc47c43cdddd98a3c18d139314786d0d3acc980de177354286d46c2c19d3"
Aug 04 23:00:19.688717 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:00:19.688682    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-ntxmt"]
Aug 04 23:00:19.689341 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:00:19.689322    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="694057cd-70d0-4977-9a71-11d11f0fae05" containerName="cleanup"
Aug 04 23:00:19.689424 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:00:19.689343    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="694057cd-70d0-4977-9a71-11d11f0fae05" containerName="cleanup"
Aug 04 23:00:19.689484 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:00:19.689474    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="694057cd-70d0-4977-9a71-11d11f0fae05" containerName="cleanup"
Aug 04 23:00:19.692704 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:00:19.692683    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-ntxmt"
Aug 04 23:00:19.695336 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:00:19.695319    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-6wzcf\""
Aug 04 23:00:19.704532 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:00:19.704512    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-ntxmt"]
Aug 04 23:00:19.754831 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:00:19.754803    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-56rr9\" (UniqueName: \"kubernetes.io/projected/8efe3e08-23c3-48e3-a310-bf5a516305b6-kube-api-access-56rr9\") pod \"kuadrant-operator-controller-manager-68cf589589-ntxmt\" (UID: \"8efe3e08-23c3-48e3-a310-bf5a516305b6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-ntxmt"
Aug 04 23:00:19.754938 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:00:19.754850    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8efe3e08-23c3-48e3-a310-bf5a516305b6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-68cf589589-ntxmt\" (UID: \"8efe3e08-23c3-48e3-a310-bf5a516305b6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-ntxmt"
Aug 04 23:00:19.855154 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:00:19.855098    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8efe3e08-23c3-48e3-a310-bf5a516305b6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-68cf589589-ntxmt\" (UID: \"8efe3e08-23c3-48e3-a310-bf5a516305b6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-ntxmt"
Aug 04 23:00:19.855286 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:00:19.855196    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-56rr9\" (UniqueName: \"kubernetes.io/projected/8efe3e08-23c3-48e3-a310-bf5a516305b6-kube-api-access-56rr9\") pod \"kuadrant-operator-controller-manager-68cf589589-ntxmt\" (UID: \"8efe3e08-23c3-48e3-a310-bf5a516305b6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-ntxmt"
Aug 04 23:00:19.855423 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:00:19.855402    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8efe3e08-23c3-48e3-a310-bf5a516305b6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-68cf589589-ntxmt\" (UID: \"8efe3e08-23c3-48e3-a310-bf5a516305b6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-ntxmt"
Aug 04 23:00:19.869678 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:00:19.869650    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-56rr9\" (UniqueName: \"kubernetes.io/projected/8efe3e08-23c3-48e3-a310-bf5a516305b6-kube-api-access-56rr9\") pod \"kuadrant-operator-controller-manager-68cf589589-ntxmt\" (UID: \"8efe3e08-23c3-48e3-a310-bf5a516305b6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-ntxmt"
Aug 04 23:00:20.003619 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:00:20.003542    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-ntxmt"
Aug 04 23:00:20.152346 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:00:20.150163    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-ntxmt"]
Aug 04 23:00:20.152346 ip-10-0-137-117 kubenswrapper[2580]: W0804 23:00:20.152198    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8efe3e08_23c3_48e3_a310_bf5a516305b6.slice/crio-45172eb4a96f0269c556a5109ab46f5cfb3fe408ba434c32456d5de200e55306 WatchSource:0}: Error finding container 45172eb4a96f0269c556a5109ab46f5cfb3fe408ba434c32456d5de200e55306: Status 404 returned error can't find the container with id 45172eb4a96f0269c556a5109ab46f5cfb3fe408ba434c32456d5de200e55306
Aug 04 23:00:20.651093 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:00:20.651046    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-ntxmt" event={"ID":"8efe3e08-23c3-48e3-a310-bf5a516305b6","Type":"ContainerStarted","Data":"690e0765a8bffe3fbd8611ff204f47fb8079246c45eedbe65fd94ab899fe7736"}
Aug 04 23:00:20.651294 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:00:20.651104    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-ntxmt" event={"ID":"8efe3e08-23c3-48e3-a310-bf5a516305b6","Type":"ContainerStarted","Data":"45172eb4a96f0269c556a5109ab46f5cfb3fe408ba434c32456d5de200e55306"}
Aug 04 23:00:20.651294 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:00:20.651251    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-ntxmt"
Aug 04 23:00:20.672842 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:00:20.672797    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-ntxmt" podStartSLOduration=1.672783929 podStartE2EDuration="1.672783929s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 23:00:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 23:00:20.670749041 +0000 UTC m=+2367.663566767" watchObservedRunningTime="2026-08-04 23:00:20.672783929 +0000 UTC m=+2367.665601657"
Aug 04 23:00:31.659763 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:00:31.659735    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-ntxmt"
Aug 04 23:00:38.450634 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:00:38.450595    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-e083a768-openshift-default-657f98c9c6-lrvd4"]
Aug 04 23:00:38.455015 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:00:38.454992    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-e083a768-openshift-default-657f98c9c6-lrvd4"
Aug 04 23:00:38.457521 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:00:38.457497    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-e083a768-openshift-default-dockercfg-f2ggw\""
Aug 04 23:00:38.464660 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:00:38.464639    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-e083a768-openshift-default-657f98c9c6-lrvd4"]
Aug 04 23:00:38.514276 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:00:38.514247    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/038b2e95-ea46-45e3-83c9-6e2b9ee25df4-istio-envoy\") pod \"e2e-mt-e083a768-openshift-default-657f98c9c6-lrvd4\" (UID: \"038b2e95-ea46-45e3-83c9-6e2b9ee25df4\") " pod="openshift-ingress/e2e-mt-e083a768-openshift-default-657f98c9c6-lrvd4"
Aug 04 23:00:38.514384 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:00:38.514284    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/038b2e95-ea46-45e3-83c9-6e2b9ee25df4-istio-data\") pod \"e2e-mt-e083a768-openshift-default-657f98c9c6-lrvd4\" (UID: \"038b2e95-ea46-45e3-83c9-6e2b9ee25df4\") " pod="openshift-ingress/e2e-mt-e083a768-openshift-default-657f98c9c6-lrvd4"
Aug 04 23:00:38.514384 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:00:38.514301    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/038b2e95-ea46-45e3-83c9-6e2b9ee25df4-istiod-ca-cert\") pod \"e2e-mt-e083a768-openshift-default-657f98c9c6-lrvd4\" (UID: \"038b2e95-ea46-45e3-83c9-6e2b9ee25df4\") " pod="openshift-ingress/e2e-mt-e083a768-openshift-default-657f98c9c6-lrvd4"
Aug 04 23:00:38.514462 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:00:38.514400    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/038b2e95-ea46-45e3-83c9-6e2b9ee25df4-workload-certs\") pod \"e2e-mt-e083a768-openshift-default-657f98c9c6-lrvd4\" (UID: \"038b2e95-ea46-45e3-83c9-6e2b9ee25df4\") " pod="openshift-ingress/e2e-mt-e083a768-openshift-default-657f98c9c6-lrvd4"
Aug 04 23:00:38.514462 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:00:38.514428    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/038b2e95-ea46-45e3-83c9-6e2b9ee25df4-istio-podinfo\") pod \"e2e-mt-e083a768-openshift-default-657f98c9c6-lrvd4\" (UID: \"038b2e95-ea46-45e3-83c9-6e2b9ee25df4\") " pod="openshift-ingress/e2e-mt-e083a768-openshift-default-657f98c9c6-lrvd4"
Aug 04 23:00:38.514567 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:00:38.514461    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zpjgq\" (UniqueName: \"kubernetes.io/projected/038b2e95-ea46-45e3-83c9-6e2b9ee25df4-kube-api-access-zpjgq\") pod \"e2e-mt-e083a768-openshift-default-657f98c9c6-lrvd4\" (UID: \"038b2e95-ea46-45e3-83c9-6e2b9ee25df4\") " pod="openshift-ingress/e2e-mt-e083a768-openshift-default-657f98c9c6-lrvd4"
Aug 04 23:00:38.514567 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:00:38.514539    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/038b2e95-ea46-45e3-83c9-6e2b9ee25df4-workload-socket\") pod \"e2e-mt-e083a768-openshift-default-657f98c9c6-lrvd4\" (UID: \"038b2e95-ea46-45e3-83c9-6e2b9ee25df4\") " pod="openshift-ingress/e2e-mt-e083a768-openshift-default-657f98c9c6-lrvd4"
Aug 04 23:00:38.514652 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:00:38.514582    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/038b2e95-ea46-45e3-83c9-6e2b9ee25df4-credential-socket\") pod \"e2e-mt-e083a768-openshift-default-657f98c9c6-lrvd4\" (UID: \"038b2e95-ea46-45e3-83c9-6e2b9ee25df4\") " pod="openshift-ingress/e2e-mt-e083a768-openshift-default-657f98c9c6-lrvd4"
Aug 04 23:00:38.514652 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:00:38.514635    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/038b2e95-ea46-45e3-83c9-6e2b9ee25df4-istio-token\") pod \"e2e-mt-e083a768-openshift-default-657f98c9c6-lrvd4\" (UID: \"038b2e95-ea46-45e3-83c9-6e2b9ee25df4\") " pod="openshift-ingress/e2e-mt-e083a768-openshift-default-657f98c9c6-lrvd4"
Aug 04 23:00:38.615389 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:00:38.615360    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/038b2e95-ea46-45e3-83c9-6e2b9ee25df4-workload-socket\") pod \"e2e-mt-e083a768-openshift-default-657f98c9c6-lrvd4\" (UID: \"038b2e95-ea46-45e3-83c9-6e2b9ee25df4\") " pod="openshift-ingress/e2e-mt-e083a768-openshift-default-657f98c9c6-lrvd4"
Aug 04 23:00:38.615389 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:00:38.615395    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/038b2e95-ea46-45e3-83c9-6e2b9ee25df4-credential-socket\") pod \"e2e-mt-e083a768-openshift-default-657f98c9c6-lrvd4\" (UID: \"038b2e95-ea46-45e3-83c9-6e2b9ee25df4\") " pod="openshift-ingress/e2e-mt-e083a768-openshift-default-657f98c9c6-lrvd4"
Aug 04 23:00:38.615634 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:00:38.615422    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/038b2e95-ea46-45e3-83c9-6e2b9ee25df4-istio-token\") pod \"e2e-mt-e083a768-openshift-default-657f98c9c6-lrvd4\" (UID: \"038b2e95-ea46-45e3-83c9-6e2b9ee25df4\") " pod="openshift-ingress/e2e-mt-e083a768-openshift-default-657f98c9c6-lrvd4"
Aug 04 23:00:38.615634 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:00:38.615455    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/038b2e95-ea46-45e3-83c9-6e2b9ee25df4-istio-envoy\") pod \"e2e-mt-e083a768-openshift-default-657f98c9c6-lrvd4\" (UID: \"038b2e95-ea46-45e3-83c9-6e2b9ee25df4\") " pod="openshift-ingress/e2e-mt-e083a768-openshift-default-657f98c9c6-lrvd4"
Aug 04 23:00:38.615634 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:00:38.615472    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/038b2e95-ea46-45e3-83c9-6e2b9ee25df4-istio-data\") pod \"e2e-mt-e083a768-openshift-default-657f98c9c6-lrvd4\" (UID: \"038b2e95-ea46-45e3-83c9-6e2b9ee25df4\") " pod="openshift-ingress/e2e-mt-e083a768-openshift-default-657f98c9c6-lrvd4"
Aug 04 23:00:38.615634 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:00:38.615488    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/038b2e95-ea46-45e3-83c9-6e2b9ee25df4-istiod-ca-cert\") pod \"e2e-mt-e083a768-openshift-default-657f98c9c6-lrvd4\" (UID: \"038b2e95-ea46-45e3-83c9-6e2b9ee25df4\") " pod="openshift-ingress/e2e-mt-e083a768-openshift-default-657f98c9c6-lrvd4"
Aug 04 23:00:38.615634 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:00:38.615536    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/038b2e95-ea46-45e3-83c9-6e2b9ee25df4-workload-certs\") pod \"e2e-mt-e083a768-openshift-default-657f98c9c6-lrvd4\" (UID: \"038b2e95-ea46-45e3-83c9-6e2b9ee25df4\") " pod="openshift-ingress/e2e-mt-e083a768-openshift-default-657f98c9c6-lrvd4"
Aug 04 23:00:38.615932 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:00:38.615804    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/038b2e95-ea46-45e3-83c9-6e2b9ee25df4-workload-socket\") pod \"e2e-mt-e083a768-openshift-default-657f98c9c6-lrvd4\" (UID: \"038b2e95-ea46-45e3-83c9-6e2b9ee25df4\") " pod="openshift-ingress/e2e-mt-e083a768-openshift-default-657f98c9c6-lrvd4"
Aug 04 23:00:38.615932 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:00:38.615808    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/038b2e95-ea46-45e3-83c9-6e2b9ee25df4-istio-podinfo\") pod \"e2e-mt-e083a768-openshift-default-657f98c9c6-lrvd4\" (UID: \"038b2e95-ea46-45e3-83c9-6e2b9ee25df4\") " pod="openshift-ingress/e2e-mt-e083a768-openshift-default-657f98c9c6-lrvd4"
Aug 04 23:00:38.615932 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:00:38.615844    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/038b2e95-ea46-45e3-83c9-6e2b9ee25df4-credential-socket\") pod \"e2e-mt-e083a768-openshift-default-657f98c9c6-lrvd4\" (UID: \"038b2e95-ea46-45e3-83c9-6e2b9ee25df4\") " pod="openshift-ingress/e2e-mt-e083a768-openshift-default-657f98c9c6-lrvd4"
Aug 04 23:00:38.615932 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:00:38.615907    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zpjgq\" (UniqueName: \"kubernetes.io/projected/038b2e95-ea46-45e3-83c9-6e2b9ee25df4-kube-api-access-zpjgq\") pod \"e2e-mt-e083a768-openshift-default-657f98c9c6-lrvd4\" (UID: \"038b2e95-ea46-45e3-83c9-6e2b9ee25df4\") " pod="openshift-ingress/e2e-mt-e083a768-openshift-default-657f98c9c6-lrvd4"
Aug 04 23:00:38.616171 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:00:38.615940    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/038b2e95-ea46-45e3-83c9-6e2b9ee25df4-istio-data\") pod \"e2e-mt-e083a768-openshift-default-657f98c9c6-lrvd4\" (UID: \"038b2e95-ea46-45e3-83c9-6e2b9ee25df4\") " pod="openshift-ingress/e2e-mt-e083a768-openshift-default-657f98c9c6-lrvd4"
Aug 04 23:00:38.616171 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:00:38.616027    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/038b2e95-ea46-45e3-83c9-6e2b9ee25df4-workload-certs\") pod \"e2e-mt-e083a768-openshift-default-657f98c9c6-lrvd4\" (UID: \"038b2e95-ea46-45e3-83c9-6e2b9ee25df4\") " pod="openshift-ingress/e2e-mt-e083a768-openshift-default-657f98c9c6-lrvd4"
Aug 04 23:00:38.616338 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:00:38.616316    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/038b2e95-ea46-45e3-83c9-6e2b9ee25df4-istiod-ca-cert\") pod \"e2e-mt-e083a768-openshift-default-657f98c9c6-lrvd4\" (UID: \"038b2e95-ea46-45e3-83c9-6e2b9ee25df4\") " pod="openshift-ingress/e2e-mt-e083a768-openshift-default-657f98c9c6-lrvd4"
Aug 04 23:00:38.618117 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:00:38.618091    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/038b2e95-ea46-45e3-83c9-6e2b9ee25df4-istio-envoy\") pod \"e2e-mt-e083a768-openshift-default-657f98c9c6-lrvd4\" (UID: \"038b2e95-ea46-45e3-83c9-6e2b9ee25df4\") " pod="openshift-ingress/e2e-mt-e083a768-openshift-default-657f98c9c6-lrvd4"
Aug 04 23:00:38.618307 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:00:38.618286    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/038b2e95-ea46-45e3-83c9-6e2b9ee25df4-istio-podinfo\") pod \"e2e-mt-e083a768-openshift-default-657f98c9c6-lrvd4\" (UID: \"038b2e95-ea46-45e3-83c9-6e2b9ee25df4\") " pod="openshift-ingress/e2e-mt-e083a768-openshift-default-657f98c9c6-lrvd4"
Aug 04 23:00:38.624315 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:00:38.624291    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/038b2e95-ea46-45e3-83c9-6e2b9ee25df4-istio-token\") pod \"e2e-mt-e083a768-openshift-default-657f98c9c6-lrvd4\" (UID: \"038b2e95-ea46-45e3-83c9-6e2b9ee25df4\") " pod="openshift-ingress/e2e-mt-e083a768-openshift-default-657f98c9c6-lrvd4"
Aug 04 23:00:38.624552 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:00:38.624532    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zpjgq\" (UniqueName: \"kubernetes.io/projected/038b2e95-ea46-45e3-83c9-6e2b9ee25df4-kube-api-access-zpjgq\") pod \"e2e-mt-e083a768-openshift-default-657f98c9c6-lrvd4\" (UID: \"038b2e95-ea46-45e3-83c9-6e2b9ee25df4\") " pod="openshift-ingress/e2e-mt-e083a768-openshift-default-657f98c9c6-lrvd4"
Aug 04 23:00:38.766728 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:00:38.766635    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-e083a768-openshift-default-657f98c9c6-lrvd4"
Aug 04 23:00:38.914166 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:00:38.914110    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-e083a768-openshift-default-657f98c9c6-lrvd4"]
Aug 04 23:00:38.914971 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:00:38.914939    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 23:00:38.915037 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:00:38.915003    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 23:00:38.915037 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:00:38.915032    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 23:00:39.777406 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:00:39.777368    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e083a768-openshift-default-657f98c9c6-lrvd4" event={"ID":"038b2e95-ea46-45e3-83c9-6e2b9ee25df4","Type":"ContainerStarted","Data":"bee04aea32289408e43954056c5ead81fc3864732eeb38b9fabc351fd37048f6"}
Aug 04 23:00:39.777802 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:00:39.777431    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e083a768-openshift-default-657f98c9c6-lrvd4" event={"ID":"038b2e95-ea46-45e3-83c9-6e2b9ee25df4","Type":"ContainerStarted","Data":"ee28dc2586cd23ce544a1476c9073ce2e13254009c29f7a1aeda976bafe5c20c"}
Aug 04 23:00:39.800264 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:00:39.800208    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-e083a768-openshift-default-657f98c9c6-lrvd4" podStartSLOduration=1.800192252 podStartE2EDuration="1.800192252s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 23:00:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 23:00:39.798512392 +0000 UTC m=+2386.791330119" watchObservedRunningTime="2026-08-04 23:00:39.800192252 +0000 UTC m=+2386.793009981"
Aug 04 23:00:40.396806 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:00:40.396772    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-595xm"]
Aug 04 23:00:40.766927 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:00:40.766855    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-e083a768-openshift-default-657f98c9c6-lrvd4"
Aug 04 23:00:40.772055 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:00:40.772033    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-e083a768-openshift-default-657f98c9c6-lrvd4"
Aug 04 23:00:40.783685 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:00:40.783667    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-e083a768-openshift-default-657f98c9c6-lrvd4"
Aug 04 23:00:40.784299 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:00:40.784283    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-e083a768-openshift-default-657f98c9c6-lrvd4"
Aug 04 23:00:50.603006 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:00:50.602968    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-595xm"]
Aug 04 23:00:53.743841 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:00:53.743810    2580 scope.go:117] "RemoveContainer" containerID="b8c2cafca6158dfd36472589d0a025531670af917d23dd0461ed5e7ded0af0e9"
Aug 04 23:00:53.752430 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:00:53.752409    2580 scope.go:117] "RemoveContainer" containerID="a1ada9f7052d1cfb4a5cb057f5f4056587a0bcbda4ed07bec83204f03f6e816b"
Aug 04 23:00:55.785486 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:00:55.785405    2580 patch_prober.go:28] interesting pod/e2e-mt-e083a768-openshift-default-657f98c9c6-lrvd4 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" start-of-body=
Aug 04 23:00:55.785864 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:00:55.785478    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-e083a768-openshift-default-657f98c9c6-lrvd4" podUID="038b2e95-ea46-45e3-83c9-6e2b9ee25df4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused"
Aug 04 23:00:55.885169 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:00:55.885114    2580 generic.go:356] "Generic (PLEG): container finished" podID="038b2e95-ea46-45e3-83c9-6e2b9ee25df4" containerID="bee04aea32289408e43954056c5ead81fc3864732eeb38b9fabc351fd37048f6" exitCode=0
Aug 04 23:00:55.885350 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:00:55.885186    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e083a768-openshift-default-657f98c9c6-lrvd4" event={"ID":"038b2e95-ea46-45e3-83c9-6e2b9ee25df4","Type":"ContainerDied","Data":"bee04aea32289408e43954056c5ead81fc3864732eeb38b9fabc351fd37048f6"}
Aug 04 23:00:55.885593 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:00:55.885579    2580 scope.go:117] "RemoveContainer" containerID="bee04aea32289408e43954056c5ead81fc3864732eeb38b9fabc351fd37048f6"
Aug 04 23:00:55.886564 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:00:55.886531    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 23:00:55.886683 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:00:55.886597    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 23:00:55.886683 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:00:55.886630    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 23:00:56.894147 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:00:56.894097    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e083a768-openshift-default-657f98c9c6-lrvd4" event={"ID":"038b2e95-ea46-45e3-83c9-6e2b9ee25df4","Type":"ContainerStarted","Data":"45a6b3a85c1b8a2bef4c8ede0afae0e65e5dab2dc05f960c8fb95312f821c306"}
Aug 04 23:00:57.767787 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:00:57.767745    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-e083a768-openshift-default-657f98c9c6-lrvd4"
Aug 04 23:00:57.767995 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:00:57.767941    2580 patch_prober.go:28] interesting pod/e2e-mt-e083a768-openshift-default-657f98c9c6-lrvd4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" start-of-body=
Aug 04 23:00:57.768072 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:00:57.767995    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-e083a768-openshift-default-657f98c9c6-lrvd4" podUID="038b2e95-ea46-45e3-83c9-6e2b9ee25df4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused"
Aug 04 23:00:58.767261 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:00:58.767220    2580 patch_prober.go:28] interesting pod/e2e-mt-e083a768-openshift-default-657f98c9c6-lrvd4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" start-of-body=
Aug 04 23:00:58.767645 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:00:58.767273    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-e083a768-openshift-default-657f98c9c6-lrvd4" podUID="038b2e95-ea46-45e3-83c9-6e2b9ee25df4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused"
Aug 04 23:00:59.767199 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:00:59.767161    2580 patch_prober.go:28] interesting pod/e2e-mt-e083a768-openshift-default-657f98c9c6-lrvd4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" start-of-body=
Aug 04 23:00:59.767377 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:00:59.767224    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-e083a768-openshift-default-657f98c9c6-lrvd4" podUID="038b2e95-ea46-45e3-83c9-6e2b9ee25df4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused"
Aug 04 23:01:00.767160 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:01:00.767108    2580 patch_prober.go:28] interesting pod/e2e-mt-e083a768-openshift-default-657f98c9c6-lrvd4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" start-of-body=
Aug 04 23:01:00.767338 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:01:00.767183    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-e083a768-openshift-default-657f98c9c6-lrvd4" podUID="038b2e95-ea46-45e3-83c9-6e2b9ee25df4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused"
Aug 04 23:01:01.772216 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:01:01.772185    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-e083a768-openshift-default-657f98c9c6-lrvd4"
Aug 04 23:01:01.772671 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:01:01.772625    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-e083a768-openshift-default-657f98c9c6-lrvd4"
Aug 04 23:01:01.773492 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:01:01.773441    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-e083a768-openshift-default-657f98c9c6-lrvd4"
Aug 04 23:01:14.901059 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:01:14.901018    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-595xm"]
Aug 04 23:01:35.608563 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:01:35.608525    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-595xm"]
Aug 04 23:01:46.243024 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:01:46.242990    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e083a768-c7mkb"]
Aug 04 23:01:46.246797 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:01:46.246777    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e083a768-c7mkb"
Aug 04 23:01:46.249303 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:01:46.249280    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Aug 04 23:01:46.249437 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:01:46.249323    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-vvngh\""
Aug 04 23:01:46.256825 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:01:46.256766    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e083a768-c7mkb"]
Aug 04 23:01:46.333766 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:01:46.333736    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/24770777-26cb-48b2-97ab-11a25700f2b8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-e083a768-c7mkb\" (UID: \"24770777-26cb-48b2-97ab-11a25700f2b8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e083a768-c7mkb"
Aug 04 23:01:46.434713 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:01:46.434685    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/24770777-26cb-48b2-97ab-11a25700f2b8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-e083a768-c7mkb\" (UID: \"24770777-26cb-48b2-97ab-11a25700f2b8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e083a768-c7mkb"
Aug 04 23:01:46.435271 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:01:46.435254    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/24770777-26cb-48b2-97ab-11a25700f2b8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-e083a768-c7mkb\" (UID: \"24770777-26cb-48b2-97ab-11a25700f2b8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e083a768-c7mkb"
Aug 04 23:01:46.561995 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:01:46.561960    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e083a768-c7mkb"
Aug 04 23:01:46.703381 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:01:46.703342    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e083a768-c7mkb"]
Aug 04 23:01:46.705355 ip-10-0-137-117 kubenswrapper[2580]: W0804 23:01:46.705324    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24770777_26cb_48b2_97ab_11a25700f2b8.slice/crio-fd27f99f2af6e612d9fab6360612466ef224fb611c6f0a6c78855957c5c6d056 WatchSource:0}: Error finding container fd27f99f2af6e612d9fab6360612466ef224fb611c6f0a6c78855957c5c6d056: Status 404 returned error can't find the container with id fd27f99f2af6e612d9fab6360612466ef224fb611c6f0a6c78855957c5c6d056
Aug 04 23:01:47.190630 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:01:47.190595    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e083a768-c7mkb" event={"ID":"24770777-26cb-48b2-97ab-11a25700f2b8","Type":"ContainerStarted","Data":"30eb8ea53207145a201171de196cb7f01b1c82fde7b8aa7ddb8e4094cddbd08f"}
Aug 04 23:01:47.190779 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:01:47.190647    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e083a768-c7mkb" event={"ID":"24770777-26cb-48b2-97ab-11a25700f2b8","Type":"ContainerStarted","Data":"fd27f99f2af6e612d9fab6360612466ef224fb611c6f0a6c78855957c5c6d056"}
Aug 04 23:01:47.209991 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:01:47.209910    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e083a768-c7mkb" podStartSLOduration=1.209894962 podStartE2EDuration="1.209894962s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 23:01:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 23:01:47.208219778 +0000 UTC m=+2454.201037507" watchObservedRunningTime="2026-08-04 23:01:47.209894962 +0000 UTC m=+2454.202712690"
Aug 04 23:01:48.197934 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:01:48.197906    2580 generic.go:356] "Generic (PLEG): container finished" podID="24770777-26cb-48b2-97ab-11a25700f2b8" containerID="30eb8ea53207145a201171de196cb7f01b1c82fde7b8aa7ddb8e4094cddbd08f" exitCode=0
Aug 04 23:01:48.198306 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:01:48.197956    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e083a768-c7mkb" event={"ID":"24770777-26cb-48b2-97ab-11a25700f2b8","Type":"ContainerDied","Data":"30eb8ea53207145a201171de196cb7f01b1c82fde7b8aa7ddb8e4094cddbd08f"}
Aug 04 23:01:49.338850 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:01:49.338820    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e083a768-c7mkb"
Aug 04 23:01:49.458193 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:01:49.458107    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/24770777-26cb-48b2-97ab-11a25700f2b8-maas-api-service-ca\") pod \"24770777-26cb-48b2-97ab-11a25700f2b8\" (UID: \"24770777-26cb-48b2-97ab-11a25700f2b8\") "
Aug 04 23:01:49.458422 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:01:49.458401    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/24770777-26cb-48b2-97ab-11a25700f2b8-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "24770777-26cb-48b2-97ab-11a25700f2b8" (UID: "24770777-26cb-48b2-97ab-11a25700f2b8"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 23:01:49.558922 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:01:49.558898    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/24770777-26cb-48b2-97ab-11a25700f2b8-maas-api-service-ca\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
Aug 04 23:01:50.211140 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:01:50.211098    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e083a768-c7mkb"
Aug 04 23:01:50.211317 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:01:50.211146    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e083a768-c7mkb" event={"ID":"24770777-26cb-48b2-97ab-11a25700f2b8","Type":"ContainerDied","Data":"fd27f99f2af6e612d9fab6360612466ef224fb611c6f0a6c78855957c5c6d056"}
Aug 04 23:01:50.211317 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:01:50.211227    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fd27f99f2af6e612d9fab6360612466ef224fb611c6f0a6c78855957c5c6d056"
Aug 04 23:01:53.778457 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:01:53.778429    2580 scope.go:117] "RemoveContainer" containerID="1d80985ba192c0e8aedc7e306ab32fec2c8e655e1d98b94e34036a439ba9e4a7"
Aug 04 23:01:59.503144 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:01:59.503106    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-595xm"]
Aug 04 23:02:02.106094 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:02:02.106046    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e083a768-c7mkb"]
Aug 04 23:02:02.109667 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:02:02.109640    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e083a768-c7mkb"]
Aug 04 23:02:03.500502 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:02:03.500468    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="24770777-26cb-48b2-97ab-11a25700f2b8" path="/var/lib/kubelet/pods/24770777-26cb-48b2-97ab-11a25700f2b8/volumes"
Aug 04 23:02:05.299818 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:02:05.299778    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-595xm"]
Aug 04 23:02:53.232355 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:02:53.232317    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-e083a768-openshift-default-657f98c9c6-lrvd4"]
Aug 04 23:02:53.232935 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:02:53.232572    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-e083a768-openshift-default-657f98c9c6-lrvd4" podUID="038b2e95-ea46-45e3-83c9-6e2b9ee25df4" containerName="istio-proxy" containerID="cri-o://45a6b3a85c1b8a2bef4c8ede0afae0e65e5dab2dc05f960c8fb95312f821c306" gracePeriod=30
Aug 04 23:02:55.297392 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:02:55.297354    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-595xm"]
Aug 04 23:02:58.482654 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:02:58.482631    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-e083a768-openshift-default-657f98c9c6-lrvd4"
Aug 04 23:02:58.579924 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:02:58.579890    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/038b2e95-ea46-45e3-83c9-6e2b9ee25df4-credential-socket\") pod \"038b2e95-ea46-45e3-83c9-6e2b9ee25df4\" (UID: \"038b2e95-ea46-45e3-83c9-6e2b9ee25df4\") "
Aug 04 23:02:58.580113 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:02:58.579932    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/038b2e95-ea46-45e3-83c9-6e2b9ee25df4-workload-certs\") pod \"038b2e95-ea46-45e3-83c9-6e2b9ee25df4\" (UID: \"038b2e95-ea46-45e3-83c9-6e2b9ee25df4\") "
Aug 04 23:02:58.580113 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:02:58.579958    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/038b2e95-ea46-45e3-83c9-6e2b9ee25df4-istio-envoy\") pod \"038b2e95-ea46-45e3-83c9-6e2b9ee25df4\" (UID: \"038b2e95-ea46-45e3-83c9-6e2b9ee25df4\") "
Aug 04 23:02:58.580113 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:02:58.579979    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/038b2e95-ea46-45e3-83c9-6e2b9ee25df4-istiod-ca-cert\") pod \"038b2e95-ea46-45e3-83c9-6e2b9ee25df4\" (UID: \"038b2e95-ea46-45e3-83c9-6e2b9ee25df4\") "
Aug 04 23:02:58.580113 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:02:58.580011    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/038b2e95-ea46-45e3-83c9-6e2b9ee25df4-workload-socket\") pod \"038b2e95-ea46-45e3-83c9-6e2b9ee25df4\" (UID: \"038b2e95-ea46-45e3-83c9-6e2b9ee25df4\") "
Aug 04 23:02:58.580113 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:02:58.580045    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/038b2e95-ea46-45e3-83c9-6e2b9ee25df4-istio-token\") pod \"038b2e95-ea46-45e3-83c9-6e2b9ee25df4\" (UID: \"038b2e95-ea46-45e3-83c9-6e2b9ee25df4\") "
Aug 04 23:02:58.580113 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:02:58.580071    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/038b2e95-ea46-45e3-83c9-6e2b9ee25df4-istio-data\") pod \"038b2e95-ea46-45e3-83c9-6e2b9ee25df4\" (UID: \"038b2e95-ea46-45e3-83c9-6e2b9ee25df4\") "
Aug 04 23:02:58.580113 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:02:58.580102    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zpjgq\" (UniqueName: \"kubernetes.io/projected/038b2e95-ea46-45e3-83c9-6e2b9ee25df4-kube-api-access-zpjgq\") pod \"038b2e95-ea46-45e3-83c9-6e2b9ee25df4\" (UID: \"038b2e95-ea46-45e3-83c9-6e2b9ee25df4\") "
Aug 04 23:02:58.580527 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:02:58.580191    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/038b2e95-ea46-45e3-83c9-6e2b9ee25df4-istio-podinfo\") pod \"038b2e95-ea46-45e3-83c9-6e2b9ee25df4\" (UID: \"038b2e95-ea46-45e3-83c9-6e2b9ee25df4\") "
Aug 04 23:02:58.580527 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:02:58.580210    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/038b2e95-ea46-45e3-83c9-6e2b9ee25df4-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "038b2e95-ea46-45e3-83c9-6e2b9ee25df4" (UID: "038b2e95-ea46-45e3-83c9-6e2b9ee25df4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 23:02:58.580527 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:02:58.580283    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/038b2e95-ea46-45e3-83c9-6e2b9ee25df4-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "038b2e95-ea46-45e3-83c9-6e2b9ee25df4" (UID: "038b2e95-ea46-45e3-83c9-6e2b9ee25df4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 23:02:58.580527 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:02:58.580396    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/038b2e95-ea46-45e3-83c9-6e2b9ee25df4-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "038b2e95-ea46-45e3-83c9-6e2b9ee25df4" (UID: "038b2e95-ea46-45e3-83c9-6e2b9ee25df4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 23:02:58.580527 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:02:58.580411    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/038b2e95-ea46-45e3-83c9-6e2b9ee25df4-istio-data" (OuterVolumeSpecName: "istio-data") pod "038b2e95-ea46-45e3-83c9-6e2b9ee25df4" (UID: "038b2e95-ea46-45e3-83c9-6e2b9ee25df4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 23:02:58.580527 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:02:58.580480    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/038b2e95-ea46-45e3-83c9-6e2b9ee25df4-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "038b2e95-ea46-45e3-83c9-6e2b9ee25df4" (UID: "038b2e95-ea46-45e3-83c9-6e2b9ee25df4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 23:02:58.580527 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:02:58.580520    2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/038b2e95-ea46-45e3-83c9-6e2b9ee25df4-workload-socket\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
Aug 04 23:02:58.580894 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:02:58.580540    2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/038b2e95-ea46-45e3-83c9-6e2b9ee25df4-istio-data\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
Aug 04 23:02:58.580894 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:02:58.580554    2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/038b2e95-ea46-45e3-83c9-6e2b9ee25df4-credential-socket\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
Aug 04 23:02:58.580894 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:02:58.580566    2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/038b2e95-ea46-45e3-83c9-6e2b9ee25df4-workload-certs\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
Aug 04 23:02:58.582316 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:02:58.582287    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/038b2e95-ea46-45e3-83c9-6e2b9ee25df4-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "038b2e95-ea46-45e3-83c9-6e2b9ee25df4" (UID: "038b2e95-ea46-45e3-83c9-6e2b9ee25df4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 23:02:58.582402 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:02:58.582359    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/038b2e95-ea46-45e3-83c9-6e2b9ee25df4-kube-api-access-zpjgq" (OuterVolumeSpecName: "kube-api-access-zpjgq") pod "038b2e95-ea46-45e3-83c9-6e2b9ee25df4" (UID: "038b2e95-ea46-45e3-83c9-6e2b9ee25df4"). InnerVolumeSpecName "kube-api-access-zpjgq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 23:02:58.582402 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:02:58.582367    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/038b2e95-ea46-45e3-83c9-6e2b9ee25df4-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "038b2e95-ea46-45e3-83c9-6e2b9ee25df4" (UID: "038b2e95-ea46-45e3-83c9-6e2b9ee25df4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Aug 04 23:02:58.582480 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:02:58.582444    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/038b2e95-ea46-45e3-83c9-6e2b9ee25df4-istio-token" (OuterVolumeSpecName: "istio-token") pod "038b2e95-ea46-45e3-83c9-6e2b9ee25df4" (UID: "038b2e95-ea46-45e3-83c9-6e2b9ee25df4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 23:02:58.628199 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:02:58.628168    2580 generic.go:356] "Generic (PLEG): container finished" podID="038b2e95-ea46-45e3-83c9-6e2b9ee25df4" containerID="45a6b3a85c1b8a2bef4c8ede0afae0e65e5dab2dc05f960c8fb95312f821c306" exitCode=0
Aug 04 23:02:58.628328 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:02:58.628222    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-e083a768-openshift-default-657f98c9c6-lrvd4"
Aug 04 23:02:58.628328 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:02:58.628243    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e083a768-openshift-default-657f98c9c6-lrvd4" event={"ID":"038b2e95-ea46-45e3-83c9-6e2b9ee25df4","Type":"ContainerDied","Data":"45a6b3a85c1b8a2bef4c8ede0afae0e65e5dab2dc05f960c8fb95312f821c306"}
Aug 04 23:02:58.628328 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:02:58.628287    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e083a768-openshift-default-657f98c9c6-lrvd4" event={"ID":"038b2e95-ea46-45e3-83c9-6e2b9ee25df4","Type":"ContainerDied","Data":"ee28dc2586cd23ce544a1476c9073ce2e13254009c29f7a1aeda976bafe5c20c"}
Aug 04 23:02:58.628328 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:02:58.628307    2580 scope.go:117] "RemoveContainer" containerID="45a6b3a85c1b8a2bef4c8ede0afae0e65e5dab2dc05f960c8fb95312f821c306"
Aug 04 23:02:58.641188 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:02:58.641165    2580 scope.go:117] "RemoveContainer" containerID="bee04aea32289408e43954056c5ead81fc3864732eeb38b9fabc351fd37048f6"
Aug 04 23:02:58.650330 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:02:58.650300    2580 scope.go:117] "RemoveContainer" containerID="45a6b3a85c1b8a2bef4c8ede0afae0e65e5dab2dc05f960c8fb95312f821c306"
Aug 04 23:02:58.650629 ip-10-0-137-117 kubenswrapper[2580]: E0804 23:02:58.650607    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"45a6b3a85c1b8a2bef4c8ede0afae0e65e5dab2dc05f960c8fb95312f821c306\": container with ID starting with 45a6b3a85c1b8a2bef4c8ede0afae0e65e5dab2dc05f960c8fb95312f821c306 not found: ID does not exist" containerID="45a6b3a85c1b8a2bef4c8ede0afae0e65e5dab2dc05f960c8fb95312f821c306"
Aug 04 23:02:58.650704 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:02:58.650638    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"45a6b3a85c1b8a2bef4c8ede0afae0e65e5dab2dc05f960c8fb95312f821c306"} err="failed to get container status \"45a6b3a85c1b8a2bef4c8ede0afae0e65e5dab2dc05f960c8fb95312f821c306\": rpc error: code = NotFound desc = could not find container \"45a6b3a85c1b8a2bef4c8ede0afae0e65e5dab2dc05f960c8fb95312f821c306\": container with ID starting with 45a6b3a85c1b8a2bef4c8ede0afae0e65e5dab2dc05f960c8fb95312f821c306 not found: ID does not exist"
Aug 04 23:02:58.650704 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:02:58.650655    2580 scope.go:117] "RemoveContainer" containerID="bee04aea32289408e43954056c5ead81fc3864732eeb38b9fabc351fd37048f6"
Aug 04 23:02:58.650920 ip-10-0-137-117 kubenswrapper[2580]: E0804 23:02:58.650904    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bee04aea32289408e43954056c5ead81fc3864732eeb38b9fabc351fd37048f6\": container with ID starting with bee04aea32289408e43954056c5ead81fc3864732eeb38b9fabc351fd37048f6 not found: ID does not exist" containerID="bee04aea32289408e43954056c5ead81fc3864732eeb38b9fabc351fd37048f6"
Aug 04 23:02:58.650968 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:02:58.650928    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bee04aea32289408e43954056c5ead81fc3864732eeb38b9fabc351fd37048f6"} err="failed to get container status \"bee04aea32289408e43954056c5ead81fc3864732eeb38b9fabc351fd37048f6\": rpc error: code = NotFound desc = could not find container \"bee04aea32289408e43954056c5ead81fc3864732eeb38b9fabc351fd37048f6\": container with ID starting with bee04aea32289408e43954056c5ead81fc3864732eeb38b9fabc351fd37048f6 not found: ID does not exist"
Aug 04 23:02:58.652790 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:02:58.652770    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-e083a768-openshift-default-657f98c9c6-lrvd4"]
Aug 04 23:02:58.657101 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:02:58.657080    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-e083a768-openshift-default-657f98c9c6-lrvd4"]
Aug 04 23:02:58.681526 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:02:58.681502    2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/038b2e95-ea46-45e3-83c9-6e2b9ee25df4-istio-token\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
Aug 04 23:02:58.681526 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:02:58.681523    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zpjgq\" (UniqueName: \"kubernetes.io/projected/038b2e95-ea46-45e3-83c9-6e2b9ee25df4-kube-api-access-zpjgq\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
Aug 04 23:02:58.681649 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:02:58.681532    2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/038b2e95-ea46-45e3-83c9-6e2b9ee25df4-istio-podinfo\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
Aug 04 23:02:58.681649 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:02:58.681545    2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/038b2e95-ea46-45e3-83c9-6e2b9ee25df4-istio-envoy\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
Aug 04 23:02:58.681649 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:02:58.681557    2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/038b2e95-ea46-45e3-83c9-6e2b9ee25df4-istiod-ca-cert\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
Aug 04 23:02:59.500564 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:02:59.500531    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="038b2e95-ea46-45e3-83c9-6e2b9ee25df4" path="/var/lib/kubelet/pods/038b2e95-ea46-45e3-83c9-6e2b9ee25df4/volumes"
Aug 04 23:03:06.595949 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:03:06.595917    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-595xm"]
Aug 04 23:03:12.097852 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:03:12.097816    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-595xm"]
Aug 04 23:03:19.307352 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:03:19.307313    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-595xm"]
Aug 04 23:03:53.811020 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:03:53.810986    2580 scope.go:117] "RemoveContainer" containerID="39cb30eb4bbefd49f2a4aa6d35eaa9983d59dfbb22c4aa90d1aa3fa282eb27a6"
Aug 04 23:04:00.749160 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:04:00.749110    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-549992-openshift-default-646964c7db-4b9zv"]
Aug 04 23:04:00.749609 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:04:00.749576    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="038b2e95-ea46-45e3-83c9-6e2b9ee25df4" containerName="istio-proxy"
Aug 04 23:04:00.749609 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:04:00.749589    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="038b2e95-ea46-45e3-83c9-6e2b9ee25df4" containerName="istio-proxy"
Aug 04 23:04:00.749609 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:04:00.749602    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24770777-26cb-48b2-97ab-11a25700f2b8" containerName="revoke-keys"
Aug 04 23:04:00.749609 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:04:00.749607    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="24770777-26cb-48b2-97ab-11a25700f2b8" containerName="revoke-keys"
Aug 04 23:04:00.749741 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:04:00.749677    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="038b2e95-ea46-45e3-83c9-6e2b9ee25df4" containerName="istio-proxy"
Aug 04 23:04:00.749741 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:04:00.749686    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="24770777-26cb-48b2-97ab-11a25700f2b8" containerName="revoke-keys"
Aug 04 23:04:00.749741 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:04:00.749693    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="038b2e95-ea46-45e3-83c9-6e2b9ee25df4" containerName="istio-proxy"
Aug 04 23:04:00.752955 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:04:00.752935    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-549992-openshift-default-646964c7db-4b9zv"
Aug 04 23:04:00.756989 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:04:00.756968    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-549992-openshift-default-dockercfg-qrm7g\""
Aug 04 23:04:00.765329 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:04:00.765307    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-549992-openshift-default-646964c7db-4b9zv"]
Aug 04 23:04:00.841555 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:04:00.841524    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/67efa195-8644-4145-af1b-fe19f2d7b83e-istiod-ca-cert\") pod \"e2e-inf-a-549992-openshift-default-646964c7db-4b9zv\" (UID: \"67efa195-8644-4145-af1b-fe19f2d7b83e\") " pod="openshift-ingress/e2e-inf-a-549992-openshift-default-646964c7db-4b9zv"
Aug 04 23:04:00.841555 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:04:00.841558    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/67efa195-8644-4145-af1b-fe19f2d7b83e-istio-data\") pod \"e2e-inf-a-549992-openshift-default-646964c7db-4b9zv\" (UID: \"67efa195-8644-4145-af1b-fe19f2d7b83e\") " pod="openshift-ingress/e2e-inf-a-549992-openshift-default-646964c7db-4b9zv"
Aug 04 23:04:00.841794 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:04:00.841586    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/67efa195-8644-4145-af1b-fe19f2d7b83e-istio-envoy\") pod \"e2e-inf-a-549992-openshift-default-646964c7db-4b9zv\" (UID: \"67efa195-8644-4145-af1b-fe19f2d7b83e\") " pod="openshift-ingress/e2e-inf-a-549992-openshift-default-646964c7db-4b9zv"
Aug 04 23:04:00.841794 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:04:00.841641    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/67efa195-8644-4145-af1b-fe19f2d7b83e-workload-socket\") pod \"e2e-inf-a-549992-openshift-default-646964c7db-4b9zv\" (UID: \"67efa195-8644-4145-af1b-fe19f2d7b83e\") " pod="openshift-ingress/e2e-inf-a-549992-openshift-default-646964c7db-4b9zv"
Aug 04 23:04:00.841794 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:04:00.841658    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c9mbw\" (UniqueName: \"kubernetes.io/projected/67efa195-8644-4145-af1b-fe19f2d7b83e-kube-api-access-c9mbw\") pod \"e2e-inf-a-549992-openshift-default-646964c7db-4b9zv\" (UID: \"67efa195-8644-4145-af1b-fe19f2d7b83e\") " pod="openshift-ingress/e2e-inf-a-549992-openshift-default-646964c7db-4b9zv"
Aug 04 23:04:00.841794 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:04:00.841710    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/67efa195-8644-4145-af1b-fe19f2d7b83e-istio-token\") pod \"e2e-inf-a-549992-openshift-default-646964c7db-4b9zv\" (UID: \"67efa195-8644-4145-af1b-fe19f2d7b83e\") " pod="openshift-ingress/e2e-inf-a-549992-openshift-default-646964c7db-4b9zv"
Aug 04 23:04:00.841794 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:04:00.841770    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/67efa195-8644-4145-af1b-fe19f2d7b83e-credential-socket\") pod \"e2e-inf-a-549992-openshift-default-646964c7db-4b9zv\" (UID: \"67efa195-8644-4145-af1b-fe19f2d7b83e\") " pod="openshift-ingress/e2e-inf-a-549992-openshift-default-646964c7db-4b9zv"
Aug 04 23:04:00.841794 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:04:00.841793    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/67efa195-8644-4145-af1b-fe19f2d7b83e-istio-podinfo\") pod \"e2e-inf-a-549992-openshift-default-646964c7db-4b9zv\" (UID: \"67efa195-8644-4145-af1b-fe19f2d7b83e\") " pod="openshift-ingress/e2e-inf-a-549992-openshift-default-646964c7db-4b9zv"
Aug 04 23:04:00.842345 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:04:00.841820    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/67efa195-8644-4145-af1b-fe19f2d7b83e-workload-certs\") pod \"e2e-inf-a-549992-openshift-default-646964c7db-4b9zv\" (UID: \"67efa195-8644-4145-af1b-fe19f2d7b83e\") " pod="openshift-ingress/e2e-inf-a-549992-openshift-default-646964c7db-4b9zv"
Aug 04 23:04:00.942674 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:04:00.942637    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/67efa195-8644-4145-af1b-fe19f2d7b83e-workload-socket\") pod \"e2e-inf-a-549992-openshift-default-646964c7db-4b9zv\" (UID: \"67efa195-8644-4145-af1b-fe19f2d7b83e\") " pod="openshift-ingress/e2e-inf-a-549992-openshift-default-646964c7db-4b9zv"
Aug 04 23:04:00.942828 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:04:00.942691    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c9mbw\" (UniqueName: \"kubernetes.io/projected/67efa195-8644-4145-af1b-fe19f2d7b83e-kube-api-access-c9mbw\") pod \"e2e-inf-a-549992-openshift-default-646964c7db-4b9zv\" (UID: \"67efa195-8644-4145-af1b-fe19f2d7b83e\") " pod="openshift-ingress/e2e-inf-a-549992-openshift-default-646964c7db-4b9zv"
Aug 04 23:04:00.942828 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:04:00.942746    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/67efa195-8644-4145-af1b-fe19f2d7b83e-istio-token\") pod \"e2e-inf-a-549992-openshift-default-646964c7db-4b9zv\" (UID: \"67efa195-8644-4145-af1b-fe19f2d7b83e\") " pod="openshift-ingress/e2e-inf-a-549992-openshift-default-646964c7db-4b9zv"
Aug 04 23:04:00.942828 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:04:00.942817    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/67efa195-8644-4145-af1b-fe19f2d7b83e-credential-socket\") pod \"e2e-inf-a-549992-openshift-default-646964c7db-4b9zv\" (UID: \"67efa195-8644-4145-af1b-fe19f2d7b83e\") " pod="openshift-ingress/e2e-inf-a-549992-openshift-default-646964c7db-4b9zv"
Aug 04 23:04:00.943015 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:04:00.942878    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/67efa195-8644-4145-af1b-fe19f2d7b83e-istio-podinfo\") pod \"e2e-inf-a-549992-openshift-default-646964c7db-4b9zv\" (UID: \"67efa195-8644-4145-af1b-fe19f2d7b83e\") " pod="openshift-ingress/e2e-inf-a-549992-openshift-default-646964c7db-4b9zv"
Aug 04 23:04:00.943015 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:04:00.942935    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/67efa195-8644-4145-af1b-fe19f2d7b83e-workload-certs\") pod \"e2e-inf-a-549992-openshift-default-646964c7db-4b9zv\" (UID: \"67efa195-8644-4145-af1b-fe19f2d7b83e\") " pod="openshift-ingress/e2e-inf-a-549992-openshift-default-646964c7db-4b9zv"
Aug 04 23:04:00.943015 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:04:00.942965    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/67efa195-8644-4145-af1b-fe19f2d7b83e-istiod-ca-cert\") pod \"e2e-inf-a-549992-openshift-default-646964c7db-4b9zv\" (UID: \"67efa195-8644-4145-af1b-fe19f2d7b83e\") " pod="openshift-ingress/e2e-inf-a-549992-openshift-default-646964c7db-4b9zv"
Aug 04 23:04:00.943015 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:04:00.942993    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/67efa195-8644-4145-af1b-fe19f2d7b83e-istio-data\") pod \"e2e-inf-a-549992-openshift-default-646964c7db-4b9zv\" (UID: \"67efa195-8644-4145-af1b-fe19f2d7b83e\") " pod="openshift-ingress/e2e-inf-a-549992-openshift-default-646964c7db-4b9zv"
Aug 04 23:04:00.943261 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:04:00.943021    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/67efa195-8644-4145-af1b-fe19f2d7b83e-workload-socket\") pod \"e2e-inf-a-549992-openshift-default-646964c7db-4b9zv\" (UID: \"67efa195-8644-4145-af1b-fe19f2d7b83e\") " pod="openshift-ingress/e2e-inf-a-549992-openshift-default-646964c7db-4b9zv"
Aug 04 23:04:00.943261 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:04:00.943041    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/67efa195-8644-4145-af1b-fe19f2d7b83e-istio-envoy\") pod \"e2e-inf-a-549992-openshift-default-646964c7db-4b9zv\" (UID: \"67efa195-8644-4145-af1b-fe19f2d7b83e\") " pod="openshift-ingress/e2e-inf-a-549992-openshift-default-646964c7db-4b9zv"
Aug 04 23:04:00.943378 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:04:00.943356    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/67efa195-8644-4145-af1b-fe19f2d7b83e-credential-socket\") pod \"e2e-inf-a-549992-openshift-default-646964c7db-4b9zv\" (UID: \"67efa195-8644-4145-af1b-fe19f2d7b83e\") " pod="openshift-ingress/e2e-inf-a-549992-openshift-default-646964c7db-4b9zv"
Aug 04 23:04:00.943427 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:04:00.943374    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/67efa195-8644-4145-af1b-fe19f2d7b83e-workload-certs\") pod \"e2e-inf-a-549992-openshift-default-646964c7db-4b9zv\" (UID: \"67efa195-8644-4145-af1b-fe19f2d7b83e\") " pod="openshift-ingress/e2e-inf-a-549992-openshift-default-646964c7db-4b9zv"
Aug 04 23:04:00.943613 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:04:00.943587    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/67efa195-8644-4145-af1b-fe19f2d7b83e-istio-data\") pod \"e2e-inf-a-549992-openshift-default-646964c7db-4b9zv\" (UID: \"67efa195-8644-4145-af1b-fe19f2d7b83e\") " pod="openshift-ingress/e2e-inf-a-549992-openshift-default-646964c7db-4b9zv"
Aug 04 23:04:00.943995 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:04:00.943968    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/67efa195-8644-4145-af1b-fe19f2d7b83e-istiod-ca-cert\") pod \"e2e-inf-a-549992-openshift-default-646964c7db-4b9zv\" (UID: \"67efa195-8644-4145-af1b-fe19f2d7b83e\") " pod="openshift-ingress/e2e-inf-a-549992-openshift-default-646964c7db-4b9zv"
Aug 04 23:04:00.945403 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:04:00.945380    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/67efa195-8644-4145-af1b-fe19f2d7b83e-istio-envoy\") pod \"e2e-inf-a-549992-openshift-default-646964c7db-4b9zv\" (UID: \"67efa195-8644-4145-af1b-fe19f2d7b83e\") " pod="openshift-ingress/e2e-inf-a-549992-openshift-default-646964c7db-4b9zv"
Aug 04 23:04:00.945830 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:04:00.945811    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/67efa195-8644-4145-af1b-fe19f2d7b83e-istio-podinfo\") pod \"e2e-inf-a-549992-openshift-default-646964c7db-4b9zv\" (UID: \"67efa195-8644-4145-af1b-fe19f2d7b83e\") " pod="openshift-ingress/e2e-inf-a-549992-openshift-default-646964c7db-4b9zv"
Aug 04 23:04:00.957566 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:04:00.957540    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/67efa195-8644-4145-af1b-fe19f2d7b83e-istio-token\") pod \"e2e-inf-a-549992-openshift-default-646964c7db-4b9zv\" (UID: \"67efa195-8644-4145-af1b-fe19f2d7b83e\") " pod="openshift-ingress/e2e-inf-a-549992-openshift-default-646964c7db-4b9zv"
Aug 04 23:04:00.957649 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:04:00.957609    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c9mbw\" (UniqueName: \"kubernetes.io/projected/67efa195-8644-4145-af1b-fe19f2d7b83e-kube-api-access-c9mbw\") pod \"e2e-inf-a-549992-openshift-default-646964c7db-4b9zv\" (UID: \"67efa195-8644-4145-af1b-fe19f2d7b83e\") " pod="openshift-ingress/e2e-inf-a-549992-openshift-default-646964c7db-4b9zv"
Aug 04 23:04:01.064327 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:04:01.064302    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-549992-openshift-default-646964c7db-4b9zv"
Aug 04 23:04:01.217941 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:04:01.217915    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-549992-openshift-default-646964c7db-4b9zv"]
Aug 04 23:04:01.218711 ip-10-0-137-117 kubenswrapper[2580]: W0804 23:04:01.218686    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67efa195_8644_4145_af1b_fe19f2d7b83e.slice/crio-652a36b5012d93ee76163fa662a0f3bc8c419b90d9656e46345137ab4c246b21 WatchSource:0}: Error finding container 652a36b5012d93ee76163fa662a0f3bc8c419b90d9656e46345137ab4c246b21: Status 404 returned error can't find the container with id 652a36b5012d93ee76163fa662a0f3bc8c419b90d9656e46345137ab4c246b21
Aug 04 23:04:01.220795 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:04:01.220760    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 23:04:01.220907 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:04:01.220838    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 23:04:01.220907 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:04:01.220883    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 23:04:02.014976 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:04:02.014937    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-549992-openshift-default-646964c7db-4b9zv" event={"ID":"67efa195-8644-4145-af1b-fe19f2d7b83e","Type":"ContainerStarted","Data":"988d9ef8cd9f229e41c38ecd3b8fe7d88ce21d59797f2107aec7e547fd5ab8e5"}
Aug 04 23:04:02.015366 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:04:02.014999    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-549992-openshift-default-646964c7db-4b9zv" event={"ID":"67efa195-8644-4145-af1b-fe19f2d7b83e","Type":"ContainerStarted","Data":"652a36b5012d93ee76163fa662a0f3bc8c419b90d9656e46345137ab4c246b21"}
Aug 04 23:04:02.040804 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:04:02.040750    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-549992-openshift-default-646964c7db-4b9zv" podStartSLOduration=2.040731903 podStartE2EDuration="2.040731903s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 23:04:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 23:04:02.035481529 +0000 UTC m=+2589.028299257" watchObservedRunningTime="2026-08-04 23:04:02.040731903 +0000 UTC m=+2589.033549632"
Aug 04 23:04:02.064485 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:04:02.064457    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-549992-openshift-default-646964c7db-4b9zv"
Aug 04 23:04:02.069494 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:04:02.069473    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-549992-openshift-default-646964c7db-4b9zv"
Aug 04 23:04:03.021075 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:04:03.021047    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-549992-openshift-default-646964c7db-4b9zv"
Aug 04 23:04:03.022027 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:04:03.022005    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-549992-openshift-default-646964c7db-4b9zv"
Aug 04 23:04:08.090575 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:04:08.090531    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-595xm"]
Aug 04 23:04:18.022516 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:04:18.022405    2580 patch_prober.go:28] interesting pod/e2e-inf-a-549992-openshift-default-646964c7db-4b9zv container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" start-of-body=
Aug 04 23:04:18.022516 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:04:18.022480    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-549992-openshift-default-646964c7db-4b9zv" podUID="67efa195-8644-4145-af1b-fe19f2d7b83e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused"
Aug 04 23:04:18.116351 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:04:18.116321    2580 generic.go:356] "Generic (PLEG): container finished" podID="67efa195-8644-4145-af1b-fe19f2d7b83e" containerID="988d9ef8cd9f229e41c38ecd3b8fe7d88ce21d59797f2107aec7e547fd5ab8e5" exitCode=0
Aug 04 23:04:18.116520 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:04:18.116403    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-549992-openshift-default-646964c7db-4b9zv" event={"ID":"67efa195-8644-4145-af1b-fe19f2d7b83e","Type":"ContainerDied","Data":"988d9ef8cd9f229e41c38ecd3b8fe7d88ce21d59797f2107aec7e547fd5ab8e5"}
Aug 04 23:04:18.116837 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:04:18.116822    2580 scope.go:117] "RemoveContainer" containerID="988d9ef8cd9f229e41c38ecd3b8fe7d88ce21d59797f2107aec7e547fd5ab8e5"
Aug 04 23:04:18.117790 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:04:18.117761    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 23:04:18.117883 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:04:18.117845    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 23:04:18.117943 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:04:18.117894    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 23:04:19.125225 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:04:19.125185    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-549992-openshift-default-646964c7db-4b9zv" event={"ID":"67efa195-8644-4145-af1b-fe19f2d7b83e","Type":"ContainerStarted","Data":"af49c81166719180eb07561c3011f7f5e86020f2534d5514b511b4315082cff3"}
Aug 04 23:04:20.065022 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:04:20.064988    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-549992-openshift-default-646964c7db-4b9zv"
Aug 04 23:04:20.065337 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:04:20.065310    2580 patch_prober.go:28] interesting pod/e2e-inf-a-549992-openshift-default-646964c7db-4b9zv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" start-of-body=
Aug 04 23:04:20.065394 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:04:20.065370    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-549992-openshift-default-646964c7db-4b9zv" podUID="67efa195-8644-4145-af1b-fe19f2d7b83e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused"
Aug 04 23:04:21.065185 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:04:21.065118    2580 patch_prober.go:28] interesting pod/e2e-inf-a-549992-openshift-default-646964c7db-4b9zv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" start-of-body=
Aug 04 23:04:21.065569 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:04:21.065204    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-549992-openshift-default-646964c7db-4b9zv" podUID="67efa195-8644-4145-af1b-fe19f2d7b83e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused"
Aug 04 23:04:22.065643 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:04:22.065607    2580 patch_prober.go:28] interesting pod/e2e-inf-a-549992-openshift-default-646964c7db-4b9zv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" start-of-body=
Aug 04 23:04:22.066039 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:04:22.065662    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-549992-openshift-default-646964c7db-4b9zv" podUID="67efa195-8644-4145-af1b-fe19f2d7b83e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused"
Aug 04 23:04:23.065778 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:04:23.065722    2580 patch_prober.go:28] interesting pod/e2e-inf-a-549992-openshift-default-646964c7db-4b9zv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" start-of-body=
Aug 04 23:04:23.066224 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:04:23.065797    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-549992-openshift-default-646964c7db-4b9zv" podUID="67efa195-8644-4145-af1b-fe19f2d7b83e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused"
Aug 04 23:04:24.065681 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:04:24.065635    2580 patch_prober.go:28] interesting pod/e2e-inf-a-549992-openshift-default-646964c7db-4b9zv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" start-of-body=
Aug 04 23:04:24.065901 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:04:24.065709    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-549992-openshift-default-646964c7db-4b9zv" podUID="67efa195-8644-4145-af1b-fe19f2d7b83e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused"
Aug 04 23:04:25.068335 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:04:25.068304    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-549992-openshift-default-646964c7db-4b9zv"
Aug 04 23:04:25.068707 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:04:25.068638    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-549992-openshift-default-646964c7db-4b9zv"
Aug 04 23:04:25.069314 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:04:25.069298    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-549992-openshift-default-646964c7db-4b9zv"
Aug 04 23:04:38.645952 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:04:38.645914    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-2d20db-95f574764-w4m8k"]
Aug 04 23:04:38.646662 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:04:38.646638    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="038b2e95-ea46-45e3-83c9-6e2b9ee25df4" containerName="istio-proxy"
Aug 04 23:04:38.646662 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:04:38.646663    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="038b2e95-ea46-45e3-83c9-6e2b9ee25df4" containerName="istio-proxy"
Aug 04 23:04:38.650164 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:04:38.650116    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2d20db-95f574764-w4m8k"
Aug 04 23:04:38.652658 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:04:38.652622    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Aug 04 23:04:38.652965 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:04:38.652948    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-2d20db-serving-cert\""
Aug 04 23:04:38.653039 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:04:38.652948    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Aug 04 23:04:38.653142 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:04:38.653115    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-qqbsd\""
Aug 04 23:04:38.658100 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:04:38.658077    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-2d20db-95f574764-w4m8k"]
Aug 04 23:04:38.718481 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:04:38.718452    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d06bff3e-4273-4c12-bb5e-43000f758455-openshift-service-ca\") pod \"maas-api-e2e-inf-b-2d20db-95f574764-w4m8k\" (UID: \"d06bff3e-4273-4c12-bb5e-43000f758455\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2d20db-95f574764-w4m8k"
Aug 04 23:04:38.718623 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:04:38.718499    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d06bff3e-4273-4c12-bb5e-43000f758455-maas-api-tls\") pod \"maas-api-e2e-inf-b-2d20db-95f574764-w4m8k\" (UID: \"d06bff3e-4273-4c12-bb5e-43000f758455\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2d20db-95f574764-w4m8k"
Aug 04 23:04:38.718623 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:04:38.718611    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qnbb5\" (UniqueName: \"kubernetes.io/projected/d06bff3e-4273-4c12-bb5e-43000f758455-kube-api-access-qnbb5\") pod \"maas-api-e2e-inf-b-2d20db-95f574764-w4m8k\" (UID: \"d06bff3e-4273-4c12-bb5e-43000f758455\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2d20db-95f574764-w4m8k"
Aug 04 23:04:38.819760 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:04:38.819729    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d06bff3e-4273-4c12-bb5e-43000f758455-openshift-service-ca\") pod \"maas-api-e2e-inf-b-2d20db-95f574764-w4m8k\" (UID: \"d06bff3e-4273-4c12-bb5e-43000f758455\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2d20db-95f574764-w4m8k"
Aug 04 23:04:38.819930 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:04:38.819762    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d06bff3e-4273-4c12-bb5e-43000f758455-maas-api-tls\") pod \"maas-api-e2e-inf-b-2d20db-95f574764-w4m8k\" (UID: \"d06bff3e-4273-4c12-bb5e-43000f758455\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2d20db-95f574764-w4m8k"
Aug 04 23:04:38.819930 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:04:38.819814    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qnbb5\" (UniqueName: \"kubernetes.io/projected/d06bff3e-4273-4c12-bb5e-43000f758455-kube-api-access-qnbb5\") pod \"maas-api-e2e-inf-b-2d20db-95f574764-w4m8k\" (UID: \"d06bff3e-4273-4c12-bb5e-43000f758455\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2d20db-95f574764-w4m8k"
Aug 04 23:04:38.820059 ip-10-0-137-117 kubenswrapper[2580]: E0804 23:04:38.819938    2580 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-2d20db-serving-cert: secret "maas-api-e2e-inf-b-2d20db-serving-cert" not found
Aug 04 23:04:38.820059 ip-10-0-137-117 kubenswrapper[2580]: E0804 23:04:38.819999    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d06bff3e-4273-4c12-bb5e-43000f758455-maas-api-tls podName:d06bff3e-4273-4c12-bb5e-43000f758455 nodeName:}" failed. No retries permitted until 2026-08-04 23:04:39.319979543 +0000 UTC m=+2626.312797267 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/d06bff3e-4273-4c12-bb5e-43000f758455-maas-api-tls") pod "maas-api-e2e-inf-b-2d20db-95f574764-w4m8k" (UID: "d06bff3e-4273-4c12-bb5e-43000f758455") : secret "maas-api-e2e-inf-b-2d20db-serving-cert" not found
Aug 04 23:04:38.820477 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:04:38.820453    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d06bff3e-4273-4c12-bb5e-43000f758455-openshift-service-ca\") pod \"maas-api-e2e-inf-b-2d20db-95f574764-w4m8k\" (UID: \"d06bff3e-4273-4c12-bb5e-43000f758455\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2d20db-95f574764-w4m8k"
Aug 04 23:04:38.827952 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:04:38.827927    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qnbb5\" (UniqueName: \"kubernetes.io/projected/d06bff3e-4273-4c12-bb5e-43000f758455-kube-api-access-qnbb5\") pod \"maas-api-e2e-inf-b-2d20db-95f574764-w4m8k\" (UID: \"d06bff3e-4273-4c12-bb5e-43000f758455\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2d20db-95f574764-w4m8k"
Aug 04 23:04:39.324927 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:04:39.324893    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d06bff3e-4273-4c12-bb5e-43000f758455-maas-api-tls\") pod \"maas-api-e2e-inf-b-2d20db-95f574764-w4m8k\" (UID: \"d06bff3e-4273-4c12-bb5e-43000f758455\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2d20db-95f574764-w4m8k"
Aug 04 23:04:39.327355 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:04:39.327331    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d06bff3e-4273-4c12-bb5e-43000f758455-maas-api-tls\") pod \"maas-api-e2e-inf-b-2d20db-95f574764-w4m8k\" (UID: \"d06bff3e-4273-4c12-bb5e-43000f758455\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2d20db-95f574764-w4m8k"
Aug 04 23:04:39.564302 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:04:39.564269    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2d20db-95f574764-w4m8k"
Aug 04 23:04:39.705403 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:04:39.705372    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-2d20db-95f574764-w4m8k"]
Aug 04 23:04:39.706981 ip-10-0-137-117 kubenswrapper[2580]: W0804 23:04:39.706954    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd06bff3e_4273_4c12_bb5e_43000f758455.slice/crio-3c7f8c153905c57e415be67e4ccf86a536307667a11236ee0992035025419c09 WatchSource:0}: Error finding container 3c7f8c153905c57e415be67e4ccf86a536307667a11236ee0992035025419c09: Status 404 returned error can't find the container with id 3c7f8c153905c57e415be67e4ccf86a536307667a11236ee0992035025419c09
Aug 04 23:04:39.708381 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:04:39.708362    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 04 23:04:40.268203 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:04:40.268159    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2d20db-95f574764-w4m8k" event={"ID":"d06bff3e-4273-4c12-bb5e-43000f758455","Type":"ContainerStarted","Data":"3c7f8c153905c57e415be67e4ccf86a536307667a11236ee0992035025419c09"}
Aug 04 23:04:41.809855 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:04:41.809817    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-595xm"]
Aug 04 23:04:42.282548 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:04:42.282460    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2d20db-95f574764-w4m8k" event={"ID":"d06bff3e-4273-4c12-bb5e-43000f758455","Type":"ContainerStarted","Data":"08dd21b023f02e825b4407bbd474d7c17663493bd4ea8b14c3ef536fb4800a35"}
Aug 04 23:04:42.282722 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:04:42.282652    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2d20db-95f574764-w4m8k"
Aug 04 23:04:42.301527 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:04:42.301478    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2d20db-95f574764-w4m8k" podStartSLOduration=2.768099542 podStartE2EDuration="4.30146271s" totalImagesPullingTime="1.533363168s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 23:04:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 23:04:42.300082301 +0000 UTC m=+2629.292900030" watchObservedRunningTime="2026-08-04 23:04:42.30146271 +0000 UTC m=+2629.294280438"
Aug 04 23:04:48.293439 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:04:48.293409    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2d20db-95f574764-w4m8k"
Aug 04 23:04:53.836997 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:04:53.836963    2580 scope.go:117] "RemoveContainer" containerID="cbf494bf7e227456507e2afda1f57bc25870a42b6f5ffe4344455b6e9fd67ede"
Aug 04 23:05:13.198534 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:05:13.198498    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-595xm"]
Aug 04 23:05:20.408034 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:05:20.407994    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-595xm"]
Aug 04 23:05:45.802176 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:05:45.802070    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-595xm"]
Aug 04 23:05:54.196613 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:05:54.196579    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-595xm"]
Aug 04 23:06:23.404728 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:06:23.404693    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-549992-z5p6v"]
Aug 04 23:06:23.408575 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:06:23.408556    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-549992-z5p6v"
Aug 04 23:06:23.411038 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:06:23.411013    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-vvngh\""
Aug 04 23:06:23.416081 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:06:23.416056    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-549992-z5p6v"]
Aug 04 23:06:23.512100 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:06:23.512066    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/00b643de-fca9-4439-887c-c3c7157ed8e2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-549992-z5p6v\" (UID: \"00b643de-fca9-4439-887c-c3c7157ed8e2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-549992-z5p6v"
Aug 04 23:06:23.612941 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:06:23.612908    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/00b643de-fca9-4439-887c-c3c7157ed8e2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-549992-z5p6v\" (UID: \"00b643de-fca9-4439-887c-c3c7157ed8e2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-549992-z5p6v"
Aug 04 23:06:23.613582 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:06:23.613555    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/00b643de-fca9-4439-887c-c3c7157ed8e2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-549992-z5p6v\" (UID: \"00b643de-fca9-4439-887c-c3c7157ed8e2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-549992-z5p6v"
Aug 04 23:06:23.721191 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:06:23.721108    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-549992-z5p6v"
Aug 04 23:06:23.864318 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:06:23.864270    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-549992-z5p6v"]
Aug 04 23:06:23.866142 ip-10-0-137-117 kubenswrapper[2580]: W0804 23:06:23.866098    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00b643de_fca9_4439_887c_c3c7157ed8e2.slice/crio-5ccfb739b951f52657dad922dc6c16110722896c3ddc96aa03fd5322698bce98 WatchSource:0}: Error finding container 5ccfb739b951f52657dad922dc6c16110722896c3ddc96aa03fd5322698bce98: Status 404 returned error can't find the container with id 5ccfb739b951f52657dad922dc6c16110722896c3ddc96aa03fd5322698bce98
Aug 04 23:06:23.906842 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:06:23.906811    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-549992-z5p6v" event={"ID":"00b643de-fca9-4439-887c-c3c7157ed8e2","Type":"ContainerStarted","Data":"5ccfb739b951f52657dad922dc6c16110722896c3ddc96aa03fd5322698bce98"}
Aug 04 23:06:24.914301 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:06:24.914205    2580 generic.go:356] "Generic (PLEG): container finished" podID="00b643de-fca9-4439-887c-c3c7157ed8e2" containerID="07994bbc6750bd91ffb595803b30162057c12292a84fca2278659d36d5b6dbda" exitCode=0
Aug 04 23:06:24.914695 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:06:24.914299    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-549992-z5p6v" event={"ID":"00b643de-fca9-4439-887c-c3c7157ed8e2","Type":"ContainerDied","Data":"07994bbc6750bd91ffb595803b30162057c12292a84fca2278659d36d5b6dbda"}
Aug 04 23:06:25.490008 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:06:25.489962    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-595xm"]
Aug 04 23:06:26.065589 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:06:26.065564    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-549992-z5p6v"
Aug 04 23:06:26.138156 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:06:26.138098    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/00b643de-fca9-4439-887c-c3c7157ed8e2-maas-api-service-ca\") pod \"00b643de-fca9-4439-887c-c3c7157ed8e2\" (UID: \"00b643de-fca9-4439-887c-c3c7157ed8e2\") "
Aug 04 23:06:26.138439 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:06:26.138416    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/00b643de-fca9-4439-887c-c3c7157ed8e2-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "00b643de-fca9-4439-887c-c3c7157ed8e2" (UID: "00b643de-fca9-4439-887c-c3c7157ed8e2"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 23:06:26.239655 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:06:26.239577    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/00b643de-fca9-4439-887c-c3c7157ed8e2-maas-api-service-ca\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
Aug 04 23:06:26.926873 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:06:26.926841    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-549992-z5p6v"
Aug 04 23:06:26.927053 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:06:26.926837    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-549992-z5p6v" event={"ID":"00b643de-fca9-4439-887c-c3c7157ed8e2","Type":"ContainerDied","Data":"5ccfb739b951f52657dad922dc6c16110722896c3ddc96aa03fd5322698bce98"}
Aug 04 23:06:26.927053 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:06:26.926974    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5ccfb739b951f52657dad922dc6c16110722896c3ddc96aa03fd5322698bce98"
Aug 04 23:06:34.106853 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:06:34.106817    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-549992-z5p6v"]
Aug 04 23:06:34.109227 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:06:34.109206    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-549992-z5p6v"]
Aug 04 23:06:35.499553 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:06:35.499515    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="00b643de-fca9-4439-887c-c3c7157ed8e2" path="/var/lib/kubelet/pods/00b643de-fca9-4439-887c-c3c7157ed8e2/volumes"
Aug 04 23:06:36.294061 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:06:36.294020    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-595xm"]
Aug 04 23:06:40.808578 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:06:40.808545    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-549992-openshift-default-646964c7db-4b9zv"]
Aug 04 23:06:40.808994 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:06:40.808767    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-549992-openshift-default-646964c7db-4b9zv" podUID="67efa195-8644-4145-af1b-fe19f2d7b83e" containerName="istio-proxy" containerID="cri-o://af49c81166719180eb07561c3011f7f5e86020f2534d5514b511b4315082cff3" gracePeriod=30
Aug 04 23:06:41.158259 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:06:41.158173    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2d20db-pfgtf"]
Aug 04 23:06:41.158618 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:06:41.158605    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="00b643de-fca9-4439-887c-c3c7157ed8e2" containerName="revoke-keys"
Aug 04 23:06:41.158666 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:06:41.158619    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="00b643de-fca9-4439-887c-c3c7157ed8e2" containerName="revoke-keys"
Aug 04 23:06:41.158702 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:06:41.158693    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="00b643de-fca9-4439-887c-c3c7157ed8e2" containerName="revoke-keys"
Aug 04 23:06:41.162073 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:06:41.162056    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2d20db-pfgtf"
Aug 04 23:06:41.164322 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:06:41.164298    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-vvngh\""
Aug 04 23:06:41.168205 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:06:41.168177    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2d20db-pfgtf"]
Aug 04 23:06:41.174698 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:06:41.174670    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b0c66baf-f6c7-44b4-916e-45bf111b0918-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-2d20db-pfgtf\" (UID: \"b0c66baf-f6c7-44b4-916e-45bf111b0918\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2d20db-pfgtf"
Aug 04 23:06:41.276071 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:06:41.276034    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b0c66baf-f6c7-44b4-916e-45bf111b0918-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-2d20db-pfgtf\" (UID: \"b0c66baf-f6c7-44b4-916e-45bf111b0918\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2d20db-pfgtf"
Aug 04 23:06:41.276693 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:06:41.276672    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b0c66baf-f6c7-44b4-916e-45bf111b0918-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-2d20db-pfgtf\" (UID: \"b0c66baf-f6c7-44b4-916e-45bf111b0918\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2d20db-pfgtf"
Aug 04 23:06:41.476375 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:06:41.476295    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2d20db-pfgtf"
Aug 04 23:06:41.616728 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:06:41.616698    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2d20db-pfgtf"]
Aug 04 23:06:41.618432 ip-10-0-137-117 kubenswrapper[2580]: W0804 23:06:41.618406    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0c66baf_f6c7_44b4_916e_45bf111b0918.slice/crio-4e9bf5d95d04d28ddf58ae4bdd4939cb07286220cf23f448ba9e672d76e81925 WatchSource:0}: Error finding container 4e9bf5d95d04d28ddf58ae4bdd4939cb07286220cf23f448ba9e672d76e81925: Status 404 returned error can't find the container with id 4e9bf5d95d04d28ddf58ae4bdd4939cb07286220cf23f448ba9e672d76e81925
Aug 04 23:06:42.032397 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:06:42.032358    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2d20db-pfgtf" event={"ID":"b0c66baf-f6c7-44b4-916e-45bf111b0918","Type":"ContainerStarted","Data":"6534f734476137844f11c7d2c5885ab78deeaa37309d286e25cf737ff13d9a41"}
Aug 04 23:06:42.032754 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:06:42.032424    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2d20db-pfgtf" event={"ID":"b0c66baf-f6c7-44b4-916e-45bf111b0918","Type":"ContainerStarted","Data":"4e9bf5d95d04d28ddf58ae4bdd4939cb07286220cf23f448ba9e672d76e81925"}
Aug 04 23:06:42.047902 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:06:42.047849    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2d20db-pfgtf" podStartSLOduration=1.047830119 podStartE2EDuration="1.047830119s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 23:06:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 23:06:42.047118796 +0000 UTC m=+2749.039936524" watchObservedRunningTime="2026-08-04 23:06:42.047830119 +0000 UTC m=+2749.040647848"
Aug 04 23:06:43.040764 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:06:43.040724    2580 generic.go:356] "Generic (PLEG): container finished" podID="b0c66baf-f6c7-44b4-916e-45bf111b0918" containerID="6534f734476137844f11c7d2c5885ab78deeaa37309d286e25cf737ff13d9a41" exitCode=0
Aug 04 23:06:43.041198 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:06:43.040804    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2d20db-pfgtf" event={"ID":"b0c66baf-f6c7-44b4-916e-45bf111b0918","Type":"ContainerDied","Data":"6534f734476137844f11c7d2c5885ab78deeaa37309d286e25cf737ff13d9a41"}
Aug 04 23:06:44.181849 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:06:44.181824    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2d20db-pfgtf"
Aug 04 23:06:44.204605 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:06:44.204582    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b0c66baf-f6c7-44b4-916e-45bf111b0918-maas-api-service-ca\") pod \"b0c66baf-f6c7-44b4-916e-45bf111b0918\" (UID: \"b0c66baf-f6c7-44b4-916e-45bf111b0918\") "
Aug 04 23:06:44.204889 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:06:44.204868    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b0c66baf-f6c7-44b4-916e-45bf111b0918-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "b0c66baf-f6c7-44b4-916e-45bf111b0918" (UID: "b0c66baf-f6c7-44b4-916e-45bf111b0918"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 23:06:44.305927 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:06:44.305849    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b0c66baf-f6c7-44b4-916e-45bf111b0918-maas-api-service-ca\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
Aug 04 23:06:45.054848 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:06:45.054817    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2d20db-pfgtf"
Aug 04 23:06:45.055018 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:06:45.054860    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2d20db-pfgtf" event={"ID":"b0c66baf-f6c7-44b4-916e-45bf111b0918","Type":"ContainerDied","Data":"4e9bf5d95d04d28ddf58ae4bdd4939cb07286220cf23f448ba9e672d76e81925"}
Aug 04 23:06:45.055018 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:06:45.054910    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4e9bf5d95d04d28ddf58ae4bdd4939cb07286220cf23f448ba9e672d76e81925"
Aug 04 23:06:46.063057 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:06:46.063032    2580 generic.go:356] "Generic (PLEG): container finished" podID="67efa195-8644-4145-af1b-fe19f2d7b83e" containerID="af49c81166719180eb07561c3011f7f5e86020f2534d5514b511b4315082cff3" exitCode=0
Aug 04 23:06:46.063422 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:06:46.063101    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-549992-openshift-default-646964c7db-4b9zv" event={"ID":"67efa195-8644-4145-af1b-fe19f2d7b83e","Type":"ContainerDied","Data":"af49c81166719180eb07561c3011f7f5e86020f2534d5514b511b4315082cff3"}
Aug 04 23:06:46.063422 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:06:46.063170    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-549992-openshift-default-646964c7db-4b9zv" event={"ID":"67efa195-8644-4145-af1b-fe19f2d7b83e","Type":"ContainerDied","Data":"652a36b5012d93ee76163fa662a0f3bc8c419b90d9656e46345137ab4c246b21"}
Aug 04 23:06:46.063422 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:06:46.063192    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="652a36b5012d93ee76163fa662a0f3bc8c419b90d9656e46345137ab4c246b21"
Aug 04 23:06:46.063422 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:06:46.063205    2580 scope.go:117] "RemoveContainer" containerID="988d9ef8cd9f229e41c38ecd3b8fe7d88ce21d59797f2107aec7e547fd5ab8e5"
Aug 04 23:06:46.063681 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:06:46.063662    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-549992-openshift-default-646964c7db-4b9zv"
Aug 04 23:06:46.123635 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:06:46.123578    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c9mbw\" (UniqueName: \"kubernetes.io/projected/67efa195-8644-4145-af1b-fe19f2d7b83e-kube-api-access-c9mbw\") pod \"67efa195-8644-4145-af1b-fe19f2d7b83e\" (UID: \"67efa195-8644-4145-af1b-fe19f2d7b83e\") "
Aug 04 23:06:46.123635 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:06:46.123611    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/67efa195-8644-4145-af1b-fe19f2d7b83e-workload-socket\") pod \"67efa195-8644-4145-af1b-fe19f2d7b83e\" (UID: \"67efa195-8644-4145-af1b-fe19f2d7b83e\") "
Aug 04 23:06:46.123635 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:06:46.123627    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/67efa195-8644-4145-af1b-fe19f2d7b83e-workload-certs\") pod \"67efa195-8644-4145-af1b-fe19f2d7b83e\" (UID: \"67efa195-8644-4145-af1b-fe19f2d7b83e\") "
Aug 04 23:06:46.123888 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:06:46.123657    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/67efa195-8644-4145-af1b-fe19f2d7b83e-istiod-ca-cert\") pod \"67efa195-8644-4145-af1b-fe19f2d7b83e\" (UID: \"67efa195-8644-4145-af1b-fe19f2d7b83e\") "
Aug 04 23:06:46.123888 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:06:46.123675    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/67efa195-8644-4145-af1b-fe19f2d7b83e-istio-token\") pod \"67efa195-8644-4145-af1b-fe19f2d7b83e\" (UID: \"67efa195-8644-4145-af1b-fe19f2d7b83e\") "
Aug 04 23:06:46.123888 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:06:46.123697    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/67efa195-8644-4145-af1b-fe19f2d7b83e-istio-podinfo\") pod \"67efa195-8644-4145-af1b-fe19f2d7b83e\" (UID: \"67efa195-8644-4145-af1b-fe19f2d7b83e\") "
Aug 04 23:06:46.123888 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:06:46.123740    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/67efa195-8644-4145-af1b-fe19f2d7b83e-credential-socket\") pod \"67efa195-8644-4145-af1b-fe19f2d7b83e\" (UID: \"67efa195-8644-4145-af1b-fe19f2d7b83e\") "
Aug 04 23:06:46.123888 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:06:46.123763    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/67efa195-8644-4145-af1b-fe19f2d7b83e-istio-envoy\") pod \"67efa195-8644-4145-af1b-fe19f2d7b83e\" (UID: \"67efa195-8644-4145-af1b-fe19f2d7b83e\") "
Aug 04 23:06:46.123888 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:06:46.123790    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/67efa195-8644-4145-af1b-fe19f2d7b83e-istio-data\") pod \"67efa195-8644-4145-af1b-fe19f2d7b83e\" (UID: \"67efa195-8644-4145-af1b-fe19f2d7b83e\") "
Aug 04 23:06:46.124255 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:06:46.123907    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67efa195-8644-4145-af1b-fe19f2d7b83e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "67efa195-8644-4145-af1b-fe19f2d7b83e" (UID: "67efa195-8644-4145-af1b-fe19f2d7b83e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 23:06:46.124255 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:06:46.123924    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67efa195-8644-4145-af1b-fe19f2d7b83e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "67efa195-8644-4145-af1b-fe19f2d7b83e" (UID: "67efa195-8644-4145-af1b-fe19f2d7b83e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 23:06:46.124255 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:06:46.124117    2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/67efa195-8644-4145-af1b-fe19f2d7b83e-workload-socket\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
Aug 04 23:06:46.124255 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:06:46.124110    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67efa195-8644-4145-af1b-fe19f2d7b83e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "67efa195-8644-4145-af1b-fe19f2d7b83e" (UID: "67efa195-8644-4145-af1b-fe19f2d7b83e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 23:06:46.124255 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:06:46.124153    2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/67efa195-8644-4145-af1b-fe19f2d7b83e-workload-certs\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
Aug 04 23:06:46.124255 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:06:46.124183    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67efa195-8644-4145-af1b-fe19f2d7b83e-istio-data" (OuterVolumeSpecName: "istio-data") pod "67efa195-8644-4145-af1b-fe19f2d7b83e" (UID: "67efa195-8644-4145-af1b-fe19f2d7b83e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 23:06:46.124497 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:06:46.124350    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/67efa195-8644-4145-af1b-fe19f2d7b83e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "67efa195-8644-4145-af1b-fe19f2d7b83e" (UID: "67efa195-8644-4145-af1b-fe19f2d7b83e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 23:06:46.125869 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:06:46.125839    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/67efa195-8644-4145-af1b-fe19f2d7b83e-istio-token" (OuterVolumeSpecName: "istio-token") pod "67efa195-8644-4145-af1b-fe19f2d7b83e" (UID: "67efa195-8644-4145-af1b-fe19f2d7b83e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 23:06:46.125970 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:06:46.125913    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67efa195-8644-4145-af1b-fe19f2d7b83e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "67efa195-8644-4145-af1b-fe19f2d7b83e" (UID: "67efa195-8644-4145-af1b-fe19f2d7b83e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 23:06:46.126212 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:06:46.126182    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/67efa195-8644-4145-af1b-fe19f2d7b83e-kube-api-access-c9mbw" (OuterVolumeSpecName: "kube-api-access-c9mbw") pod "67efa195-8644-4145-af1b-fe19f2d7b83e" (UID: "67efa195-8644-4145-af1b-fe19f2d7b83e"). InnerVolumeSpecName "kube-api-access-c9mbw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 23:06:46.126282 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:06:46.126257    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/67efa195-8644-4145-af1b-fe19f2d7b83e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "67efa195-8644-4145-af1b-fe19f2d7b83e" (UID: "67efa195-8644-4145-af1b-fe19f2d7b83e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Aug 04 23:06:46.225096 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:06:46.225068    2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/67efa195-8644-4145-af1b-fe19f2d7b83e-credential-socket\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
Aug 04 23:06:46.225096 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:06:46.225091    2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/67efa195-8644-4145-af1b-fe19f2d7b83e-istio-envoy\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
Aug 04 23:06:46.225096 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:06:46.225100    2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/67efa195-8644-4145-af1b-fe19f2d7b83e-istio-data\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
Aug 04 23:06:46.225303 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:06:46.225109    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c9mbw\" (UniqueName: \"kubernetes.io/projected/67efa195-8644-4145-af1b-fe19f2d7b83e-kube-api-access-c9mbw\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
Aug 04 23:06:46.225303 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:06:46.225117    2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/67efa195-8644-4145-af1b-fe19f2d7b83e-istiod-ca-cert\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
Aug 04 23:06:46.225303 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:06:46.225147    2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/67efa195-8644-4145-af1b-fe19f2d7b83e-istio-token\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
Aug 04 23:06:46.225303 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:06:46.225155    2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/67efa195-8644-4145-af1b-fe19f2d7b83e-istio-podinfo\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
Aug 04 23:06:47.071734 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:06:47.071702    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-549992-openshift-default-646964c7db-4b9zv"
Aug 04 23:06:47.104728 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:06:47.104694    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-549992-openshift-default-646964c7db-4b9zv"]
Aug 04 23:06:47.111477 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:06:47.111441    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-549992-openshift-default-646964c7db-4b9zv"]
Aug 04 23:06:47.506924 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:06:47.506881    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="67efa195-8644-4145-af1b-fe19f2d7b83e" path="/var/lib/kubelet/pods/67efa195-8644-4145-af1b-fe19f2d7b83e/volumes"
Aug 04 23:06:51.577062 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:06:51.577025    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-2d20db-95f574764-w4m8k"]
Aug 04 23:06:51.577573 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:06:51.577294    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2d20db-95f574764-w4m8k" podUID="d06bff3e-4273-4c12-bb5e-43000f758455" containerName="maas-api" containerID="cri-o://08dd21b023f02e825b4407bbd474d7c17663493bd4ea8b14c3ef536fb4800a35" gracePeriod=30
Aug 04 23:06:51.812773 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:06:51.812740    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2d20db-pfgtf"]
Aug 04 23:06:51.816040 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:06:51.816008    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2d20db-pfgtf"]
Aug 04 23:06:51.847565 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:06:51.847536    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2d20db-95f574764-w4m8k"
Aug 04 23:06:51.974360 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:06:51.974288    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qnbb5\" (UniqueName: \"kubernetes.io/projected/d06bff3e-4273-4c12-bb5e-43000f758455-kube-api-access-qnbb5\") pod \"d06bff3e-4273-4c12-bb5e-43000f758455\" (UID: \"d06bff3e-4273-4c12-bb5e-43000f758455\") "
Aug 04 23:06:51.974534 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:06:51.974376    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d06bff3e-4273-4c12-bb5e-43000f758455-openshift-service-ca\") pod \"d06bff3e-4273-4c12-bb5e-43000f758455\" (UID: \"d06bff3e-4273-4c12-bb5e-43000f758455\") "
Aug 04 23:06:51.974534 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:06:51.974395    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d06bff3e-4273-4c12-bb5e-43000f758455-maas-api-tls\") pod \"d06bff3e-4273-4c12-bb5e-43000f758455\" (UID: \"d06bff3e-4273-4c12-bb5e-43000f758455\") "
Aug 04 23:06:51.974765 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:06:51.974737    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d06bff3e-4273-4c12-bb5e-43000f758455-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "d06bff3e-4273-4c12-bb5e-43000f758455" (UID: "d06bff3e-4273-4c12-bb5e-43000f758455"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 23:06:51.976573 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:06:51.976542    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d06bff3e-4273-4c12-bb5e-43000f758455-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "d06bff3e-4273-4c12-bb5e-43000f758455" (UID: "d06bff3e-4273-4c12-bb5e-43000f758455"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 23:06:51.976672 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:06:51.976606    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d06bff3e-4273-4c12-bb5e-43000f758455-kube-api-access-qnbb5" (OuterVolumeSpecName: "kube-api-access-qnbb5") pod "d06bff3e-4273-4c12-bb5e-43000f758455" (UID: "d06bff3e-4273-4c12-bb5e-43000f758455"). InnerVolumeSpecName "kube-api-access-qnbb5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 23:06:52.075064 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:06:52.075029    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d06bff3e-4273-4c12-bb5e-43000f758455-openshift-service-ca\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
Aug 04 23:06:52.075064 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:06:52.075056    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d06bff3e-4273-4c12-bb5e-43000f758455-maas-api-tls\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
Aug 04 23:06:52.075064 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:06:52.075066    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qnbb5\" (UniqueName: \"kubernetes.io/projected/d06bff3e-4273-4c12-bb5e-43000f758455-kube-api-access-qnbb5\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
Aug 04 23:06:52.102486 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:06:52.102398    2580 generic.go:356] "Generic (PLEG): container finished" podID="d06bff3e-4273-4c12-bb5e-43000f758455" containerID="08dd21b023f02e825b4407bbd474d7c17663493bd4ea8b14c3ef536fb4800a35" exitCode=0
Aug 04 23:06:52.102486 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:06:52.102443    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2d20db-95f574764-w4m8k"
Aug 04 23:06:52.102683 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:06:52.102484    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2d20db-95f574764-w4m8k" event={"ID":"d06bff3e-4273-4c12-bb5e-43000f758455","Type":"ContainerDied","Data":"08dd21b023f02e825b4407bbd474d7c17663493bd4ea8b14c3ef536fb4800a35"}
Aug 04 23:06:52.102683 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:06:52.102545    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2d20db-95f574764-w4m8k" event={"ID":"d06bff3e-4273-4c12-bb5e-43000f758455","Type":"ContainerDied","Data":"3c7f8c153905c57e415be67e4ccf86a536307667a11236ee0992035025419c09"}
Aug 04 23:06:52.102683 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:06:52.102573    2580 scope.go:117] "RemoveContainer" containerID="08dd21b023f02e825b4407bbd474d7c17663493bd4ea8b14c3ef536fb4800a35"
Aug 04 23:06:52.112972 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:06:52.112951    2580 scope.go:117] "RemoveContainer" containerID="08dd21b023f02e825b4407bbd474d7c17663493bd4ea8b14c3ef536fb4800a35"
Aug 04 23:06:52.113244 ip-10-0-137-117 kubenswrapper[2580]: E0804 23:06:52.113222    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"08dd21b023f02e825b4407bbd474d7c17663493bd4ea8b14c3ef536fb4800a35\": container with ID starting with 08dd21b023f02e825b4407bbd474d7c17663493bd4ea8b14c3ef536fb4800a35 not found: ID does not exist" containerID="08dd21b023f02e825b4407bbd474d7c17663493bd4ea8b14c3ef536fb4800a35"
Aug 04 23:06:52.113325 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:06:52.113257    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"08dd21b023f02e825b4407bbd474d7c17663493bd4ea8b14c3ef536fb4800a35"} err="failed to get container status \"08dd21b023f02e825b4407bbd474d7c17663493bd4ea8b14c3ef536fb4800a35\": rpc error: code = NotFound desc = could not find container \"08dd21b023f02e825b4407bbd474d7c17663493bd4ea8b14c3ef536fb4800a35\": container with ID starting with 08dd21b023f02e825b4407bbd474d7c17663493bd4ea8b14c3ef536fb4800a35 not found: ID does not exist"
Aug 04 23:06:52.130788 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:06:52.130758    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-2d20db-95f574764-w4m8k"]
Aug 04 23:06:52.134761 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:06:52.134738    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-2d20db-95f574764-w4m8k"]
Aug 04 23:06:53.499802 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:06:53.499765    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b0c66baf-f6c7-44b4-916e-45bf111b0918" path="/var/lib/kubelet/pods/b0c66baf-f6c7-44b4-916e-45bf111b0918/volumes"
Aug 04 23:06:53.500248 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:06:53.500233    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d06bff3e-4273-4c12-bb5e-43000f758455" path="/var/lib/kubelet/pods/d06bff3e-4273-4c12-bb5e-43000f758455/volumes"
Aug 04 23:06:53.696222 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:06:53.696190    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-595xm"]
Aug 04 23:06:59.210812 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:06:59.210772    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-8f0bc6-openshift-default-7958bb65db-kp9k9"]
Aug 04 23:06:59.211443 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:06:59.211424    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b0c66baf-f6c7-44b4-916e-45bf111b0918" containerName="revoke-keys"
Aug 04 23:06:59.211443 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:06:59.211445    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0c66baf-f6c7-44b4-916e-45bf111b0918" containerName="revoke-keys"
Aug 04 23:06:59.211554 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:06:59.211474    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="67efa195-8644-4145-af1b-fe19f2d7b83e" containerName="istio-proxy"
Aug 04 23:06:59.211554 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:06:59.211483    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="67efa195-8644-4145-af1b-fe19f2d7b83e" containerName="istio-proxy"
Aug 04 23:06:59.211554 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:06:59.211520    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d06bff3e-4273-4c12-bb5e-43000f758455" containerName="maas-api"
Aug 04 23:06:59.211554 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:06:59.211529    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="d06bff3e-4273-4c12-bb5e-43000f758455" containerName="maas-api"
Aug 04 23:06:59.211685 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:06:59.211618    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="67efa195-8644-4145-af1b-fe19f2d7b83e" containerName="istio-proxy"
Aug 04 23:06:59.211685 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:06:59.211631    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="67efa195-8644-4145-af1b-fe19f2d7b83e" containerName="istio-proxy"
Aug 04 23:06:59.211685 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:06:59.211642    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="b0c66baf-f6c7-44b4-916e-45bf111b0918" containerName="revoke-keys"
Aug 04 23:06:59.211685 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:06:59.211650    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="d06bff3e-4273-4c12-bb5e-43000f758455" containerName="maas-api"
Aug 04 23:06:59.216590 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:06:59.216569    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-8f0bc6-openshift-default-7958bb65db-kp9k9"
Aug 04 23:06:59.219872 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:06:59.219844    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-8f0bc6-openshift-default-dockercfg-wjc8l\""
Aug 04 23:06:59.225250 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:06:59.225226    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-8f0bc6-openshift-default-7958bb65db-kp9k9"]
Aug 04 23:06:59.342660 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:06:59.342621    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f00e0ed-23ee-4b3a-8184-0ddcc43f3ce2-workload-socket\") pod \"e2e-api-a-8f0bc6-openshift-default-7958bb65db-kp9k9\" (UID: \"4f00e0ed-23ee-4b3a-8184-0ddcc43f3ce2\") " pod="openshift-ingress/e2e-api-a-8f0bc6-openshift-default-7958bb65db-kp9k9"
Aug 04 23:06:59.342870 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:06:59.342841    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4f00e0ed-23ee-4b3a-8184-0ddcc43f3ce2-istio-data\") pod \"e2e-api-a-8f0bc6-openshift-default-7958bb65db-kp9k9\" (UID: \"4f00e0ed-23ee-4b3a-8184-0ddcc43f3ce2\") " pod="openshift-ingress/e2e-api-a-8f0bc6-openshift-default-7958bb65db-kp9k9"
Aug 04 23:06:59.342958 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:06:59.342918    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4f00e0ed-23ee-4b3a-8184-0ddcc43f3ce2-istio-token\") pod \"e2e-api-a-8f0bc6-openshift-default-7958bb65db-kp9k9\" (UID: \"4f00e0ed-23ee-4b3a-8184-0ddcc43f3ce2\") " pod="openshift-ingress/e2e-api-a-8f0bc6-openshift-default-7958bb65db-kp9k9"
Aug 04 23:06:59.343023 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:06:59.342974    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hz9ct\" (UniqueName: \"kubernetes.io/projected/4f00e0ed-23ee-4b3a-8184-0ddcc43f3ce2-kube-api-access-hz9ct\") pod \"e2e-api-a-8f0bc6-openshift-default-7958bb65db-kp9k9\" (UID: \"4f00e0ed-23ee-4b3a-8184-0ddcc43f3ce2\") " pod="openshift-ingress/e2e-api-a-8f0bc6-openshift-default-7958bb65db-kp9k9"
Aug 04 23:06:59.343156 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:06:59.343101    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f00e0ed-23ee-4b3a-8184-0ddcc43f3ce2-credential-socket\") pod \"e2e-api-a-8f0bc6-openshift-default-7958bb65db-kp9k9\" (UID: \"4f00e0ed-23ee-4b3a-8184-0ddcc43f3ce2\") " pod="openshift-ingress/e2e-api-a-8f0bc6-openshift-default-7958bb65db-kp9k9"
Aug 04 23:06:59.343239 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:06:59.343185    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4f00e0ed-23ee-4b3a-8184-0ddcc43f3ce2-istio-podinfo\") pod \"e2e-api-a-8f0bc6-openshift-default-7958bb65db-kp9k9\" (UID: \"4f00e0ed-23ee-4b3a-8184-0ddcc43f3ce2\") " pod="openshift-ingress/e2e-api-a-8f0bc6-openshift-default-7958bb65db-kp9k9"
Aug 04 23:06:59.343309 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:06:59.343238    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4f00e0ed-23ee-4b3a-8184-0ddcc43f3ce2-istiod-ca-cert\") pod \"e2e-api-a-8f0bc6-openshift-default-7958bb65db-kp9k9\" (UID: \"4f00e0ed-23ee-4b3a-8184-0ddcc43f3ce2\") " pod="openshift-ingress/e2e-api-a-8f0bc6-openshift-default-7958bb65db-kp9k9"
Aug 04 23:06:59.343434 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:06:59.343416    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4f00e0ed-23ee-4b3a-8184-0ddcc43f3ce2-workload-certs\") pod \"e2e-api-a-8f0bc6-openshift-default-7958bb65db-kp9k9\" (UID: \"4f00e0ed-23ee-4b3a-8184-0ddcc43f3ce2\") " pod="openshift-ingress/e2e-api-a-8f0bc6-openshift-default-7958bb65db-kp9k9"
Aug 04 23:06:59.343551 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:06:59.343535    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4f00e0ed-23ee-4b3a-8184-0ddcc43f3ce2-istio-envoy\") pod \"e2e-api-a-8f0bc6-openshift-default-7958bb65db-kp9k9\" (UID: \"4f00e0ed-23ee-4b3a-8184-0ddcc43f3ce2\") " pod="openshift-ingress/e2e-api-a-8f0bc6-openshift-default-7958bb65db-kp9k9"
Aug 04 23:06:59.444913 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:06:59.444869    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f00e0ed-23ee-4b3a-8184-0ddcc43f3ce2-credential-socket\") pod \"e2e-api-a-8f0bc6-openshift-default-7958bb65db-kp9k9\" (UID: \"4f00e0ed-23ee-4b3a-8184-0ddcc43f3ce2\") " pod="openshift-ingress/e2e-api-a-8f0bc6-openshift-default-7958bb65db-kp9k9"
Aug 04 23:06:59.444913 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:06:59.444909    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4f00e0ed-23ee-4b3a-8184-0ddcc43f3ce2-istio-podinfo\") pod \"e2e-api-a-8f0bc6-openshift-default-7958bb65db-kp9k9\" (UID: \"4f00e0ed-23ee-4b3a-8184-0ddcc43f3ce2\") " pod="openshift-ingress/e2e-api-a-8f0bc6-openshift-default-7958bb65db-kp9k9"
Aug 04 23:06:59.445186 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:06:59.444934    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4f00e0ed-23ee-4b3a-8184-0ddcc43f3ce2-istiod-ca-cert\") pod \"e2e-api-a-8f0bc6-openshift-default-7958bb65db-kp9k9\" (UID: \"4f00e0ed-23ee-4b3a-8184-0ddcc43f3ce2\") " pod="openshift-ingress/e2e-api-a-8f0bc6-openshift-default-7958bb65db-kp9k9"
Aug 04 23:06:59.445186 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:06:59.444980    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4f00e0ed-23ee-4b3a-8184-0ddcc43f3ce2-workload-certs\") pod \"e2e-api-a-8f0bc6-openshift-default-7958bb65db-kp9k9\" (UID: \"4f00e0ed-23ee-4b3a-8184-0ddcc43f3ce2\") " pod="openshift-ingress/e2e-api-a-8f0bc6-openshift-default-7958bb65db-kp9k9"
Aug 04 23:06:59.445186 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:06:59.445003    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4f00e0ed-23ee-4b3a-8184-0ddcc43f3ce2-istio-envoy\") pod \"e2e-api-a-8f0bc6-openshift-default-7958bb65db-kp9k9\" (UID: \"4f00e0ed-23ee-4b3a-8184-0ddcc43f3ce2\") " pod="openshift-ingress/e2e-api-a-8f0bc6-openshift-default-7958bb65db-kp9k9"
Aug 04 23:06:59.445186 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:06:59.445125    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f00e0ed-23ee-4b3a-8184-0ddcc43f3ce2-workload-socket\") pod \"e2e-api-a-8f0bc6-openshift-default-7958bb65db-kp9k9\" (UID: \"4f00e0ed-23ee-4b3a-8184-0ddcc43f3ce2\") " pod="openshift-ingress/e2e-api-a-8f0bc6-openshift-default-7958bb65db-kp9k9"
Aug 04 23:06:59.445432 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:06:59.445237    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4f00e0ed-23ee-4b3a-8184-0ddcc43f3ce2-istio-data\") pod \"e2e-api-a-8f0bc6-openshift-default-7958bb65db-kp9k9\" (UID: \"4f00e0ed-23ee-4b3a-8184-0ddcc43f3ce2\") " pod="openshift-ingress/e2e-api-a-8f0bc6-openshift-default-7958bb65db-kp9k9"
Aug 04 23:06:59.445432 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:06:59.445280    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4f00e0ed-23ee-4b3a-8184-0ddcc43f3ce2-istio-token\") pod \"e2e-api-a-8f0bc6-openshift-default-7958bb65db-kp9k9\" (UID: \"4f00e0ed-23ee-4b3a-8184-0ddcc43f3ce2\") " pod="openshift-ingress/e2e-api-a-8f0bc6-openshift-default-7958bb65db-kp9k9"
Aug 04 23:06:59.445432 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:06:59.445306    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hz9ct\" (UniqueName: \"kubernetes.io/projected/4f00e0ed-23ee-4b3a-8184-0ddcc43f3ce2-kube-api-access-hz9ct\") pod \"e2e-api-a-8f0bc6-openshift-default-7958bb65db-kp9k9\" (UID: \"4f00e0ed-23ee-4b3a-8184-0ddcc43f3ce2\") " pod="openshift-ingress/e2e-api-a-8f0bc6-openshift-default-7958bb65db-kp9k9"
Aug 04 23:06:59.445432 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:06:59.445339    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f00e0ed-23ee-4b3a-8184-0ddcc43f3ce2-credential-socket\") pod \"e2e-api-a-8f0bc6-openshift-default-7958bb65db-kp9k9\" (UID: \"4f00e0ed-23ee-4b3a-8184-0ddcc43f3ce2\") " pod="openshift-ingress/e2e-api-a-8f0bc6-openshift-default-7958bb65db-kp9k9"
Aug 04 23:06:59.445432 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:06:59.445404    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4f00e0ed-23ee-4b3a-8184-0ddcc43f3ce2-workload-certs\") pod \"e2e-api-a-8f0bc6-openshift-default-7958bb65db-kp9k9\" (UID: \"4f00e0ed-23ee-4b3a-8184-0ddcc43f3ce2\") " pod="openshift-ingress/e2e-api-a-8f0bc6-openshift-default-7958bb65db-kp9k9"
Aug 04 23:06:59.445694 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:06:59.445493    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f00e0ed-23ee-4b3a-8184-0ddcc43f3ce2-workload-socket\") pod \"e2e-api-a-8f0bc6-openshift-default-7958bb65db-kp9k9\" (UID: \"4f00e0ed-23ee-4b3a-8184-0ddcc43f3ce2\") " pod="openshift-ingress/e2e-api-a-8f0bc6-openshift-default-7958bb65db-kp9k9"
Aug 04 23:06:59.445694 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:06:59.445671    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4f00e0ed-23ee-4b3a-8184-0ddcc43f3ce2-istio-data\") pod \"e2e-api-a-8f0bc6-openshift-default-7958bb65db-kp9k9\" (UID: \"4f00e0ed-23ee-4b3a-8184-0ddcc43f3ce2\") " pod="openshift-ingress/e2e-api-a-8f0bc6-openshift-default-7958bb65db-kp9k9"
Aug 04 23:06:59.446108 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:06:59.446085    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4f00e0ed-23ee-4b3a-8184-0ddcc43f3ce2-istiod-ca-cert\") pod \"e2e-api-a-8f0bc6-openshift-default-7958bb65db-kp9k9\" (UID: \"4f00e0ed-23ee-4b3a-8184-0ddcc43f3ce2\") " pod="openshift-ingress/e2e-api-a-8f0bc6-openshift-default-7958bb65db-kp9k9"
Aug 04 23:06:59.447709 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:06:59.447687    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4f00e0ed-23ee-4b3a-8184-0ddcc43f3ce2-istio-envoy\") pod \"e2e-api-a-8f0bc6-openshift-default-7958bb65db-kp9k9\" (UID: \"4f00e0ed-23ee-4b3a-8184-0ddcc43f3ce2\") " pod="openshift-ingress/e2e-api-a-8f0bc6-openshift-default-7958bb65db-kp9k9"
Aug 04 23:06:59.447918 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:06:59.447900    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4f00e0ed-23ee-4b3a-8184-0ddcc43f3ce2-istio-podinfo\") pod \"e2e-api-a-8f0bc6-openshift-default-7958bb65db-kp9k9\" (UID: \"4f00e0ed-23ee-4b3a-8184-0ddcc43f3ce2\") " pod="openshift-ingress/e2e-api-a-8f0bc6-openshift-default-7958bb65db-kp9k9"
Aug 04 23:06:59.453740 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:06:59.453720    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4f00e0ed-23ee-4b3a-8184-0ddcc43f3ce2-istio-token\") pod \"e2e-api-a-8f0bc6-openshift-default-7958bb65db-kp9k9\" (UID: \"4f00e0ed-23ee-4b3a-8184-0ddcc43f3ce2\") " pod="openshift-ingress/e2e-api-a-8f0bc6-openshift-default-7958bb65db-kp9k9"
Aug 04 23:06:59.454157 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:06:59.454117    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hz9ct\" (UniqueName: \"kubernetes.io/projected/4f00e0ed-23ee-4b3a-8184-0ddcc43f3ce2-kube-api-access-hz9ct\") pod \"e2e-api-a-8f0bc6-openshift-default-7958bb65db-kp9k9\" (UID: \"4f00e0ed-23ee-4b3a-8184-0ddcc43f3ce2\") " pod="openshift-ingress/e2e-api-a-8f0bc6-openshift-default-7958bb65db-kp9k9"
Aug 04 23:06:59.529869 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:06:59.529812    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-8f0bc6-openshift-default-7958bb65db-kp9k9"
Aug 04 23:06:59.682437 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:06:59.682403    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-8f0bc6-openshift-default-7958bb65db-kp9k9"]
Aug 04 23:06:59.685485 ip-10-0-137-117 kubenswrapper[2580]: W0804 23:06:59.685455    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f00e0ed_23ee_4b3a_8184_0ddcc43f3ce2.slice/crio-cce655cedf5f9ef1756259925587d830d6bc86a13d7d0ac91a3912d1552ed1b3 WatchSource:0}: Error finding container cce655cedf5f9ef1756259925587d830d6bc86a13d7d0ac91a3912d1552ed1b3: Status 404 returned error can't find the container with id cce655cedf5f9ef1756259925587d830d6bc86a13d7d0ac91a3912d1552ed1b3
Aug 04 23:06:59.687711 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:06:59.687675    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 23:06:59.687804 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:06:59.687755    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 23:06:59.687872 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:06:59.687803    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 23:07:00.160729 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:07:00.160697    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-8f0bc6-openshift-default-7958bb65db-kp9k9" event={"ID":"4f00e0ed-23ee-4b3a-8184-0ddcc43f3ce2","Type":"ContainerStarted","Data":"0b3b4b1d4f1f19894158c06047f427211689ae29d4fa3e6e4ad49bdb46123d5f"}
Aug 04 23:07:00.160897 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:07:00.160749    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-8f0bc6-openshift-default-7958bb65db-kp9k9" event={"ID":"4f00e0ed-23ee-4b3a-8184-0ddcc43f3ce2","Type":"ContainerStarted","Data":"cce655cedf5f9ef1756259925587d830d6bc86a13d7d0ac91a3912d1552ed1b3"}
Aug 04 23:07:00.183482 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:07:00.183429    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-8f0bc6-openshift-default-7958bb65db-kp9k9" podStartSLOduration=1.183414199 podStartE2EDuration="1.183414199s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 23:06:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 23:07:00.180778394 +0000 UTC m=+2767.173596122" watchObservedRunningTime="2026-08-04 23:07:00.183414199 +0000 UTC m=+2767.176231927"
Aug 04 23:07:00.530471 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:07:00.530392    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-8f0bc6-openshift-default-7958bb65db-kp9k9"
Aug 04 23:07:00.535613 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:07:00.535589    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-8f0bc6-openshift-default-7958bb65db-kp9k9"
Aug 04 23:07:01.166465 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:07:01.166431    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-8f0bc6-openshift-default-7958bb65db-kp9k9"
Aug 04 23:07:01.167292 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:07:01.167270    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-8f0bc6-openshift-default-7958bb65db-kp9k9"
Aug 04 23:07:05.801182 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:07:05.801120    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-595xm"]
Aug 04 23:07:16.167681 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:07:16.167644    2580 patch_prober.go:28] interesting pod/e2e-api-a-8f0bc6-openshift-default-7958bb65db-kp9k9 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body=
Aug 04 23:07:16.168103 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:07:16.167700    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-8f0bc6-openshift-default-7958bb65db-kp9k9" podUID="4f00e0ed-23ee-4b3a-8184-0ddcc43f3ce2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused"
Aug 04 23:07:16.275990 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:07:16.275959    2580 generic.go:356] "Generic (PLEG): container finished" podID="4f00e0ed-23ee-4b3a-8184-0ddcc43f3ce2" containerID="0b3b4b1d4f1f19894158c06047f427211689ae29d4fa3e6e4ad49bdb46123d5f" exitCode=0
Aug 04 23:07:16.276198 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:07:16.276033    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-8f0bc6-openshift-default-7958bb65db-kp9k9" event={"ID":"4f00e0ed-23ee-4b3a-8184-0ddcc43f3ce2","Type":"ContainerDied","Data":"0b3b4b1d4f1f19894158c06047f427211689ae29d4fa3e6e4ad49bdb46123d5f"}
Aug 04 23:07:16.276488 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:07:16.276471    2580 scope.go:117] "RemoveContainer" containerID="0b3b4b1d4f1f19894158c06047f427211689ae29d4fa3e6e4ad49bdb46123d5f"
Aug 04 23:07:16.277561 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:07:16.277525    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 23:07:16.277640 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:07:16.277620    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 23:07:16.277684 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:07:16.277657    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 23:07:17.284059 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:07:17.284022    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-8f0bc6-openshift-default-7958bb65db-kp9k9" event={"ID":"4f00e0ed-23ee-4b3a-8184-0ddcc43f3ce2","Type":"ContainerStarted","Data":"3aba8dada97e66e680689d054d716230699440bfd3a88dfe8fbf3bf19833125d"}
Aug 04 23:07:17.530374 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:07:17.530335    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-8f0bc6-openshift-default-7958bb65db-kp9k9"
Aug 04 23:07:17.530579 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:07:17.530557    2580 patch_prober.go:28] interesting pod/e2e-api-a-8f0bc6-openshift-default-7958bb65db-kp9k9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body=
Aug 04 23:07:17.530630 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:07:17.530616    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-8f0bc6-openshift-default-7958bb65db-kp9k9" podUID="4f00e0ed-23ee-4b3a-8184-0ddcc43f3ce2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused"
Aug 04 23:07:18.530743 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:07:18.530704    2580 patch_prober.go:28] interesting pod/e2e-api-a-8f0bc6-openshift-default-7958bb65db-kp9k9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body=
Aug 04 23:07:18.531199 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:07:18.530761    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-8f0bc6-openshift-default-7958bb65db-kp9k9" podUID="4f00e0ed-23ee-4b3a-8184-0ddcc43f3ce2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused"
Aug 04 23:07:19.530483 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:07:19.530447    2580 patch_prober.go:28] interesting pod/e2e-api-a-8f0bc6-openshift-default-7958bb65db-kp9k9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body=
Aug 04 23:07:19.530657 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:07:19.530497    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-8f0bc6-openshift-default-7958bb65db-kp9k9" podUID="4f00e0ed-23ee-4b3a-8184-0ddcc43f3ce2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused"
Aug 04 23:07:20.530103 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:07:20.530064    2580 patch_prober.go:28] interesting pod/e2e-api-a-8f0bc6-openshift-default-7958bb65db-kp9k9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body=
Aug 04 23:07:20.530513 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:07:20.530124    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-8f0bc6-openshift-default-7958bb65db-kp9k9" podUID="4f00e0ed-23ee-4b3a-8184-0ddcc43f3ce2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused"
Aug 04 23:07:21.530562 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:07:21.530523    2580 patch_prober.go:28] interesting pod/e2e-api-a-8f0bc6-openshift-default-7958bb65db-kp9k9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body=
Aug 04 23:07:21.530966 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:07:21.530585    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-8f0bc6-openshift-default-7958bb65db-kp9k9" podUID="4f00e0ed-23ee-4b3a-8184-0ddcc43f3ce2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused"
Aug 04 23:07:22.534340 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:07:22.534306    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-8f0bc6-openshift-default-7958bb65db-kp9k9"
Aug 04 23:07:22.534748 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:07:22.534561    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-8f0bc6-openshift-default-7958bb65db-kp9k9"
Aug 04 23:07:22.535205 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:07:22.535186    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-8f0bc6-openshift-default-7958bb65db-kp9k9"
Aug 04 23:07:32.344049 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:07:32.344005    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-25c344-cdb6b868-6gztm"]
Aug 04 23:07:32.344518 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:07:32.344502    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="67efa195-8644-4145-af1b-fe19f2d7b83e" containerName="istio-proxy"
Aug 04 23:07:32.344574 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:07:32.344520    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="67efa195-8644-4145-af1b-fe19f2d7b83e" containerName="istio-proxy"
Aug 04 23:07:32.356242 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:07:32.354850    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-25c344-cdb6b868-6gztm"
Aug 04 23:07:32.358338 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:07:32.358315    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-qqbsd\""
Aug 04 23:07:32.359008 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:07:32.358986    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-25c344-serving-cert\""
Aug 04 23:07:32.359572 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:07:32.359552    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Aug 04 23:07:32.366351 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:07:32.366325    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Aug 04 23:07:32.374352 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:07:32.374317    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-25c344-cdb6b868-6gztm"]
Aug 04 23:07:32.464266 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:07:32.464225    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1a589567-a877-4b86-b8e7-1178039df91b-openshift-service-ca\") pod \"maas-api-e2e-api-b-25c344-cdb6b868-6gztm\" (UID: \"1a589567-a877-4b86-b8e7-1178039df91b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-25c344-cdb6b868-6gztm"
Aug 04 23:07:32.464440 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:07:32.464290    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1a589567-a877-4b86-b8e7-1178039df91b-maas-api-tls\") pod \"maas-api-e2e-api-b-25c344-cdb6b868-6gztm\" (UID: \"1a589567-a877-4b86-b8e7-1178039df91b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-25c344-cdb6b868-6gztm"
Aug 04 23:07:32.464440 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:07:32.464344    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sj8ps\" (UniqueName: \"kubernetes.io/projected/1a589567-a877-4b86-b8e7-1178039df91b-kube-api-access-sj8ps\") pod \"maas-api-e2e-api-b-25c344-cdb6b868-6gztm\" (UID: \"1a589567-a877-4b86-b8e7-1178039df91b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-25c344-cdb6b868-6gztm"
Aug 04 23:07:32.565487 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:07:32.565446    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sj8ps\" (UniqueName: \"kubernetes.io/projected/1a589567-a877-4b86-b8e7-1178039df91b-kube-api-access-sj8ps\") pod \"maas-api-e2e-api-b-25c344-cdb6b868-6gztm\" (UID: \"1a589567-a877-4b86-b8e7-1178039df91b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-25c344-cdb6b868-6gztm"
Aug 04 23:07:32.565687 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:07:32.565603    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1a589567-a877-4b86-b8e7-1178039df91b-openshift-service-ca\") pod \"maas-api-e2e-api-b-25c344-cdb6b868-6gztm\" (UID: \"1a589567-a877-4b86-b8e7-1178039df91b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-25c344-cdb6b868-6gztm"
Aug 04 23:07:32.565761 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:07:32.565693    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1a589567-a877-4b86-b8e7-1178039df91b-maas-api-tls\") pod \"maas-api-e2e-api-b-25c344-cdb6b868-6gztm\" (UID: \"1a589567-a877-4b86-b8e7-1178039df91b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-25c344-cdb6b868-6gztm"
Aug 04 23:07:32.566322 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:07:32.566298    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1a589567-a877-4b86-b8e7-1178039df91b-openshift-service-ca\") pod \"maas-api-e2e-api-b-25c344-cdb6b868-6gztm\" (UID: \"1a589567-a877-4b86-b8e7-1178039df91b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-25c344-cdb6b868-6gztm"
Aug 04 23:07:32.568190 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:07:32.568167    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1a589567-a877-4b86-b8e7-1178039df91b-maas-api-tls\") pod \"maas-api-e2e-api-b-25c344-cdb6b868-6gztm\" (UID: \"1a589567-a877-4b86-b8e7-1178039df91b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-25c344-cdb6b868-6gztm"
Aug 04 23:07:32.573849 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:07:32.573823    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sj8ps\" (UniqueName: \"kubernetes.io/projected/1a589567-a877-4b86-b8e7-1178039df91b-kube-api-access-sj8ps\") pod \"maas-api-e2e-api-b-25c344-cdb6b868-6gztm\" (UID: \"1a589567-a877-4b86-b8e7-1178039df91b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-25c344-cdb6b868-6gztm"
Aug 04 23:07:32.681339 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:07:32.681247    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-25c344-cdb6b868-6gztm"
Aug 04 23:07:32.829921 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:07:32.829862    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-25c344-cdb6b868-6gztm"]
Aug 04 23:07:32.831998 ip-10-0-137-117 kubenswrapper[2580]: W0804 23:07:32.831969    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a589567_a877_4b86_b8e7_1178039df91b.slice/crio-52240c3a70b54ae1d3a411b2fe8bedf6937cdac86ee65fd209f4550db36a677d WatchSource:0}: Error finding container 52240c3a70b54ae1d3a411b2fe8bedf6937cdac86ee65fd209f4550db36a677d: Status 404 returned error can't find the container with id 52240c3a70b54ae1d3a411b2fe8bedf6937cdac86ee65fd209f4550db36a677d
Aug 04 23:07:33.000067 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:07:32.999971    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-25c344-6b7ccd47bd-5kf5r"]
Aug 04 23:07:33.003530 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:07:33.003504    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-25c344-6b7ccd47bd-5kf5r"
Aug 04 23:07:33.006314 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:07:33.006287    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-25c344\""
Aug 04 23:07:33.006442 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:07:33.006287    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-b-25c344-dockercfg-x86vm\""
Aug 04 23:07:33.022207 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:07:33.022172    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-25c344-6b7ccd47bd-5kf5r"]
Aug 04 23:07:33.070360 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:07:33.070324    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tlhhs\" (UniqueName: \"kubernetes.io/projected/079c32c5-09da-4eff-b22c-aad740c8d99b-kube-api-access-tlhhs\") pod \"payload-processing-e2e-api-b-25c344-6b7ccd47bd-5kf5r\" (UID: \"079c32c5-09da-4eff-b22c-aad740c8d99b\") " pod="openshift-ingress/payload-processing-e2e-api-b-25c344-6b7ccd47bd-5kf5r"
Aug 04 23:07:33.070537 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:07:33.070470    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/079c32c5-09da-4eff-b22c-aad740c8d99b-plugins-config-volume\") pod \"payload-processing-e2e-api-b-25c344-6b7ccd47bd-5kf5r\" (UID: \"079c32c5-09da-4eff-b22c-aad740c8d99b\") " pod="openshift-ingress/payload-processing-e2e-api-b-25c344-6b7ccd47bd-5kf5r"
Aug 04 23:07:33.171616 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:07:33.171575    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/079c32c5-09da-4eff-b22c-aad740c8d99b-plugins-config-volume\") pod \"payload-processing-e2e-api-b-25c344-6b7ccd47bd-5kf5r\" (UID: \"079c32c5-09da-4eff-b22c-aad740c8d99b\") " pod="openshift-ingress/payload-processing-e2e-api-b-25c344-6b7ccd47bd-5kf5r"
Aug 04 23:07:33.171819 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:07:33.171630    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tlhhs\" (UniqueName: \"kubernetes.io/projected/079c32c5-09da-4eff-b22c-aad740c8d99b-kube-api-access-tlhhs\") pod \"payload-processing-e2e-api-b-25c344-6b7ccd47bd-5kf5r\" (UID: \"079c32c5-09da-4eff-b22c-aad740c8d99b\") " pod="openshift-ingress/payload-processing-e2e-api-b-25c344-6b7ccd47bd-5kf5r"
Aug 04 23:07:33.172409 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:07:33.172389    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/079c32c5-09da-4eff-b22c-aad740c8d99b-plugins-config-volume\") pod \"payload-processing-e2e-api-b-25c344-6b7ccd47bd-5kf5r\" (UID: \"079c32c5-09da-4eff-b22c-aad740c8d99b\") " pod="openshift-ingress/payload-processing-e2e-api-b-25c344-6b7ccd47bd-5kf5r"
Aug 04 23:07:33.189778 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:07:33.189751    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tlhhs\" (UniqueName: \"kubernetes.io/projected/079c32c5-09da-4eff-b22c-aad740c8d99b-kube-api-access-tlhhs\") pod \"payload-processing-e2e-api-b-25c344-6b7ccd47bd-5kf5r\" (UID: \"079c32c5-09da-4eff-b22c-aad740c8d99b\") " pod="openshift-ingress/payload-processing-e2e-api-b-25c344-6b7ccd47bd-5kf5r"
Aug 04 23:07:33.315076 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:07:33.315036    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-25c344-6b7ccd47bd-5kf5r"
Aug 04 23:07:33.390486 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:07:33.390449    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-25c344-cdb6b868-6gztm" event={"ID":"1a589567-a877-4b86-b8e7-1178039df91b","Type":"ContainerStarted","Data":"6eb2253468e70132b9e694d09aceeb7f58a305977b3431baa3ae65bab1f9ab07"}
Aug 04 23:07:33.390859 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:07:33.390515    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-25c344-cdb6b868-6gztm" event={"ID":"1a589567-a877-4b86-b8e7-1178039df91b","Type":"ContainerStarted","Data":"52240c3a70b54ae1d3a411b2fe8bedf6937cdac86ee65fd209f4550db36a677d"}
Aug 04 23:07:33.390859 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:07:33.390546    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-25c344-cdb6b868-6gztm"
Aug 04 23:07:33.409535 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:07:33.409473    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-25c344-cdb6b868-6gztm" podStartSLOduration=1.00282822 podStartE2EDuration="1.40945073s" totalImagesPullingTime="406.62251ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 23:07:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 23:07:33.40729608 +0000 UTC m=+2800.400113832" watchObservedRunningTime="2026-08-04 23:07:33.40945073 +0000 UTC m=+2800.402268459"
Aug 04 23:07:33.468035 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:07:33.468004    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-25c344-6b7ccd47bd-5kf5r"]
Aug 04 23:07:33.470520 ip-10-0-137-117 kubenswrapper[2580]: W0804 23:07:33.470490    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod079c32c5_09da_4eff_b22c_aad740c8d99b.slice/crio-242bc3b298beac647dfa1abe7d8d758dea9a88dfe48f0c5ac44ca9abcf7f4065 WatchSource:0}: Error finding container 242bc3b298beac647dfa1abe7d8d758dea9a88dfe48f0c5ac44ca9abcf7f4065: Status 404 returned error can't find the container with id 242bc3b298beac647dfa1abe7d8d758dea9a88dfe48f0c5ac44ca9abcf7f4065
Aug 04 23:07:34.402295 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:07:34.402254    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-25c344-6b7ccd47bd-5kf5r" event={"ID":"079c32c5-09da-4eff-b22c-aad740c8d99b","Type":"ContainerStarted","Data":"1957aca121fda4f76906a2bf524137a04f4b6cd47f1f93e9ce568bea99947121"}
Aug 04 23:07:34.402717 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:07:34.402315    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-25c344-6b7ccd47bd-5kf5r" event={"ID":"079c32c5-09da-4eff-b22c-aad740c8d99b","Type":"ContainerStarted","Data":"242bc3b298beac647dfa1abe7d8d758dea9a88dfe48f0c5ac44ca9abcf7f4065"}
Aug 04 23:07:34.402717 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:07:34.402407    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-b-25c344-6b7ccd47bd-5kf5r"
Aug 04 23:07:34.417968 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:07:34.417912    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-b-25c344-6b7ccd47bd-5kf5r" podStartSLOduration=2.417895582 podStartE2EDuration="2.417895582s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 23:07:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 23:07:34.416359297 +0000 UTC m=+2801.409177025" watchObservedRunningTime="2026-08-04 23:07:34.417895582 +0000 UTC m=+2801.410713309"
Aug 04 23:07:35.906187 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:07:35.906149    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-595xm"]
Aug 04 23:07:39.407977 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:07:39.407942    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-25c344-cdb6b868-6gztm"
Aug 04 23:07:45.410802 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:07:45.410767    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-b-25c344-6b7ccd47bd-5kf5r"
Aug 04 23:07:53.881948 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:07:53.881907    2580 scope.go:117] "RemoveContainer" containerID="30eb8ea53207145a201171de196cb7f01b1c82fde7b8aa7ddb8e4094cddbd08f"
Aug 04 23:07:59.175233 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:07:59.175183    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-8f0bc6-w4m9m"]
Aug 04 23:07:59.179004 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:07:59.178981    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-8f0bc6-w4m9m"
Aug 04 23:07:59.181316 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:07:59.181293    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-vvngh\""
Aug 04 23:07:59.186399 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:07:59.186373    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-8f0bc6-w4m9m"]
Aug 04 23:07:59.322559 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:07:59.322513    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9bc84275-bb33-40ba-8861-96d0b3a9b1d3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-8f0bc6-w4m9m\" (UID: \"9bc84275-bb33-40ba-8861-96d0b3a9b1d3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-8f0bc6-w4m9m"
Aug 04 23:07:59.423084 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:07:59.423047    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9bc84275-bb33-40ba-8861-96d0b3a9b1d3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-8f0bc6-w4m9m\" (UID: \"9bc84275-bb33-40ba-8861-96d0b3a9b1d3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-8f0bc6-w4m9m"
Aug 04 23:07:59.423670 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:07:59.423642    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9bc84275-bb33-40ba-8861-96d0b3a9b1d3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-8f0bc6-w4m9m\" (UID: \"9bc84275-bb33-40ba-8861-96d0b3a9b1d3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-8f0bc6-w4m9m"
Aug 04 23:07:59.491783 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:07:59.491707    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-8f0bc6-w4m9m"
Aug 04 23:07:59.631824 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:07:59.631788    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-8f0bc6-w4m9m"]
Aug 04 23:07:59.633083 ip-10-0-137-117 kubenswrapper[2580]: W0804 23:07:59.633056    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9bc84275_bb33_40ba_8861_96d0b3a9b1d3.slice/crio-8fa6f092f5f95d54b19e6745232c63cded34e13cabc96608c99d11c52c2920f9 WatchSource:0}: Error finding container 8fa6f092f5f95d54b19e6745232c63cded34e13cabc96608c99d11c52c2920f9: Status 404 returned error can't find the container with id 8fa6f092f5f95d54b19e6745232c63cded34e13cabc96608c99d11c52c2920f9
Aug 04 23:08:00.577350 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:00.577317    2580 generic.go:356] "Generic (PLEG): container finished" podID="9bc84275-bb33-40ba-8861-96d0b3a9b1d3" containerID="a3df643adb7139a32eb51a9999ecb6364eae1afb02b912f0fa91f138947abea6" exitCode=0
Aug 04 23:08:00.577836 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:00.577398    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-8f0bc6-w4m9m" event={"ID":"9bc84275-bb33-40ba-8861-96d0b3a9b1d3","Type":"ContainerDied","Data":"a3df643adb7139a32eb51a9999ecb6364eae1afb02b912f0fa91f138947abea6"}
Aug 04 23:08:00.577836 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:00.577458    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-8f0bc6-w4m9m" event={"ID":"9bc84275-bb33-40ba-8861-96d0b3a9b1d3","Type":"ContainerStarted","Data":"8fa6f092f5f95d54b19e6745232c63cded34e13cabc96608c99d11c52c2920f9"}
Aug 04 23:08:01.725393 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:01.725352    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-8f0bc6-w4m9m"
Aug 04 23:08:01.845994 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:01.845898    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9bc84275-bb33-40ba-8861-96d0b3a9b1d3-maas-api-service-ca\") pod \"9bc84275-bb33-40ba-8861-96d0b3a9b1d3\" (UID: \"9bc84275-bb33-40ba-8861-96d0b3a9b1d3\") "
Aug 04 23:08:01.846410 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:01.846383    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9bc84275-bb33-40ba-8861-96d0b3a9b1d3-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "9bc84275-bb33-40ba-8861-96d0b3a9b1d3" (UID: "9bc84275-bb33-40ba-8861-96d0b3a9b1d3"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 23:08:01.946571 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:01.946540    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9bc84275-bb33-40ba-8861-96d0b3a9b1d3-maas-api-service-ca\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
Aug 04 23:08:02.591803 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:02.591775    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-8f0bc6-w4m9m"
Aug 04 23:08:02.591995 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:02.591773    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-8f0bc6-w4m9m" event={"ID":"9bc84275-bb33-40ba-8861-96d0b3a9b1d3","Type":"ContainerDied","Data":"8fa6f092f5f95d54b19e6745232c63cded34e13cabc96608c99d11c52c2920f9"}
Aug 04 23:08:02.591995 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:02.591914    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8fa6f092f5f95d54b19e6745232c63cded34e13cabc96608c99d11c52c2920f9"
Aug 04 23:08:15.102892 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:15.102859    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-8f0bc6-w4m9m"]
Aug 04 23:08:15.106439 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:15.106409    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-8f0bc6-w4m9m"]
Aug 04 23:08:15.499641 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:15.499555    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9bc84275-bb33-40ba-8861-96d0b3a9b1d3" path="/var/lib/kubelet/pods/9bc84275-bb33-40ba-8861-96d0b3a9b1d3/volumes"
Aug 04 23:08:16.600645 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:16.600602    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-595xm"]
Aug 04 23:08:21.446150 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:21.446099    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-8f0bc6-openshift-default-7958bb65db-kp9k9"]
Aug 04 23:08:21.446550 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:21.446400    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-8f0bc6-openshift-default-7958bb65db-kp9k9" podUID="4f00e0ed-23ee-4b3a-8184-0ddcc43f3ce2" containerName="istio-proxy" containerID="cri-o://3aba8dada97e66e680689d054d716230699440bfd3a88dfe8fbf3bf19833125d" gracePeriod=30
Aug 04 23:08:21.827264 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:21.827227    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-25c344-s9z65"]
Aug 04 23:08:21.827769 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:21.827749    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9bc84275-bb33-40ba-8861-96d0b3a9b1d3" containerName="revoke-keys"
Aug 04 23:08:21.827867 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:21.827771    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="9bc84275-bb33-40ba-8861-96d0b3a9b1d3" containerName="revoke-keys"
Aug 04 23:08:21.827922 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:21.827883    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="9bc84275-bb33-40ba-8861-96d0b3a9b1d3" containerName="revoke-keys"
Aug 04 23:08:21.832426 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:21.832406    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-25c344-s9z65"
Aug 04 23:08:21.834767 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:21.834746    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-vvngh\""
Aug 04 23:08:21.842689 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:21.842666    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-25c344-s9z65"]
Aug 04 23:08:21.924855 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:21.924812    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/26d4ce2c-015b-4a7a-8596-a9b941cb91e4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-25c344-s9z65\" (UID: \"26d4ce2c-015b-4a7a-8596-a9b941cb91e4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-25c344-s9z65"
Aug 04 23:08:22.026246 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:22.026211    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/26d4ce2c-015b-4a7a-8596-a9b941cb91e4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-25c344-s9z65\" (UID: \"26d4ce2c-015b-4a7a-8596-a9b941cb91e4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-25c344-s9z65"
Aug 04 23:08:22.026799 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:22.026779    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/26d4ce2c-015b-4a7a-8596-a9b941cb91e4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-25c344-s9z65\" (UID: \"26d4ce2c-015b-4a7a-8596-a9b941cb91e4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-25c344-s9z65"
Aug 04 23:08:22.148676 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:22.148594    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-25c344-s9z65"
Aug 04 23:08:22.492749 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:22.492725    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-25c344-s9z65"]
Aug 04 23:08:22.495360 ip-10-0-137-117 kubenswrapper[2580]: W0804 23:08:22.495333    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26d4ce2c_015b_4a7a_8596_a9b941cb91e4.slice/crio-0f877f76d3d84f10b7c554ce5e5b769dfc45693d8171ed7f1cfb3260d2a5fe17 WatchSource:0}: Error finding container 0f877f76d3d84f10b7c554ce5e5b769dfc45693d8171ed7f1cfb3260d2a5fe17: Status 404 returned error can't find the container with id 0f877f76d3d84f10b7c554ce5e5b769dfc45693d8171ed7f1cfb3260d2a5fe17
Aug 04 23:08:22.536545 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:22.536518    2580 patch_prober.go:28] interesting pod/e2e-api-a-8f0bc6-openshift-default-7958bb65db-kp9k9 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused
Aug 04 23:08:22.536642 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:22.536565    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-8f0bc6-openshift-default-7958bb65db-kp9k9" podUID="4f00e0ed-23ee-4b3a-8184-0ddcc43f3ce2" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Aug 04 23:08:22.725208 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:22.725169    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-25c344-s9z65" event={"ID":"26d4ce2c-015b-4a7a-8596-a9b941cb91e4","Type":"ContainerStarted","Data":"0f877f76d3d84f10b7c554ce5e5b769dfc45693d8171ed7f1cfb3260d2a5fe17"}
Aug 04 23:08:23.732911 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:23.732817    2580 generic.go:356] "Generic (PLEG): container finished" podID="26d4ce2c-015b-4a7a-8596-a9b941cb91e4" containerID="7e790d2600e3509875b36a02dd75022e6d8007f705dfda3f95b40cd76f40ecc5" exitCode=0
Aug 04 23:08:23.733338 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:23.732919    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-25c344-s9z65" event={"ID":"26d4ce2c-015b-4a7a-8596-a9b941cb91e4","Type":"ContainerDied","Data":"7e790d2600e3509875b36a02dd75022e6d8007f705dfda3f95b40cd76f40ecc5"}
Aug 04 23:08:24.874082 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:24.874057    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-25c344-s9z65"
Aug 04 23:08:24.954052 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:24.954023    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/26d4ce2c-015b-4a7a-8596-a9b941cb91e4-maas-api-service-ca\") pod \"26d4ce2c-015b-4a7a-8596-a9b941cb91e4\" (UID: \"26d4ce2c-015b-4a7a-8596-a9b941cb91e4\") "
Aug 04 23:08:24.954411 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:24.954388    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/26d4ce2c-015b-4a7a-8596-a9b941cb91e4-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "26d4ce2c-015b-4a7a-8596-a9b941cb91e4" (UID: "26d4ce2c-015b-4a7a-8596-a9b941cb91e4"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 23:08:25.055237 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:25.055212    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/26d4ce2c-015b-4a7a-8596-a9b941cb91e4-maas-api-service-ca\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
Aug 04 23:08:25.745740 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:25.745712    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-25c344-s9z65"
Aug 04 23:08:25.745932 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:25.745752    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-25c344-s9z65" event={"ID":"26d4ce2c-015b-4a7a-8596-a9b941cb91e4","Type":"ContainerDied","Data":"0f877f76d3d84f10b7c554ce5e5b769dfc45693d8171ed7f1cfb3260d2a5fe17"}
Aug 04 23:08:25.745932 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:25.745800    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0f877f76d3d84f10b7c554ce5e5b769dfc45693d8171ed7f1cfb3260d2a5fe17"
Aug 04 23:08:26.708318 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:26.708296    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-8f0bc6-openshift-default-7958bb65db-kp9k9"
Aug 04 23:08:26.754482 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:26.754409    2580 generic.go:356] "Generic (PLEG): container finished" podID="4f00e0ed-23ee-4b3a-8184-0ddcc43f3ce2" containerID="3aba8dada97e66e680689d054d716230699440bfd3a88dfe8fbf3bf19833125d" exitCode=0
Aug 04 23:08:26.754482 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:26.754461    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-8f0bc6-openshift-default-7958bb65db-kp9k9"
Aug 04 23:08:26.754641 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:26.754497    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-8f0bc6-openshift-default-7958bb65db-kp9k9" event={"ID":"4f00e0ed-23ee-4b3a-8184-0ddcc43f3ce2","Type":"ContainerDied","Data":"3aba8dada97e66e680689d054d716230699440bfd3a88dfe8fbf3bf19833125d"}
Aug 04 23:08:26.754641 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:26.754557    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-8f0bc6-openshift-default-7958bb65db-kp9k9" event={"ID":"4f00e0ed-23ee-4b3a-8184-0ddcc43f3ce2","Type":"ContainerDied","Data":"cce655cedf5f9ef1756259925587d830d6bc86a13d7d0ac91a3912d1552ed1b3"}
Aug 04 23:08:26.754641 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:26.754586    2580 scope.go:117] "RemoveContainer" containerID="3aba8dada97e66e680689d054d716230699440bfd3a88dfe8fbf3bf19833125d"
Aug 04 23:08:26.763795 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:26.763776    2580 scope.go:117] "RemoveContainer" containerID="0b3b4b1d4f1f19894158c06047f427211689ae29d4fa3e6e4ad49bdb46123d5f"
Aug 04 23:08:26.772037 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:26.772013    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f00e0ed-23ee-4b3a-8184-0ddcc43f3ce2-workload-socket\") pod \"4f00e0ed-23ee-4b3a-8184-0ddcc43f3ce2\" (UID: \"4f00e0ed-23ee-4b3a-8184-0ddcc43f3ce2\") "
Aug 04 23:08:26.772123 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:26.772059    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4f00e0ed-23ee-4b3a-8184-0ddcc43f3ce2-istio-envoy\") pod \"4f00e0ed-23ee-4b3a-8184-0ddcc43f3ce2\" (UID: \"4f00e0ed-23ee-4b3a-8184-0ddcc43f3ce2\") "
Aug 04 23:08:26.772123 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:26.772086    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4f00e0ed-23ee-4b3a-8184-0ddcc43f3ce2-istio-token\") pod \"4f00e0ed-23ee-4b3a-8184-0ddcc43f3ce2\" (UID: \"4f00e0ed-23ee-4b3a-8184-0ddcc43f3ce2\") "
Aug 04 23:08:26.772323 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:26.772233    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4f00e0ed-23ee-4b3a-8184-0ddcc43f3ce2-istio-podinfo\") pod \"4f00e0ed-23ee-4b3a-8184-0ddcc43f3ce2\" (UID: \"4f00e0ed-23ee-4b3a-8184-0ddcc43f3ce2\") "
Aug 04 23:08:26.772323 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:26.772274    2580 scope.go:117] "RemoveContainer" containerID="3aba8dada97e66e680689d054d716230699440bfd3a88dfe8fbf3bf19833125d"
Aug 04 23:08:26.772323 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:26.772286    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f00e0ed-23ee-4b3a-8184-0ddcc43f3ce2-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "4f00e0ed-23ee-4b3a-8184-0ddcc43f3ce2" (UID: "4f00e0ed-23ee-4b3a-8184-0ddcc43f3ce2"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 23:08:26.772633 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:26.772264    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4f00e0ed-23ee-4b3a-8184-0ddcc43f3ce2-istiod-ca-cert\") pod \"4f00e0ed-23ee-4b3a-8184-0ddcc43f3ce2\" (UID: \"4f00e0ed-23ee-4b3a-8184-0ddcc43f3ce2\") "
Aug 04 23:08:26.772720 ip-10-0-137-117 kubenswrapper[2580]: E0804 23:08:26.772627    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3aba8dada97e66e680689d054d716230699440bfd3a88dfe8fbf3bf19833125d\": container with ID starting with 3aba8dada97e66e680689d054d716230699440bfd3a88dfe8fbf3bf19833125d not found: ID does not exist" containerID="3aba8dada97e66e680689d054d716230699440bfd3a88dfe8fbf3bf19833125d"
Aug 04 23:08:26.772720 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:26.772665    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hz9ct\" (UniqueName: \"kubernetes.io/projected/4f00e0ed-23ee-4b3a-8184-0ddcc43f3ce2-kube-api-access-hz9ct\") pod \"4f00e0ed-23ee-4b3a-8184-0ddcc43f3ce2\" (UID: \"4f00e0ed-23ee-4b3a-8184-0ddcc43f3ce2\") "
Aug 04 23:08:26.772720 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:26.772668    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3aba8dada97e66e680689d054d716230699440bfd3a88dfe8fbf3bf19833125d"} err="failed to get container status \"3aba8dada97e66e680689d054d716230699440bfd3a88dfe8fbf3bf19833125d\": rpc error: code = NotFound desc = could not find container \"3aba8dada97e66e680689d054d716230699440bfd3a88dfe8fbf3bf19833125d\": container with ID starting with 3aba8dada97e66e680689d054d716230699440bfd3a88dfe8fbf3bf19833125d not found: ID does not exist"
Aug 04 23:08:26.772720 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:26.772694    2580 scope.go:117] "RemoveContainer" containerID="0b3b4b1d4f1f19894158c06047f427211689ae29d4fa3e6e4ad49bdb46123d5f"
Aug 04 23:08:26.772720 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:26.772712    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4f00e0ed-23ee-4b3a-8184-0ddcc43f3ce2-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "4f00e0ed-23ee-4b3a-8184-0ddcc43f3ce2" (UID: "4f00e0ed-23ee-4b3a-8184-0ddcc43f3ce2"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 23:08:26.772999 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:26.772692    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f00e0ed-23ee-4b3a-8184-0ddcc43f3ce2-credential-socket\") pod \"4f00e0ed-23ee-4b3a-8184-0ddcc43f3ce2\" (UID: \"4f00e0ed-23ee-4b3a-8184-0ddcc43f3ce2\") "
Aug 04 23:08:26.772999 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:26.772796    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4f00e0ed-23ee-4b3a-8184-0ddcc43f3ce2-istio-data\") pod \"4f00e0ed-23ee-4b3a-8184-0ddcc43f3ce2\" (UID: \"4f00e0ed-23ee-4b3a-8184-0ddcc43f3ce2\") "
Aug 04 23:08:26.772999 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:26.772891    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4f00e0ed-23ee-4b3a-8184-0ddcc43f3ce2-workload-certs\") pod \"4f00e0ed-23ee-4b3a-8184-0ddcc43f3ce2\" (UID: \"4f00e0ed-23ee-4b3a-8184-0ddcc43f3ce2\") "
Aug 04 23:08:26.772999 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:26.772909    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f00e0ed-23ee-4b3a-8184-0ddcc43f3ce2-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "4f00e0ed-23ee-4b3a-8184-0ddcc43f3ce2" (UID: "4f00e0ed-23ee-4b3a-8184-0ddcc43f3ce2"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 23:08:26.773284 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:26.773065    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f00e0ed-23ee-4b3a-8184-0ddcc43f3ce2-istio-data" (OuterVolumeSpecName: "istio-data") pod "4f00e0ed-23ee-4b3a-8184-0ddcc43f3ce2" (UID: "4f00e0ed-23ee-4b3a-8184-0ddcc43f3ce2"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 23:08:26.773284 ip-10-0-137-117 kubenswrapper[2580]: E0804 23:08:26.773230    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0b3b4b1d4f1f19894158c06047f427211689ae29d4fa3e6e4ad49bdb46123d5f\": container with ID starting with 0b3b4b1d4f1f19894158c06047f427211689ae29d4fa3e6e4ad49bdb46123d5f not found: ID does not exist" containerID="0b3b4b1d4f1f19894158c06047f427211689ae29d4fa3e6e4ad49bdb46123d5f"
Aug 04 23:08:26.773284 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:26.773274    2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f00e0ed-23ee-4b3a-8184-0ddcc43f3ce2-credential-socket\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
Aug 04 23:08:26.773284 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:26.773274    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b3b4b1d4f1f19894158c06047f427211689ae29d4fa3e6e4ad49bdb46123d5f"} err="failed to get container status \"0b3b4b1d4f1f19894158c06047f427211689ae29d4fa3e6e4ad49bdb46123d5f\": rpc error: code = NotFound desc = could not find container \"0b3b4b1d4f1f19894158c06047f427211689ae29d4fa3e6e4ad49bdb46123d5f\": container with ID starting with 0b3b4b1d4f1f19894158c06047f427211689ae29d4fa3e6e4ad49bdb46123d5f not found: ID does not exist"
Aug 04 23:08:26.773512 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:26.773293    2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4f00e0ed-23ee-4b3a-8184-0ddcc43f3ce2-istio-data\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
Aug 04 23:08:26.773512 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:26.773307    2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f00e0ed-23ee-4b3a-8184-0ddcc43f3ce2-workload-socket\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
Aug 04 23:08:26.773512 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:26.773320    2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4f00e0ed-23ee-4b3a-8184-0ddcc43f3ce2-istiod-ca-cert\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
Aug 04 23:08:26.773512 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:26.773331    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f00e0ed-23ee-4b3a-8184-0ddcc43f3ce2-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "4f00e0ed-23ee-4b3a-8184-0ddcc43f3ce2" (UID: "4f00e0ed-23ee-4b3a-8184-0ddcc43f3ce2"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 23:08:26.774633 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:26.774607    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4f00e0ed-23ee-4b3a-8184-0ddcc43f3ce2-istio-token" (OuterVolumeSpecName: "istio-token") pod "4f00e0ed-23ee-4b3a-8184-0ddcc43f3ce2" (UID: "4f00e0ed-23ee-4b3a-8184-0ddcc43f3ce2"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 23:08:26.774737 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:26.774702    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4f00e0ed-23ee-4b3a-8184-0ddcc43f3ce2-kube-api-access-hz9ct" (OuterVolumeSpecName: "kube-api-access-hz9ct") pod "4f00e0ed-23ee-4b3a-8184-0ddcc43f3ce2" (UID: "4f00e0ed-23ee-4b3a-8184-0ddcc43f3ce2"). InnerVolumeSpecName "kube-api-access-hz9ct". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 23:08:26.774799 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:26.774734    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4f00e0ed-23ee-4b3a-8184-0ddcc43f3ce2-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "4f00e0ed-23ee-4b3a-8184-0ddcc43f3ce2" (UID: "4f00e0ed-23ee-4b3a-8184-0ddcc43f3ce2"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Aug 04 23:08:26.774799 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:26.774750    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f00e0ed-23ee-4b3a-8184-0ddcc43f3ce2-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "4f00e0ed-23ee-4b3a-8184-0ddcc43f3ce2" (UID: "4f00e0ed-23ee-4b3a-8184-0ddcc43f3ce2"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 23:08:26.874627 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:26.874600    2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4f00e0ed-23ee-4b3a-8184-0ddcc43f3ce2-workload-certs\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
Aug 04 23:08:26.874627 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:26.874625    2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4f00e0ed-23ee-4b3a-8184-0ddcc43f3ce2-istio-envoy\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
Aug 04 23:08:26.874627 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:26.874634    2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4f00e0ed-23ee-4b3a-8184-0ddcc43f3ce2-istio-token\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
Aug 04 23:08:26.874809 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:26.874642    2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4f00e0ed-23ee-4b3a-8184-0ddcc43f3ce2-istio-podinfo\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
Aug 04 23:08:26.874809 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:26.874650    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hz9ct\" (UniqueName: \"kubernetes.io/projected/4f00e0ed-23ee-4b3a-8184-0ddcc43f3ce2-kube-api-access-hz9ct\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
Aug 04 23:08:27.076899 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:27.076873    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-8f0bc6-openshift-default-7958bb65db-kp9k9"]
Aug 04 23:08:27.080423 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:27.080399    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-8f0bc6-openshift-default-7958bb65db-kp9k9"]
Aug 04 23:08:27.499690 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:27.499619    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4f00e0ed-23ee-4b3a-8184-0ddcc43f3ce2" path="/var/lib/kubelet/pods/4f00e0ed-23ee-4b3a-8184-0ddcc43f3ce2/volumes"
Aug 04 23:08:37.378331 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:37.378290    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-25c344-cdb6b868-6gztm"]
Aug 04 23:08:37.378832 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:37.378546    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-25c344-cdb6b868-6gztm" podUID="1a589567-a877-4b86-b8e7-1178039df91b" containerName="maas-api" containerID="cri-o://6eb2253468e70132b9e694d09aceeb7f58a305977b3431baa3ae65bab1f9ab07" gracePeriod=30
Aug 04 23:08:37.442867 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:37.442830    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-25c344-6b7ccd47bd-5kf5r"]
Aug 04 23:08:37.443285 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:37.443087    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-b-25c344-6b7ccd47bd-5kf5r" podUID="079c32c5-09da-4eff-b22c-aad740c8d99b" containerName="payload-processing" containerID="cri-o://1957aca121fda4f76906a2bf524137a04f4b6cd47f1f93e9ce568bea99947121" gracePeriod=30
Aug 04 23:08:37.574565 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:37.574530    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-25c344-s9z65"]
Aug 04 23:08:37.577644 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:37.577617    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-25c344-s9z65"]
Aug 04 23:08:37.695790 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:37.695763    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-25c344-cdb6b868-6gztm"
Aug 04 23:08:37.755101 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:37.755074    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-25c344-6b7ccd47bd-5kf5r"
Aug 04 23:08:37.767619 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:37.767597    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1a589567-a877-4b86-b8e7-1178039df91b-openshift-service-ca\") pod \"1a589567-a877-4b86-b8e7-1178039df91b\" (UID: \"1a589567-a877-4b86-b8e7-1178039df91b\") "
Aug 04 23:08:37.767713 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:37.767628    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sj8ps\" (UniqueName: \"kubernetes.io/projected/1a589567-a877-4b86-b8e7-1178039df91b-kube-api-access-sj8ps\") pod \"1a589567-a877-4b86-b8e7-1178039df91b\" (UID: \"1a589567-a877-4b86-b8e7-1178039df91b\") "
Aug 04 23:08:37.767761 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:37.767725    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1a589567-a877-4b86-b8e7-1178039df91b-maas-api-tls\") pod \"1a589567-a877-4b86-b8e7-1178039df91b\" (UID: \"1a589567-a877-4b86-b8e7-1178039df91b\") "
Aug 04 23:08:37.767937 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:37.767916    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1a589567-a877-4b86-b8e7-1178039df91b-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "1a589567-a877-4b86-b8e7-1178039df91b" (UID: "1a589567-a877-4b86-b8e7-1178039df91b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 23:08:37.769695 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:37.769670    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1a589567-a877-4b86-b8e7-1178039df91b-kube-api-access-sj8ps" (OuterVolumeSpecName: "kube-api-access-sj8ps") pod "1a589567-a877-4b86-b8e7-1178039df91b" (UID: "1a589567-a877-4b86-b8e7-1178039df91b"). InnerVolumeSpecName "kube-api-access-sj8ps". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 23:08:37.769791 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:37.769678    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1a589567-a877-4b86-b8e7-1178039df91b-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "1a589567-a877-4b86-b8e7-1178039df91b" (UID: "1a589567-a877-4b86-b8e7-1178039df91b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 23:08:37.824119 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:37.824092    2580 generic.go:356] "Generic (PLEG): container finished" podID="1a589567-a877-4b86-b8e7-1178039df91b" containerID="6eb2253468e70132b9e694d09aceeb7f58a305977b3431baa3ae65bab1f9ab07" exitCode=0
Aug 04 23:08:37.824260 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:37.824148    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-25c344-cdb6b868-6gztm"
Aug 04 23:08:37.824260 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:37.824160    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-25c344-cdb6b868-6gztm" event={"ID":"1a589567-a877-4b86-b8e7-1178039df91b","Type":"ContainerDied","Data":"6eb2253468e70132b9e694d09aceeb7f58a305977b3431baa3ae65bab1f9ab07"}
Aug 04 23:08:37.824260 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:37.824212    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-25c344-cdb6b868-6gztm" event={"ID":"1a589567-a877-4b86-b8e7-1178039df91b","Type":"ContainerDied","Data":"52240c3a70b54ae1d3a411b2fe8bedf6937cdac86ee65fd209f4550db36a677d"}
Aug 04 23:08:37.824260 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:37.824235    2580 scope.go:117] "RemoveContainer" containerID="6eb2253468e70132b9e694d09aceeb7f58a305977b3431baa3ae65bab1f9ab07"
Aug 04 23:08:37.825616 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:37.825595    2580 generic.go:356] "Generic (PLEG): container finished" podID="079c32c5-09da-4eff-b22c-aad740c8d99b" containerID="1957aca121fda4f76906a2bf524137a04f4b6cd47f1f93e9ce568bea99947121" exitCode=0
Aug 04 23:08:37.825721 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:37.825644    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-25c344-6b7ccd47bd-5kf5r"
Aug 04 23:08:37.825721 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:37.825683    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-25c344-6b7ccd47bd-5kf5r" event={"ID":"079c32c5-09da-4eff-b22c-aad740c8d99b","Type":"ContainerDied","Data":"1957aca121fda4f76906a2bf524137a04f4b6cd47f1f93e9ce568bea99947121"}
Aug 04 23:08:37.825811 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:37.825750    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-25c344-6b7ccd47bd-5kf5r" event={"ID":"079c32c5-09da-4eff-b22c-aad740c8d99b","Type":"ContainerDied","Data":"242bc3b298beac647dfa1abe7d8d758dea9a88dfe48f0c5ac44ca9abcf7f4065"}
Aug 04 23:08:37.834199 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:37.834181    2580 scope.go:117] "RemoveContainer" containerID="6eb2253468e70132b9e694d09aceeb7f58a305977b3431baa3ae65bab1f9ab07"
Aug 04 23:08:37.834457 ip-10-0-137-117 kubenswrapper[2580]: E0804 23:08:37.834432    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6eb2253468e70132b9e694d09aceeb7f58a305977b3431baa3ae65bab1f9ab07\": container with ID starting with 6eb2253468e70132b9e694d09aceeb7f58a305977b3431baa3ae65bab1f9ab07 not found: ID does not exist" containerID="6eb2253468e70132b9e694d09aceeb7f58a305977b3431baa3ae65bab1f9ab07"
Aug 04 23:08:37.834615 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:37.834461    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6eb2253468e70132b9e694d09aceeb7f58a305977b3431baa3ae65bab1f9ab07"} err="failed to get container status \"6eb2253468e70132b9e694d09aceeb7f58a305977b3431baa3ae65bab1f9ab07\": rpc error: code = NotFound desc = could not find container \"6eb2253468e70132b9e694d09aceeb7f58a305977b3431baa3ae65bab1f9ab07\": container with ID starting with 6eb2253468e70132b9e694d09aceeb7f58a305977b3431baa3ae65bab1f9ab07 not found: ID does not exist"
Aug 04 23:08:37.834615 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:37.834478    2580 scope.go:117] "RemoveContainer" containerID="1957aca121fda4f76906a2bf524137a04f4b6cd47f1f93e9ce568bea99947121"
Aug 04 23:08:37.847604 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:37.847581    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-25c344-cdb6b868-6gztm"]
Aug 04 23:08:37.848792 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:37.848775    2580 scope.go:117] "RemoveContainer" containerID="1957aca121fda4f76906a2bf524137a04f4b6cd47f1f93e9ce568bea99947121"
Aug 04 23:08:37.849065 ip-10-0-137-117 kubenswrapper[2580]: E0804 23:08:37.849038    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1957aca121fda4f76906a2bf524137a04f4b6cd47f1f93e9ce568bea99947121\": container with ID starting with 1957aca121fda4f76906a2bf524137a04f4b6cd47f1f93e9ce568bea99947121 not found: ID does not exist" containerID="1957aca121fda4f76906a2bf524137a04f4b6cd47f1f93e9ce568bea99947121"
Aug 04 23:08:37.849159 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:37.849063    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1957aca121fda4f76906a2bf524137a04f4b6cd47f1f93e9ce568bea99947121"} err="failed to get container status \"1957aca121fda4f76906a2bf524137a04f4b6cd47f1f93e9ce568bea99947121\": rpc error: code = NotFound desc = could not find container \"1957aca121fda4f76906a2bf524137a04f4b6cd47f1f93e9ce568bea99947121\": container with ID starting with 1957aca121fda4f76906a2bf524137a04f4b6cd47f1f93e9ce568bea99947121 not found: ID does not exist"
Aug 04 23:08:37.850121 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:37.850100    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-25c344-cdb6b868-6gztm"]
Aug 04 23:08:37.868388 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:37.868366    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tlhhs\" (UniqueName: \"kubernetes.io/projected/079c32c5-09da-4eff-b22c-aad740c8d99b-kube-api-access-tlhhs\") pod \"079c32c5-09da-4eff-b22c-aad740c8d99b\" (UID: \"079c32c5-09da-4eff-b22c-aad740c8d99b\") "
Aug 04 23:08:37.868490 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:37.868478    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/079c32c5-09da-4eff-b22c-aad740c8d99b-plugins-config-volume\") pod \"079c32c5-09da-4eff-b22c-aad740c8d99b\" (UID: \"079c32c5-09da-4eff-b22c-aad740c8d99b\") "
Aug 04 23:08:37.868649 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:37.868637    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1a589567-a877-4b86-b8e7-1178039df91b-openshift-service-ca\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
Aug 04 23:08:37.868688 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:37.868651    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sj8ps\" (UniqueName: \"kubernetes.io/projected/1a589567-a877-4b86-b8e7-1178039df91b-kube-api-access-sj8ps\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
Aug 04 23:08:37.868688 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:37.868661    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1a589567-a877-4b86-b8e7-1178039df91b-maas-api-tls\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
Aug 04 23:08:37.868799 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:37.868780    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/079c32c5-09da-4eff-b22c-aad740c8d99b-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "079c32c5-09da-4eff-b22c-aad740c8d99b" (UID: "079c32c5-09da-4eff-b22c-aad740c8d99b"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 23:08:37.870267 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:37.870246    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/079c32c5-09da-4eff-b22c-aad740c8d99b-kube-api-access-tlhhs" (OuterVolumeSpecName: "kube-api-access-tlhhs") pod "079c32c5-09da-4eff-b22c-aad740c8d99b" (UID: "079c32c5-09da-4eff-b22c-aad740c8d99b"). InnerVolumeSpecName "kube-api-access-tlhhs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 23:08:37.969605 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:37.969551    2580 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/079c32c5-09da-4eff-b22c-aad740c8d99b-plugins-config-volume\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
Aug 04 23:08:37.969605 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:37.969572    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tlhhs\" (UniqueName: \"kubernetes.io/projected/079c32c5-09da-4eff-b22c-aad740c8d99b-kube-api-access-tlhhs\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
Aug 04 23:08:38.149732 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:38.149706    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-25c344-6b7ccd47bd-5kf5r"]
Aug 04 23:08:38.158098 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:38.158070    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-25c344-6b7ccd47bd-5kf5r"]
Aug 04 23:08:39.499521 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:39.499492    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="079c32c5-09da-4eff-b22c-aad740c8d99b" path="/var/lib/kubelet/pods/079c32c5-09da-4eff-b22c-aad740c8d99b/volumes"
Aug 04 23:08:39.499898 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:39.499855    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1a589567-a877-4b86-b8e7-1178039df91b" path="/var/lib/kubelet/pods/1a589567-a877-4b86-b8e7-1178039df91b/volumes"
Aug 04 23:08:39.500153 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:39.500125    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="26d4ce2c-015b-4a7a-8596-a9b941cb91e4" path="/var/lib/kubelet/pods/26d4ce2c-015b-4a7a-8596-a9b941cb91e4/volumes"
Aug 04 23:08:39.603909 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:39.603867    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-595xm"]
Aug 04 23:08:44.920242 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:44.920207    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-ec06a8-openshift-default-78f548b7d4-5mfqs"]
Aug 04 23:08:44.920629 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:44.920615    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a589567-a877-4b86-b8e7-1178039df91b" containerName="maas-api"
Aug 04 23:08:44.920684 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:44.920630    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a589567-a877-4b86-b8e7-1178039df91b" containerName="maas-api"
Aug 04 23:08:44.920684 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:44.920639    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26d4ce2c-015b-4a7a-8596-a9b941cb91e4" containerName="revoke-keys"
Aug 04 23:08:44.920684 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:44.920644    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="26d4ce2c-015b-4a7a-8596-a9b941cb91e4" containerName="revoke-keys"
Aug 04 23:08:44.920684 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:44.920659    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4f00e0ed-23ee-4b3a-8184-0ddcc43f3ce2" containerName="istio-proxy"
Aug 04 23:08:44.920684 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:44.920665    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f00e0ed-23ee-4b3a-8184-0ddcc43f3ce2" containerName="istio-proxy"
Aug 04 23:08:44.920684 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:44.920674    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4f00e0ed-23ee-4b3a-8184-0ddcc43f3ce2" containerName="istio-proxy"
Aug 04 23:08:44.920684 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:44.920680    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f00e0ed-23ee-4b3a-8184-0ddcc43f3ce2" containerName="istio-proxy"
Aug 04 23:08:44.920898 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:44.920698    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="079c32c5-09da-4eff-b22c-aad740c8d99b" containerName="payload-processing"
Aug 04 23:08:44.920898 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:44.920704    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="079c32c5-09da-4eff-b22c-aad740c8d99b" containerName="payload-processing"
Aug 04 23:08:44.920898 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:44.920762    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="4f00e0ed-23ee-4b3a-8184-0ddcc43f3ce2" containerName="istio-proxy"
Aug 04 23:08:44.920898 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:44.920770    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="1a589567-a877-4b86-b8e7-1178039df91b" containerName="maas-api"
Aug 04 23:08:44.920898 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:44.920776    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="079c32c5-09da-4eff-b22c-aad740c8d99b" containerName="payload-processing"
Aug 04 23:08:44.920898 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:44.920784    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="4f00e0ed-23ee-4b3a-8184-0ddcc43f3ce2" containerName="istio-proxy"
Aug 04 23:08:44.920898 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:44.920790    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="26d4ce2c-015b-4a7a-8596-a9b941cb91e4" containerName="revoke-keys"
Aug 04 23:08:44.925434 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:44.925414    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-ec06a8-openshift-default-78f548b7d4-5mfqs"
Aug 04 23:08:44.928716 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:44.928668    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-ec06a8-openshift-default-dockercfg-gj6nl\""
Aug 04 23:08:44.944200 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:44.944054    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-ec06a8-openshift-default-78f548b7d4-5mfqs"]
Aug 04 23:08:45.038504 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:45.038466    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5614bb85-922a-46df-bf9b-d992043ef34f-istio-envoy\") pod \"e2e-shared-a-ec06a8-openshift-default-78f548b7d4-5mfqs\" (UID: \"5614bb85-922a-46df-bf9b-d992043ef34f\") " pod="openshift-ingress/e2e-shared-a-ec06a8-openshift-default-78f548b7d4-5mfqs"
Aug 04 23:08:45.038678 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:45.038520    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5614bb85-922a-46df-bf9b-d992043ef34f-credential-socket\") pod \"e2e-shared-a-ec06a8-openshift-default-78f548b7d4-5mfqs\" (UID: \"5614bb85-922a-46df-bf9b-d992043ef34f\") " pod="openshift-ingress/e2e-shared-a-ec06a8-openshift-default-78f548b7d4-5mfqs"
Aug 04 23:08:45.038678 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:45.038644    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s7pgc\" (UniqueName: \"kubernetes.io/projected/5614bb85-922a-46df-bf9b-d992043ef34f-kube-api-access-s7pgc\") pod \"e2e-shared-a-ec06a8-openshift-default-78f548b7d4-5mfqs\" (UID: \"5614bb85-922a-46df-bf9b-d992043ef34f\") " pod="openshift-ingress/e2e-shared-a-ec06a8-openshift-default-78f548b7d4-5mfqs"
Aug 04 23:08:45.038804 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:45.038686    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5614bb85-922a-46df-bf9b-d992043ef34f-istio-data\") pod \"e2e-shared-a-ec06a8-openshift-default-78f548b7d4-5mfqs\" (UID: \"5614bb85-922a-46df-bf9b-d992043ef34f\") " pod="openshift-ingress/e2e-shared-a-ec06a8-openshift-default-78f548b7d4-5mfqs"
Aug 04 23:08:45.038804 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:45.038727    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5614bb85-922a-46df-bf9b-d992043ef34f-workload-socket\") pod \"e2e-shared-a-ec06a8-openshift-default-78f548b7d4-5mfqs\" (UID: \"5614bb85-922a-46df-bf9b-d992043ef34f\") " pod="openshift-ingress/e2e-shared-a-ec06a8-openshift-default-78f548b7d4-5mfqs"
Aug 04 23:08:45.038898 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:45.038809    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5614bb85-922a-46df-bf9b-d992043ef34f-istio-podinfo\") pod \"e2e-shared-a-ec06a8-openshift-default-78f548b7d4-5mfqs\" (UID: \"5614bb85-922a-46df-bf9b-d992043ef34f\") " pod="openshift-ingress/e2e-shared-a-ec06a8-openshift-default-78f548b7d4-5mfqs"
Aug 04 23:08:45.038898 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:45.038852    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5614bb85-922a-46df-bf9b-d992043ef34f-istio-token\") pod \"e2e-shared-a-ec06a8-openshift-default-78f548b7d4-5mfqs\" (UID: \"5614bb85-922a-46df-bf9b-d992043ef34f\") " pod="openshift-ingress/e2e-shared-a-ec06a8-openshift-default-78f548b7d4-5mfqs"
Aug 04 23:08:45.038898 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:45.038881    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5614bb85-922a-46df-bf9b-d992043ef34f-workload-certs\") pod \"e2e-shared-a-ec06a8-openshift-default-78f548b7d4-5mfqs\" (UID: \"5614bb85-922a-46df-bf9b-d992043ef34f\") " pod="openshift-ingress/e2e-shared-a-ec06a8-openshift-default-78f548b7d4-5mfqs"
Aug 04 23:08:45.039016 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:45.038904    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5614bb85-922a-46df-bf9b-d992043ef34f-istiod-ca-cert\") pod \"e2e-shared-a-ec06a8-openshift-default-78f548b7d4-5mfqs\" (UID: \"5614bb85-922a-46df-bf9b-d992043ef34f\") " pod="openshift-ingress/e2e-shared-a-ec06a8-openshift-default-78f548b7d4-5mfqs"
Aug 04 23:08:45.140275 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:45.140231    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5614bb85-922a-46df-bf9b-d992043ef34f-istio-data\") pod \"e2e-shared-a-ec06a8-openshift-default-78f548b7d4-5mfqs\" (UID: \"5614bb85-922a-46df-bf9b-d992043ef34f\") " pod="openshift-ingress/e2e-shared-a-ec06a8-openshift-default-78f548b7d4-5mfqs"
Aug 04 23:08:45.140455 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:45.140287    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5614bb85-922a-46df-bf9b-d992043ef34f-workload-socket\") pod \"e2e-shared-a-ec06a8-openshift-default-78f548b7d4-5mfqs\" (UID: \"5614bb85-922a-46df-bf9b-d992043ef34f\") " pod="openshift-ingress/e2e-shared-a-ec06a8-openshift-default-78f548b7d4-5mfqs"
Aug 04 23:08:45.140455 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:45.140337    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5614bb85-922a-46df-bf9b-d992043ef34f-istio-podinfo\") pod \"e2e-shared-a-ec06a8-openshift-default-78f548b7d4-5mfqs\" (UID: \"5614bb85-922a-46df-bf9b-d992043ef34f\") " pod="openshift-ingress/e2e-shared-a-ec06a8-openshift-default-78f548b7d4-5mfqs"
Aug 04 23:08:45.140455 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:45.140362    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5614bb85-922a-46df-bf9b-d992043ef34f-istio-token\") pod \"e2e-shared-a-ec06a8-openshift-default-78f548b7d4-5mfqs\" (UID: \"5614bb85-922a-46df-bf9b-d992043ef34f\") " pod="openshift-ingress/e2e-shared-a-ec06a8-openshift-default-78f548b7d4-5mfqs"
Aug 04 23:08:45.140455 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:45.140388    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5614bb85-922a-46df-bf9b-d992043ef34f-workload-certs\") pod \"e2e-shared-a-ec06a8-openshift-default-78f548b7d4-5mfqs\" (UID: \"5614bb85-922a-46df-bf9b-d992043ef34f\") " pod="openshift-ingress/e2e-shared-a-ec06a8-openshift-default-78f548b7d4-5mfqs"
Aug 04 23:08:45.140704 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:45.140679    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5614bb85-922a-46df-bf9b-d992043ef34f-istio-data\") pod \"e2e-shared-a-ec06a8-openshift-default-78f548b7d4-5mfqs\" (UID: \"5614bb85-922a-46df-bf9b-d992043ef34f\") " pod="openshift-ingress/e2e-shared-a-ec06a8-openshift-default-78f548b7d4-5mfqs"
Aug 04 23:08:45.140785 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:45.140705    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5614bb85-922a-46df-bf9b-d992043ef34f-workload-socket\") pod \"e2e-shared-a-ec06a8-openshift-default-78f548b7d4-5mfqs\" (UID: \"5614bb85-922a-46df-bf9b-d992043ef34f\") " pod="openshift-ingress/e2e-shared-a-ec06a8-openshift-default-78f548b7d4-5mfqs"
Aug 04 23:08:45.140785 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:45.140690    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5614bb85-922a-46df-bf9b-d992043ef34f-istiod-ca-cert\") pod \"e2e-shared-a-ec06a8-openshift-default-78f548b7d4-5mfqs\" (UID: \"5614bb85-922a-46df-bf9b-d992043ef34f\") " pod="openshift-ingress/e2e-shared-a-ec06a8-openshift-default-78f548b7d4-5mfqs"
Aug 04 23:08:45.140894 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:45.140821    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5614bb85-922a-46df-bf9b-d992043ef34f-istio-envoy\") pod \"e2e-shared-a-ec06a8-openshift-default-78f548b7d4-5mfqs\" (UID: \"5614bb85-922a-46df-bf9b-d992043ef34f\") " pod="openshift-ingress/e2e-shared-a-ec06a8-openshift-default-78f548b7d4-5mfqs"
Aug 04 23:08:45.140894 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:45.140851    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5614bb85-922a-46df-bf9b-d992043ef34f-credential-socket\") pod \"e2e-shared-a-ec06a8-openshift-default-78f548b7d4-5mfqs\" (UID: \"5614bb85-922a-46df-bf9b-d992043ef34f\") " pod="openshift-ingress/e2e-shared-a-ec06a8-openshift-default-78f548b7d4-5mfqs"
Aug 04 23:08:45.141005 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:45.140908    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s7pgc\" (UniqueName: \"kubernetes.io/projected/5614bb85-922a-46df-bf9b-d992043ef34f-kube-api-access-s7pgc\") pod \"e2e-shared-a-ec06a8-openshift-default-78f548b7d4-5mfqs\" (UID: \"5614bb85-922a-46df-bf9b-d992043ef34f\") " pod="openshift-ingress/e2e-shared-a-ec06a8-openshift-default-78f548b7d4-5mfqs"
Aug 04 23:08:45.141065 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:45.141002    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5614bb85-922a-46df-bf9b-d992043ef34f-workload-certs\") pod \"e2e-shared-a-ec06a8-openshift-default-78f548b7d4-5mfqs\" (UID: \"5614bb85-922a-46df-bf9b-d992043ef34f\") " pod="openshift-ingress/e2e-shared-a-ec06a8-openshift-default-78f548b7d4-5mfqs"
Aug 04 23:08:45.141426 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:45.141403    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5614bb85-922a-46df-bf9b-d992043ef34f-istiod-ca-cert\") pod \"e2e-shared-a-ec06a8-openshift-default-78f548b7d4-5mfqs\" (UID: \"5614bb85-922a-46df-bf9b-d992043ef34f\") " pod="openshift-ingress/e2e-shared-a-ec06a8-openshift-default-78f548b7d4-5mfqs"
Aug 04 23:08:45.141605 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:45.141449    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5614bb85-922a-46df-bf9b-d992043ef34f-credential-socket\") pod \"e2e-shared-a-ec06a8-openshift-default-78f548b7d4-5mfqs\" (UID: \"5614bb85-922a-46df-bf9b-d992043ef34f\") " pod="openshift-ingress/e2e-shared-a-ec06a8-openshift-default-78f548b7d4-5mfqs"
Aug 04 23:08:45.143286 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:45.143261    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5614bb85-922a-46df-bf9b-d992043ef34f-istio-envoy\") pod \"e2e-shared-a-ec06a8-openshift-default-78f548b7d4-5mfqs\" (UID: \"5614bb85-922a-46df-bf9b-d992043ef34f\") " pod="openshift-ingress/e2e-shared-a-ec06a8-openshift-default-78f548b7d4-5mfqs"
Aug 04 23:08:45.143938 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:45.143916    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5614bb85-922a-46df-bf9b-d992043ef34f-istio-podinfo\") pod \"e2e-shared-a-ec06a8-openshift-default-78f548b7d4-5mfqs\" (UID: \"5614bb85-922a-46df-bf9b-d992043ef34f\") " pod="openshift-ingress/e2e-shared-a-ec06a8-openshift-default-78f548b7d4-5mfqs"
Aug 04 23:08:45.151754 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:45.151736    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5614bb85-922a-46df-bf9b-d992043ef34f-istio-token\") pod \"e2e-shared-a-ec06a8-openshift-default-78f548b7d4-5mfqs\" (UID: \"5614bb85-922a-46df-bf9b-d992043ef34f\") " pod="openshift-ingress/e2e-shared-a-ec06a8-openshift-default-78f548b7d4-5mfqs"
Aug 04 23:08:45.155565 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:45.155546    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s7pgc\" (UniqueName: \"kubernetes.io/projected/5614bb85-922a-46df-bf9b-d992043ef34f-kube-api-access-s7pgc\") pod \"e2e-shared-a-ec06a8-openshift-default-78f548b7d4-5mfqs\" (UID: \"5614bb85-922a-46df-bf9b-d992043ef34f\") " pod="openshift-ingress/e2e-shared-a-ec06a8-openshift-default-78f548b7d4-5mfqs"
Aug 04 23:08:45.249490 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:45.249417    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-ec06a8-openshift-default-78f548b7d4-5mfqs"
Aug 04 23:08:45.396335 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:45.396308    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-ec06a8-openshift-default-78f548b7d4-5mfqs"]
Aug 04 23:08:45.398124 ip-10-0-137-117 kubenswrapper[2580]: W0804 23:08:45.398095    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5614bb85_922a_46df_bf9b_d992043ef34f.slice/crio-1d3760dd69dbf8be8955a49b1f740db683a0caef94cc09a9eeb2f7d0c4058fb0 WatchSource:0}: Error finding container 1d3760dd69dbf8be8955a49b1f740db683a0caef94cc09a9eeb2f7d0c4058fb0: Status 404 returned error can't find the container with id 1d3760dd69dbf8be8955a49b1f740db683a0caef94cc09a9eeb2f7d0c4058fb0
Aug 04 23:08:45.400368 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:45.400334    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 23:08:45.400473 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:45.400414    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 23:08:45.400473 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:45.400459    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 23:08:45.879477 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:45.879442    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-ec06a8-openshift-default-78f548b7d4-5mfqs" event={"ID":"5614bb85-922a-46df-bf9b-d992043ef34f","Type":"ContainerStarted","Data":"510b85b1afdaa803aa159ad1eb1a6932619b3ff47ea1e9c644b74287649f7d02"}
Aug 04 23:08:45.879742 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:45.879496    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-ec06a8-openshift-default-78f548b7d4-5mfqs" event={"ID":"5614bb85-922a-46df-bf9b-d992043ef34f","Type":"ContainerStarted","Data":"1d3760dd69dbf8be8955a49b1f740db683a0caef94cc09a9eeb2f7d0c4058fb0"}
Aug 04 23:08:45.901828 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:45.901781    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-ec06a8-openshift-default-78f548b7d4-5mfqs" podStartSLOduration=1.9017673560000001 podStartE2EDuration="1.901767356s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 23:08:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 23:08:45.898555801 +0000 UTC m=+2872.891373529" watchObservedRunningTime="2026-08-04 23:08:45.901767356 +0000 UTC m=+2872.894585084"
Aug 04 23:08:46.250689 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:46.250610    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-ec06a8-openshift-default-78f548b7d4-5mfqs"
Aug 04 23:08:46.255513 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:46.255492    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-ec06a8-openshift-default-78f548b7d4-5mfqs"
Aug 04 23:08:46.886082 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:46.886048    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-ec06a8-openshift-default-78f548b7d4-5mfqs"
Aug 04 23:08:46.886897 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:46.886879    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-ec06a8-openshift-default-78f548b7d4-5mfqs"
Aug 04 23:08:51.393825 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:08:51.393787    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-595xm"]
Aug 04 23:09:00.985423 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:09:00.985392    2580 generic.go:356] "Generic (PLEG): container finished" podID="5614bb85-922a-46df-bf9b-d992043ef34f" containerID="510b85b1afdaa803aa159ad1eb1a6932619b3ff47ea1e9c644b74287649f7d02" exitCode=0
Aug 04 23:09:00.985761 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:09:00.985473    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-ec06a8-openshift-default-78f548b7d4-5mfqs" event={"ID":"5614bb85-922a-46df-bf9b-d992043ef34f","Type":"ContainerDied","Data":"510b85b1afdaa803aa159ad1eb1a6932619b3ff47ea1e9c644b74287649f7d02"}
Aug 04 23:09:00.986001 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:09:00.985985    2580 scope.go:117] "RemoveContainer" containerID="510b85b1afdaa803aa159ad1eb1a6932619b3ff47ea1e9c644b74287649f7d02"
Aug 04 23:09:00.987081 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:09:00.987055    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 23:09:00.987160 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:09:00.987122    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 23:09:00.987204 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:09:00.987176    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Aug 04 23:09:01.886449 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:09:01.886410    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-ec06a8-openshift-default-78f548b7d4-5mfqs"
Aug 04 23:09:01.993520 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:09:01.993484    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-ec06a8-openshift-default-78f548b7d4-5mfqs" event={"ID":"5614bb85-922a-46df-bf9b-d992043ef34f","Type":"ContainerStarted","Data":"0ce1458544ee6824beb70ede9e47db8d0471b1cbc19da04dbbd2a50b42140a70"}
Aug 04 23:09:02.250290 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:09:02.250195    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-ec06a8-openshift-default-78f548b7d4-5mfqs"
Aug 04 23:09:02.251410 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:09:02.251379    2580 patch_prober.go:28] interesting pod/e2e-shared-a-ec06a8-openshift-default-78f548b7d4-5mfqs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused" start-of-body=
Aug 04 23:09:02.251618 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:09:02.251593    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-ec06a8-openshift-default-78f548b7d4-5mfqs" podUID="5614bb85-922a-46df-bf9b-d992043ef34f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused"
Aug 04 23:09:03.250833 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:09:03.250785    2580 patch_prober.go:28] interesting pod/e2e-shared-a-ec06a8-openshift-default-78f548b7d4-5mfqs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused" start-of-body=
Aug 04 23:09:03.251371 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:09:03.250860    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-ec06a8-openshift-default-78f548b7d4-5mfqs" podUID="5614bb85-922a-46df-bf9b-d992043ef34f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused"
Aug 04 23:09:04.257156 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:09:04.252873    2580 patch_prober.go:28] interesting pod/e2e-shared-a-ec06a8-openshift-default-78f548b7d4-5mfqs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused" start-of-body=
Aug 04 23:09:04.257156 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:09:04.252944    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-ec06a8-openshift-default-78f548b7d4-5mfqs" podUID="5614bb85-922a-46df-bf9b-d992043ef34f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused"
Aug 04 23:09:05.250548 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:09:05.250509    2580 patch_prober.go:28] interesting pod/e2e-shared-a-ec06a8-openshift-default-78f548b7d4-5mfqs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused" start-of-body=
Aug 04 23:09:05.250824 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:09:05.250794    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-ec06a8-openshift-default-78f548b7d4-5mfqs" podUID="5614bb85-922a-46df-bf9b-d992043ef34f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused"
Aug 04 23:09:06.250447 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:09:06.250407    2580 patch_prober.go:28] interesting pod/e2e-shared-a-ec06a8-openshift-default-78f548b7d4-5mfqs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused" start-of-body=
Aug 04 23:09:06.251030 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:09:06.250996    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-ec06a8-openshift-default-78f548b7d4-5mfqs" podUID="5614bb85-922a-46df-bf9b-d992043ef34f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused"
Aug 04 23:09:07.254351 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:09:07.254322    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-ec06a8-openshift-default-78f548b7d4-5mfqs"
Aug 04 23:09:07.254742 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:09:07.254709    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-ec06a8-openshift-default-78f548b7d4-5mfqs"
Aug 04 23:09:07.255419 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:09:07.255401    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-ec06a8-openshift-default-78f548b7d4-5mfqs"
Aug 04 23:09:17.785972 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:09:17.785936    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-55909a-5df65f6859-sqgl7"]
Aug 04 23:09:17.790343 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:09:17.790319    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-55909a-5df65f6859-sqgl7"
Aug 04 23:09:17.792698 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:09:17.792675    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-55909a-serving-cert\""
Aug 04 23:09:17.792822 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:09:17.792680    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-qqbsd\""
Aug 04 23:09:17.792920 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:09:17.792825    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Aug 04 23:09:17.793637 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:09:17.793616    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Aug 04 23:09:17.797591 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:09:17.797567    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-55909a-5df65f6859-sqgl7"]
Aug 04 23:09:17.937540 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:09:17.937509    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/11ae30af-2c7f-47be-9cff-0e38ea164339-openshift-service-ca\") pod \"maas-api-e2e-shared-b-55909a-5df65f6859-sqgl7\" (UID: \"11ae30af-2c7f-47be-9cff-0e38ea164339\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-55909a-5df65f6859-sqgl7"
Aug 04 23:09:17.937690 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:09:17.937565    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rjdtn\" (UniqueName: \"kubernetes.io/projected/11ae30af-2c7f-47be-9cff-0e38ea164339-kube-api-access-rjdtn\") pod \"maas-api-e2e-shared-b-55909a-5df65f6859-sqgl7\" (UID: \"11ae30af-2c7f-47be-9cff-0e38ea164339\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-55909a-5df65f6859-sqgl7"
Aug 04 23:09:17.937690 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:09:17.937619    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/11ae30af-2c7f-47be-9cff-0e38ea164339-maas-api-tls\") pod \"maas-api-e2e-shared-b-55909a-5df65f6859-sqgl7\" (UID: \"11ae30af-2c7f-47be-9cff-0e38ea164339\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-55909a-5df65f6859-sqgl7"
Aug 04 23:09:18.038863 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:09:18.038783    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/11ae30af-2c7f-47be-9cff-0e38ea164339-openshift-service-ca\") pod \"maas-api-e2e-shared-b-55909a-5df65f6859-sqgl7\" (UID: \"11ae30af-2c7f-47be-9cff-0e38ea164339\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-55909a-5df65f6859-sqgl7"
Aug 04 23:09:18.038863 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:09:18.038857    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rjdtn\" (UniqueName: \"kubernetes.io/projected/11ae30af-2c7f-47be-9cff-0e38ea164339-kube-api-access-rjdtn\") pod \"maas-api-e2e-shared-b-55909a-5df65f6859-sqgl7\" (UID: \"11ae30af-2c7f-47be-9cff-0e38ea164339\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-55909a-5df65f6859-sqgl7"
Aug 04 23:09:18.039050 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:09:18.038903    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/11ae30af-2c7f-47be-9cff-0e38ea164339-maas-api-tls\") pod \"maas-api-e2e-shared-b-55909a-5df65f6859-sqgl7\" (UID: \"11ae30af-2c7f-47be-9cff-0e38ea164339\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-55909a-5df65f6859-sqgl7"
Aug 04 23:09:18.039540 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:09:18.039523    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/11ae30af-2c7f-47be-9cff-0e38ea164339-openshift-service-ca\") pod \"maas-api-e2e-shared-b-55909a-5df65f6859-sqgl7\" (UID: \"11ae30af-2c7f-47be-9cff-0e38ea164339\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-55909a-5df65f6859-sqgl7"
Aug 04 23:09:18.041464 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:09:18.041429    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/11ae30af-2c7f-47be-9cff-0e38ea164339-maas-api-tls\") pod \"maas-api-e2e-shared-b-55909a-5df65f6859-sqgl7\" (UID: \"11ae30af-2c7f-47be-9cff-0e38ea164339\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-55909a-5df65f6859-sqgl7"
Aug 04 23:09:18.047472 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:09:18.047448    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rjdtn\" (UniqueName: \"kubernetes.io/projected/11ae30af-2c7f-47be-9cff-0e38ea164339-kube-api-access-rjdtn\") pod \"maas-api-e2e-shared-b-55909a-5df65f6859-sqgl7\" (UID: \"11ae30af-2c7f-47be-9cff-0e38ea164339\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-55909a-5df65f6859-sqgl7"
Aug 04 23:09:18.104633 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:09:18.104609    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-55909a-5df65f6859-sqgl7"
Aug 04 23:09:18.246222 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:09:18.246184    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-55909a-5df65f6859-sqgl7"]
Aug 04 23:09:18.248334 ip-10-0-137-117 kubenswrapper[2580]: W0804 23:09:18.248299    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11ae30af_2c7f_47be_9cff_0e38ea164339.slice/crio-66a8769b29d9b2f415a46f0b88c521dcd29b86d20e23dca3e86353770d42623a WatchSource:0}: Error finding container 66a8769b29d9b2f415a46f0b88c521dcd29b86d20e23dca3e86353770d42623a: Status 404 returned error can't find the container with id 66a8769b29d9b2f415a46f0b88c521dcd29b86d20e23dca3e86353770d42623a
Aug 04 23:09:18.484854 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:09:18.484823    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-55909a-5f6cf86454-d7fd9"]
Aug 04 23:09:18.489584 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:09:18.489564    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-55909a-5f6cf86454-d7fd9"
Aug 04 23:09:18.492921 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:09:18.492894    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-55909a-dockercfg-tfsgl\""
Aug 04 23:09:18.493062 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:09:18.493009    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-55909a\""
Aug 04 23:09:18.502632 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:09:18.502610    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-55909a-5f6cf86454-d7fd9"]
Aug 04 23:09:18.645485 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:09:18.645453    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c0ad3121-c724-4d67-bbdf-dd7a4d75e94c-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-55909a-5f6cf86454-d7fd9\" (UID: \"c0ad3121-c724-4d67-bbdf-dd7a4d75e94c\") " pod="openshift-ingress/payload-processing-e2e-shared-b-55909a-5f6cf86454-d7fd9"
Aug 04 23:09:18.645767 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:09:18.645745    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-str4f\" (UniqueName: \"kubernetes.io/projected/c0ad3121-c724-4d67-bbdf-dd7a4d75e94c-kube-api-access-str4f\") pod \"payload-processing-e2e-shared-b-55909a-5f6cf86454-d7fd9\" (UID: \"c0ad3121-c724-4d67-bbdf-dd7a4d75e94c\") " pod="openshift-ingress/payload-processing-e2e-shared-b-55909a-5f6cf86454-d7fd9"
Aug 04 23:09:18.746996 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:09:18.746927    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c0ad3121-c724-4d67-bbdf-dd7a4d75e94c-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-55909a-5f6cf86454-d7fd9\" (UID: \"c0ad3121-c724-4d67-bbdf-dd7a4d75e94c\") " pod="openshift-ingress/payload-processing-e2e-shared-b-55909a-5f6cf86454-d7fd9"
Aug 04 23:09:18.746996 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:09:18.746975    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-str4f\" (UniqueName: \"kubernetes.io/projected/c0ad3121-c724-4d67-bbdf-dd7a4d75e94c-kube-api-access-str4f\") pod \"payload-processing-e2e-shared-b-55909a-5f6cf86454-d7fd9\" (UID: \"c0ad3121-c724-4d67-bbdf-dd7a4d75e94c\") " pod="openshift-ingress/payload-processing-e2e-shared-b-55909a-5f6cf86454-d7fd9"
Aug 04 23:09:18.747855 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:09:18.747829    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c0ad3121-c724-4d67-bbdf-dd7a4d75e94c-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-55909a-5f6cf86454-d7fd9\" (UID: \"c0ad3121-c724-4d67-bbdf-dd7a4d75e94c\") " pod="openshift-ingress/payload-processing-e2e-shared-b-55909a-5f6cf86454-d7fd9"
Aug 04 23:09:18.756323 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:09:18.756300    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-str4f\" (UniqueName: \"kubernetes.io/projected/c0ad3121-c724-4d67-bbdf-dd7a4d75e94c-kube-api-access-str4f\") pod \"payload-processing-e2e-shared-b-55909a-5f6cf86454-d7fd9\" (UID: \"c0ad3121-c724-4d67-bbdf-dd7a4d75e94c\") " pod="openshift-ingress/payload-processing-e2e-shared-b-55909a-5f6cf86454-d7fd9"
Aug 04 23:09:18.801022 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:09:18.800996    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-55909a-5f6cf86454-d7fd9"
Aug 04 23:09:19.096965 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:09:19.096923    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-55909a-5df65f6859-sqgl7" event={"ID":"11ae30af-2c7f-47be-9cff-0e38ea164339","Type":"ContainerStarted","Data":"662663c70ee627f671c9221a04e4d1fd810d6e55d6677e4130d3f33f1337454b"}
Aug 04 23:09:19.097155 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:09:19.096989    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-55909a-5df65f6859-sqgl7" event={"ID":"11ae30af-2c7f-47be-9cff-0e38ea164339","Type":"ContainerStarted","Data":"66a8769b29d9b2f415a46f0b88c521dcd29b86d20e23dca3e86353770d42623a"}
Aug 04 23:09:19.097210 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:09:19.097171    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-55909a-5df65f6859-sqgl7"
Aug 04 23:09:19.114750 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:09:19.114702    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-55909a-5df65f6859-sqgl7" podStartSLOduration=1.755893372 podStartE2EDuration="2.114687491s" totalImagesPullingTime="358.794119ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 23:09:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 23:09:19.111905593 +0000 UTC m=+2906.104723322" watchObservedRunningTime="2026-08-04 23:09:19.114687491 +0000 UTC m=+2906.107505219"
Aug 04 23:09:19.146776 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:09:19.146754    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-55909a-5f6cf86454-d7fd9"]
Aug 04 23:09:19.149004 ip-10-0-137-117 kubenswrapper[2580]: W0804 23:09:19.148978    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0ad3121_c724_4d67_bbdf_dd7a4d75e94c.slice/crio-2437e8610d7d6683ba4d56511a9ab09ebc225a1a6000cb3fb7022ecf9f93d639 WatchSource:0}: Error finding container 2437e8610d7d6683ba4d56511a9ab09ebc225a1a6000cb3fb7022ecf9f93d639: Status 404 returned error can't find the container with id 2437e8610d7d6683ba4d56511a9ab09ebc225a1a6000cb3fb7022ecf9f93d639
Aug 04 23:09:20.104649 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:09:20.104613    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-55909a-5f6cf86454-d7fd9" event={"ID":"c0ad3121-c724-4d67-bbdf-dd7a4d75e94c","Type":"ContainerStarted","Data":"7a7e23d8729dc0b6e459b5dfcf12c3f635b12d838f3828e6471b2b595f2ae14f"}
Aug 04 23:09:20.105038 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:09:20.104668    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-55909a-5f6cf86454-d7fd9" event={"ID":"c0ad3121-c724-4d67-bbdf-dd7a4d75e94c","Type":"ContainerStarted","Data":"2437e8610d7d6683ba4d56511a9ab09ebc225a1a6000cb3fb7022ecf9f93d639"}
Aug 04 23:09:20.105038 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:09:20.104707    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-55909a-5f6cf86454-d7fd9"
Aug 04 23:09:20.119212 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:09:20.119152    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-55909a-5f6cf86454-d7fd9" podStartSLOduration=2.119120325 podStartE2EDuration="2.119120325s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 23:09:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 23:09:20.118259843 +0000 UTC m=+2907.111077572" watchObservedRunningTime="2026-08-04 23:09:20.119120325 +0000 UTC m=+2907.111938050"
Aug 04 23:09:20.597576 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:09:20.597543    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-595xm"]
Aug 04 23:09:25.110263 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:09:25.110237    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-55909a-5df65f6859-sqgl7"
Aug 04 23:09:31.113571 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:09:31.113543    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-55909a-5f6cf86454-d7fd9"
Aug 04 23:09:49.691500 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:09:49.691463    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-595xm"]
Aug 04 23:10:10.595197 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:10:10.595162    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-595xm"]
Aug 04 23:10:31.894997 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:10:31.894920    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-595xm"]
Aug 04 23:10:47.488950 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:10:47.488913    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-595xm"]
Aug 04 23:10:53.940661 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:10:53.940626    2580 scope.go:117] "RemoveContainer" containerID="af49c81166719180eb07561c3011f7f5e86020f2534d5514b511b4315082cff3"
Aug 04 23:10:59.288536 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:10:59.288500    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-595xm"]
Aug 04 23:11:13.988604 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:11:13.988560    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-595xm"]
Aug 04 23:11:25.794897 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:11:25.794857    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-595xm"]
Aug 04 23:11:40.489655 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:11:40.489620    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-595xm"]
Aug 04 23:11:49.605563 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:11:49.605524    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-595xm"]
Aug 04 23:12:06.791403 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:12:06.791369    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-595xm"]
Aug 04 23:12:20.188391 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:12:20.188354    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-595xm"]
Aug 04 23:12:32.091895 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:12:32.091859    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-595xm"]
Aug 04 23:12:46.693240 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:12:46.693203    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-595xm"]
Aug 04 23:12:53.978458 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:12:53.978420    2580 scope.go:117] "RemoveContainer" containerID="07994bbc6750bd91ffb595803b30162057c12292a84fca2278659d36d5b6dbda"
Aug 04 23:12:53.987663 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:12:53.987640    2580 scope.go:117] "RemoveContainer" containerID="6534f734476137844f11c7d2c5885ab78deeaa37309d286e25cf737ff13d9a41"
Aug 04 23:12:57.992858 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:12:57.992824    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-595xm"]
Aug 04 23:13:13.287049 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:13:13.287007    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-595xm"]
Aug 04 23:13:23.894038 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:13:23.893950    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-595xm"]
Aug 04 23:13:46.795391 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:13:46.795354    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-595xm"]
Aug 04 23:14:01.800087 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:14:01.800050    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-595xm"]
Aug 04 23:14:40.898021 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:14:40.897986    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-595xm"]
Aug 04 23:14:53.100960 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:14:53.100923    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-595xm"]
Aug 04 23:14:54.025786 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:14:54.025755    2580 scope.go:117] "RemoveContainer" containerID="a3df643adb7139a32eb51a9999ecb6364eae1afb02b912f0fa91f138947abea6"
Aug 04 23:14:54.034833 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:14:54.034813    2580 scope.go:117] "RemoveContainer" containerID="7e790d2600e3509875b36a02dd75022e6d8007f705dfda3f95b40cd76f40ecc5"
Aug 04 23:15:00.130465 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:15:00.130413    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-ec06a8-29764755-t2wqf"]
Aug 04 23:15:00.135413 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:15:00.135389    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29764755-8vfzn"]
Aug 04 23:15:00.135546 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:15:00.135503    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-ec06a8-29764755-t2wqf"
Aug 04 23:15:00.138267 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:15:00.137879    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-vvngh\""
Aug 04 23:15:00.139149 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:15:00.139099    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-55909a-29764755-kbc6q"]
Aug 04 23:15:00.139349 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:15:00.139330    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29764755-8vfzn"
Aug 04 23:15:00.142944 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:15:00.142917    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-ec06a8-29764755-t2wqf"]
Aug 04 23:15:00.143051 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:15:00.143011    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-55909a-29764755-kbc6q"
Aug 04 23:15:00.145440 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:15:00.145264    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29764755-8vfzn"]
Aug 04 23:15:00.148681 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:15:00.148657    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-55909a-29764755-kbc6q"]
Aug 04 23:15:00.151562 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:15:00.151375    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-ec06a8-29764755-t2wqf"
Aug 04 23:15:00.162645 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:15:00.162628    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29764755-8vfzn"
Aug 04 23:15:00.202679 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:15:00.202655    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-55909a-29764755-kbc6q"
Aug 04 23:15:00.531509 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:15:00.531484    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-ec06a8-29764755-t2wqf"]
Aug 04 23:15:00.533559 ip-10-0-137-117 kubenswrapper[2580]: W0804 23:15:00.533532    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e1b4a8d_d879_4f4d_a1c5_e8ba4820d3fb.slice/crio-df1c5ffa82ad59cdeb5c69e1943ac1a2a2d40bf11133c58d0cfe9d9a675f236f WatchSource:0}: Error finding container df1c5ffa82ad59cdeb5c69e1943ac1a2a2d40bf11133c58d0cfe9d9a675f236f: Status 404 returned error can't find the container with id df1c5ffa82ad59cdeb5c69e1943ac1a2a2d40bf11133c58d0cfe9d9a675f236f
Aug 04 23:15:00.558555 ip-10-0-137-117 kubenswrapper[2580]: W0804 23:15:00.558525    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c110744_705c_4312_8320_5384bff1ea15.slice/crio-b2f9e667fff1c12742ece2b3da50c1a9da5e2ce11c70d677fefe8b3190b5a5d0 WatchSource:0}: Error finding container b2f9e667fff1c12742ece2b3da50c1a9da5e2ce11c70d677fefe8b3190b5a5d0: Status 404 returned error can't find the container with id b2f9e667fff1c12742ece2b3da50c1a9da5e2ce11c70d677fefe8b3190b5a5d0
Aug 04 23:15:00.558758 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:15:00.558738    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29764755-8vfzn"]
Aug 04 23:15:00.585677 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:15:00.585656    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-55909a-29764755-kbc6q"]
Aug 04 23:15:00.594151 ip-10-0-137-117 kubenswrapper[2580]: W0804 23:15:00.594110    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1325d1f_7a20_47f1_b096_b11941c99545.slice/crio-182389f3ac8d81e5e8343be3f8e6b4fef885bcdae58f46fcb71f14e0b364633b WatchSource:0}: Error finding container 182389f3ac8d81e5e8343be3f8e6b4fef885bcdae58f46fcb71f14e0b364633b: Status 404 returned error can't find the container with id 182389f3ac8d81e5e8343be3f8e6b4fef885bcdae58f46fcb71f14e0b364633b
Aug 04 23:15:01.271361 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:15:01.271267    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29764755-8vfzn" event={"ID":"1c110744-705c-4312-8320-5384bff1ea15","Type":"ContainerStarted","Data":"60bffa20963e971c9fcc11d47930f2095b064329a851262195293ae3b7e87e88"}
Aug 04 23:15:01.271361 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:15:01.271349    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29764755-8vfzn" event={"ID":"1c110744-705c-4312-8320-5384bff1ea15","Type":"ContainerStarted","Data":"b2f9e667fff1c12742ece2b3da50c1a9da5e2ce11c70d677fefe8b3190b5a5d0"}
Aug 04 23:15:01.272804 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:15:01.272777    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-55909a-29764755-kbc6q" event={"ID":"c1325d1f-7a20-47f1-b096-b11941c99545","Type":"ContainerStarted","Data":"0d65b0d6ea238aa7985391f43be19ad55f65a5fa247c07a2f198ee4b80cd0c39"}
Aug 04 23:15:01.272924 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:15:01.272823    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-55909a-29764755-kbc6q" event={"ID":"c1325d1f-7a20-47f1-b096-b11941c99545","Type":"ContainerStarted","Data":"182389f3ac8d81e5e8343be3f8e6b4fef885bcdae58f46fcb71f14e0b364633b"}
Aug 04 23:15:01.274269 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:15:01.274247    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-ec06a8-29764755-t2wqf" event={"ID":"3e1b4a8d-d879-4f4d-a1c5-e8ba4820d3fb","Type":"ContainerStarted","Data":"13e8f1831dd3934ca57e7b1e5ab27dc3b6d2821f36fbe0e6fb4a795950157bd3"}
Aug 04 23:15:01.274431 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:15:01.274284    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-ec06a8-29764755-t2wqf" event={"ID":"3e1b4a8d-d879-4f4d-a1c5-e8ba4820d3fb","Type":"ContainerStarted","Data":"df1c5ffa82ad59cdeb5c69e1943ac1a2a2d40bf11133c58d0cfe9d9a675f236f"}
Aug 04 23:15:01.285822 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:15:01.285776    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29764755-8vfzn" podStartSLOduration=1.28576463 podStartE2EDuration="1.28576463s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 23:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 23:15:01.283394389 +0000 UTC m=+3248.276212113" watchObservedRunningTime="2026-08-04 23:15:01.28576463 +0000 UTC m=+3248.278582357"
Aug 04 23:15:01.295884 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:15:01.295851    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-55909a-29764755-kbc6q" podStartSLOduration=1.295843703 podStartE2EDuration="1.295843703s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 23:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 23:15:01.295356815 +0000 UTC m=+3248.288174544" watchObservedRunningTime="2026-08-04 23:15:01.295843703 +0000 UTC m=+3248.288661431"
Aug 04 23:15:01.308762 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:15:01.308715    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-ec06a8-29764755-t2wqf" podStartSLOduration=1.308704983 podStartE2EDuration="1.308704983s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 23:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 23:15:01.306728918 +0000 UTC m=+3248.299546647" watchObservedRunningTime="2026-08-04 23:15:01.308704983 +0000 UTC m=+3248.301522751"
Aug 04 23:15:02.281581 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:15:02.281549    2580 generic.go:356] "Generic (PLEG): container finished" podID="3e1b4a8d-d879-4f4d-a1c5-e8ba4820d3fb" containerID="13e8f1831dd3934ca57e7b1e5ab27dc3b6d2821f36fbe0e6fb4a795950157bd3" exitCode=0
Aug 04 23:15:02.282015 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:15:02.281637    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-ec06a8-29764755-t2wqf" event={"ID":"3e1b4a8d-d879-4f4d-a1c5-e8ba4820d3fb","Type":"ContainerDied","Data":"13e8f1831dd3934ca57e7b1e5ab27dc3b6d2821f36fbe0e6fb4a795950157bd3"}
Aug 04 23:15:02.283232 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:15:02.283208    2580 generic.go:356] "Generic (PLEG): container finished" podID="1c110744-705c-4312-8320-5384bff1ea15" containerID="60bffa20963e971c9fcc11d47930f2095b064329a851262195293ae3b7e87e88" exitCode=0
Aug 04 23:15:02.283323 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:15:02.283293    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29764755-8vfzn" event={"ID":"1c110744-705c-4312-8320-5384bff1ea15","Type":"ContainerDied","Data":"60bffa20963e971c9fcc11d47930f2095b064329a851262195293ae3b7e87e88"}
Aug 04 23:15:02.284766 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:15:02.284741    2580 generic.go:356] "Generic (PLEG): container finished" podID="c1325d1f-7a20-47f1-b096-b11941c99545" containerID="0d65b0d6ea238aa7985391f43be19ad55f65a5fa247c07a2f198ee4b80cd0c39" exitCode=0
Aug 04 23:15:02.284896 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:15:02.284817    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-55909a-29764755-kbc6q" event={"ID":"c1325d1f-7a20-47f1-b096-b11941c99545","Type":"ContainerDied","Data":"0d65b0d6ea238aa7985391f43be19ad55f65a5fa247c07a2f198ee4b80cd0c39"}
Aug 04 23:15:03.447665 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:15:03.447641    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29764755-8vfzn"
Aug 04 23:15:03.499921 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:15:03.499892    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-ec06a8-29764755-t2wqf"
Aug 04 23:15:03.504530 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:15:03.504507    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-55909a-29764755-kbc6q"
Aug 04 23:15:04.088618 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:15:04.088578    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-595xm"]
Aug 04 23:15:04.298817 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:15:04.298783    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-ec06a8-29764755-t2wqf"
Aug 04 23:15:04.298817 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:15:04.298801    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-ec06a8-29764755-t2wqf" event={"ID":"3e1b4a8d-d879-4f4d-a1c5-e8ba4820d3fb","Type":"ContainerDied","Data":"df1c5ffa82ad59cdeb5c69e1943ac1a2a2d40bf11133c58d0cfe9d9a675f236f"}
Aug 04 23:15:04.299068 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:15:04.298873    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="df1c5ffa82ad59cdeb5c69e1943ac1a2a2d40bf11133c58d0cfe9d9a675f236f"
Aug 04 23:15:04.300264 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:15:04.300245    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29764755-8vfzn"
Aug 04 23:15:04.300401 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:15:04.300281    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29764755-8vfzn" event={"ID":"1c110744-705c-4312-8320-5384bff1ea15","Type":"ContainerDied","Data":"b2f9e667fff1c12742ece2b3da50c1a9da5e2ce11c70d677fefe8b3190b5a5d0"}
Aug 04 23:15:04.300401 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:15:04.300336    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b2f9e667fff1c12742ece2b3da50c1a9da5e2ce11c70d677fefe8b3190b5a5d0"
Aug 04 23:15:04.301727 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:15:04.301703    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-55909a-29764755-kbc6q" event={"ID":"c1325d1f-7a20-47f1-b096-b11941c99545","Type":"ContainerDied","Data":"182389f3ac8d81e5e8343be3f8e6b4fef885bcdae58f46fcb71f14e0b364633b"}
Aug 04 23:15:04.301852 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:15:04.301743    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="182389f3ac8d81e5e8343be3f8e6b4fef885bcdae58f46fcb71f14e0b364633b"
Aug 04 23:15:04.301852 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:15:04.301693    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-55909a-29764755-kbc6q"
Aug 04 23:15:14.383394 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:15:14.383359    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-595xm"]
Aug 04 23:15:33.292888 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:15:33.292855    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-595xm"]
Aug 04 23:16:15.499805 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:16:15.499733    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-595xm"]
Aug 04 23:16:52.390884 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:16:52.390847    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-595xm"]
Aug 04 23:17:01.393863 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:17:01.393825    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-595xm"]
Aug 04 23:17:33.296426 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:17:33.296379    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-595xm"]
Aug 04 23:17:40.878736 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:17:40.878699    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7475-140121857698480"]
Aug 04 23:17:40.879196 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:17:40.879176    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3e1b4a8d-d879-4f4d-a1c5-e8ba4820d3fb" containerName="cleanup"
Aug 04 23:17:40.879196 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:17:40.879191    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="3e1b4a8d-d879-4f4d-a1c5-e8ba4820d3fb" containerName="cleanup"
Aug 04 23:17:40.879280 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:17:40.879207    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c1325d1f-7a20-47f1-b096-b11941c99545" containerName="cleanup"
Aug 04 23:17:40.879280 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:17:40.879216    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="c1325d1f-7a20-47f1-b096-b11941c99545" containerName="cleanup"
Aug 04 23:17:40.879280 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:17:40.879230    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c110744-705c-4312-8320-5384bff1ea15" containerName="cleanup"
Aug 04 23:17:40.879280 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:17:40.879236    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c110744-705c-4312-8320-5384bff1ea15" containerName="cleanup"
Aug 04 23:17:40.879406 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:17:40.879321    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="c1325d1f-7a20-47f1-b096-b11941c99545" containerName="cleanup"
Aug 04 23:17:40.879406 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:17:40.879330    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="1c110744-705c-4312-8320-5384bff1ea15" containerName="cleanup"
Aug 04 23:17:40.879406 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:17:40.879339    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="3e1b4a8d-d879-4f4d-a1c5-e8ba4820d3fb" containerName="cleanup"
Aug 04 23:17:40.882543 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:17:40.882527    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7475-140121857698480"
Aug 04 23:17:40.884769 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:17:40.884735    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-j25t4\""
Aug 04 23:17:40.887875 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:17:40.887843    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7475-140121857698480"]
Aug 04 23:17:40.934086 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:17:40.934057    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fwpx9\" (UniqueName: \"kubernetes.io/projected/ba5ccadb-08ab-4c76-b3dd-f16c07bedc77-kube-api-access-fwpx9\") pod \"test-curl-7475-140121857698480\" (UID: \"ba5ccadb-08ab-4c76-b3dd-f16c07bedc77\") " pod="opendatahub/test-curl-7475-140121857698480"
Aug 04 23:17:41.034661 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:17:41.034633    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fwpx9\" (UniqueName: \"kubernetes.io/projected/ba5ccadb-08ab-4c76-b3dd-f16c07bedc77-kube-api-access-fwpx9\") pod \"test-curl-7475-140121857698480\" (UID: \"ba5ccadb-08ab-4c76-b3dd-f16c07bedc77\") " pod="opendatahub/test-curl-7475-140121857698480"
Aug 04 23:17:41.042730 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:17:41.042700    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fwpx9\" (UniqueName: \"kubernetes.io/projected/ba5ccadb-08ab-4c76-b3dd-f16c07bedc77-kube-api-access-fwpx9\") pod \"test-curl-7475-140121857698480\" (UID: \"ba5ccadb-08ab-4c76-b3dd-f16c07bedc77\") " pod="opendatahub/test-curl-7475-140121857698480"
Aug 04 23:17:41.194421 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:17:41.194341    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7475-140121857698480"
Aug 04 23:17:41.329214 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:17:41.329190    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7475-140121857698480"]
Aug 04 23:17:41.330933 ip-10-0-137-117 kubenswrapper[2580]: W0804 23:17:41.330905    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podba5ccadb_08ab_4c76_b3dd_f16c07bedc77.slice/crio-ef29b880f7b5bdf707f55c21f8b14cd05319a29004fcf300ddb5bfababef918b WatchSource:0}: Error finding container ef29b880f7b5bdf707f55c21f8b14cd05319a29004fcf300ddb5bfababef918b: Status 404 returned error can't find the container with id ef29b880f7b5bdf707f55c21f8b14cd05319a29004fcf300ddb5bfababef918b
Aug 04 23:17:41.332627 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:17:41.332609    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 04 23:17:42.281019 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:17:42.280927    2580 generic.go:356] "Generic (PLEG): container finished" podID="ba5ccadb-08ab-4c76-b3dd-f16c07bedc77" containerID="58a48f9f1ce05d6cdea90e5e8b0acee30f1d5129542f6f3bf38bfc303f70952d" exitCode=0
Aug 04 23:17:42.281446 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:17:42.281021    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7475-140121857698480" event={"ID":"ba5ccadb-08ab-4c76-b3dd-f16c07bedc77","Type":"ContainerDied","Data":"58a48f9f1ce05d6cdea90e5e8b0acee30f1d5129542f6f3bf38bfc303f70952d"}
Aug 04 23:17:42.281446 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:17:42.281069    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7475-140121857698480" event={"ID":"ba5ccadb-08ab-4c76-b3dd-f16c07bedc77","Type":"ContainerStarted","Data":"ef29b880f7b5bdf707f55c21f8b14cd05319a29004fcf300ddb5bfababef918b"}
Aug 04 23:17:42.500496 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:17:42.500462    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-595xm"]
Aug 04 23:17:43.419243 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:17:43.419216    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7475-140121857698480"
Aug 04 23:17:43.451687 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:17:43.451661    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7475-140121857698480_ba5ccadb-08ab-4c76-b3dd-f16c07bedc77/test-curl-7475-140121857698480/0.log"
Aug 04 23:17:43.472631 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:17:43.472607    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7475-140121857698480"]
Aug 04 23:17:43.476036 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:17:43.476015    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7475-140121857698480"]
Aug 04 23:17:43.557914 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:17:43.557887    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fwpx9\" (UniqueName: \"kubernetes.io/projected/ba5ccadb-08ab-4c76-b3dd-f16c07bedc77-kube-api-access-fwpx9\") pod \"ba5ccadb-08ab-4c76-b3dd-f16c07bedc77\" (UID: \"ba5ccadb-08ab-4c76-b3dd-f16c07bedc77\") "
Aug 04 23:17:43.560093 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:17:43.560060    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ba5ccadb-08ab-4c76-b3dd-f16c07bedc77-kube-api-access-fwpx9" (OuterVolumeSpecName: "kube-api-access-fwpx9") pod "ba5ccadb-08ab-4c76-b3dd-f16c07bedc77" (UID: "ba5ccadb-08ab-4c76-b3dd-f16c07bedc77"). InnerVolumeSpecName "kube-api-access-fwpx9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 23:17:43.608757 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:17:43.608729    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7475-140121857724720"]
Aug 04 23:17:43.609201 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:17:43.609188    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba5ccadb-08ab-4c76-b3dd-f16c07bedc77" containerName="test-curl-7475-140121857698480"
Aug 04 23:17:43.609247 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:17:43.609203    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba5ccadb-08ab-4c76-b3dd-f16c07bedc77" containerName="test-curl-7475-140121857698480"
Aug 04 23:17:43.609290 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:17:43.609269    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba5ccadb-08ab-4c76-b3dd-f16c07bedc77" containerName="test-curl-7475-140121857698480"
Aug 04 23:17:43.612507 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:17:43.612484    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7475-140121857724720"
Aug 04 23:17:43.616580 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:17:43.616554    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7475-140121857724720"]
Aug 04 23:17:43.659248 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:17:43.659218    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fwpx9\" (UniqueName: \"kubernetes.io/projected/ba5ccadb-08ab-4c76-b3dd-f16c07bedc77-kube-api-access-fwpx9\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
Aug 04 23:17:43.759987 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:17:43.759951    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t2z5h\" (UniqueName: \"kubernetes.io/projected/11921f4d-100b-4984-8856-ff46a82254bb-kube-api-access-t2z5h\") pod \"test-curl-7475-140121857724720\" (UID: \"11921f4d-100b-4984-8856-ff46a82254bb\") " pod="opendatahub/test-curl-7475-140121857724720"
Aug 04 23:17:43.861019 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:17:43.860949    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t2z5h\" (UniqueName: \"kubernetes.io/projected/11921f4d-100b-4984-8856-ff46a82254bb-kube-api-access-t2z5h\") pod \"test-curl-7475-140121857724720\" (UID: \"11921f4d-100b-4984-8856-ff46a82254bb\") " pod="opendatahub/test-curl-7475-140121857724720"
Aug 04 23:17:43.869205 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:17:43.869179    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t2z5h\" (UniqueName: \"kubernetes.io/projected/11921f4d-100b-4984-8856-ff46a82254bb-kube-api-access-t2z5h\") pod \"test-curl-7475-140121857724720\" (UID: \"11921f4d-100b-4984-8856-ff46a82254bb\") " pod="opendatahub/test-curl-7475-140121857724720"
Aug 04 23:17:43.922697 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:17:43.922671    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7475-140121857724720"
Aug 04 23:17:44.057258 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:17:44.057233    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7475-140121857724720"]
Aug 04 23:17:44.058098 ip-10-0-137-117 kubenswrapper[2580]: W0804 23:17:44.058077    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod11921f4d_100b_4984_8856_ff46a82254bb.slice/crio-3202e8f12b22cec15f64a9d5a20c8b3ec2b949259564393d5ae49853a4ba0d76 WatchSource:0}: Error finding container 3202e8f12b22cec15f64a9d5a20c8b3ec2b949259564393d5ae49853a4ba0d76: Status 404 returned error can't find the container with id 3202e8f12b22cec15f64a9d5a20c8b3ec2b949259564393d5ae49853a4ba0d76
Aug 04 23:17:44.294371 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:17:44.294290    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7475-140121857724720" event={"ID":"11921f4d-100b-4984-8856-ff46a82254bb","Type":"ContainerStarted","Data":"3202e8f12b22cec15f64a9d5a20c8b3ec2b949259564393d5ae49853a4ba0d76"}
Aug 04 23:17:44.295574 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:17:44.295543    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7475-140121857698480"
Aug 04 23:17:44.295709 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:17:44.295594    2580 scope.go:117] "RemoveContainer" containerID="58a48f9f1ce05d6cdea90e5e8b0acee30f1d5129542f6f3bf38bfc303f70952d"
Aug 04 23:17:45.303022 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:17:45.302935    2580 generic.go:356] "Generic (PLEG): container finished" podID="11921f4d-100b-4984-8856-ff46a82254bb" containerID="15d7344a6a1c16b68a5fcbe07a93916492fa69a90c26d184868286f692fbbc34" exitCode=0
Aug 04 23:17:45.303458 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:17:45.303023    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7475-140121857724720" event={"ID":"11921f4d-100b-4984-8856-ff46a82254bb","Type":"ContainerDied","Data":"15d7344a6a1c16b68a5fcbe07a93916492fa69a90c26d184868286f692fbbc34"}
Aug 04 23:17:45.499673 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:17:45.499636    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ba5ccadb-08ab-4c76-b3dd-f16c07bedc77" path="/var/lib/kubelet/pods/ba5ccadb-08ab-4c76-b3dd-f16c07bedc77/volumes"
Aug 04 23:17:46.457121 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:17:46.457096    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7475-140121857724720"
Aug 04 23:17:46.475505 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:17:46.475471    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7475-140121857724720_11921f4d-100b-4984-8856-ff46a82254bb/test-curl-7475-140121857724720/0.log"
Aug 04 23:17:46.497631 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:17:46.497604    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7475-140121857724720"]
Aug 04 23:17:46.501175 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:17:46.501148    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7475-140121857724720"]
Aug 04 23:17:46.587673 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:17:46.587605    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t2z5h\" (UniqueName: \"kubernetes.io/projected/11921f4d-100b-4984-8856-ff46a82254bb-kube-api-access-t2z5h\") pod \"11921f4d-100b-4984-8856-ff46a82254bb\" (UID: \"11921f4d-100b-4984-8856-ff46a82254bb\") "
Aug 04 23:17:46.589725 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:17:46.589698    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/11921f4d-100b-4984-8856-ff46a82254bb-kube-api-access-t2z5h" (OuterVolumeSpecName: "kube-api-access-t2z5h") pod "11921f4d-100b-4984-8856-ff46a82254bb" (UID: "11921f4d-100b-4984-8856-ff46a82254bb"). InnerVolumeSpecName "kube-api-access-t2z5h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 23:17:46.671182 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:17:46.671151    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7475-140121857682720"]
Aug 04 23:17:46.671613 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:17:46.671599    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11921f4d-100b-4984-8856-ff46a82254bb" containerName="test-curl-7475-140121857724720"
Aug 04 23:17:46.671669 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:17:46.671615    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="11921f4d-100b-4984-8856-ff46a82254bb" containerName="test-curl-7475-140121857724720"
Aug 04 23:17:46.671708 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:17:46.671674    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="11921f4d-100b-4984-8856-ff46a82254bb" containerName="test-curl-7475-140121857724720"
Aug 04 23:17:46.674611 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:17:46.674595    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7475-140121857682720"
Aug 04 23:17:46.680682 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:17:46.680657    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7475-140121857682720"]
Aug 04 23:17:46.688423 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:17:46.688402    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t2z5h\" (UniqueName: \"kubernetes.io/projected/11921f4d-100b-4984-8856-ff46a82254bb-kube-api-access-t2z5h\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
Aug 04 23:17:46.789765 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:17:46.789731    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jthdh\" (UniqueName: \"kubernetes.io/projected/17b8bb5c-b128-4a06-b33a-663a0a7f45c4-kube-api-access-jthdh\") pod \"test-curl-7475-140121857682720\" (UID: \"17b8bb5c-b128-4a06-b33a-663a0a7f45c4\") " pod="opendatahub/test-curl-7475-140121857682720"
Aug 04 23:17:46.890941 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:17:46.890850    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jthdh\" (UniqueName: \"kubernetes.io/projected/17b8bb5c-b128-4a06-b33a-663a0a7f45c4-kube-api-access-jthdh\") pod \"test-curl-7475-140121857682720\" (UID: \"17b8bb5c-b128-4a06-b33a-663a0a7f45c4\") " pod="opendatahub/test-curl-7475-140121857682720"
Aug 04 23:17:46.898071 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:17:46.898035    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jthdh\" (UniqueName: \"kubernetes.io/projected/17b8bb5c-b128-4a06-b33a-663a0a7f45c4-kube-api-access-jthdh\") pod \"test-curl-7475-140121857682720\" (UID: \"17b8bb5c-b128-4a06-b33a-663a0a7f45c4\") " pod="opendatahub/test-curl-7475-140121857682720"
Aug 04 23:17:46.986106 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:17:46.986079    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7475-140121857682720"
Aug 04 23:17:47.130995 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:17:47.130970    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7475-140121857682720"]
Aug 04 23:17:47.131951 ip-10-0-137-117 kubenswrapper[2580]: W0804 23:17:47.131929    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod17b8bb5c_b128_4a06_b33a_663a0a7f45c4.slice/crio-782ae4f5af27c38d6ea3ccfe303014808927c9bab127b8b9cb6105ea79654144 WatchSource:0}: Error finding container 782ae4f5af27c38d6ea3ccfe303014808927c9bab127b8b9cb6105ea79654144: Status 404 returned error can't find the container with id 782ae4f5af27c38d6ea3ccfe303014808927c9bab127b8b9cb6105ea79654144
Aug 04 23:17:47.316918 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:17:47.316889    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3202e8f12b22cec15f64a9d5a20c8b3ec2b949259564393d5ae49853a4ba0d76"
Aug 04 23:17:47.316918 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:17:47.316894    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7475-140121857724720"
Aug 04 23:17:47.318125 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:17:47.318095    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7475-140121857682720" event={"ID":"17b8bb5c-b128-4a06-b33a-663a0a7f45c4","Type":"ContainerStarted","Data":"782ae4f5af27c38d6ea3ccfe303014808927c9bab127b8b9cb6105ea79654144"}
Aug 04 23:17:47.327216 ip-10-0-137-117 kubenswrapper[2580]: E0804 23:17:47.327188    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7475-140121857724720\" is forbidden: User \"system:node:ip-10-0-137-117.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-137-117.ec2.internal' and this object" podUID="11921f4d-100b-4984-8856-ff46a82254bb" pod="opendatahub/test-curl-7475-140121857724720"
Aug 04 23:17:47.501886 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:17:47.501854    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="11921f4d-100b-4984-8856-ff46a82254bb" path="/var/lib/kubelet/pods/11921f4d-100b-4984-8856-ff46a82254bb/volumes"
Aug 04 23:17:48.326824 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:17:48.326791    2580 generic.go:356] "Generic (PLEG): container finished" podID="17b8bb5c-b128-4a06-b33a-663a0a7f45c4" containerID="c1bd4ef877ce36ea802d05b731fe9c2f30f4184006e9f98561897e3dfc5f0c20" exitCode=0
Aug 04 23:17:48.327001 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:17:48.326880    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7475-140121857682720" event={"ID":"17b8bb5c-b128-4a06-b33a-663a0a7f45c4","Type":"ContainerDied","Data":"c1bd4ef877ce36ea802d05b731fe9c2f30f4184006e9f98561897e3dfc5f0c20"}
Aug 04 23:17:49.481193 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:17:49.481167    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7475-140121857682720"
Aug 04 23:17:49.499161 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:17:49.499100    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7475-140121857682720_17b8bb5c-b128-4a06-b33a-663a0a7f45c4/test-curl-7475-140121857682720/0.log"
Aug 04 23:17:49.526413 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:17:49.526378    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7475-140121857682720"]
Aug 04 23:17:49.531079 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:17:49.531050    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7475-140121857682720"]
Aug 04 23:17:49.614509 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:17:49.614436    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jthdh\" (UniqueName: \"kubernetes.io/projected/17b8bb5c-b128-4a06-b33a-663a0a7f45c4-kube-api-access-jthdh\") pod \"17b8bb5c-b128-4a06-b33a-663a0a7f45c4\" (UID: \"17b8bb5c-b128-4a06-b33a-663a0a7f45c4\") "
Aug 04 23:17:49.616504 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:17:49.616478    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/17b8bb5c-b128-4a06-b33a-663a0a7f45c4-kube-api-access-jthdh" (OuterVolumeSpecName: "kube-api-access-jthdh") pod "17b8bb5c-b128-4a06-b33a-663a0a7f45c4" (UID: "17b8bb5c-b128-4a06-b33a-663a0a7f45c4"). InnerVolumeSpecName "kube-api-access-jthdh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 23:17:49.643996 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:17:49.643972    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7475-140121857682720"]
Aug 04 23:17:49.644436 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:17:49.644421    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="17b8bb5c-b128-4a06-b33a-663a0a7f45c4" containerName="test-curl-7475-140121857682720"
Aug 04 23:17:49.644489 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:17:49.644440    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="17b8bb5c-b128-4a06-b33a-663a0a7f45c4" containerName="test-curl-7475-140121857682720"
Aug 04 23:17:49.644550 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:17:49.644540    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="17b8bb5c-b128-4a06-b33a-663a0a7f45c4" containerName="test-curl-7475-140121857682720"
Aug 04 23:17:49.647667 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:17:49.647650    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7475-140121857682720"
Aug 04 23:17:49.654669 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:17:49.654647    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7475-140121857682720"]
Aug 04 23:17:49.715723 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:17:49.715698    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jthdh\" (UniqueName: \"kubernetes.io/projected/17b8bb5c-b128-4a06-b33a-663a0a7f45c4-kube-api-access-jthdh\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
Aug 04 23:17:49.816571 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:17:49.816523    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7vw7p\" (UniqueName: \"kubernetes.io/projected/95ea57bf-e208-45e8-a2cc-167fdcd6250a-kube-api-access-7vw7p\") pod \"test-curl-7475-140121857682720\" (UID: \"95ea57bf-e208-45e8-a2cc-167fdcd6250a\") " pod="opendatahub/test-curl-7475-140121857682720"
Aug 04 23:17:49.917756 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:17:49.917685    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7vw7p\" (UniqueName: \"kubernetes.io/projected/95ea57bf-e208-45e8-a2cc-167fdcd6250a-kube-api-access-7vw7p\") pod \"test-curl-7475-140121857682720\" (UID: \"95ea57bf-e208-45e8-a2cc-167fdcd6250a\") " pod="opendatahub/test-curl-7475-140121857682720"
Aug 04 23:17:49.925400 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:17:49.925365    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7vw7p\" (UniqueName: \"kubernetes.io/projected/95ea57bf-e208-45e8-a2cc-167fdcd6250a-kube-api-access-7vw7p\") pod \"test-curl-7475-140121857682720\" (UID: \"95ea57bf-e208-45e8-a2cc-167fdcd6250a\") " pod="opendatahub/test-curl-7475-140121857682720"
Aug 04 23:17:49.958021 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:17:49.957997    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7475-140121857682720"
Aug 04 23:17:50.099273 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:17:50.099244    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7475-140121857682720"]
Aug 04 23:17:50.099822 ip-10-0-137-117 kubenswrapper[2580]: W0804 23:17:50.099798    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod95ea57bf_e208_45e8_a2cc_167fdcd6250a.slice/crio-1f2175c05ee56c3373b31dc69b4e31b83af8a625b1952617938c8e6a83e244ca WatchSource:0}: Error finding container 1f2175c05ee56c3373b31dc69b4e31b83af8a625b1952617938c8e6a83e244ca: Status 404 returned error can't find the container with id 1f2175c05ee56c3373b31dc69b4e31b83af8a625b1952617938c8e6a83e244ca
Aug 04 23:17:50.340016 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:17:50.339983    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7475-140121857682720"
Aug 04 23:17:50.340016 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:17:50.339999    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="782ae4f5af27c38d6ea3ccfe303014808927c9bab127b8b9cb6105ea79654144"
Aug 04 23:17:50.341300 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:17:50.341273    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7475-140121857682720" event={"ID":"95ea57bf-e208-45e8-a2cc-167fdcd6250a","Type":"ContainerStarted","Data":"1f2175c05ee56c3373b31dc69b4e31b83af8a625b1952617938c8e6a83e244ca"}
Aug 04 23:17:50.351262 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:17:50.351232    2580 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="opendatahub/test-curl-7475-140121857682720" oldPodUID="17b8bb5c-b128-4a06-b33a-663a0a7f45c4" podUID="95ea57bf-e208-45e8-a2cc-167fdcd6250a"
Aug 04 23:17:51.349684 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:17:51.349649    2580 generic.go:356] "Generic (PLEG): container finished" podID="95ea57bf-e208-45e8-a2cc-167fdcd6250a" containerID="9cad9dd1a62afe6d88c32713dfa622c0e481a058da3baf1eaa913bb58deffb5b" exitCode=0
Aug 04 23:17:51.350049 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:17:51.349731    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7475-140121857682720" event={"ID":"95ea57bf-e208-45e8-a2cc-167fdcd6250a","Type":"ContainerDied","Data":"9cad9dd1a62afe6d88c32713dfa622c0e481a058da3baf1eaa913bb58deffb5b"}
Aug 04 23:17:51.500177 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:17:51.500144    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="17b8bb5c-b128-4a06-b33a-663a0a7f45c4" path="/var/lib/kubelet/pods/17b8bb5c-b128-4a06-b33a-663a0a7f45c4/volumes"
Aug 04 23:17:52.497602 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:17:52.497573    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7475-140121857682720"
Aug 04 23:17:52.516181 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:17:52.516118    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7475-140121857682720_95ea57bf-e208-45e8-a2cc-167fdcd6250a/test-curl-7475-140121857682720/0.log"
Aug 04 23:17:52.537296 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:17:52.537269    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7475-140121857682720"]
Aug 04 23:17:52.539922 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:17:52.539901    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7475-140121857682720"]
Aug 04 23:17:52.643952 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:17:52.643864    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7vw7p\" (UniqueName: \"kubernetes.io/projected/95ea57bf-e208-45e8-a2cc-167fdcd6250a-kube-api-access-7vw7p\") pod \"95ea57bf-e208-45e8-a2cc-167fdcd6250a\" (UID: \"95ea57bf-e208-45e8-a2cc-167fdcd6250a\") "
Aug 04 23:17:52.645893 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:17:52.645863    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/95ea57bf-e208-45e8-a2cc-167fdcd6250a-kube-api-access-7vw7p" (OuterVolumeSpecName: "kube-api-access-7vw7p") pod "95ea57bf-e208-45e8-a2cc-167fdcd6250a" (UID: "95ea57bf-e208-45e8-a2cc-167fdcd6250a"). InnerVolumeSpecName "kube-api-access-7vw7p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 23:17:52.664421 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:17:52.664394    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7475-140121857728848"]
Aug 04 23:17:52.664845 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:17:52.664832    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="95ea57bf-e208-45e8-a2cc-167fdcd6250a" containerName="test-curl-7475-140121857682720"
Aug 04 23:17:52.664888 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:17:52.664847    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="95ea57bf-e208-45e8-a2cc-167fdcd6250a" containerName="test-curl-7475-140121857682720"
Aug 04 23:17:52.664932 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:17:52.664921    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="95ea57bf-e208-45e8-a2cc-167fdcd6250a" containerName="test-curl-7475-140121857682720"
Aug 04 23:17:52.668009 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:17:52.667994    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7475-140121857728848"
Aug 04 23:17:52.673645 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:17:52.673619    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7475-140121857728848"]
Aug 04 23:17:52.745316 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:17:52.745282    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7vw7p\" (UniqueName: \"kubernetes.io/projected/95ea57bf-e208-45e8-a2cc-167fdcd6250a-kube-api-access-7vw7p\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
Aug 04 23:17:52.846188 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:17:52.846153    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fr4n4\" (UniqueName: \"kubernetes.io/projected/6cab087e-298b-41b9-a6d6-6d1a83038bde-kube-api-access-fr4n4\") pod \"test-curl-7475-140121857728848\" (UID: \"6cab087e-298b-41b9-a6d6-6d1a83038bde\") " pod="opendatahub/test-curl-7475-140121857728848"
Aug 04 23:17:52.947569 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:17:52.947477    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fr4n4\" (UniqueName: \"kubernetes.io/projected/6cab087e-298b-41b9-a6d6-6d1a83038bde-kube-api-access-fr4n4\") pod \"test-curl-7475-140121857728848\" (UID: \"6cab087e-298b-41b9-a6d6-6d1a83038bde\") " pod="opendatahub/test-curl-7475-140121857728848"
Aug 04 23:17:52.956116 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:17:52.956089    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fr4n4\" (UniqueName: \"kubernetes.io/projected/6cab087e-298b-41b9-a6d6-6d1a83038bde-kube-api-access-fr4n4\") pod \"test-curl-7475-140121857728848\" (UID: \"6cab087e-298b-41b9-a6d6-6d1a83038bde\") " pod="opendatahub/test-curl-7475-140121857728848"
Aug 04 23:17:52.979123 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:17:52.979101    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7475-140121857728848"
Aug 04 23:17:53.111408 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:17:53.111384    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7475-140121857728848"]
Aug 04 23:17:53.112718 ip-10-0-137-117 kubenswrapper[2580]: W0804 23:17:53.112691    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6cab087e_298b_41b9_a6d6_6d1a83038bde.slice/crio-e124460a8935e001a5f39a94ee3e277e318874e9b6855b4888b67febc3f73b33 WatchSource:0}: Error finding container e124460a8935e001a5f39a94ee3e277e318874e9b6855b4888b67febc3f73b33: Status 404 returned error can't find the container with id e124460a8935e001a5f39a94ee3e277e318874e9b6855b4888b67febc3f73b33
Aug 04 23:17:53.363907 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:17:53.363881    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1f2175c05ee56c3373b31dc69b4e31b83af8a625b1952617938c8e6a83e244ca"
Aug 04 23:17:53.363907 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:17:53.363880    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7475-140121857682720"
Aug 04 23:17:53.365186 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:17:53.365158    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7475-140121857728848" event={"ID":"6cab087e-298b-41b9-a6d6-6d1a83038bde","Type":"ContainerStarted","Data":"e124460a8935e001a5f39a94ee3e277e318874e9b6855b4888b67febc3f73b33"}
Aug 04 23:17:53.374801 ip-10-0-137-117 kubenswrapper[2580]: E0804 23:17:53.374774    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7475-140121857682720\" is forbidden: User \"system:node:ip-10-0-137-117.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-137-117.ec2.internal' and this object" podUID="95ea57bf-e208-45e8-a2cc-167fdcd6250a" pod="opendatahub/test-curl-7475-140121857682720"
Aug 04 23:17:53.498380 ip-10-0-137-117 kubenswrapper[2580]: E0804 23:17:53.498343    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7475-140121857682720\" is forbidden: User \"system:node:ip-10-0-137-117.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-137-117.ec2.internal' and this object" podUID="95ea57bf-e208-45e8-a2cc-167fdcd6250a" pod="opendatahub/test-curl-7475-140121857682720"
Aug 04 23:17:53.500315 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:17:53.500291    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="95ea57bf-e208-45e8-a2cc-167fdcd6250a" path="/var/lib/kubelet/pods/95ea57bf-e208-45e8-a2cc-167fdcd6250a/volumes"
Aug 04 23:17:54.373116 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:17:54.373019    2580 generic.go:356] "Generic (PLEG): container finished" podID="6cab087e-298b-41b9-a6d6-6d1a83038bde" containerID="62243924ec0ddda44aa230f1274ee6a631c787bdd37fdad82f5f25b760663bb8" exitCode=0
Aug 04 23:17:54.373116 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:17:54.373075    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7475-140121857728848" event={"ID":"6cab087e-298b-41b9-a6d6-6d1a83038bde","Type":"ContainerDied","Data":"62243924ec0ddda44aa230f1274ee6a631c787bdd37fdad82f5f25b760663bb8"}
Aug 04 23:17:55.513506 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:17:55.513483    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7475-140121857728848"
Aug 04 23:17:55.532206 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:17:55.532169    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7475-140121857728848_6cab087e-298b-41b9-a6d6-6d1a83038bde/test-curl-7475-140121857728848/0.log"
Aug 04 23:17:55.556305 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:17:55.556271    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7475-140121857728848"]
Aug 04 23:17:55.559455 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:17:55.559433    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7475-140121857728848"]
Aug 04 23:17:55.676808 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:17:55.676742    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fr4n4\" (UniqueName: \"kubernetes.io/projected/6cab087e-298b-41b9-a6d6-6d1a83038bde-kube-api-access-fr4n4\") pod \"6cab087e-298b-41b9-a6d6-6d1a83038bde\" (UID: \"6cab087e-298b-41b9-a6d6-6d1a83038bde\") "
Aug 04 23:17:55.677466 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:17:55.677449    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7475-140121857728848"]
Aug 04 23:17:55.677894 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:17:55.677882    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6cab087e-298b-41b9-a6d6-6d1a83038bde" containerName="test-curl-7475-140121857728848"
Aug 04 23:17:55.677935 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:17:55.677896    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="6cab087e-298b-41b9-a6d6-6d1a83038bde" containerName="test-curl-7475-140121857728848"
Aug 04 23:17:55.677970 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:17:55.677959    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="6cab087e-298b-41b9-a6d6-6d1a83038bde" containerName="test-curl-7475-140121857728848"
Aug 04 23:17:55.678963 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:17:55.678936    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6cab087e-298b-41b9-a6d6-6d1a83038bde-kube-api-access-fr4n4" (OuterVolumeSpecName: "kube-api-access-fr4n4") pod "6cab087e-298b-41b9-a6d6-6d1a83038bde" (UID: "6cab087e-298b-41b9-a6d6-6d1a83038bde"). InnerVolumeSpecName "kube-api-access-fr4n4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 23:17:55.681303 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:17:55.681283    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7475-140121857728848"
Aug 04 23:17:55.684278 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:17:55.684252    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7475-140121857728848"]
Aug 04 23:17:55.778391 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:17:55.778365    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rxxfw\" (UniqueName: \"kubernetes.io/projected/f92759f7-f21a-4585-8650-2304d62bb1ab-kube-api-access-rxxfw\") pod \"test-curl-7475-140121857728848\" (UID: \"f92759f7-f21a-4585-8650-2304d62bb1ab\") " pod="opendatahub/test-curl-7475-140121857728848"
Aug 04 23:17:55.778518 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:17:55.778423    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fr4n4\" (UniqueName: \"kubernetes.io/projected/6cab087e-298b-41b9-a6d6-6d1a83038bde-kube-api-access-fr4n4\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
Aug 04 23:17:55.879140 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:17:55.879104    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rxxfw\" (UniqueName: \"kubernetes.io/projected/f92759f7-f21a-4585-8650-2304d62bb1ab-kube-api-access-rxxfw\") pod \"test-curl-7475-140121857728848\" (UID: \"f92759f7-f21a-4585-8650-2304d62bb1ab\") " pod="opendatahub/test-curl-7475-140121857728848"
Aug 04 23:17:55.886089 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:17:55.886070    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rxxfw\" (UniqueName: \"kubernetes.io/projected/f92759f7-f21a-4585-8650-2304d62bb1ab-kube-api-access-rxxfw\") pod \"test-curl-7475-140121857728848\" (UID: \"f92759f7-f21a-4585-8650-2304d62bb1ab\") " pod="opendatahub/test-curl-7475-140121857728848"
Aug 04 23:17:55.997863 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:17:55.997788    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7475-140121857728848"
Aug 04 23:17:56.128870 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:17:56.128846    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7475-140121857728848"]
Aug 04 23:17:56.130323 ip-10-0-137-117 kubenswrapper[2580]: W0804 23:17:56.130297    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf92759f7_f21a_4585_8650_2304d62bb1ab.slice/crio-9bd98223e09e72c9c48c188ba85d118bf9ea6984abda4e807d002e702601caa3 WatchSource:0}: Error finding container 9bd98223e09e72c9c48c188ba85d118bf9ea6984abda4e807d002e702601caa3: Status 404 returned error can't find the container with id 9bd98223e09e72c9c48c188ba85d118bf9ea6984abda4e807d002e702601caa3
Aug 04 23:17:56.387541 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:17:56.387505    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7475-140121857728848" event={"ID":"f92759f7-f21a-4585-8650-2304d62bb1ab","Type":"ContainerStarted","Data":"9bd98223e09e72c9c48c188ba85d118bf9ea6984abda4e807d002e702601caa3"}
Aug 04 23:17:56.388750 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:17:56.388726    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e124460a8935e001a5f39a94ee3e277e318874e9b6855b4888b67febc3f73b33"
Aug 04 23:17:56.388750 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:17:56.388734    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7475-140121857728848"
Aug 04 23:17:56.399805 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:17:56.399780    2580 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="opendatahub/test-curl-7475-140121857728848" oldPodUID="6cab087e-298b-41b9-a6d6-6d1a83038bde" podUID="f92759f7-f21a-4585-8650-2304d62bb1ab"
Aug 04 23:17:57.396760 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:17:57.396728    2580 generic.go:356] "Generic (PLEG): container finished" podID="f92759f7-f21a-4585-8650-2304d62bb1ab" containerID="83c7bc51e2ab514c0fe86a55e279bddcc9a3336f372d2df0ff5d587941b6a7f8" exitCode=0
Aug 04 23:17:57.397170 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:17:57.396823    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7475-140121857728848" event={"ID":"f92759f7-f21a-4585-8650-2304d62bb1ab","Type":"ContainerDied","Data":"83c7bc51e2ab514c0fe86a55e279bddcc9a3336f372d2df0ff5d587941b6a7f8"}
Aug 04 23:17:57.499477 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:17:57.499444    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6cab087e-298b-41b9-a6d6-6d1a83038bde" path="/var/lib/kubelet/pods/6cab087e-298b-41b9-a6d6-6d1a83038bde/volumes"
Aug 04 23:17:58.547022 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:17:58.546998    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7475-140121857728848"
Aug 04 23:17:58.564677 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:17:58.564656    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7475-140121857728848_f92759f7-f21a-4585-8650-2304d62bb1ab/test-curl-7475-140121857728848/0.log"
Aug 04 23:17:58.585246 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:17:58.585221    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7475-140121857728848"]
Aug 04 23:17:58.588333 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:17:58.588312    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7475-140121857728848"]
Aug 04 23:17:58.603348 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:17:58.603325    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rxxfw\" (UniqueName: \"kubernetes.io/projected/f92759f7-f21a-4585-8650-2304d62bb1ab-kube-api-access-rxxfw\") pod \"f92759f7-f21a-4585-8650-2304d62bb1ab\" (UID: \"f92759f7-f21a-4585-8650-2304d62bb1ab\") "
Aug 04 23:17:58.605670 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:17:58.605645    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f92759f7-f21a-4585-8650-2304d62bb1ab-kube-api-access-rxxfw" (OuterVolumeSpecName: "kube-api-access-rxxfw") pod "f92759f7-f21a-4585-8650-2304d62bb1ab" (UID: "f92759f7-f21a-4585-8650-2304d62bb1ab"). InnerVolumeSpecName "kube-api-access-rxxfw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 23:17:58.704281 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:17:58.704222    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rxxfw\" (UniqueName: \"kubernetes.io/projected/f92759f7-f21a-4585-8650-2304d62bb1ab-kube-api-access-rxxfw\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
Aug 04 23:17:59.411349 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:17:59.411316    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7475-140121857728848"
Aug 04 23:17:59.411349 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:17:59.411346    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9bd98223e09e72c9c48c188ba85d118bf9ea6984abda4e807d002e702601caa3"
Aug 04 23:17:59.422086 ip-10-0-137-117 kubenswrapper[2580]: E0804 23:17:59.422056    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7475-140121857728848\" is forbidden: User \"system:node:ip-10-0-137-117.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-137-117.ec2.internal' and this object" podUID="f92759f7-f21a-4585-8650-2304d62bb1ab" pod="opendatahub/test-curl-7475-140121857728848"
Aug 04 23:17:59.500708 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:17:59.500670    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f92759f7-f21a-4585-8650-2304d62bb1ab" path="/var/lib/kubelet/pods/f92759f7-f21a-4585-8650-2304d62bb1ab/volumes"
Aug 04 23:18:03.547803 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:18:03.547770    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-d1b011-545894c48d-nd8fh"]
Aug 04 23:18:03.548230 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:18:03.548200    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f92759f7-f21a-4585-8650-2304d62bb1ab" containerName="test-curl-7475-140121857728848"
Aug 04 23:18:03.548230 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:18:03.548212    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="f92759f7-f21a-4585-8650-2304d62bb1ab" containerName="test-curl-7475-140121857728848"
Aug 04 23:18:03.548330 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:18:03.548295    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="f92759f7-f21a-4585-8650-2304d62bb1ab" containerName="test-curl-7475-140121857728848"
Aug 04 23:18:03.551512 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:18:03.551496    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-d1b011-545894c48d-nd8fh"
Aug 04 23:18:03.555770 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:18:03.555748    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-a-d1b011-dockercfg-ht9vk\""
Aug 04 23:18:03.555892 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:18:03.555839    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-d1b011\""
Aug 04 23:18:03.563234 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:18:03.563216    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-d1b011-545894c48d-nd8fh"]
Aug 04 23:18:03.653352 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:18:03.653313    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d83d1237-9a1c-4e34-8ef4-22cd8f54734d-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-d1b011-545894c48d-nd8fh\" (UID: \"d83d1237-9a1c-4e34-8ef4-22cd8f54734d\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-d1b011-545894c48d-nd8fh"
Aug 04 23:18:03.653514 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:18:03.653362    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7smq2\" (UniqueName: \"kubernetes.io/projected/d83d1237-9a1c-4e34-8ef4-22cd8f54734d-kube-api-access-7smq2\") pod \"payload-pre-processing-e2e-ipp-a-d1b011-545894c48d-nd8fh\" (UID: \"d83d1237-9a1c-4e34-8ef4-22cd8f54734d\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-d1b011-545894c48d-nd8fh"
Aug 04 23:18:03.754815 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:18:03.754777    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d83d1237-9a1c-4e34-8ef4-22cd8f54734d-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-d1b011-545894c48d-nd8fh\" (UID: \"d83d1237-9a1c-4e34-8ef4-22cd8f54734d\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-d1b011-545894c48d-nd8fh"
Aug 04 23:18:03.755014 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:18:03.754825    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7smq2\" (UniqueName: \"kubernetes.io/projected/d83d1237-9a1c-4e34-8ef4-22cd8f54734d-kube-api-access-7smq2\") pod \"payload-pre-processing-e2e-ipp-a-d1b011-545894c48d-nd8fh\" (UID: \"d83d1237-9a1c-4e34-8ef4-22cd8f54734d\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-d1b011-545894c48d-nd8fh"
Aug 04 23:18:03.755528 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:18:03.755508    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d83d1237-9a1c-4e34-8ef4-22cd8f54734d-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-d1b011-545894c48d-nd8fh\" (UID: \"d83d1237-9a1c-4e34-8ef4-22cd8f54734d\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-d1b011-545894c48d-nd8fh"
Aug 04 23:18:03.762353 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:18:03.762326    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7smq2\" (UniqueName: \"kubernetes.io/projected/d83d1237-9a1c-4e34-8ef4-22cd8f54734d-kube-api-access-7smq2\") pod \"payload-pre-processing-e2e-ipp-a-d1b011-545894c48d-nd8fh\" (UID: \"d83d1237-9a1c-4e34-8ef4-22cd8f54734d\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-d1b011-545894c48d-nd8fh"
Aug 04 23:18:03.863519 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:18:03.863455    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-d1b011-545894c48d-nd8fh"
Aug 04 23:18:04.212492 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:18:04.212454    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-d1b011-545894c48d-nd8fh"]
Aug 04 23:18:04.213966 ip-10-0-137-117 kubenswrapper[2580]: W0804 23:18:04.213940    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd83d1237_9a1c_4e34_8ef4_22cd8f54734d.slice/crio-82bedfe0f26e1e9271388d7d248174ba2af82e60a1cba3ecf49d98f948692acc WatchSource:0}: Error finding container 82bedfe0f26e1e9271388d7d248174ba2af82e60a1cba3ecf49d98f948692acc: Status 404 returned error can't find the container with id 82bedfe0f26e1e9271388d7d248174ba2af82e60a1cba3ecf49d98f948692acc
Aug 04 23:18:04.454860 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:18:04.454823    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-d1b011-545894c48d-nd8fh" event={"ID":"d83d1237-9a1c-4e34-8ef4-22cd8f54734d","Type":"ContainerStarted","Data":"d1d4eec2d0f9df8ea967ddaf1b3d40558209a11dc5fcace53db5f5864341bf39"}
Aug 04 23:18:04.455047 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:18:04.454903    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-d1b011-545894c48d-nd8fh" event={"ID":"d83d1237-9a1c-4e34-8ef4-22cd8f54734d","Type":"ContainerStarted","Data":"82bedfe0f26e1e9271388d7d248174ba2af82e60a1cba3ecf49d98f948692acc"}
Aug 04 23:18:04.455108 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:18:04.455040    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-d1b011-545894c48d-nd8fh"
Aug 04 23:18:04.491445 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:18:04.491346    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-d1b011-545894c48d-nd8fh" podStartSLOduration=1.491327586 podStartE2EDuration="1.491327586s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 23:18:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 23:18:04.488452104 +0000 UTC m=+3431.481269831" watchObservedRunningTime="2026-08-04 23:18:04.491327586 +0000 UTC m=+3431.484145313"
Aug 04 23:18:05.992481 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:18:05.992444    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-595xm"]
Aug 04 23:18:15.463646 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:18:15.463616    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-d1b011-545894c48d-nd8fh"
Aug 04 23:18:32.696676 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:18:32.696640    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-edf378-858f4df796-wbsn4"]
Aug 04 23:18:32.702102 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:18:32.702083    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-edf378-858f4df796-wbsn4"
Aug 04 23:18:32.704469 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:18:32.704446    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-b-edf378-dockercfg-pcrfg\""
Aug 04 23:18:32.704574 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:18:32.704478    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-b-edf378\""
Aug 04 23:18:32.710822 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:18:32.710738    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-edf378-858f4df796-wbsn4"]
Aug 04 23:18:32.730487 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:18:32.730459    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-edf378-677b4dffcd-cjl2m"]
Aug 04 23:18:32.734362 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:18:32.734340    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-edf378-677b4dffcd-cjl2m"
Aug 04 23:18:32.746324 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:18:32.746296    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-edf378-677b4dffcd-cjl2m"]
Aug 04 23:18:32.833550 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:18:32.833516    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9wzsf\" (UniqueName: \"kubernetes.io/projected/ac4b9bcc-9191-41ed-81bb-fcb24c267811-kube-api-access-9wzsf\") pod \"payload-processing-e2e-ipp-b-edf378-677b4dffcd-cjl2m\" (UID: \"ac4b9bcc-9191-41ed-81bb-fcb24c267811\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-edf378-677b4dffcd-cjl2m"
Aug 04 23:18:32.833750 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:18:32.833591    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e3500a62-9bf2-45df-a83e-1c9d2a124e50-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-edf378-858f4df796-wbsn4\" (UID: \"e3500a62-9bf2-45df-a83e-1c9d2a124e50\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-edf378-858f4df796-wbsn4"
Aug 04 23:18:32.833750 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:18:32.833658    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tmkp5\" (UniqueName: \"kubernetes.io/projected/e3500a62-9bf2-45df-a83e-1c9d2a124e50-kube-api-access-tmkp5\") pod \"payload-pre-processing-e2e-ipp-b-edf378-858f4df796-wbsn4\" (UID: \"e3500a62-9bf2-45df-a83e-1c9d2a124e50\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-edf378-858f4df796-wbsn4"
Aug 04 23:18:32.833856 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:18:32.833754    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ac4b9bcc-9191-41ed-81bb-fcb24c267811-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-edf378-677b4dffcd-cjl2m\" (UID: \"ac4b9bcc-9191-41ed-81bb-fcb24c267811\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-edf378-677b4dffcd-cjl2m"
Aug 04 23:18:32.935221 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:18:32.935182    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9wzsf\" (UniqueName: \"kubernetes.io/projected/ac4b9bcc-9191-41ed-81bb-fcb24c267811-kube-api-access-9wzsf\") pod \"payload-processing-e2e-ipp-b-edf378-677b4dffcd-cjl2m\" (UID: \"ac4b9bcc-9191-41ed-81bb-fcb24c267811\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-edf378-677b4dffcd-cjl2m"
Aug 04 23:18:32.935441 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:18:32.935262    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e3500a62-9bf2-45df-a83e-1c9d2a124e50-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-edf378-858f4df796-wbsn4\" (UID: \"e3500a62-9bf2-45df-a83e-1c9d2a124e50\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-edf378-858f4df796-wbsn4"
Aug 04 23:18:32.935441 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:18:32.935306    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tmkp5\" (UniqueName: \"kubernetes.io/projected/e3500a62-9bf2-45df-a83e-1c9d2a124e50-kube-api-access-tmkp5\") pod \"payload-pre-processing-e2e-ipp-b-edf378-858f4df796-wbsn4\" (UID: \"e3500a62-9bf2-45df-a83e-1c9d2a124e50\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-edf378-858f4df796-wbsn4"
Aug 04 23:18:32.935441 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:18:32.935379    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ac4b9bcc-9191-41ed-81bb-fcb24c267811-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-edf378-677b4dffcd-cjl2m\" (UID: \"ac4b9bcc-9191-41ed-81bb-fcb24c267811\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-edf378-677b4dffcd-cjl2m"
Aug 04 23:18:32.936100 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:18:32.936076    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ac4b9bcc-9191-41ed-81bb-fcb24c267811-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-edf378-677b4dffcd-cjl2m\" (UID: \"ac4b9bcc-9191-41ed-81bb-fcb24c267811\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-edf378-677b4dffcd-cjl2m"
Aug 04 23:18:32.936259 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:18:32.936086    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e3500a62-9bf2-45df-a83e-1c9d2a124e50-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-edf378-858f4df796-wbsn4\" (UID: \"e3500a62-9bf2-45df-a83e-1c9d2a124e50\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-edf378-858f4df796-wbsn4"
Aug 04 23:18:32.942885 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:18:32.942859    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tmkp5\" (UniqueName: \"kubernetes.io/projected/e3500a62-9bf2-45df-a83e-1c9d2a124e50-kube-api-access-tmkp5\") pod \"payload-pre-processing-e2e-ipp-b-edf378-858f4df796-wbsn4\" (UID: \"e3500a62-9bf2-45df-a83e-1c9d2a124e50\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-edf378-858f4df796-wbsn4"
Aug 04 23:18:32.943202 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:18:32.943147    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9wzsf\" (UniqueName: \"kubernetes.io/projected/ac4b9bcc-9191-41ed-81bb-fcb24c267811-kube-api-access-9wzsf\") pod \"payload-processing-e2e-ipp-b-edf378-677b4dffcd-cjl2m\" (UID: \"ac4b9bcc-9191-41ed-81bb-fcb24c267811\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-edf378-677b4dffcd-cjl2m"
Aug 04 23:18:33.015664 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:18:33.015580    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-edf378-858f4df796-wbsn4"
Aug 04 23:18:33.048105 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:18:33.048064    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-edf378-677b4dffcd-cjl2m"
Aug 04 23:18:33.223654 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:18:33.223625    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-edf378-677b4dffcd-cjl2m"]
Aug 04 23:18:33.224754 ip-10-0-137-117 kubenswrapper[2580]: W0804 23:18:33.224730    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac4b9bcc_9191_41ed_81bb_fcb24c267811.slice/crio-2a7a8d05095581a1f5c6d1d8a4e66b4377c3561e9df2444e870ce4820d1d9938 WatchSource:0}: Error finding container 2a7a8d05095581a1f5c6d1d8a4e66b4377c3561e9df2444e870ce4820d1d9938: Status 404 returned error can't find the container with id 2a7a8d05095581a1f5c6d1d8a4e66b4377c3561e9df2444e870ce4820d1d9938
Aug 04 23:18:33.380929 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:18:33.380893    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-edf378-858f4df796-wbsn4"]
Aug 04 23:18:33.382375 ip-10-0-137-117 kubenswrapper[2580]: W0804 23:18:33.382353    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3500a62_9bf2_45df_a83e_1c9d2a124e50.slice/crio-e6377607ea3bf4b7d43587d4d9a55cc9e7e30f475a2feee7043e11d5587da430 WatchSource:0}: Error finding container e6377607ea3bf4b7d43587d4d9a55cc9e7e30f475a2feee7043e11d5587da430: Status 404 returned error can't find the container with id e6377607ea3bf4b7d43587d4d9a55cc9e7e30f475a2feee7043e11d5587da430
Aug 04 23:18:33.645213 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:18:33.645172    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-edf378-858f4df796-wbsn4" event={"ID":"e3500a62-9bf2-45df-a83e-1c9d2a124e50","Type":"ContainerStarted","Data":"ca81dd1ac96a13badfefc9544a4f287a99427e2669808abebe545f3ee547b861"}
Aug 04 23:18:33.645440 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:18:33.645251    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-edf378-858f4df796-wbsn4" event={"ID":"e3500a62-9bf2-45df-a83e-1c9d2a124e50","Type":"ContainerStarted","Data":"e6377607ea3bf4b7d43587d4d9a55cc9e7e30f475a2feee7043e11d5587da430"}
Aug 04 23:18:33.647425 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:18:33.647400    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-edf378-677b4dffcd-cjl2m" event={"ID":"ac4b9bcc-9191-41ed-81bb-fcb24c267811","Type":"ContainerStarted","Data":"d127f64b7dc74cac6bfbb77866b71e3c82bdac37606e55bff3f91bb2314983a3"}
Aug 04 23:18:33.647586 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:18:33.647448    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-edf378-677b4dffcd-cjl2m" event={"ID":"ac4b9bcc-9191-41ed-81bb-fcb24c267811","Type":"ContainerStarted","Data":"2a7a8d05095581a1f5c6d1d8a4e66b4377c3561e9df2444e870ce4820d1d9938"}
Aug 04 23:18:33.647586 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:18:33.647477    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-edf378-677b4dffcd-cjl2m"
Aug 04 23:18:33.661314 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:18:33.661264    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-edf378-858f4df796-wbsn4" podStartSLOduration=1.661243893 podStartE2EDuration="1.661243893s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 23:18:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 23:18:33.659578651 +0000 UTC m=+3460.652396405" watchObservedRunningTime="2026-08-04 23:18:33.661243893 +0000 UTC m=+3460.654061622"
Aug 04 23:18:33.674398 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:18:33.674356    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-b-edf378-677b4dffcd-cjl2m" podStartSLOduration=1.6743394729999999 podStartE2EDuration="1.674339473s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 23:18:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 23:18:33.672647131 +0000 UTC m=+3460.665464860" watchObservedRunningTime="2026-08-04 23:18:33.674339473 +0000 UTC m=+3460.667157212"
Aug 04 23:18:34.656507 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:18:34.656471    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-edf378-858f4df796-wbsn4"
Aug 04 23:18:35.991300 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:18:35.991264    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-595xm"]
Aug 04 23:18:44.659304 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:18:44.659271    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-edf378-677b4dffcd-cjl2m"
Aug 04 23:18:45.665338 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:18:45.665302    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-edf378-858f4df796-wbsn4"
Aug 04 23:19:03.028808 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:19:03.028772    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-edf378-677b4dffcd-cjl2m_ac4b9bcc-9191-41ed-81bb-fcb24c267811/payload-processing/0.log"
Aug 04 23:19:38.589108 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:19:38.589023    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-595xm"]
Aug 04 23:20:02.899616 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:20:02.899581    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-595xm"]
Aug 04 23:20:13.756051 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:20:13.756023    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-edf378-677b4dffcd-cjl2m_ac4b9bcc-9191-41ed-81bb-fcb24c267811/payload-processing/0.log"
Aug 04 23:20:18.633011 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:20:18.632976    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-2b5cc7-76689c6666-bd64d"]
Aug 04 23:20:18.646115 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:20:18.645529    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-2b5cc7-76689c6666-bd64d"
Aug 04 23:20:18.646962 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:20:18.646933    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-2b5cc7-76689c6666-bd64d"]
Aug 04 23:20:18.648106 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:20:18.648086    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-cleanup-2b5cc7-serving-cert\""
Aug 04 23:20:18.685748 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:20:18.685712    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rwgnm\" (UniqueName: \"kubernetes.io/projected/fad05cd8-69cc-41ff-9411-f7d7d7e258ad-kube-api-access-rwgnm\") pod \"maas-api-e2e-ipp-cleanup-2b5cc7-76689c6666-bd64d\" (UID: \"fad05cd8-69cc-41ff-9411-f7d7d7e258ad\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-2b5cc7-76689c6666-bd64d"
Aug 04 23:20:18.685916 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:20:18.685815    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fad05cd8-69cc-41ff-9411-f7d7d7e258ad-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-2b5cc7-76689c6666-bd64d\" (UID: \"fad05cd8-69cc-41ff-9411-f7d7d7e258ad\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-2b5cc7-76689c6666-bd64d"
Aug 04 23:20:18.685916 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:20:18.685848    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fad05cd8-69cc-41ff-9411-f7d7d7e258ad-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-2b5cc7-76689c6666-bd64d\" (UID: \"fad05cd8-69cc-41ff-9411-f7d7d7e258ad\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-2b5cc7-76689c6666-bd64d"
Aug 04 23:20:18.787158 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:20:18.787109    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fad05cd8-69cc-41ff-9411-f7d7d7e258ad-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-2b5cc7-76689c6666-bd64d\" (UID: \"fad05cd8-69cc-41ff-9411-f7d7d7e258ad\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-2b5cc7-76689c6666-bd64d"
Aug 04 23:20:18.787362 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:20:18.787177    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rwgnm\" (UniqueName: \"kubernetes.io/projected/fad05cd8-69cc-41ff-9411-f7d7d7e258ad-kube-api-access-rwgnm\") pod \"maas-api-e2e-ipp-cleanup-2b5cc7-76689c6666-bd64d\" (UID: \"fad05cd8-69cc-41ff-9411-f7d7d7e258ad\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-2b5cc7-76689c6666-bd64d"
Aug 04 23:20:18.787362 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:20:18.787258    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fad05cd8-69cc-41ff-9411-f7d7d7e258ad-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-2b5cc7-76689c6666-bd64d\" (UID: \"fad05cd8-69cc-41ff-9411-f7d7d7e258ad\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-2b5cc7-76689c6666-bd64d"
Aug 04 23:20:18.787362 ip-10-0-137-117 kubenswrapper[2580]: E0804 23:20:18.787280    2580 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-2b5cc7-serving-cert: secret "maas-api-e2e-ipp-cleanup-2b5cc7-serving-cert" not found
Aug 04 23:20:18.787362 ip-10-0-137-117 kubenswrapper[2580]: E0804 23:20:18.787356    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fad05cd8-69cc-41ff-9411-f7d7d7e258ad-maas-api-tls podName:fad05cd8-69cc-41ff-9411-f7d7d7e258ad nodeName:}" failed. No retries permitted until 2026-08-04 23:20:19.287336786 +0000 UTC m=+3566.280154505 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/fad05cd8-69cc-41ff-9411-f7d7d7e258ad-maas-api-tls") pod "maas-api-e2e-ipp-cleanup-2b5cc7-76689c6666-bd64d" (UID: "fad05cd8-69cc-41ff-9411-f7d7d7e258ad") : secret "maas-api-e2e-ipp-cleanup-2b5cc7-serving-cert" not found
Aug 04 23:20:18.787864 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:20:18.787847    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fad05cd8-69cc-41ff-9411-f7d7d7e258ad-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-2b5cc7-76689c6666-bd64d\" (UID: \"fad05cd8-69cc-41ff-9411-f7d7d7e258ad\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-2b5cc7-76689c6666-bd64d"
Aug 04 23:20:18.796931 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:20:18.796906    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rwgnm\" (UniqueName: \"kubernetes.io/projected/fad05cd8-69cc-41ff-9411-f7d7d7e258ad-kube-api-access-rwgnm\") pod \"maas-api-e2e-ipp-cleanup-2b5cc7-76689c6666-bd64d\" (UID: \"fad05cd8-69cc-41ff-9411-f7d7d7e258ad\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-2b5cc7-76689c6666-bd64d"
Aug 04 23:20:19.291705 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:20:19.291667    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fad05cd8-69cc-41ff-9411-f7d7d7e258ad-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-2b5cc7-76689c6666-bd64d\" (UID: \"fad05cd8-69cc-41ff-9411-f7d7d7e258ad\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-2b5cc7-76689c6666-bd64d"
Aug 04 23:20:19.294115 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:20:19.294090    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fad05cd8-69cc-41ff-9411-f7d7d7e258ad-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-2b5cc7-76689c6666-bd64d\" (UID: \"fad05cd8-69cc-41ff-9411-f7d7d7e258ad\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-2b5cc7-76689c6666-bd64d"
Aug 04 23:20:19.558090 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:20:19.558049    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-2b5cc7-76689c6666-bd64d"
Aug 04 23:20:19.703818 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:20:19.703790    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-2b5cc7-76689c6666-bd64d"]
Aug 04 23:20:19.706450 ip-10-0-137-117 kubenswrapper[2580]: W0804 23:20:19.706412    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfad05cd8_69cc_41ff_9411_f7d7d7e258ad.slice/crio-68178c77e29b25482e4301326b109b7bac9b87cbdfa04a572258e93316dcee77 WatchSource:0}: Error finding container 68178c77e29b25482e4301326b109b7bac9b87cbdfa04a572258e93316dcee77: Status 404 returned error can't find the container with id 68178c77e29b25482e4301326b109b7bac9b87cbdfa04a572258e93316dcee77
Aug 04 23:20:20.355803 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:20:20.355765    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-2b5cc7-76689c6666-bd64d" event={"ID":"fad05cd8-69cc-41ff-9411-f7d7d7e258ad","Type":"ContainerStarted","Data":"67690f473116ef982866400a90d6f0b17c0929d3ab1ebbedff89ca6f9b23703f"}
Aug 04 23:20:20.355972 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:20:20.355850    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-2b5cc7-76689c6666-bd64d" event={"ID":"fad05cd8-69cc-41ff-9411-f7d7d7e258ad","Type":"ContainerStarted","Data":"68178c77e29b25482e4301326b109b7bac9b87cbdfa04a572258e93316dcee77"}
Aug 04 23:20:20.355972 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:20:20.355872    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-2b5cc7-76689c6666-bd64d"
Aug 04 23:20:20.373962 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:20:20.373910    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-2b5cc7-76689c6666-bd64d" podStartSLOduration=1.878620847 podStartE2EDuration="2.373894651s" totalImagesPullingTime="495.273804ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 23:20:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 23:20:20.372025786 +0000 UTC m=+3567.364843512" watchObservedRunningTime="2026-08-04 23:20:20.373894651 +0000 UTC m=+3567.366712408"
Aug 04 23:20:24.395964 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:20:24.395929    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-595xm"]
Aug 04 23:20:26.369384 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:20:26.369355    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-2b5cc7-76689c6666-bd64d"
Aug 04 23:20:43.148550 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:20:43.148516    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-2b5cc7-zj69b"]
Aug 04 23:20:43.152713 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:20:43.152683    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-2b5cc7-zj69b"
Aug 04 23:20:43.154997 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:20:43.154976    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-vvngh\""
Aug 04 23:20:43.160523 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:20:43.160499    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-2b5cc7-zj69b"]
Aug 04 23:20:43.201367 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:20:43.201329    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/10d5df52-e3cf-41b9-a54a-f244e9382d22-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-2b5cc7-zj69b\" (UID: \"10d5df52-e3cf-41b9-a54a-f244e9382d22\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-2b5cc7-zj69b"
Aug 04 23:20:43.302687 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:20:43.302656    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/10d5df52-e3cf-41b9-a54a-f244e9382d22-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-2b5cc7-zj69b\" (UID: \"10d5df52-e3cf-41b9-a54a-f244e9382d22\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-2b5cc7-zj69b"
Aug 04 23:20:43.303256 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:20:43.303240    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/10d5df52-e3cf-41b9-a54a-f244e9382d22-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-2b5cc7-zj69b\" (UID: \"10d5df52-e3cf-41b9-a54a-f244e9382d22\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-2b5cc7-zj69b"
Aug 04 23:20:43.468001 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:20:43.467934    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-2b5cc7-zj69b"
Aug 04 23:20:43.608360 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:20:43.608327    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-2b5cc7-zj69b"]
Aug 04 23:20:43.609835 ip-10-0-137-117 kubenswrapper[2580]: W0804 23:20:43.609796    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10d5df52_e3cf_41b9_a54a_f244e9382d22.slice/crio-68f399bf4686810770bd03281d074a8f54045ed0c6a20a18ac48cc19897c1fac WatchSource:0}: Error finding container 68f399bf4686810770bd03281d074a8f54045ed0c6a20a18ac48cc19897c1fac: Status 404 returned error can't find the container with id 68f399bf4686810770bd03281d074a8f54045ed0c6a20a18ac48cc19897c1fac
Aug 04 23:20:44.517551 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:20:44.517519    2580 generic.go:356] "Generic (PLEG): container finished" podID="10d5df52-e3cf-41b9-a54a-f244e9382d22" containerID="9f14a1e3b8c32acebaaf7009476cd660a76511dd35005eecfc63deadbe6c852d" exitCode=0
Aug 04 23:20:44.517926 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:20:44.517576    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-2b5cc7-zj69b" event={"ID":"10d5df52-e3cf-41b9-a54a-f244e9382d22","Type":"ContainerDied","Data":"9f14a1e3b8c32acebaaf7009476cd660a76511dd35005eecfc63deadbe6c852d"}
Aug 04 23:20:44.517926 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:20:44.517622    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-2b5cc7-zj69b" event={"ID":"10d5df52-e3cf-41b9-a54a-f244e9382d22","Type":"ContainerStarted","Data":"68f399bf4686810770bd03281d074a8f54045ed0c6a20a18ac48cc19897c1fac"}
Aug 04 23:20:45.671101 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:20:45.671077    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-2b5cc7-zj69b"
Aug 04 23:20:45.723341 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:20:45.723310    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/10d5df52-e3cf-41b9-a54a-f244e9382d22-maas-api-service-ca\") pod \"10d5df52-e3cf-41b9-a54a-f244e9382d22\" (UID: \"10d5df52-e3cf-41b9-a54a-f244e9382d22\") "
Aug 04 23:20:45.723676 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:20:45.723649    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/10d5df52-e3cf-41b9-a54a-f244e9382d22-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "10d5df52-e3cf-41b9-a54a-f244e9382d22" (UID: "10d5df52-e3cf-41b9-a54a-f244e9382d22"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 23:20:45.824110 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:20:45.824082    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/10d5df52-e3cf-41b9-a54a-f244e9382d22-maas-api-service-ca\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
Aug 04 23:20:46.532674 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:20:46.532649    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-2b5cc7-zj69b"
Aug 04 23:20:46.532839 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:20:46.532644    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-2b5cc7-zj69b" event={"ID":"10d5df52-e3cf-41b9-a54a-f244e9382d22","Type":"ContainerDied","Data":"68f399bf4686810770bd03281d074a8f54045ed0c6a20a18ac48cc19897c1fac"}
Aug 04 23:20:46.532839 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:20:46.532775    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="68f399bf4686810770bd03281d074a8f54045ed0c6a20a18ac48cc19897c1fac"
Aug 04 23:20:49.142810 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:20:49.142767    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-2b5cc7-76689c6666-bd64d"]
Aug 04 23:20:49.143290 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:20:49.143032    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-2b5cc7-76689c6666-bd64d" podUID="fad05cd8-69cc-41ff-9411-f7d7d7e258ad" containerName="maas-api" containerID="cri-o://67690f473116ef982866400a90d6f0b17c0929d3ab1ebbedff89ca6f9b23703f" gracePeriod=30
Aug 04 23:20:49.309054 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:20:49.309022    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-2b5cc7-zj69b"]
Aug 04 23:20:49.311731 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:20:49.311707    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-2b5cc7-zj69b"]
Aug 04 23:20:49.415876 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:20:49.415852    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-2b5cc7-76689c6666-bd64d"
Aug 04 23:20:49.501821 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:20:49.501785    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="10d5df52-e3cf-41b9-a54a-f244e9382d22" path="/var/lib/kubelet/pods/10d5df52-e3cf-41b9-a54a-f244e9382d22/volumes"
Aug 04 23:20:49.552219 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:20:49.552188    2580 generic.go:356] "Generic (PLEG): container finished" podID="fad05cd8-69cc-41ff-9411-f7d7d7e258ad" containerID="67690f473116ef982866400a90d6f0b17c0929d3ab1ebbedff89ca6f9b23703f" exitCode=0
Aug 04 23:20:49.552379 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:20:49.552224    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-2b5cc7-76689c6666-bd64d" event={"ID":"fad05cd8-69cc-41ff-9411-f7d7d7e258ad","Type":"ContainerDied","Data":"67690f473116ef982866400a90d6f0b17c0929d3ab1ebbedff89ca6f9b23703f"}
Aug 04 23:20:49.552379 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:20:49.552252    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-2b5cc7-76689c6666-bd64d"
Aug 04 23:20:49.552379 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:20:49.552291    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-2b5cc7-76689c6666-bd64d" event={"ID":"fad05cd8-69cc-41ff-9411-f7d7d7e258ad","Type":"ContainerDied","Data":"68178c77e29b25482e4301326b109b7bac9b87cbdfa04a572258e93316dcee77"}
Aug 04 23:20:49.552379 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:20:49.552317    2580 scope.go:117] "RemoveContainer" containerID="67690f473116ef982866400a90d6f0b17c0929d3ab1ebbedff89ca6f9b23703f"
Aug 04 23:20:49.562170 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:20:49.562154    2580 scope.go:117] "RemoveContainer" containerID="67690f473116ef982866400a90d6f0b17c0929d3ab1ebbedff89ca6f9b23703f"
Aug 04 23:20:49.562415 ip-10-0-137-117 kubenswrapper[2580]: E0804 23:20:49.562396    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"67690f473116ef982866400a90d6f0b17c0929d3ab1ebbedff89ca6f9b23703f\": container with ID starting with 67690f473116ef982866400a90d6f0b17c0929d3ab1ebbedff89ca6f9b23703f not found: ID does not exist" containerID="67690f473116ef982866400a90d6f0b17c0929d3ab1ebbedff89ca6f9b23703f"
Aug 04 23:20:49.562482 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:20:49.562428    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"67690f473116ef982866400a90d6f0b17c0929d3ab1ebbedff89ca6f9b23703f"} err="failed to get container status \"67690f473116ef982866400a90d6f0b17c0929d3ab1ebbedff89ca6f9b23703f\": rpc error: code = NotFound desc = could not find container \"67690f473116ef982866400a90d6f0b17c0929d3ab1ebbedff89ca6f9b23703f\": container with ID starting with 67690f473116ef982866400a90d6f0b17c0929d3ab1ebbedff89ca6f9b23703f not found: ID does not exist"
Aug 04 23:20:49.564949 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:20:49.564932    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fad05cd8-69cc-41ff-9411-f7d7d7e258ad-maas-api-tls\") pod \"fad05cd8-69cc-41ff-9411-f7d7d7e258ad\" (UID: \"fad05cd8-69cc-41ff-9411-f7d7d7e258ad\") "
Aug 04 23:20:49.565016 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:20:49.564962    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fad05cd8-69cc-41ff-9411-f7d7d7e258ad-openshift-service-ca\") pod \"fad05cd8-69cc-41ff-9411-f7d7d7e258ad\" (UID: \"fad05cd8-69cc-41ff-9411-f7d7d7e258ad\") "
Aug 04 23:20:49.565016 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:20:49.564990    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rwgnm\" (UniqueName: \"kubernetes.io/projected/fad05cd8-69cc-41ff-9411-f7d7d7e258ad-kube-api-access-rwgnm\") pod \"fad05cd8-69cc-41ff-9411-f7d7d7e258ad\" (UID: \"fad05cd8-69cc-41ff-9411-f7d7d7e258ad\") "
Aug 04 23:20:49.565359 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:20:49.565328    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fad05cd8-69cc-41ff-9411-f7d7d7e258ad-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "fad05cd8-69cc-41ff-9411-f7d7d7e258ad" (UID: "fad05cd8-69cc-41ff-9411-f7d7d7e258ad"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 23:20:49.566962 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:20:49.566942    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fad05cd8-69cc-41ff-9411-f7d7d7e258ad-kube-api-access-rwgnm" (OuterVolumeSpecName: "kube-api-access-rwgnm") pod "fad05cd8-69cc-41ff-9411-f7d7d7e258ad" (UID: "fad05cd8-69cc-41ff-9411-f7d7d7e258ad"). InnerVolumeSpecName "kube-api-access-rwgnm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 23:20:49.567054 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:20:49.566965    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fad05cd8-69cc-41ff-9411-f7d7d7e258ad-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "fad05cd8-69cc-41ff-9411-f7d7d7e258ad" (UID: "fad05cd8-69cc-41ff-9411-f7d7d7e258ad"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 23:20:49.666366 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:20:49.666301    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fad05cd8-69cc-41ff-9411-f7d7d7e258ad-maas-api-tls\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
Aug 04 23:20:49.666366 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:20:49.666324    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fad05cd8-69cc-41ff-9411-f7d7d7e258ad-openshift-service-ca\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
Aug 04 23:20:49.666366 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:20:49.666338    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rwgnm\" (UniqueName: \"kubernetes.io/projected/fad05cd8-69cc-41ff-9411-f7d7d7e258ad-kube-api-access-rwgnm\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
Aug 04 23:20:49.873712 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:20:49.873682    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-2b5cc7-76689c6666-bd64d"]
Aug 04 23:20:49.877690 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:20:49.877666    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-2b5cc7-76689c6666-bd64d"]
Aug 04 23:20:51.195510 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:20:51.195473    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-595xm"]
Aug 04 23:20:51.500515 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:20:51.500438    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fad05cd8-69cc-41ff-9411-f7d7d7e258ad" path="/var/lib/kubelet/pods/fad05cd8-69cc-41ff-9411-f7d7d7e258ad/volumes"
Aug 04 23:20:59.312241 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:20:59.312205    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-d1b011-9xkph"]
Aug 04 23:20:59.312730 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:20:59.312710    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fad05cd8-69cc-41ff-9411-f7d7d7e258ad" containerName="maas-api"
Aug 04 23:20:59.312730 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:20:59.312731    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="fad05cd8-69cc-41ff-9411-f7d7d7e258ad" containerName="maas-api"
Aug 04 23:20:59.312835 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:20:59.312740    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="10d5df52-e3cf-41b9-a54a-f244e9382d22" containerName="revoke-keys"
Aug 04 23:20:59.312835 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:20:59.312747    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="10d5df52-e3cf-41b9-a54a-f244e9382d22" containerName="revoke-keys"
Aug 04 23:20:59.312835 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:20:59.312827    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="fad05cd8-69cc-41ff-9411-f7d7d7e258ad" containerName="maas-api"
Aug 04 23:20:59.312835 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:20:59.312836    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="10d5df52-e3cf-41b9-a54a-f244e9382d22" containerName="revoke-keys"
Aug 04 23:20:59.317485 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:20:59.317468    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-d1b011-9xkph"
Aug 04 23:20:59.319527 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:20:59.319495    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-vvngh\""
Aug 04 23:20:59.322225 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:20:59.322196    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-d1b011-9xkph"]
Aug 04 23:20:59.460018 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:20:59.459979    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5b453331-da62-4f56-ba18-b9c793d154f6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-d1b011-9xkph\" (UID: \"5b453331-da62-4f56-ba18-b9c793d154f6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-d1b011-9xkph"
Aug 04 23:20:59.561078 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:20:59.561039    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5b453331-da62-4f56-ba18-b9c793d154f6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-d1b011-9xkph\" (UID: \"5b453331-da62-4f56-ba18-b9c793d154f6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-d1b011-9xkph"
Aug 04 23:20:59.561816 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:20:59.561792    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5b453331-da62-4f56-ba18-b9c793d154f6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-d1b011-9xkph\" (UID: \"5b453331-da62-4f56-ba18-b9c793d154f6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-d1b011-9xkph"
Aug 04 23:20:59.630621 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:20:59.630553    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-d1b011-9xkph"
Aug 04 23:20:59.769177 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:20:59.769149    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-d1b011-9xkph"]
Aug 04 23:20:59.771071 ip-10-0-137-117 kubenswrapper[2580]: W0804 23:20:59.771046    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b453331_da62_4f56_ba18_b9c793d154f6.slice/crio-420a8ad0ce5c9b4df8a0b3b920389db334a85e71b1811565dc5775490ef9eb15 WatchSource:0}: Error finding container 420a8ad0ce5c9b4df8a0b3b920389db334a85e71b1811565dc5775490ef9eb15: Status 404 returned error can't find the container with id 420a8ad0ce5c9b4df8a0b3b920389db334a85e71b1811565dc5775490ef9eb15
Aug 04 23:21:00.626242 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:21:00.626203    2580 generic.go:356] "Generic (PLEG): container finished" podID="5b453331-da62-4f56-ba18-b9c793d154f6" containerID="e4fc8042c30f2c4fa6bfe8669af125bede8ebecfc63302b8171d7671e4433afb" exitCode=0
Aug 04 23:21:00.626651 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:21:00.626295    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-d1b011-9xkph" event={"ID":"5b453331-da62-4f56-ba18-b9c793d154f6","Type":"ContainerDied","Data":"e4fc8042c30f2c4fa6bfe8669af125bede8ebecfc63302b8171d7671e4433afb"}
Aug 04 23:21:00.626651 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:21:00.626352    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-d1b011-9xkph" event={"ID":"5b453331-da62-4f56-ba18-b9c793d154f6","Type":"ContainerStarted","Data":"420a8ad0ce5c9b4df8a0b3b920389db334a85e71b1811565dc5775490ef9eb15"}
Aug 04 23:21:01.789018 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:21:01.788991    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-d1b011-9xkph"
Aug 04 23:21:01.985490 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:21:01.985386    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5b453331-da62-4f56-ba18-b9c793d154f6-maas-api-service-ca\") pod \"5b453331-da62-4f56-ba18-b9c793d154f6\" (UID: \"5b453331-da62-4f56-ba18-b9c793d154f6\") "
Aug 04 23:21:01.985801 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:21:01.985774    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5b453331-da62-4f56-ba18-b9c793d154f6-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "5b453331-da62-4f56-ba18-b9c793d154f6" (UID: "5b453331-da62-4f56-ba18-b9c793d154f6"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 23:21:02.086460 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:21:02.086425    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5b453331-da62-4f56-ba18-b9c793d154f6-maas-api-service-ca\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
Aug 04 23:21:02.641742 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:21:02.641713    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-d1b011-9xkph"
Aug 04 23:21:02.641911 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:21:02.641759    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-d1b011-9xkph" event={"ID":"5b453331-da62-4f56-ba18-b9c793d154f6","Type":"ContainerDied","Data":"420a8ad0ce5c9b4df8a0b3b920389db334a85e71b1811565dc5775490ef9eb15"}
Aug 04 23:21:02.641911 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:21:02.641818    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="420a8ad0ce5c9b4df8a0b3b920389db334a85e71b1811565dc5775490ef9eb15"
Aug 04 23:21:13.095072 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:21:13.095039    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-595xm"]
Aug 04 23:21:14.843547 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:21:14.843512    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-d1b011-545894c48d-nd8fh"]
Aug 04 23:21:14.844345 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:21:14.844116    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-d1b011-545894c48d-nd8fh" podUID="d83d1237-9a1c-4e34-8ef4-22cd8f54734d" containerName="payload-pre-processing" containerID="cri-o://d1d4eec2d0f9df8ea967ddaf1b3d40558209a11dc5fcace53db5f5864341bf39" gracePeriod=30
Aug 04 23:21:14.969298 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:21:14.969269    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-d1b011-9xkph"]
Aug 04 23:21:14.972007 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:21:14.971985    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-d1b011-9xkph"]
Aug 04 23:21:15.109263 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:21:15.109205    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-d1b011-545894c48d-nd8fh"
Aug 04 23:21:15.196680 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:21:15.196652    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d83d1237-9a1c-4e34-8ef4-22cd8f54734d-plugins-config-volume\") pod \"d83d1237-9a1c-4e34-8ef4-22cd8f54734d\" (UID: \"d83d1237-9a1c-4e34-8ef4-22cd8f54734d\") "
Aug 04 23:21:15.196869 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:21:15.196699    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7smq2\" (UniqueName: \"kubernetes.io/projected/d83d1237-9a1c-4e34-8ef4-22cd8f54734d-kube-api-access-7smq2\") pod \"d83d1237-9a1c-4e34-8ef4-22cd8f54734d\" (UID: \"d83d1237-9a1c-4e34-8ef4-22cd8f54734d\") "
Aug 04 23:21:15.197076 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:21:15.197050    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d83d1237-9a1c-4e34-8ef4-22cd8f54734d-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "d83d1237-9a1c-4e34-8ef4-22cd8f54734d" (UID: "d83d1237-9a1c-4e34-8ef4-22cd8f54734d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 23:21:15.198812 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:21:15.198791    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d83d1237-9a1c-4e34-8ef4-22cd8f54734d-kube-api-access-7smq2" (OuterVolumeSpecName: "kube-api-access-7smq2") pod "d83d1237-9a1c-4e34-8ef4-22cd8f54734d" (UID: "d83d1237-9a1c-4e34-8ef4-22cd8f54734d"). InnerVolumeSpecName "kube-api-access-7smq2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 23:21:15.297696 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:21:15.297669    2580 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d83d1237-9a1c-4e34-8ef4-22cd8f54734d-plugins-config-volume\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
Aug 04 23:21:15.297696 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:21:15.297693    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7smq2\" (UniqueName: \"kubernetes.io/projected/d83d1237-9a1c-4e34-8ef4-22cd8f54734d-kube-api-access-7smq2\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
Aug 04 23:21:15.500750 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:21:15.500677    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5b453331-da62-4f56-ba18-b9c793d154f6" path="/var/lib/kubelet/pods/5b453331-da62-4f56-ba18-b9c793d154f6/volumes"
Aug 04 23:21:15.726003 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:21:15.725969    2580 generic.go:356] "Generic (PLEG): container finished" podID="d83d1237-9a1c-4e34-8ef4-22cd8f54734d" containerID="d1d4eec2d0f9df8ea967ddaf1b3d40558209a11dc5fcace53db5f5864341bf39" exitCode=0
Aug 04 23:21:15.726219 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:21:15.726018    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-d1b011-545894c48d-nd8fh"
Aug 04 23:21:15.726219 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:21:15.726056    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-d1b011-545894c48d-nd8fh" event={"ID":"d83d1237-9a1c-4e34-8ef4-22cd8f54734d","Type":"ContainerDied","Data":"d1d4eec2d0f9df8ea967ddaf1b3d40558209a11dc5fcace53db5f5864341bf39"}
Aug 04 23:21:15.726219 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:21:15.726124    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-d1b011-545894c48d-nd8fh" event={"ID":"d83d1237-9a1c-4e34-8ef4-22cd8f54734d","Type":"ContainerDied","Data":"82bedfe0f26e1e9271388d7d248174ba2af82e60a1cba3ecf49d98f948692acc"}
Aug 04 23:21:15.726219 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:21:15.726171    2580 scope.go:117] "RemoveContainer" containerID="d1d4eec2d0f9df8ea967ddaf1b3d40558209a11dc5fcace53db5f5864341bf39"
Aug 04 23:21:15.736459 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:21:15.736438    2580 scope.go:117] "RemoveContainer" containerID="d1d4eec2d0f9df8ea967ddaf1b3d40558209a11dc5fcace53db5f5864341bf39"
Aug 04 23:21:15.736784 ip-10-0-137-117 kubenswrapper[2580]: E0804 23:21:15.736752    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d1d4eec2d0f9df8ea967ddaf1b3d40558209a11dc5fcace53db5f5864341bf39\": container with ID starting with d1d4eec2d0f9df8ea967ddaf1b3d40558209a11dc5fcace53db5f5864341bf39 not found: ID does not exist" containerID="d1d4eec2d0f9df8ea967ddaf1b3d40558209a11dc5fcace53db5f5864341bf39"
Aug 04 23:21:15.736893 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:21:15.736791    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d1d4eec2d0f9df8ea967ddaf1b3d40558209a11dc5fcace53db5f5864341bf39"} err="failed to get container status \"d1d4eec2d0f9df8ea967ddaf1b3d40558209a11dc5fcace53db5f5864341bf39\": rpc error: code = NotFound desc = could not find container \"d1d4eec2d0f9df8ea967ddaf1b3d40558209a11dc5fcace53db5f5864341bf39\": container with ID starting with d1d4eec2d0f9df8ea967ddaf1b3d40558209a11dc5fcace53db5f5864341bf39 not found: ID does not exist"
Aug 04 23:21:15.743163 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:21:15.743125    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-d1b011-545894c48d-nd8fh"]
Aug 04 23:21:15.745978 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:21:15.745958    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-d1b011-545894c48d-nd8fh"]
Aug 04 23:21:17.500614 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:21:17.500585    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d83d1237-9a1c-4e34-8ef4-22cd8f54734d" path="/var/lib/kubelet/pods/d83d1237-9a1c-4e34-8ef4-22cd8f54734d/volumes"
Aug 04 23:21:21.886808 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:21:21.886774    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-595xm"]
Aug 04 23:22:03.501684 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:03.501652    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-edf378-mkj95"]
Aug 04 23:22:03.502122 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:03.502066    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5b453331-da62-4f56-ba18-b9c793d154f6" containerName="revoke-keys"
Aug 04 23:22:03.502122 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:03.502078    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b453331-da62-4f56-ba18-b9c793d154f6" containerName="revoke-keys"
Aug 04 23:22:03.502122 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:03.502087    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d83d1237-9a1c-4e34-8ef4-22cd8f54734d" containerName="payload-pre-processing"
Aug 04 23:22:03.502122 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:03.502093    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="d83d1237-9a1c-4e34-8ef4-22cd8f54734d" containerName="payload-pre-processing"
Aug 04 23:22:03.502285 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:03.502199    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="d83d1237-9a1c-4e34-8ef4-22cd8f54734d" containerName="payload-pre-processing"
Aug 04 23:22:03.502285 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:03.502207    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="5b453331-da62-4f56-ba18-b9c793d154f6" containerName="revoke-keys"
Aug 04 23:22:03.506639 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:03.506614    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-edf378-mkj95"
Aug 04 23:22:03.507689 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:03.507663    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-edf378-mkj95"]
Aug 04 23:22:03.508736 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:03.508717    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-vvngh\""
Aug 04 23:22:03.525539 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:03.525509    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4a84e890-0208-4e3d-ac80-234fdcfcaa31-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-edf378-mkj95\" (UID: \"4a84e890-0208-4e3d-ac80-234fdcfcaa31\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-edf378-mkj95"
Aug 04 23:22:03.626522 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:03.626494    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4a84e890-0208-4e3d-ac80-234fdcfcaa31-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-edf378-mkj95\" (UID: \"4a84e890-0208-4e3d-ac80-234fdcfcaa31\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-edf378-mkj95"
Aug 04 23:22:03.627110 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:03.627091    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4a84e890-0208-4e3d-ac80-234fdcfcaa31-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-edf378-mkj95\" (UID: \"4a84e890-0208-4e3d-ac80-234fdcfcaa31\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-edf378-mkj95"
Aug 04 23:22:03.819880 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:03.819850    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-edf378-mkj95"
Aug 04 23:22:03.962206 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:03.962181    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-edf378-mkj95"]
Aug 04 23:22:03.963963 ip-10-0-137-117 kubenswrapper[2580]: W0804 23:22:03.963937    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a84e890_0208_4e3d_ac80_234fdcfcaa31.slice/crio-2002a4d63c61cda278cbf124dcbacd45da2188d0648baaaf9875f7f26acc48a3 WatchSource:0}: Error finding container 2002a4d63c61cda278cbf124dcbacd45da2188d0648baaaf9875f7f26acc48a3: Status 404 returned error can't find the container with id 2002a4d63c61cda278cbf124dcbacd45da2188d0648baaaf9875f7f26acc48a3
Aug 04 23:22:04.049971 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:04.049944    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-edf378-mkj95" event={"ID":"4a84e890-0208-4e3d-ac80-234fdcfcaa31","Type":"ContainerStarted","Data":"2002a4d63c61cda278cbf124dcbacd45da2188d0648baaaf9875f7f26acc48a3"}
Aug 04 23:22:05.058141 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:05.058089    2580 generic.go:356] "Generic (PLEG): container finished" podID="4a84e890-0208-4e3d-ac80-234fdcfcaa31" containerID="2249db1a69449680cb160eb6bbb01fc81a216109df9db59c35eb8f85e8122687" exitCode=0
Aug 04 23:22:05.058515 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:05.058161    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-edf378-mkj95" event={"ID":"4a84e890-0208-4e3d-ac80-234fdcfcaa31","Type":"ContainerDied","Data":"2249db1a69449680cb160eb6bbb01fc81a216109df9db59c35eb8f85e8122687"}
Aug 04 23:22:06.198093 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:06.198065    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-edf378-mkj95"
Aug 04 23:22:06.248736 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:06.248709    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4a84e890-0208-4e3d-ac80-234fdcfcaa31-maas-api-service-ca\") pod \"4a84e890-0208-4e3d-ac80-234fdcfcaa31\" (UID: \"4a84e890-0208-4e3d-ac80-234fdcfcaa31\") "
Aug 04 23:22:06.249068 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:06.249042    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4a84e890-0208-4e3d-ac80-234fdcfcaa31-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "4a84e890-0208-4e3d-ac80-234fdcfcaa31" (UID: "4a84e890-0208-4e3d-ac80-234fdcfcaa31"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 23:22:06.350072 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:06.349998    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4a84e890-0208-4e3d-ac80-234fdcfcaa31-maas-api-service-ca\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
Aug 04 23:22:07.072330 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:07.072299    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-edf378-mkj95"
Aug 04 23:22:07.072514 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:07.072349    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-edf378-mkj95" event={"ID":"4a84e890-0208-4e3d-ac80-234fdcfcaa31","Type":"ContainerDied","Data":"2002a4d63c61cda278cbf124dcbacd45da2188d0648baaaf9875f7f26acc48a3"}
Aug 04 23:22:07.072514 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:07.072429    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2002a4d63c61cda278cbf124dcbacd45da2188d0648baaaf9875f7f26acc48a3"
Aug 04 23:22:13.929100 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:13.929066    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-edf378-677b4dffcd-cjl2m"]
Aug 04 23:22:13.929590 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:13.929355    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-b-edf378-677b4dffcd-cjl2m" podUID="ac4b9bcc-9191-41ed-81bb-fcb24c267811" containerName="payload-processing" containerID="cri-o://d127f64b7dc74cac6bfbb77866b71e3c82bdac37606e55bff3f91bb2314983a3" gracePeriod=30
Aug 04 23:22:13.937291 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:13.937225    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-edf378-858f4df796-wbsn4"]
Aug 04 23:22:13.937500 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:13.937447    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-edf378-858f4df796-wbsn4" podUID="e3500a62-9bf2-45df-a83e-1c9d2a124e50" containerName="payload-pre-processing" containerID="cri-o://ca81dd1ac96a13badfefc9544a4f287a99427e2669808abebe545f3ee547b861" gracePeriod=30
Aug 04 23:22:14.056325 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:14.056293    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-edf378-mkj95"]
Aug 04 23:22:14.060776 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:14.060731    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-edf378-mkj95"]
Aug 04 23:22:14.127659 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:14.127629    2580 generic.go:356] "Generic (PLEG): container finished" podID="e3500a62-9bf2-45df-a83e-1c9d2a124e50" containerID="ca81dd1ac96a13badfefc9544a4f287a99427e2669808abebe545f3ee547b861" exitCode=0
Aug 04 23:22:14.127858 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:14.127696    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-edf378-858f4df796-wbsn4" event={"ID":"e3500a62-9bf2-45df-a83e-1c9d2a124e50","Type":"ContainerDied","Data":"ca81dd1ac96a13badfefc9544a4f287a99427e2669808abebe545f3ee547b861"}
Aug 04 23:22:14.129531 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:14.129499    2580 generic.go:356] "Generic (PLEG): container finished" podID="ac4b9bcc-9191-41ed-81bb-fcb24c267811" containerID="d127f64b7dc74cac6bfbb77866b71e3c82bdac37606e55bff3f91bb2314983a3" exitCode=0
Aug 04 23:22:14.129640 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:14.129572    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-edf378-677b4dffcd-cjl2m" event={"ID":"ac4b9bcc-9191-41ed-81bb-fcb24c267811","Type":"ContainerDied","Data":"d127f64b7dc74cac6bfbb77866b71e3c82bdac37606e55bff3f91bb2314983a3"}
Aug 04 23:22:14.218140 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:14.218106    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-edf378-677b4dffcd-cjl2m"
Aug 04 23:22:14.246318 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:14.246290    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-edf378-858f4df796-wbsn4"
Aug 04 23:22:14.322844 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:14.322805    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e3500a62-9bf2-45df-a83e-1c9d2a124e50-plugins-config-volume\") pod \"e3500a62-9bf2-45df-a83e-1c9d2a124e50\" (UID: \"e3500a62-9bf2-45df-a83e-1c9d2a124e50\") "
Aug 04 23:22:14.323025 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:14.322960    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tmkp5\" (UniqueName: \"kubernetes.io/projected/e3500a62-9bf2-45df-a83e-1c9d2a124e50-kube-api-access-tmkp5\") pod \"e3500a62-9bf2-45df-a83e-1c9d2a124e50\" (UID: \"e3500a62-9bf2-45df-a83e-1c9d2a124e50\") "
Aug 04 23:22:14.323025 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:14.323000    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ac4b9bcc-9191-41ed-81bb-fcb24c267811-plugins-config-volume\") pod \"ac4b9bcc-9191-41ed-81bb-fcb24c267811\" (UID: \"ac4b9bcc-9191-41ed-81bb-fcb24c267811\") "
Aug 04 23:22:14.323188 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:14.323038    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9wzsf\" (UniqueName: \"kubernetes.io/projected/ac4b9bcc-9191-41ed-81bb-fcb24c267811-kube-api-access-9wzsf\") pod \"ac4b9bcc-9191-41ed-81bb-fcb24c267811\" (UID: \"ac4b9bcc-9191-41ed-81bb-fcb24c267811\") "
Aug 04 23:22:14.323411 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:14.323384    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e3500a62-9bf2-45df-a83e-1c9d2a124e50-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "e3500a62-9bf2-45df-a83e-1c9d2a124e50" (UID: "e3500a62-9bf2-45df-a83e-1c9d2a124e50"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 23:22:14.323477 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:14.323404    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ac4b9bcc-9191-41ed-81bb-fcb24c267811-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "ac4b9bcc-9191-41ed-81bb-fcb24c267811" (UID: "ac4b9bcc-9191-41ed-81bb-fcb24c267811"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 23:22:14.325170 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:14.325143    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e3500a62-9bf2-45df-a83e-1c9d2a124e50-kube-api-access-tmkp5" (OuterVolumeSpecName: "kube-api-access-tmkp5") pod "e3500a62-9bf2-45df-a83e-1c9d2a124e50" (UID: "e3500a62-9bf2-45df-a83e-1c9d2a124e50"). InnerVolumeSpecName "kube-api-access-tmkp5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 23:22:14.325259 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:14.325217    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ac4b9bcc-9191-41ed-81bb-fcb24c267811-kube-api-access-9wzsf" (OuterVolumeSpecName: "kube-api-access-9wzsf") pod "ac4b9bcc-9191-41ed-81bb-fcb24c267811" (UID: "ac4b9bcc-9191-41ed-81bb-fcb24c267811"). InnerVolumeSpecName "kube-api-access-9wzsf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 23:22:14.424564 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:14.424532    2580 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ac4b9bcc-9191-41ed-81bb-fcb24c267811-plugins-config-volume\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
Aug 04 23:22:14.424564 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:14.424561    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9wzsf\" (UniqueName: \"kubernetes.io/projected/ac4b9bcc-9191-41ed-81bb-fcb24c267811-kube-api-access-9wzsf\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
Aug 04 23:22:14.424564 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:14.424571    2580 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e3500a62-9bf2-45df-a83e-1c9d2a124e50-plugins-config-volume\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
Aug 04 23:22:14.424820 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:14.424579    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tmkp5\" (UniqueName: \"kubernetes.io/projected/e3500a62-9bf2-45df-a83e-1c9d2a124e50-kube-api-access-tmkp5\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
Aug 04 23:22:15.137499 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:15.137462    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-edf378-677b4dffcd-cjl2m"
Aug 04 23:22:15.137499 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:15.137485    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-edf378-677b4dffcd-cjl2m" event={"ID":"ac4b9bcc-9191-41ed-81bb-fcb24c267811","Type":"ContainerDied","Data":"2a7a8d05095581a1f5c6d1d8a4e66b4377c3561e9df2444e870ce4820d1d9938"}
Aug 04 23:22:15.138024 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:15.137555    2580 scope.go:117] "RemoveContainer" containerID="d127f64b7dc74cac6bfbb77866b71e3c82bdac37606e55bff3f91bb2314983a3"
Aug 04 23:22:15.139016 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:15.138992    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-edf378-858f4df796-wbsn4" event={"ID":"e3500a62-9bf2-45df-a83e-1c9d2a124e50","Type":"ContainerDied","Data":"e6377607ea3bf4b7d43587d4d9a55cc9e7e30f475a2feee7043e11d5587da430"}
Aug 04 23:22:15.139100 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:15.139033    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-edf378-858f4df796-wbsn4"
Aug 04 23:22:15.148426 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:15.148408    2580 scope.go:117] "RemoveContainer" containerID="ca81dd1ac96a13badfefc9544a4f287a99427e2669808abebe545f3ee547b861"
Aug 04 23:22:15.164489 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:15.164465    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-edf378-677b4dffcd-cjl2m"]
Aug 04 23:22:15.168329 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:15.168307    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-edf378-677b4dffcd-cjl2m"]
Aug 04 23:22:15.177151 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:15.177112    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-edf378-858f4df796-wbsn4"]
Aug 04 23:22:15.179601 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:15.179578    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-edf378-858f4df796-wbsn4"]
Aug 04 23:22:15.500044 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:15.500012    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4a84e890-0208-4e3d-ac80-234fdcfcaa31" path="/var/lib/kubelet/pods/4a84e890-0208-4e3d-ac80-234fdcfcaa31/volumes"
Aug 04 23:22:15.500414 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:15.500401    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ac4b9bcc-9191-41ed-81bb-fcb24c267811" path="/var/lib/kubelet/pods/ac4b9bcc-9191-41ed-81bb-fcb24c267811/volumes"
Aug 04 23:22:15.500718 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:15.500707    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e3500a62-9bf2-45df-a83e-1c9d2a124e50" path="/var/lib/kubelet/pods/e3500a62-9bf2-45df-a83e-1c9d2a124e50/volumes"
Aug 04 23:22:16.388024 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:16.387985    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-595xm"]
Aug 04 23:22:20.924299 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:20.924265    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-ec06a8-sfdrn"]
Aug 04 23:22:20.924752 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:20.924738    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e3500a62-9bf2-45df-a83e-1c9d2a124e50" containerName="payload-pre-processing"
Aug 04 23:22:20.924752 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:20.924753    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="e3500a62-9bf2-45df-a83e-1c9d2a124e50" containerName="payload-pre-processing"
Aug 04 23:22:20.924832 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:20.924773    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a84e890-0208-4e3d-ac80-234fdcfcaa31" containerName="revoke-keys"
Aug 04 23:22:20.924832 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:20.924782    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a84e890-0208-4e3d-ac80-234fdcfcaa31" containerName="revoke-keys"
Aug 04 23:22:20.924832 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:20.924798    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac4b9bcc-9191-41ed-81bb-fcb24c267811" containerName="payload-processing"
Aug 04 23:22:20.924832 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:20.924804    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac4b9bcc-9191-41ed-81bb-fcb24c267811" containerName="payload-processing"
Aug 04 23:22:20.924963 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:20.924903    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="e3500a62-9bf2-45df-a83e-1c9d2a124e50" containerName="payload-pre-processing"
Aug 04 23:22:20.924963 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:20.924916    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="ac4b9bcc-9191-41ed-81bb-fcb24c267811" containerName="payload-processing"
Aug 04 23:22:20.924963 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:20.924922    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="4a84e890-0208-4e3d-ac80-234fdcfcaa31" containerName="revoke-keys"
Aug 04 23:22:20.929356 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:20.929338    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-ec06a8-sfdrn"
Aug 04 23:22:20.931606 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:20.931502    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-vvngh\""
Aug 04 23:22:20.934759 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:20.934682    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-ec06a8-sfdrn"]
Aug 04 23:22:20.986195 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:20.986169    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fe32d667-0309-4c5e-9ef8-7dd2cb67601b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-ec06a8-sfdrn\" (UID: \"fe32d667-0309-4c5e-9ef8-7dd2cb67601b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-ec06a8-sfdrn"
Aug 04 23:22:21.087513 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:21.087477    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fe32d667-0309-4c5e-9ef8-7dd2cb67601b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-ec06a8-sfdrn\" (UID: \"fe32d667-0309-4c5e-9ef8-7dd2cb67601b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-ec06a8-sfdrn"
Aug 04 23:22:21.088121 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:21.088101    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fe32d667-0309-4c5e-9ef8-7dd2cb67601b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-ec06a8-sfdrn\" (UID: \"fe32d667-0309-4c5e-9ef8-7dd2cb67601b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-ec06a8-sfdrn"
Aug 04 23:22:21.244007 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:21.243916    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-ec06a8-sfdrn"
Aug 04 23:22:21.383803 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:21.383772    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-ec06a8-sfdrn"]
Aug 04 23:22:21.385223 ip-10-0-137-117 kubenswrapper[2580]: W0804 23:22:21.385195    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe32d667_0309_4c5e_9ef8_7dd2cb67601b.slice/crio-9503b7b9a96e244f8291ec06beeb7654f5c76f2c55cef76a21b9b5b297b6763e WatchSource:0}: Error finding container 9503b7b9a96e244f8291ec06beeb7654f5c76f2c55cef76a21b9b5b297b6763e: Status 404 returned error can't find the container with id 9503b7b9a96e244f8291ec06beeb7654f5c76f2c55cef76a21b9b5b297b6763e
Aug 04 23:22:22.189442 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:22.189411    2580 generic.go:356] "Generic (PLEG): container finished" podID="fe32d667-0309-4c5e-9ef8-7dd2cb67601b" containerID="5196a94bf246afb90eab06dc5eeb0367dccc85f39cdb47f7d3a5ffbabfb137d1" exitCode=0
Aug 04 23:22:22.189791 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:22.189489    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-ec06a8-sfdrn" event={"ID":"fe32d667-0309-4c5e-9ef8-7dd2cb67601b","Type":"ContainerDied","Data":"5196a94bf246afb90eab06dc5eeb0367dccc85f39cdb47f7d3a5ffbabfb137d1"}
Aug 04 23:22:22.189791 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:22.189531    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-ec06a8-sfdrn" event={"ID":"fe32d667-0309-4c5e-9ef8-7dd2cb67601b","Type":"ContainerStarted","Data":"9503b7b9a96e244f8291ec06beeb7654f5c76f2c55cef76a21b9b5b297b6763e"}
Aug 04 23:22:23.343156 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:23.343082    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-ec06a8-sfdrn"
Aug 04 23:22:23.409175 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:23.409122    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fe32d667-0309-4c5e-9ef8-7dd2cb67601b-maas-api-service-ca\") pod \"fe32d667-0309-4c5e-9ef8-7dd2cb67601b\" (UID: \"fe32d667-0309-4c5e-9ef8-7dd2cb67601b\") "
Aug 04 23:22:23.409458 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:23.409436    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fe32d667-0309-4c5e-9ef8-7dd2cb67601b-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "fe32d667-0309-4c5e-9ef8-7dd2cb67601b" (UID: "fe32d667-0309-4c5e-9ef8-7dd2cb67601b"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 23:22:23.510439 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:23.510412    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fe32d667-0309-4c5e-9ef8-7dd2cb67601b-maas-api-service-ca\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
Aug 04 23:22:24.208148 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:24.208107    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-ec06a8-sfdrn"
Aug 04 23:22:24.208326 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:24.208157    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-ec06a8-sfdrn" event={"ID":"fe32d667-0309-4c5e-9ef8-7dd2cb67601b","Type":"ContainerDied","Data":"9503b7b9a96e244f8291ec06beeb7654f5c76f2c55cef76a21b9b5b297b6763e"}
Aug 04 23:22:24.208326 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:24.208216    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9503b7b9a96e244f8291ec06beeb7654f5c76f2c55cef76a21b9b5b297b6763e"
Aug 04 23:22:31.335184 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:31.335149    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-ec06a8-29764755-t2wqf"]
Aug 04 23:22:31.337813 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:31.337784    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-ec06a8-29764755-t2wqf"]
Aug 04 23:22:31.500867 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:31.500832    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3e1b4a8d-d879-4f4d-a1c5-e8ba4820d3fb" path="/var/lib/kubelet/pods/3e1b4a8d-d879-4f4d-a1c5-e8ba4820d3fb/volumes"
Aug 04 23:22:31.501101 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:31.501087    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-ec06a8-sfdrn"]
Aug 04 23:22:31.501209 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:31.501116    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-ec06a8-sfdrn"]
Aug 04 23:22:33.499926 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:33.499896    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fe32d667-0309-4c5e-9ef8-7dd2cb67601b" path="/var/lib/kubelet/pods/fe32d667-0309-4c5e-9ef8-7dd2cb67601b/volumes"
Aug 04 23:22:33.588663 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:33.588630    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-595xm"]
Aug 04 23:22:37.855062 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:37.855028    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-ec06a8-openshift-default-78f548b7d4-5mfqs"]
Aug 04 23:22:37.855568 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:37.855326    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-ec06a8-openshift-default-78f548b7d4-5mfqs" podUID="5614bb85-922a-46df-bf9b-d992043ef34f" containerName="istio-proxy" containerID="cri-o://0ce1458544ee6824beb70ede9e47db8d0471b1cbc19da04dbbd2a50b42140a70" gracePeriod=30
Aug 04 23:22:38.223953 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:38.223873    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-55909a-2rrlt"]
Aug 04 23:22:38.224584 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:38.224564    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe32d667-0309-4c5e-9ef8-7dd2cb67601b" containerName="revoke-keys"
Aug 04 23:22:38.224632 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:38.224589    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe32d667-0309-4c5e-9ef8-7dd2cb67601b" containerName="revoke-keys"
Aug 04 23:22:38.224739 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:38.224728    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="fe32d667-0309-4c5e-9ef8-7dd2cb67601b" containerName="revoke-keys"
Aug 04 23:22:38.229398 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:38.229374    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-55909a-2rrlt"
Aug 04 23:22:38.231634 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:38.231610    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-vvngh\""
Aug 04 23:22:38.231858 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:38.231682    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-55909a-2rrlt"]
Aug 04 23:22:38.347109 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:38.347077    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/724b95d3-24ca-4aa2-b8f3-ec8992353d93-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-55909a-2rrlt\" (UID: \"724b95d3-24ca-4aa2-b8f3-ec8992353d93\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-55909a-2rrlt"
Aug 04 23:22:38.448488 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:38.448451    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/724b95d3-24ca-4aa2-b8f3-ec8992353d93-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-55909a-2rrlt\" (UID: \"724b95d3-24ca-4aa2-b8f3-ec8992353d93\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-55909a-2rrlt"
Aug 04 23:22:38.449095 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:38.449076    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/724b95d3-24ca-4aa2-b8f3-ec8992353d93-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-55909a-2rrlt\" (UID: \"724b95d3-24ca-4aa2-b8f3-ec8992353d93\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-55909a-2rrlt"
Aug 04 23:22:38.543878 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:38.543799    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-55909a-2rrlt"
Aug 04 23:22:38.680843 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:38.680815    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-55909a-2rrlt"]
Aug 04 23:22:38.682258 ip-10-0-137-117 kubenswrapper[2580]: W0804 23:22:38.682229    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod724b95d3_24ca_4aa2_b8f3_ec8992353d93.slice/crio-a6c6c28356eda9e206dfad5f98740b7b206f47261884a5feec118fd976a91210 WatchSource:0}: Error finding container a6c6c28356eda9e206dfad5f98740b7b206f47261884a5feec118fd976a91210: Status 404 returned error can't find the container with id a6c6c28356eda9e206dfad5f98740b7b206f47261884a5feec118fd976a91210
Aug 04 23:22:39.313207 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:39.313170    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-55909a-2rrlt" event={"ID":"724b95d3-24ca-4aa2-b8f3-ec8992353d93","Type":"ContainerStarted","Data":"19e68fda24fd7af52ca8d69dfe83b1840c70b179fbfc8ca099b58dc808664067"}
Aug 04 23:22:39.313598 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:39.313225    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-55909a-2rrlt" event={"ID":"724b95d3-24ca-4aa2-b8f3-ec8992353d93","Type":"ContainerStarted","Data":"a6c6c28356eda9e206dfad5f98740b7b206f47261884a5feec118fd976a91210"}
Aug 04 23:22:39.328525 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:39.328476    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-55909a-2rrlt" podStartSLOduration=1.32846205 podStartE2EDuration="1.32846205s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 23:22:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 23:22:39.325547281 +0000 UTC m=+3706.318365011" watchObservedRunningTime="2026-08-04 23:22:39.32846205 +0000 UTC m=+3706.321279779"
Aug 04 23:22:40.321114 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:40.321076    2580 generic.go:356] "Generic (PLEG): container finished" podID="724b95d3-24ca-4aa2-b8f3-ec8992353d93" containerID="19e68fda24fd7af52ca8d69dfe83b1840c70b179fbfc8ca099b58dc808664067" exitCode=0
Aug 04 23:22:40.321545 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:40.321161    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-55909a-2rrlt" event={"ID":"724b95d3-24ca-4aa2-b8f3-ec8992353d93","Type":"ContainerDied","Data":"19e68fda24fd7af52ca8d69dfe83b1840c70b179fbfc8ca099b58dc808664067"}
Aug 04 23:22:41.463480 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:41.463456    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-55909a-2rrlt"
Aug 04 23:22:41.576937 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:41.576904    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/724b95d3-24ca-4aa2-b8f3-ec8992353d93-maas-api-service-ca\") pod \"724b95d3-24ca-4aa2-b8f3-ec8992353d93\" (UID: \"724b95d3-24ca-4aa2-b8f3-ec8992353d93\") "
Aug 04 23:22:41.577253 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:41.577228    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/724b95d3-24ca-4aa2-b8f3-ec8992353d93-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "724b95d3-24ca-4aa2-b8f3-ec8992353d93" (UID: "724b95d3-24ca-4aa2-b8f3-ec8992353d93"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 23:22:41.678579 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:41.678516    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/724b95d3-24ca-4aa2-b8f3-ec8992353d93-maas-api-service-ca\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
Aug 04 23:22:42.335948 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:42.335921    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-55909a-2rrlt"
Aug 04 23:22:42.336157 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:42.335960    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-55909a-2rrlt" event={"ID":"724b95d3-24ca-4aa2-b8f3-ec8992353d93","Type":"ContainerDied","Data":"a6c6c28356eda9e206dfad5f98740b7b206f47261884a5feec118fd976a91210"}
Aug 04 23:22:42.336157 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:42.336010    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a6c6c28356eda9e206dfad5f98740b7b206f47261884a5feec118fd976a91210"
Aug 04 23:22:43.137670 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:43.137648    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-ec06a8-openshift-default-78f548b7d4-5mfqs"
Aug 04 23:22:43.292892 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:43.292860    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5614bb85-922a-46df-bf9b-d992043ef34f-istio-envoy\") pod \"5614bb85-922a-46df-bf9b-d992043ef34f\" (UID: \"5614bb85-922a-46df-bf9b-d992043ef34f\") "
Aug 04 23:22:43.292892 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:43.292896    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5614bb85-922a-46df-bf9b-d992043ef34f-credential-socket\") pod \"5614bb85-922a-46df-bf9b-d992043ef34f\" (UID: \"5614bb85-922a-46df-bf9b-d992043ef34f\") "
Aug 04 23:22:43.293171 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:43.292921    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5614bb85-922a-46df-bf9b-d992043ef34f-istio-token\") pod \"5614bb85-922a-46df-bf9b-d992043ef34f\" (UID: \"5614bb85-922a-46df-bf9b-d992043ef34f\") "
Aug 04 23:22:43.293171 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:43.292953    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s7pgc\" (UniqueName: \"kubernetes.io/projected/5614bb85-922a-46df-bf9b-d992043ef34f-kube-api-access-s7pgc\") pod \"5614bb85-922a-46df-bf9b-d992043ef34f\" (UID: \"5614bb85-922a-46df-bf9b-d992043ef34f\") "
Aug 04 23:22:43.293171 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:43.292998    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5614bb85-922a-46df-bf9b-d992043ef34f-istio-podinfo\") pod \"5614bb85-922a-46df-bf9b-d992043ef34f\" (UID: \"5614bb85-922a-46df-bf9b-d992043ef34f\") "
Aug 04 23:22:43.293171 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:43.293022    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5614bb85-922a-46df-bf9b-d992043ef34f-workload-socket\") pod \"5614bb85-922a-46df-bf9b-d992043ef34f\" (UID: \"5614bb85-922a-46df-bf9b-d992043ef34f\") "
Aug 04 23:22:43.293171 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:43.293086    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5614bb85-922a-46df-bf9b-d992043ef34f-istiod-ca-cert\") pod \"5614bb85-922a-46df-bf9b-d992043ef34f\" (UID: \"5614bb85-922a-46df-bf9b-d992043ef34f\") "
Aug 04 23:22:43.293171 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:43.293117    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5614bb85-922a-46df-bf9b-d992043ef34f-workload-certs\") pod \"5614bb85-922a-46df-bf9b-d992043ef34f\" (UID: \"5614bb85-922a-46df-bf9b-d992043ef34f\") "
Aug 04 23:22:43.293510 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:43.293193    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5614bb85-922a-46df-bf9b-d992043ef34f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5614bb85-922a-46df-bf9b-d992043ef34f" (UID: "5614bb85-922a-46df-bf9b-d992043ef34f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 23:22:43.293510 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:43.293394    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5614bb85-922a-46df-bf9b-d992043ef34f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5614bb85-922a-46df-bf9b-d992043ef34f" (UID: "5614bb85-922a-46df-bf9b-d992043ef34f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 23:22:43.293510 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:43.293425    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5614bb85-922a-46df-bf9b-d992043ef34f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5614bb85-922a-46df-bf9b-d992043ef34f" (UID: "5614bb85-922a-46df-bf9b-d992043ef34f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 23:22:43.293681 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:43.293631    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5614bb85-922a-46df-bf9b-d992043ef34f-istio-data" (OuterVolumeSpecName: "istio-data") pod "5614bb85-922a-46df-bf9b-d992043ef34f" (UID: "5614bb85-922a-46df-bf9b-d992043ef34f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 23:22:43.293738 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:43.293563    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5614bb85-922a-46df-bf9b-d992043ef34f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5614bb85-922a-46df-bf9b-d992043ef34f" (UID: "5614bb85-922a-46df-bf9b-d992043ef34f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 23:22:43.293738 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:43.293684    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5614bb85-922a-46df-bf9b-d992043ef34f-istio-data\") pod \"5614bb85-922a-46df-bf9b-d992043ef34f\" (UID: \"5614bb85-922a-46df-bf9b-d992043ef34f\") "
Aug 04 23:22:43.294057 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:43.294038    2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5614bb85-922a-46df-bf9b-d992043ef34f-workload-socket\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
Aug 04 23:22:43.294094 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:43.294064    2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5614bb85-922a-46df-bf9b-d992043ef34f-istiod-ca-cert\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
Aug 04 23:22:43.294094 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:43.294081    2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5614bb85-922a-46df-bf9b-d992043ef34f-workload-certs\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
Aug 04 23:22:43.294191 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:43.294094    2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5614bb85-922a-46df-bf9b-d992043ef34f-istio-data\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
Aug 04 23:22:43.294191 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:43.294107    2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5614bb85-922a-46df-bf9b-d992043ef34f-credential-socket\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
Aug 04 23:22:43.295111 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:43.295089    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5614bb85-922a-46df-bf9b-d992043ef34f-kube-api-access-s7pgc" (OuterVolumeSpecName: "kube-api-access-s7pgc") pod "5614bb85-922a-46df-bf9b-d992043ef34f" (UID: "5614bb85-922a-46df-bf9b-d992043ef34f"). InnerVolumeSpecName "kube-api-access-s7pgc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 23:22:43.295245 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:43.295226    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5614bb85-922a-46df-bf9b-d992043ef34f-istio-token" (OuterVolumeSpecName: "istio-token") pod "5614bb85-922a-46df-bf9b-d992043ef34f" (UID: "5614bb85-922a-46df-bf9b-d992043ef34f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 23:22:43.295487 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:43.295466    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5614bb85-922a-46df-bf9b-d992043ef34f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5614bb85-922a-46df-bf9b-d992043ef34f" (UID: "5614bb85-922a-46df-bf9b-d992043ef34f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 23:22:43.295589 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:43.295568    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5614bb85-922a-46df-bf9b-d992043ef34f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5614bb85-922a-46df-bf9b-d992043ef34f" (UID: "5614bb85-922a-46df-bf9b-d992043ef34f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Aug 04 23:22:43.344609 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:43.344582    2580 generic.go:356] "Generic (PLEG): container finished" podID="5614bb85-922a-46df-bf9b-d992043ef34f" containerID="0ce1458544ee6824beb70ede9e47db8d0471b1cbc19da04dbbd2a50b42140a70" exitCode=0
Aug 04 23:22:43.344711 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:43.344629    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-ec06a8-openshift-default-78f548b7d4-5mfqs"
Aug 04 23:22:43.344711 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:43.344661    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-ec06a8-openshift-default-78f548b7d4-5mfqs" event={"ID":"5614bb85-922a-46df-bf9b-d992043ef34f","Type":"ContainerDied","Data":"0ce1458544ee6824beb70ede9e47db8d0471b1cbc19da04dbbd2a50b42140a70"}
Aug 04 23:22:43.344784 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:43.344713    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-ec06a8-openshift-default-78f548b7d4-5mfqs" event={"ID":"5614bb85-922a-46df-bf9b-d992043ef34f","Type":"ContainerDied","Data":"1d3760dd69dbf8be8955a49b1f740db683a0caef94cc09a9eeb2f7d0c4058fb0"}
Aug 04 23:22:43.344784 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:43.344739    2580 scope.go:117] "RemoveContainer" containerID="0ce1458544ee6824beb70ede9e47db8d0471b1cbc19da04dbbd2a50b42140a70"
Aug 04 23:22:43.354862 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:43.354846    2580 scope.go:117] "RemoveContainer" containerID="510b85b1afdaa803aa159ad1eb1a6932619b3ff47ea1e9c644b74287649f7d02"
Aug 04 23:22:43.363912 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:43.363893    2580 scope.go:117] "RemoveContainer" containerID="0ce1458544ee6824beb70ede9e47db8d0471b1cbc19da04dbbd2a50b42140a70"
Aug 04 23:22:43.364179 ip-10-0-137-117 kubenswrapper[2580]: E0804 23:22:43.364125    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0ce1458544ee6824beb70ede9e47db8d0471b1cbc19da04dbbd2a50b42140a70\": container with ID starting with 0ce1458544ee6824beb70ede9e47db8d0471b1cbc19da04dbbd2a50b42140a70 not found: ID does not exist" containerID="0ce1458544ee6824beb70ede9e47db8d0471b1cbc19da04dbbd2a50b42140a70"
Aug 04 23:22:43.364273 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:43.364186    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0ce1458544ee6824beb70ede9e47db8d0471b1cbc19da04dbbd2a50b42140a70"} err="failed to get container status \"0ce1458544ee6824beb70ede9e47db8d0471b1cbc19da04dbbd2a50b42140a70\": rpc error: code = NotFound desc = could not find container \"0ce1458544ee6824beb70ede9e47db8d0471b1cbc19da04dbbd2a50b42140a70\": container with ID starting with 0ce1458544ee6824beb70ede9e47db8d0471b1cbc19da04dbbd2a50b42140a70 not found: ID does not exist"
Aug 04 23:22:43.364273 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:43.364210    2580 scope.go:117] "RemoveContainer" containerID="510b85b1afdaa803aa159ad1eb1a6932619b3ff47ea1e9c644b74287649f7d02"
Aug 04 23:22:43.364489 ip-10-0-137-117 kubenswrapper[2580]: E0804 23:22:43.364470    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"510b85b1afdaa803aa159ad1eb1a6932619b3ff47ea1e9c644b74287649f7d02\": container with ID starting with 510b85b1afdaa803aa159ad1eb1a6932619b3ff47ea1e9c644b74287649f7d02 not found: ID does not exist" containerID="510b85b1afdaa803aa159ad1eb1a6932619b3ff47ea1e9c644b74287649f7d02"
Aug 04 23:22:43.364541 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:43.364495    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"510b85b1afdaa803aa159ad1eb1a6932619b3ff47ea1e9c644b74287649f7d02"} err="failed to get container status \"510b85b1afdaa803aa159ad1eb1a6932619b3ff47ea1e9c644b74287649f7d02\": rpc error: code = NotFound desc = could not find container \"510b85b1afdaa803aa159ad1eb1a6932619b3ff47ea1e9c644b74287649f7d02\": container with ID starting with 510b85b1afdaa803aa159ad1eb1a6932619b3ff47ea1e9c644b74287649f7d02 not found: ID does not exist"
Aug 04 23:22:43.366908 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:43.366887    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-ec06a8-openshift-default-78f548b7d4-5mfqs"]
Aug 04 23:22:43.369628 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:43.369607    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-ec06a8-openshift-default-78f548b7d4-5mfqs"]
Aug 04 23:22:43.395014 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:43.394964    2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5614bb85-922a-46df-bf9b-d992043ef34f-istio-envoy\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
Aug 04 23:22:43.395014 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:43.394989    2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5614bb85-922a-46df-bf9b-d992043ef34f-istio-token\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
Aug 04 23:22:43.395014 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:43.395000    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s7pgc\" (UniqueName: \"kubernetes.io/projected/5614bb85-922a-46df-bf9b-d992043ef34f-kube-api-access-s7pgc\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
Aug 04 23:22:43.395014 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:43.395010    2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5614bb85-922a-46df-bf9b-d992043ef34f-istio-podinfo\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
Aug 04 23:22:43.499780 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:43.499752    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5614bb85-922a-46df-bf9b-d992043ef34f" path="/var/lib/kubelet/pods/5614bb85-922a-46df-bf9b-d992043ef34f/volumes"
Aug 04 23:22:48.697394 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:48.697355    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-55909a-5df65f6859-sqgl7"]
Aug 04 23:22:48.697914 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:48.697561    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-55909a-5df65f6859-sqgl7" podUID="11ae30af-2c7f-47be-9cff-0e38ea164339" containerName="maas-api" containerID="cri-o://662663c70ee627f671c9221a04e4d1fd810d6e55d6677e4130d3f33f1337454b" gracePeriod=30
Aug 04 23:22:48.718969 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:48.718938    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-55909a-29764755-kbc6q"]
Aug 04 23:22:48.725699 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:48.725672    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-55909a-29764755-kbc6q"]
Aug 04 23:22:48.750722 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:48.750686    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-55909a-5f6cf86454-d7fd9"]
Aug 04 23:22:48.750979 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:48.750947    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-55909a-5f6cf86454-d7fd9" podUID="c0ad3121-c724-4d67-bbdf-dd7a4d75e94c" containerName="payload-processing" containerID="cri-o://7a7e23d8729dc0b6e459b5dfcf12c3f635b12d838f3828e6471b2b595f2ae14f" gracePeriod=30
Aug 04 23:22:48.884376 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:48.884315    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-55909a-2rrlt"]
Aug 04 23:22:48.887902 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:48.887874    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-55909a-2rrlt"]
Aug 04 23:22:49.031319 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:49.031290    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-55909a-5df65f6859-sqgl7"
Aug 04 23:22:49.044119 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:49.044086    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/11ae30af-2c7f-47be-9cff-0e38ea164339-maas-api-tls\") pod \"11ae30af-2c7f-47be-9cff-0e38ea164339\" (UID: \"11ae30af-2c7f-47be-9cff-0e38ea164339\") "
Aug 04 23:22:49.044372 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:49.044226    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/11ae30af-2c7f-47be-9cff-0e38ea164339-openshift-service-ca\") pod \"11ae30af-2c7f-47be-9cff-0e38ea164339\" (UID: \"11ae30af-2c7f-47be-9cff-0e38ea164339\") "
Aug 04 23:22:49.044372 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:49.044273    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rjdtn\" (UniqueName: \"kubernetes.io/projected/11ae30af-2c7f-47be-9cff-0e38ea164339-kube-api-access-rjdtn\") pod \"11ae30af-2c7f-47be-9cff-0e38ea164339\" (UID: \"11ae30af-2c7f-47be-9cff-0e38ea164339\") "
Aug 04 23:22:49.044650 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:49.044620    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/11ae30af-2c7f-47be-9cff-0e38ea164339-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "11ae30af-2c7f-47be-9cff-0e38ea164339" (UID: "11ae30af-2c7f-47be-9cff-0e38ea164339"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 23:22:49.049006 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:49.048811    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/11ae30af-2c7f-47be-9cff-0e38ea164339-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "11ae30af-2c7f-47be-9cff-0e38ea164339" (UID: "11ae30af-2c7f-47be-9cff-0e38ea164339"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 23:22:49.049566 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:49.049010    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/11ae30af-2c7f-47be-9cff-0e38ea164339-kube-api-access-rjdtn" (OuterVolumeSpecName: "kube-api-access-rjdtn") pod "11ae30af-2c7f-47be-9cff-0e38ea164339" (UID: "11ae30af-2c7f-47be-9cff-0e38ea164339"). InnerVolumeSpecName "kube-api-access-rjdtn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 23:22:49.059353 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:49.059328    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-55909a-5f6cf86454-d7fd9"
Aug 04 23:22:49.145480 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:49.145446    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c0ad3121-c724-4d67-bbdf-dd7a4d75e94c-plugins-config-volume\") pod \"c0ad3121-c724-4d67-bbdf-dd7a4d75e94c\" (UID: \"c0ad3121-c724-4d67-bbdf-dd7a4d75e94c\") "
Aug 04 23:22:49.145696 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:49.145507    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-str4f\" (UniqueName: \"kubernetes.io/projected/c0ad3121-c724-4d67-bbdf-dd7a4d75e94c-kube-api-access-str4f\") pod \"c0ad3121-c724-4d67-bbdf-dd7a4d75e94c\" (UID: \"c0ad3121-c724-4d67-bbdf-dd7a4d75e94c\") "
Aug 04 23:22:49.145794 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:49.145758    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/11ae30af-2c7f-47be-9cff-0e38ea164339-maas-api-tls\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
Aug 04 23:22:49.145794 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:49.145784    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/11ae30af-2c7f-47be-9cff-0e38ea164339-openshift-service-ca\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
Aug 04 23:22:49.145905 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:49.145797    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rjdtn\" (UniqueName: \"kubernetes.io/projected/11ae30af-2c7f-47be-9cff-0e38ea164339-kube-api-access-rjdtn\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
Aug 04 23:22:49.145905 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:49.145822    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c0ad3121-c724-4d67-bbdf-dd7a4d75e94c-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "c0ad3121-c724-4d67-bbdf-dd7a4d75e94c" (UID: "c0ad3121-c724-4d67-bbdf-dd7a4d75e94c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 23:22:49.147689 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:49.147661    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c0ad3121-c724-4d67-bbdf-dd7a4d75e94c-kube-api-access-str4f" (OuterVolumeSpecName: "kube-api-access-str4f") pod "c0ad3121-c724-4d67-bbdf-dd7a4d75e94c" (UID: "c0ad3121-c724-4d67-bbdf-dd7a4d75e94c"). InnerVolumeSpecName "kube-api-access-str4f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 23:22:49.247226 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:49.247125    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-str4f\" (UniqueName: \"kubernetes.io/projected/c0ad3121-c724-4d67-bbdf-dd7a4d75e94c-kube-api-access-str4f\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
Aug 04 23:22:49.247226 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:49.247167    2580 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c0ad3121-c724-4d67-bbdf-dd7a4d75e94c-plugins-config-volume\") on node \"ip-10-0-137-117.ec2.internal\" DevicePath \"\""
Aug 04 23:22:49.387327 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:49.387293    2580 generic.go:356] "Generic (PLEG): container finished" podID="11ae30af-2c7f-47be-9cff-0e38ea164339" containerID="662663c70ee627f671c9221a04e4d1fd810d6e55d6677e4130d3f33f1337454b" exitCode=0
Aug 04 23:22:49.387522 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:49.387336    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-55909a-5df65f6859-sqgl7"
Aug 04 23:22:49.387522 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:49.387375    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-55909a-5df65f6859-sqgl7" event={"ID":"11ae30af-2c7f-47be-9cff-0e38ea164339","Type":"ContainerDied","Data":"662663c70ee627f671c9221a04e4d1fd810d6e55d6677e4130d3f33f1337454b"}
Aug 04 23:22:49.387522 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:49.387427    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-55909a-5df65f6859-sqgl7" event={"ID":"11ae30af-2c7f-47be-9cff-0e38ea164339","Type":"ContainerDied","Data":"66a8769b29d9b2f415a46f0b88c521dcd29b86d20e23dca3e86353770d42623a"}
Aug 04 23:22:49.387522 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:49.387453    2580 scope.go:117] "RemoveContainer" containerID="662663c70ee627f671c9221a04e4d1fd810d6e55d6677e4130d3f33f1337454b"
Aug 04 23:22:49.388930 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:49.388904    2580 generic.go:356] "Generic (PLEG): container finished" podID="c0ad3121-c724-4d67-bbdf-dd7a4d75e94c" containerID="7a7e23d8729dc0b6e459b5dfcf12c3f635b12d838f3828e6471b2b595f2ae14f" exitCode=0
Aug 04 23:22:49.389077 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:49.388957    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-55909a-5f6cf86454-d7fd9"
Aug 04 23:22:49.389077 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:49.388998    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-55909a-5f6cf86454-d7fd9" event={"ID":"c0ad3121-c724-4d67-bbdf-dd7a4d75e94c","Type":"ContainerDied","Data":"7a7e23d8729dc0b6e459b5dfcf12c3f635b12d838f3828e6471b2b595f2ae14f"}
Aug 04 23:22:49.389077 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:49.389031    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-55909a-5f6cf86454-d7fd9" event={"ID":"c0ad3121-c724-4d67-bbdf-dd7a4d75e94c","Type":"ContainerDied","Data":"2437e8610d7d6683ba4d56511a9ab09ebc225a1a6000cb3fb7022ecf9f93d639"}
Aug 04 23:22:49.399023 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:49.398974    2580 scope.go:117] "RemoveContainer" containerID="662663c70ee627f671c9221a04e4d1fd810d6e55d6677e4130d3f33f1337454b"
Aug 04 23:22:49.399340 ip-10-0-137-117 kubenswrapper[2580]: E0804 23:22:49.399318    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"662663c70ee627f671c9221a04e4d1fd810d6e55d6677e4130d3f33f1337454b\": container with ID starting with 662663c70ee627f671c9221a04e4d1fd810d6e55d6677e4130d3f33f1337454b not found: ID does not exist" containerID="662663c70ee627f671c9221a04e4d1fd810d6e55d6677e4130d3f33f1337454b"
Aug 04 23:22:49.399419 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:49.399347    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"662663c70ee627f671c9221a04e4d1fd810d6e55d6677e4130d3f33f1337454b"} err="failed to get container status \"662663c70ee627f671c9221a04e4d1fd810d6e55d6677e4130d3f33f1337454b\": rpc error: code = NotFound desc = could not find container \"662663c70ee627f671c9221a04e4d1fd810d6e55d6677e4130d3f33f1337454b\": container with ID starting with 662663c70ee627f671c9221a04e4d1fd810d6e55d6677e4130d3f33f1337454b not found: ID does not exist"
Aug 04 23:22:49.399419 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:49.399363    2580 scope.go:117] "RemoveContainer" containerID="7a7e23d8729dc0b6e459b5dfcf12c3f635b12d838f3828e6471b2b595f2ae14f"
Aug 04 23:22:49.408591 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:49.408570    2580 scope.go:117] "RemoveContainer" containerID="7a7e23d8729dc0b6e459b5dfcf12c3f635b12d838f3828e6471b2b595f2ae14f"
Aug 04 23:22:49.408887 ip-10-0-137-117 kubenswrapper[2580]: E0804 23:22:49.408867    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7a7e23d8729dc0b6e459b5dfcf12c3f635b12d838f3828e6471b2b595f2ae14f\": container with ID starting with 7a7e23d8729dc0b6e459b5dfcf12c3f635b12d838f3828e6471b2b595f2ae14f not found: ID does not exist" containerID="7a7e23d8729dc0b6e459b5dfcf12c3f635b12d838f3828e6471b2b595f2ae14f"
Aug 04 23:22:49.408939 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:49.408896    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7a7e23d8729dc0b6e459b5dfcf12c3f635b12d838f3828e6471b2b595f2ae14f"} err="failed to get container status \"7a7e23d8729dc0b6e459b5dfcf12c3f635b12d838f3828e6471b2b595f2ae14f\": rpc error: code = NotFound desc = could not find container \"7a7e23d8729dc0b6e459b5dfcf12c3f635b12d838f3828e6471b2b595f2ae14f\": container with ID starting with 7a7e23d8729dc0b6e459b5dfcf12c3f635b12d838f3828e6471b2b595f2ae14f not found: ID does not exist"
Aug 04 23:22:49.412560 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:49.412532    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-55909a-5df65f6859-sqgl7"]
Aug 04 23:22:49.416201 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:49.416175    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-55909a-5df65f6859-sqgl7"]
Aug 04 23:22:49.425496 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:49.425471    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-55909a-5f6cf86454-d7fd9"]
Aug 04 23:22:49.428732 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:49.428705    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-55909a-5f6cf86454-d7fd9"]
Aug 04 23:22:49.499685 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:49.499609    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="11ae30af-2c7f-47be-9cff-0e38ea164339" path="/var/lib/kubelet/pods/11ae30af-2c7f-47be-9cff-0e38ea164339/volumes"
Aug 04 23:22:49.499937 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:49.499925    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="724b95d3-24ca-4aa2-b8f3-ec8992353d93" path="/var/lib/kubelet/pods/724b95d3-24ca-4aa2-b8f3-ec8992353d93/volumes"
Aug 04 23:22:49.500262 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:49.500249    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c0ad3121-c724-4d67-bbdf-dd7a4d75e94c" path="/var/lib/kubelet/pods/c0ad3121-c724-4d67-bbdf-dd7a4d75e94c/volumes"
Aug 04 23:22:49.500497 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:49.500486    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c1325d1f-7a20-47f1-b096-b11941c99545" path="/var/lib/kubelet/pods/c1325d1f-7a20-47f1-b096-b11941c99545/volumes"
Aug 04 23:22:50.892417 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:50.892375    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-595xm"]
Aug 04 23:22:54.149414 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:54.149382    2580 scope.go:117] "RemoveContainer" containerID="13e8f1831dd3934ca57e7b1e5ab27dc3b6d2821f36fbe0e6fb4a795950157bd3"
Aug 04 23:22:54.158662 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:22:54.158641    2580 scope.go:117] "RemoveContainer" containerID="0d65b0d6ea238aa7985391f43be19ad55f65a5fa247c07a2f198ee4b80cd0c39"
Aug 04 23:23:01.066562 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:23:01.066530    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-fht77_f0c28a16-8649-4ae0-b34a-1a5ab2ebd867/manager/0.log"
Aug 04 23:23:01.184229 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:23:01.184193    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-bglnn_1750f21e-34b5-4693-8a9c-4c31e01241e5/manager/0.log"
Aug 04 23:23:01.298550 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:23:01.298523    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7ffd699c46-9mfpm_47cdd932-71eb-4668-a5c5-af6b1a3c8d15/manager/0.log"
Aug 04 23:23:01.404629 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:23:01.404554    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-lz56d_c1d1cba2-5e81-41b1-8acd-fd8e8c419afe/server/0.log"
Aug 04 23:23:01.517398 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:23:01.517374    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-4vg4j_52bb1513-6f34-4963-9427-5ec0949004be/manager/0.log"
Aug 04 23:23:01.875070 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:23:01.875040    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7f6cdbbfdb-wm7cd_e73397c2-acd8-428e-9d88-5595f27e6eef/copy-manifests/0.log"
Aug 04 23:23:01.881085 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:23:01.881064    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7f6cdbbfdb-wm7cd_e73397c2-acd8-428e-9d88-5595f27e6eef/manager/0.log"
Aug 04 23:23:02.319262 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:23:02.319233    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29764725-zqqw9_0b2e0994-c8c4-439e-95ef-a1154620c1b1/cleanup/0.log"
Aug 04 23:23:02.430361 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:23:02.430337    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29764740-2qrtg_694057cd-70d0-4977-9a71-11d11f0fae05/cleanup/0.log"
Aug 04 23:23:02.534627 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:23:02.534600    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29764755-8vfzn_1c110744-705c-4312-8320-5384bff1ea15/cleanup/0.log"
Aug 04 23:23:03.550528 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:23:03.550497    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-68d88948d8-6n9nb_0dfb1d09-a93f-4f1c-bb34-e5e11dbcbc58/manager/0.log"
Aug 04 23:23:03.663082 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:23:03.663051    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-5985564776-lbpvl_133a8ae5-9a8b-4eae-ac7e-04e6b1e534da/manager/0.log"
Aug 04 23:23:03.772312 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:23:03.772284    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-598f86468b-zpglm_19df4bc2-e186-4f41-8897-73231eb2c3b3/kuadrant-console-plugin/0.log"
Aug 04 23:23:03.886109 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:23:03.886023    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-68cf589589-ntxmt_8efe3e08-23c3-48e3-a310-bf5a516305b6/manager/0.log"
Aug 04 23:23:04.000690 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:23:04.000663    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-85d9db4d5d-595xm_b4fbc784-f5b0-4745-b221-028a8f8b9e8a/limitador/0.log"
Aug 04 23:23:04.118758 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:23:04.118707    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6c549b6d85-z7vgr_e66cc0f6-1ffe-4bbe-830b-d82bb52ffdae/manager/0.log"
Aug 04 23:23:04.466888 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:23:04.466859    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-fqw42_83102047-def5-4f94-a46c-a305d8f0d2b1/istio-proxy/0.log"
Aug 04 23:23:04.797443 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:23:04.797416    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5c576658-q4m2v_3aa7b540-e7e7-4dda-90ec-5461283845c0/kube-auth-proxy/0.log"
Aug 04 23:23:11.467496 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:23:11.467443    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-6vkp5/must-gather-wh99r"]
Aug 04 23:23:11.468206 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:23:11.468185    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="724b95d3-24ca-4aa2-b8f3-ec8992353d93" containerName="revoke-keys"
Aug 04 23:23:11.468206 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:23:11.468207    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="724b95d3-24ca-4aa2-b8f3-ec8992353d93" containerName="revoke-keys"
Aug 04 23:23:11.468376 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:23:11.468224    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0ad3121-c724-4d67-bbdf-dd7a4d75e94c" containerName="payload-processing"
Aug 04 23:23:11.468376 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:23:11.468233    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0ad3121-c724-4d67-bbdf-dd7a4d75e94c" containerName="payload-processing"
Aug 04 23:23:11.468376 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:23:11.468259    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5614bb85-922a-46df-bf9b-d992043ef34f" containerName="istio-proxy"
Aug 04 23:23:11.468376 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:23:11.468268    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="5614bb85-922a-46df-bf9b-d992043ef34f" containerName="istio-proxy"
Aug 04 23:23:11.468376 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:23:11.468279    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11ae30af-2c7f-47be-9cff-0e38ea164339" containerName="maas-api"
Aug 04 23:23:11.468376 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:23:11.468288    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="11ae30af-2c7f-47be-9cff-0e38ea164339" containerName="maas-api"
Aug 04 23:23:11.468376 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:23:11.468303    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5614bb85-922a-46df-bf9b-d992043ef34f" containerName="istio-proxy"
Aug 04 23:23:11.468376 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:23:11.468311    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="5614bb85-922a-46df-bf9b-d992043ef34f" containerName="istio-proxy"
Aug 04 23:23:11.468807 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:23:11.468436    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="11ae30af-2c7f-47be-9cff-0e38ea164339" containerName="maas-api"
Aug 04 23:23:11.468807 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:23:11.468450    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="c0ad3121-c724-4d67-bbdf-dd7a4d75e94c" containerName="payload-processing"
Aug 04 23:23:11.468807 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:23:11.468461    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="724b95d3-24ca-4aa2-b8f3-ec8992353d93" containerName="revoke-keys"
Aug 04 23:23:11.468807 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:23:11.468471    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="5614bb85-922a-46df-bf9b-d992043ef34f" containerName="istio-proxy"
Aug 04 23:23:11.468807 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:23:11.468482    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="5614bb85-922a-46df-bf9b-d992043ef34f" containerName="istio-proxy"
Aug 04 23:23:11.471918 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:23:11.471898    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6vkp5/must-gather-wh99r"
Aug 04 23:23:11.473981 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:23:11.473962    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-6vkp5\"/\"default-dockercfg-grvmj\""
Aug 04 23:23:11.474095 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:23:11.474013    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-6vkp5\"/\"openshift-service-ca.crt\""
Aug 04 23:23:11.474692 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:23:11.474676    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-6vkp5\"/\"kube-root-ca.crt\""
Aug 04 23:23:11.479646 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:23:11.479481    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6vkp5/must-gather-wh99r"]
Aug 04 23:23:11.542407 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:23:11.542370    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cptf7\" (UniqueName: \"kubernetes.io/projected/9c3b7d3b-0727-4877-b259-0bdcad4391d8-kube-api-access-cptf7\") pod \"must-gather-wh99r\" (UID: \"9c3b7d3b-0727-4877-b259-0bdcad4391d8\") " pod="openshift-must-gather-6vkp5/must-gather-wh99r"
Aug 04 23:23:11.542589 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:23:11.542423    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/9c3b7d3b-0727-4877-b259-0bdcad4391d8-must-gather-output\") pod \"must-gather-wh99r\" (UID: \"9c3b7d3b-0727-4877-b259-0bdcad4391d8\") " pod="openshift-must-gather-6vkp5/must-gather-wh99r"
Aug 04 23:23:11.643961 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:23:11.643923    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cptf7\" (UniqueName: \"kubernetes.io/projected/9c3b7d3b-0727-4877-b259-0bdcad4391d8-kube-api-access-cptf7\") pod \"must-gather-wh99r\" (UID: \"9c3b7d3b-0727-4877-b259-0bdcad4391d8\") " pod="openshift-must-gather-6vkp5/must-gather-wh99r"
Aug 04 23:23:11.644191 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:23:11.643987    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/9c3b7d3b-0727-4877-b259-0bdcad4391d8-must-gather-output\") pod \"must-gather-wh99r\" (UID: \"9c3b7d3b-0727-4877-b259-0bdcad4391d8\") " pod="openshift-must-gather-6vkp5/must-gather-wh99r"
Aug 04 23:23:11.644330 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:23:11.644309    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/9c3b7d3b-0727-4877-b259-0bdcad4391d8-must-gather-output\") pod \"must-gather-wh99r\" (UID: \"9c3b7d3b-0727-4877-b259-0bdcad4391d8\") " pod="openshift-must-gather-6vkp5/must-gather-wh99r"
Aug 04 23:23:11.651361 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:23:11.651340    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cptf7\" (UniqueName: \"kubernetes.io/projected/9c3b7d3b-0727-4877-b259-0bdcad4391d8-kube-api-access-cptf7\") pod \"must-gather-wh99r\" (UID: \"9c3b7d3b-0727-4877-b259-0bdcad4391d8\") " pod="openshift-must-gather-6vkp5/must-gather-wh99r"
Aug 04 23:23:11.782971 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:23:11.782879    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6vkp5/must-gather-wh99r"
Aug 04 23:23:11.918748 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:23:11.918714    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6vkp5/must-gather-wh99r"]
Aug 04 23:23:11.920143 ip-10-0-137-117 kubenswrapper[2580]: W0804 23:23:11.920107    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9c3b7d3b_0727_4877_b259_0bdcad4391d8.slice/crio-36d04c150088a2ffbd90d428bc057be9a8ac1a35ba3af94da88ba59c82a03b67 WatchSource:0}: Error finding container 36d04c150088a2ffbd90d428bc057be9a8ac1a35ba3af94da88ba59c82a03b67: Status 404 returned error can't find the container with id 36d04c150088a2ffbd90d428bc057be9a8ac1a35ba3af94da88ba59c82a03b67
Aug 04 23:23:11.922027 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:23:11.922008    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 04 23:23:12.543760 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:23:12.543721    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6vkp5/must-gather-wh99r" event={"ID":"9c3b7d3b-0727-4877-b259-0bdcad4391d8","Type":"ContainerStarted","Data":"36d04c150088a2ffbd90d428bc057be9a8ac1a35ba3af94da88ba59c82a03b67"}
Aug 04 23:23:13.556501 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:23:13.556456    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6vkp5/must-gather-wh99r" event={"ID":"9c3b7d3b-0727-4877-b259-0bdcad4391d8","Type":"ContainerStarted","Data":"cbee98058b89970bab2ff6acffe358cb5ffea508e73e2900263f3664208db19b"}
Aug 04 23:23:13.556994 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:23:13.556511    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6vkp5/must-gather-wh99r" event={"ID":"9c3b7d3b-0727-4877-b259-0bdcad4391d8","Type":"ContainerStarted","Data":"2dc3a92b9712c2f6b680a9af4bb799447dc90036aa9cd695041286b9d38b4eef"}
Aug 04 23:23:13.571322 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:23:13.571275    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-6vkp5/must-gather-wh99r" podStartSLOduration=1.8341662140000001 podStartE2EDuration="2.571257197s" totalImagesPullingTime="737.090983ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 23:23:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 23:23:13.570101865 +0000 UTC m=+3740.562919594" watchObservedRunningTime="2026-08-04 23:23:13.571257197 +0000 UTC m=+3740.564074926"
Aug 04 23:23:14.193886 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:23:14.193857    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-mms2l_1675ffcb-004e-4aa6-9f0e-8d9c4567052a/global-pull-secret-syncer/0.log"
Aug 04 23:23:14.276803 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:23:14.276773    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-jpxll_bf411845-febf-4e48-a52e-ea1741aa07cb/konnectivity-agent/0.log"
Aug 04 23:23:14.341417 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:23:14.341379    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-137-117.ec2.internal_8c189592264ca39220dc93ea9c07921f/haproxy/0.log"
Aug 04 23:23:19.353933 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:23:19.353450    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-68d88948d8-6n9nb_0dfb1d09-a93f-4f1c-bb34-e5e11dbcbc58/manager/0.log"
Aug 04 23:23:19.376093 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:23:19.376064    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-5985564776-lbpvl_133a8ae5-9a8b-4eae-ac7e-04e6b1e534da/manager/0.log"
Aug 04 23:23:19.399660 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:23:19.399631    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-598f86468b-zpglm_19df4bc2-e186-4f41-8897-73231eb2c3b3/kuadrant-console-plugin/0.log"
Aug 04 23:23:19.498932 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:23:19.498588    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-68cf589589-ntxmt_8efe3e08-23c3-48e3-a310-bf5a516305b6/manager/0.log"
Aug 04 23:23:19.523180 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:23:19.523125    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-85d9db4d5d-595xm_b4fbc784-f5b0-4745-b221-028a8f8b9e8a/limitador/0.log"
Aug 04 23:23:19.641195 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:23:19.640670    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6c549b6d85-z7vgr_e66cc0f6-1ffe-4bbe-830b-d82bb52ffdae/manager/0.log"
Aug 04 23:23:21.296016 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:23:21.293900    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_38bcb81e-e4a1-4ea4-99ec-91c4504efe29/alertmanager/0.log"
Aug 04 23:23:21.325018 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:23:21.324993    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_38bcb81e-e4a1-4ea4-99ec-91c4504efe29/config-reloader/0.log"
Aug 04 23:23:21.350078 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:23:21.350049    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_38bcb81e-e4a1-4ea4-99ec-91c4504efe29/kube-rbac-proxy-web/0.log"
Aug 04 23:23:21.372200 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:23:21.372160    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_38bcb81e-e4a1-4ea4-99ec-91c4504efe29/kube-rbac-proxy/0.log"
Aug 04 23:23:21.394875 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:23:21.394828    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_38bcb81e-e4a1-4ea4-99ec-91c4504efe29/kube-rbac-proxy-metric/0.log"
Aug 04 23:23:21.418767 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:23:21.418738    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_38bcb81e-e4a1-4ea4-99ec-91c4504efe29/prom-label-proxy/0.log"
Aug 04 23:23:21.441039 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:23:21.441010    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_38bcb81e-e4a1-4ea4-99ec-91c4504efe29/init-config-reloader/0.log"
Aug 04 23:23:21.489961 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:23:21.489904    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6f55c4f58d-2ksv9_968aa3c2-b641-483d-a1b0-d0efc3df099e/cluster-monitoring-operator/0.log"
Aug 04 23:23:21.797852 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:23:21.797824    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kfzjb_37f4874f-ae9c-4bd4-90db-135afcf9df5d/node-exporter/0.log"
Aug 04 23:23:21.818390 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:23:21.818356    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kfzjb_37f4874f-ae9c-4bd4-90db-135afcf9df5d/kube-rbac-proxy/0.log"
Aug 04 23:23:21.839874 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:23:21.839842    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kfzjb_37f4874f-ae9c-4bd4-90db-135afcf9df5d/init-textfile/0.log"
Aug 04 23:23:22.146639 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:23:22.146549    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-758d7cb874-b5799_6760248f-2efd-431a-9e9f-920cd406b973/prometheus-operator/0.log"
Aug 04 23:23:22.167020 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:23:22.166981    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-758d7cb874-b5799_6760248f-2efd-431a-9e9f-920cd406b973/kube-rbac-proxy/0.log"
Aug 04 23:23:22.193276 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:23:22.193242    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-66685ff6d4-b9n5f_5db3e8ee-b5a7-4695-b6a6-fab544a17e1b/prometheus-operator-admission-webhook/0.log"
Aug 04 23:23:22.225019 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:23:22.224974    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-55bf74f97-hnnqg_12682642-ca12-4b49-9204-4e69d19e16d2/telemeter-client/0.log"
Aug 04 23:23:22.250426 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:23:22.250391    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-55bf74f97-hnnqg_12682642-ca12-4b49-9204-4e69d19e16d2/reload/0.log"
Aug 04 23:23:22.271867 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:23:22.271835    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-55bf74f97-hnnqg_12682642-ca12-4b49-9204-4e69d19e16d2/kube-rbac-proxy/0.log"
Aug 04 23:23:23.714547 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:23:23.714515    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-f77f48c6d-ghcnq_771ddd03-8847-4587-bd07-96d0b0dccac5/networking-console-plugin/0.log"
Aug 04 23:23:24.203379 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:23:24.203328    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-6vkp5/perf-node-gather-daemonset-vkcdc"]
Aug 04 23:23:24.210828 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:23:24.210797    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6vkp5/perf-node-gather-daemonset-vkcdc"
Aug 04 23:23:24.215441 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:23:24.215408    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6vkp5/perf-node-gather-daemonset-vkcdc"]
Aug 04 23:23:24.318969 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:23:24.318916    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/22437654-7e02-4c37-aa50-739b307dc0c9-podres\") pod \"perf-node-gather-daemonset-vkcdc\" (UID: \"22437654-7e02-4c37-aa50-739b307dc0c9\") " pod="openshift-must-gather-6vkp5/perf-node-gather-daemonset-vkcdc"
Aug 04 23:23:24.319217 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:23:24.318983    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/22437654-7e02-4c37-aa50-739b307dc0c9-lib-modules\") pod \"perf-node-gather-daemonset-vkcdc\" (UID: \"22437654-7e02-4c37-aa50-739b307dc0c9\") " pod="openshift-must-gather-6vkp5/perf-node-gather-daemonset-vkcdc"
Aug 04 23:23:24.319217 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:23:24.319028    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xmkzj\" (UniqueName: \"kubernetes.io/projected/22437654-7e02-4c37-aa50-739b307dc0c9-kube-api-access-xmkzj\") pod \"perf-node-gather-daemonset-vkcdc\" (UID: \"22437654-7e02-4c37-aa50-739b307dc0c9\") " pod="openshift-must-gather-6vkp5/perf-node-gather-daemonset-vkcdc"
Aug 04 23:23:24.319217 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:23:24.319068    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/22437654-7e02-4c37-aa50-739b307dc0c9-proc\") pod \"perf-node-gather-daemonset-vkcdc\" (UID: \"22437654-7e02-4c37-aa50-739b307dc0c9\") " pod="openshift-must-gather-6vkp5/perf-node-gather-daemonset-vkcdc"
Aug 04 23:23:24.319217 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:23:24.319098    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/22437654-7e02-4c37-aa50-739b307dc0c9-sys\") pod \"perf-node-gather-daemonset-vkcdc\" (UID: \"22437654-7e02-4c37-aa50-739b307dc0c9\") " pod="openshift-must-gather-6vkp5/perf-node-gather-daemonset-vkcdc"
Aug 04 23:23:24.420452 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:23:24.420409    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/22437654-7e02-4c37-aa50-739b307dc0c9-sys\") pod \"perf-node-gather-daemonset-vkcdc\" (UID: \"22437654-7e02-4c37-aa50-739b307dc0c9\") " pod="openshift-must-gather-6vkp5/perf-node-gather-daemonset-vkcdc"
Aug 04 23:23:24.420680 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:23:24.420528    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/22437654-7e02-4c37-aa50-739b307dc0c9-podres\") pod \"perf-node-gather-daemonset-vkcdc\" (UID: \"22437654-7e02-4c37-aa50-739b307dc0c9\") " pod="openshift-must-gather-6vkp5/perf-node-gather-daemonset-vkcdc"
Aug 04 23:23:24.420680 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:23:24.420571    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/22437654-7e02-4c37-aa50-739b307dc0c9-lib-modules\") pod \"perf-node-gather-daemonset-vkcdc\" (UID: \"22437654-7e02-4c37-aa50-739b307dc0c9\") " pod="openshift-must-gather-6vkp5/perf-node-gather-daemonset-vkcdc"
Aug 04 23:23:24.420680 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:23:24.420613    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xmkzj\" (UniqueName: \"kubernetes.io/projected/22437654-7e02-4c37-aa50-739b307dc0c9-kube-api-access-xmkzj\") pod \"perf-node-gather-daemonset-vkcdc\" (UID: \"22437654-7e02-4c37-aa50-739b307dc0c9\") " pod="openshift-must-gather-6vkp5/perf-node-gather-daemonset-vkcdc"
Aug 04 23:23:24.420680 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:23:24.420653    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/22437654-7e02-4c37-aa50-739b307dc0c9-proc\") pod \"perf-node-gather-daemonset-vkcdc\" (UID: \"22437654-7e02-4c37-aa50-739b307dc0c9\") " pod="openshift-must-gather-6vkp5/perf-node-gather-daemonset-vkcdc"
Aug 04 23:23:24.420918 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:23:24.420752    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/22437654-7e02-4c37-aa50-739b307dc0c9-proc\") pod \"perf-node-gather-daemonset-vkcdc\" (UID: \"22437654-7e02-4c37-aa50-739b307dc0c9\") " pod="openshift-must-gather-6vkp5/perf-node-gather-daemonset-vkcdc"
Aug 04 23:23:24.420918 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:23:24.420809    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/22437654-7e02-4c37-aa50-739b307dc0c9-sys\") pod \"perf-node-gather-daemonset-vkcdc\" (UID: \"22437654-7e02-4c37-aa50-739b307dc0c9\") " pod="openshift-must-gather-6vkp5/perf-node-gather-daemonset-vkcdc"
Aug 04 23:23:24.420918 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:23:24.420909    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/22437654-7e02-4c37-aa50-739b307dc0c9-podres\") pod \"perf-node-gather-daemonset-vkcdc\" (UID: \"22437654-7e02-4c37-aa50-739b307dc0c9\") " pod="openshift-must-gather-6vkp5/perf-node-gather-daemonset-vkcdc"
Aug 04 23:23:24.421081 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:23:24.420990    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/22437654-7e02-4c37-aa50-739b307dc0c9-lib-modules\") pod \"perf-node-gather-daemonset-vkcdc\" (UID: \"22437654-7e02-4c37-aa50-739b307dc0c9\") " pod="openshift-must-gather-6vkp5/perf-node-gather-daemonset-vkcdc"
Aug 04 23:23:24.433689 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:23:24.433654    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xmkzj\" (UniqueName: \"kubernetes.io/projected/22437654-7e02-4c37-aa50-739b307dc0c9-kube-api-access-xmkzj\") pod \"perf-node-gather-daemonset-vkcdc\" (UID: \"22437654-7e02-4c37-aa50-739b307dc0c9\") " pod="openshift-must-gather-6vkp5/perf-node-gather-daemonset-vkcdc"
Aug 04 23:23:24.529819 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:23:24.529727    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6vkp5/perf-node-gather-daemonset-vkcdc"
Aug 04 23:23:24.745961 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:23:24.745871    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6vkp5/perf-node-gather-daemonset-vkcdc"]
Aug 04 23:23:24.747281 ip-10-0-137-117 kubenswrapper[2580]: W0804 23:23:24.747244    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod22437654_7e02_4c37_aa50_739b307dc0c9.slice/crio-7f5b3f9abd1c027607a551812f5abd664869ca1ceab52b25b7969e3e8c6260cf WatchSource:0}: Error finding container 7f5b3f9abd1c027607a551812f5abd664869ca1ceab52b25b7969e3e8c6260cf: Status 404 returned error can't find the container with id 7f5b3f9abd1c027607a551812f5abd664869ca1ceab52b25b7969e3e8c6260cf
Aug 04 23:23:24.965000 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:23:24.964974    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-659754b74-vfjt2_bb91d418-d336-4d6d-8398-f8bd800464c3/console/0.log"
Aug 04 23:23:25.005947 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:23:25.005912    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-77c974ffcf-78rnm_fe4d127d-9108-4f27-b7ed-0af0cb582a83/download-server/0.log"
Aug 04 23:23:25.683208 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:23:25.683179    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5b8776669-2pxjd_d8b1f339-0748-481e-82fd-24b4e76a721a/volume-data-source-validator/0.log"
Aug 04 23:23:25.687119 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:23:25.687082    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6vkp5/perf-node-gather-daemonset-vkcdc" event={"ID":"22437654-7e02-4c37-aa50-739b307dc0c9","Type":"ContainerStarted","Data":"32be36873730f421d3be2227acb1b015eada3f2da90de330ebac1cb80cc4e9fe"}
Aug 04 23:23:25.687316 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:23:25.687233    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-6vkp5/perf-node-gather-daemonset-vkcdc"
Aug 04 23:23:25.687316 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:23:25.687269    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6vkp5/perf-node-gather-daemonset-vkcdc" event={"ID":"22437654-7e02-4c37-aa50-739b307dc0c9","Type":"ContainerStarted","Data":"7f5b3f9abd1c027607a551812f5abd664869ca1ceab52b25b7969e3e8c6260cf"}
Aug 04 23:23:26.761524 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:23:26.761491    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-8nwrx_3363c6ec-b200-4050-b9bc-aa06ea7fad77/dns/0.log"
Aug 04 23:23:26.781209 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:23:26.781179    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-8nwrx_3363c6ec-b200-4050-b9bc-aa06ea7fad77/kube-rbac-proxy/0.log"
Aug 04 23:23:26.916481 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:23:26.916443    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-mqwtk_352301b4-da31-4c34-897a-35279eb5e2f0/dns-node-resolver/0.log"
Aug 04 23:23:27.535705 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:23:27.535668    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-xvfg9_708c6d09-57c2-4829-9e76-7d86874515ec/node-ca/0.log"
Aug 04 23:23:28.456768 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:23:28.456726    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-fqw42_83102047-def5-4f94-a46c-a305d8f0d2b1/istio-proxy/0.log"
Aug 04 23:23:28.805000 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:23:28.804963    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5c576658-q4m2v_3aa7b540-e7e7-4dda-90ec-5461283845c0/kube-auth-proxy/0.log"
Aug 04 23:23:29.718890 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:23:29.718859    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-l57vw_c8c35a7c-9cad-4e67-aa5d-eee422ea3178/serve-healthcheck-canary/0.log"
Aug 04 23:23:30.279482 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:23:30.279449    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-grmx8_8e27a6cd-73a0-4a34-ab89-c83cd76657f7/kube-rbac-proxy/0.log"
Aug 04 23:23:30.300014 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:23:30.299986    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-grmx8_8e27a6cd-73a0-4a34-ab89-c83cd76657f7/exporter/0.log"
Aug 04 23:23:30.321455 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:23:30.321424    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-grmx8_8e27a6cd-73a0-4a34-ab89-c83cd76657f7/extractor/0.log"
Aug 04 23:23:31.707781 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:23:31.707751    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-6vkp5/perf-node-gather-daemonset-vkcdc"
Aug 04 23:23:31.729093 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:23:31.729031    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-6vkp5/perf-node-gather-daemonset-vkcdc" podStartSLOduration=7.729008962 podStartE2EDuration="7.729008962s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 23:23:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 23:23:25.703498573 +0000 UTC m=+3752.696316305" watchObservedRunningTime="2026-08-04 23:23:31.729008962 +0000 UTC m=+3758.721826691"
Aug 04 23:23:32.537553 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:23:32.537526    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-fht77_f0c28a16-8649-4ae0-b34a-1a5ab2ebd867/manager/0.log"
Aug 04 23:23:32.896537 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:23:32.896486    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-bglnn_1750f21e-34b5-4693-8a9c-4c31e01241e5/manager/0.log"
Aug 04 23:23:33.119476 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:23:33.119432    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7ffd699c46-9mfpm_47cdd932-71eb-4668-a5c5-af6b1a3c8d15/manager/0.log"
Aug 04 23:23:33.169757 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:23:33.169671    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-lz56d_c1d1cba2-5e81-41b1-8acd-fd8e8c419afe/server/0.log"
Aug 04 23:23:33.296783 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:23:33.296744    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-4vg4j_52bb1513-6f34-4963-9427-5ec0949004be/manager/0.log"
Aug 04 23:23:33.505656 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:23:33.496611    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7f6cdbbfdb-wm7cd_e73397c2-acd8-428e-9d88-5595f27e6eef/manager/0.log"
Aug 04 23:23:33.526383 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:23:33.526353    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7f6cdbbfdb-wm7cd_e73397c2-acd8-428e-9d88-5595f27e6eef/copy-manifests/0.log"
Aug 04 23:23:34.944977 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:23:34.944872    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-zx5rv_0b16e7ff-2257-4402-9b5e-6c77a9f1ef96/openshift-lws-operator/0.log"
Aug 04 23:23:35.254377 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:23:35.254290    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-fqw42_83102047-def5-4f94-a46c-a305d8f0d2b1/istio-proxy/0.log"
Aug 04 23:23:35.578298 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:23:35.578265    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5c576658-q4m2v_3aa7b540-e7e7-4dda-90ec-5461283845c0/kube-auth-proxy/0.log"
Aug 04 23:23:37.038590 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:23:37.038556    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-fqw42_83102047-def5-4f94-a46c-a305d8f0d2b1/istio-proxy/0.log"
Aug 04 23:23:37.380460 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:23:37.380434    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5c576658-q4m2v_3aa7b540-e7e7-4dda-90ec-5461283845c0/kube-auth-proxy/0.log"
Aug 04 23:23:39.888201 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:23:39.888170    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-68bc745d87-spbzw_37b7e9b0-a02f-4c37-8657-57c38ccfe473/migrator/0.log"
Aug 04 23:23:39.908084 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:23:39.908053    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-68bc745d87-spbzw_37b7e9b0-a02f-4c37-8657-57c38ccfe473/graceful-termination/0.log"
Aug 04 23:23:41.485683 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:23:41.485653    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-p9zkw_c0c23bef-9c00-46e2-8f50-d67322ae45e6/kube-multus-additional-cni-plugins/0.log"
Aug 04 23:23:41.505091 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:23:41.505064    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-p9zkw_c0c23bef-9c00-46e2-8f50-d67322ae45e6/egress-router-binary-copy/0.log"
Aug 04 23:23:41.524009 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:23:41.523986    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-p9zkw_c0c23bef-9c00-46e2-8f50-d67322ae45e6/cni-plugins/0.log"
Aug 04 23:23:41.543302 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:23:41.543281    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-p9zkw_c0c23bef-9c00-46e2-8f50-d67322ae45e6/bond-cni-plugin/0.log"
Aug 04 23:23:41.562188 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:23:41.562164    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-p9zkw_c0c23bef-9c00-46e2-8f50-d67322ae45e6/routeoverride-cni/0.log"
Aug 04 23:23:41.580836 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:23:41.580817    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-p9zkw_c0c23bef-9c00-46e2-8f50-d67322ae45e6/whereabouts-cni-bincopy/0.log"
Aug 04 23:23:41.599909 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:23:41.599890    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-p9zkw_c0c23bef-9c00-46e2-8f50-d67322ae45e6/whereabouts-cni/0.log"
Aug 04 23:23:41.645341 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:23:41.645270    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-rzd7q_aae79032-9bea-47d8-8cb2-7e277f07ef6d/kube-multus/0.log"
Aug 04 23:23:41.699953 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:23:41.699930    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-5h46r_14077369-fe10-4854-8785-0bfc9addb7c4/network-metrics-daemon/0.log"
Aug 04 23:23:41.715177 ip-10-0-137-117 kubenswrapper[2580]: I0804 23:23:41.715153    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-5h46r_14077369-fe10-4854-8785-0bfc9addb7c4/kube-rbac-proxy/0.log"